You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Some newer embedding models such as https://huggingface.co/intfloat/e5-mistral-7b-instruct require a one-sentence instruction that describes the retrieval task in addition to the content that should be embedded. This model in particular is currently implemented in the FES and accessible through the ApiWrapper. It might be useful to extend the DenseEmbedding analyser to support these models as well. To accomplish this the DenseEmbedding analyser (or its methods) needs the task instruction (e.g. 'Given a web search query, retrieve relevant passages that answer the query') as a parameter. I would like to ask for your feedback if this should be configured as part of a query or as part of the field. My intuition is that it is a parameter of the query and thus should be passed as query context to newRetrieverForContent... Any thoughts?
The text was updated successfully, but these errors were encountered:
Some newer embedding models such as https://huggingface.co/intfloat/e5-mistral-7b-instruct require a one-sentence instruction that describes the retrieval task in addition to the content that should be embedded. This model in particular is currently implemented in the FES and accessible through the ApiWrapper. It might be useful to extend the DenseEmbedding analyser to support these models as well. To accomplish this the DenseEmbedding analyser (or its methods) needs the task instruction (e.g. 'Given a web search query, retrieve relevant passages that answer the query') as a parameter. I would like to ask for your feedback if this should be configured as part of a query or as part of the field. My intuition is that it is a parameter of the query and thus should be passed as query context to newRetrieverForContent... Any thoughts?
The text was updated successfully, but these errors were encountered: