Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

New embedding models support queries, so you don’t need to hallucinate a document before finding the nearest neighbor. Curious how it compares to this approach since you’d get to skip the LLM altogether.


What does it mean that an "embedding model supports queries"? An embedding model maps text to embedding vectors. You can always perform queries with such embedding vectors against a stored set of embeddings.


Retrieval models are trained on query/document pairs. At inference you tell it which side the text is on via a prefix it learned during training.

Which accomplishes the same thing as HyDE, but in the model instead of in text space. If the encoder has a query mode you skip the rewrite.

Voyage has an example of this in `input_type` https://docs.voyageai.com/reference/embeddings-api




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: