Encoders are suffering from the curse of all successful AI applications: they wo... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

llm_trw on Dec 20, 2024 | parent | context | favorite | on: A Replacement for BERT

Encoders are suffering from the curse of all successful AI applications: they work so they are no longer AI.

Excited about trying this out, less excited about recalculating a petabyte worth of embedding if it's as good as it looks like it will be. At least I can keep my house warm.

martin82 on Dec 21, 2024 [–]

Kinda curious what kind of data you have lying around there and what stack you use to create the embeddings and keep them up to date and how you use then...

llm_trw on Dec 21, 2024 | [–]

Officially financial data. Unofficially every textbook and science paper ever published. Email me if you're interested.

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact