Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is very much NOT my experience in practice, even though it's how I would expect it to work. OpenRouter will happily bounce you between several providers (none of which have downtime) even within the same session. Requesting specific providers is the only way I've been able to hit a cache rate above 90%.


Same experience here. It would choose 2 providers and then bounce between the two every 5 requests or so.

I don't know why there's no "Pick the cheapest provider above nTPS on first request and stick until cache bust" setting.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: