> Are you saying that all of them are actually losing money?
Are you saying these companies are operating on anything resembling a sustainable business model?
I think not!
If OpenAI needs to impose 5 hour limits during a time where they are aggressively trying to grow market share, what do you think they (or whatever the winning provider is) will do in 5 years once they IPO and need to boost margins?
They won’t be as friendly with usage caps as they’re being now.
`needs to impose 5 hour limits ` I'm no OpenAI defender but that's like saying Apple is going bankrupt because they charge for their products. Why wouldn't they do everything they can to turn $20 users into $200 users?
Exactly. It is common knowledge that all the AI companies have terrible margins. IMO tokens are the cheapest they'll ever be as these companies compete for users.
To the extent that the 3rd party inference resellers are a viable market because of Chinese/certain US AI labs (current) willingness to absorb substantial compute/R&D/data harvesting costs while releasing weights on permissive licensing terms for free, then yes, current pricing is distorted.
Openrouter is not so open as well, right? They take the middle man cut by enforcing their own limit restrictions and 429s on top of the model provided limit restrictions and what not.
Now why would I pay a middle man anything if I can get the same hosted model without their own whimsical service limits?