Qwen 3.8 flash next is pretty good. It is a pretty large MOE model that can be ran with Strata. That's the best local model I can run for now. I wish I could run deepseek v4.1 flash (1017), but that one is too big for my machine to run.
I swear people forget about inference providers that serve open weight models. It is hard to beat their prices. They are usually barely more expensive than electricity, so running local inference barely wins on cost (if you don't factor in the upfront hardware costs).
The thing that bothers me is the false advertising. The models are announced with specific capabilities and benchmark scores. Then they silently nerf the models after release. Without a public acknowledgement that a production model has been nerfed and what the new benchmarks are, people are assuming the model has the original capabilities. People are choosing to pay for models based on their reported capabilities. Customers trust these models to deliver the reported capability. It feels like false advertising to me when they say one thing and deliver something less silently hoping no one finds out.
If I order a 16oz beer and get a 12oz pour, I'm going to call it out.
I wonder if the questions about the quality in claude code have something to do with it. Like as long as you say it's great, they can take little steps dialing the effort back.
As uncomfortable as this may be for the tech industry, I have been hoping for AI related stock prices to come back to reality. A market correction is a healthy thing so long as it doesn't turn into a collapse. IMO, some AI companies have ludicrous valuations considering their astronomical debt. A reality check may be healthy long term.
IMO OpenAI jumped the gun and rushed an immature product to be there first, no matter the costs. The other players saw it as a threat, and started running with the same carelessness. It has been spiraling since then, and while the product keeps improving, their business model hasn't demonstrated sustainability.
Their CEOs know it, and they must have their end game. I'd hate to think they'll just keep running until a hard crash. Hopefully small corrections will slow this down in a more controlled manner.
And I wholeheartedly thank China for doing this. The open weight models are fantastic, and make power consolidation of AI monopolies less likely. Open weights bring real competition to the space and help commoditize inference.
Good hardware companies are now trading at far under ten P/E, hardly ludicrous valuations. Sure there are some poor companies out there, but Nvidia and Micron are not among them. SMCI just beat substantially. Buying opportunity when things settle down.
Nvidia has not been a buying opportunity for a while now. Training new models is the moat it possessed. The models are as good as they can be and have diminished returns beyond this. TPUs by google and CPUs by AMD are eating into their inference margins.
> Yeah I'm not sure how Anthropic is going to IPO at this rate...
There are plenty of suckers willing to gamble on a failing business (massive and rapidly growing debts, assets that can easily be cloned, no realistic path to profitability), so I don't think an IPO is off the table.
The moat is GPUs/TPUs, ram and compute. When you need $200k of compute to run the frontier models, you are likely to be renting access to generate your tokens.
That is not a moat. (and it is not theirs either) It just means that their models are highly inefficient that it requires a lot of compute to run them.
Open weight models such as Deepseek, GLM are just as good as the frontier closed models and already we have bank such as Revolut migrating off of frontier closed models and self-hosting. [0]
Current RAM is no moat. Upcoming Compute-in-RAM is. And nobody has that built up at scale yet. So, while a moat might become possible, we only have yesteryear's hardware as "moat".
The academic term is now "Compute-in-Memory". That's MOSTLY what has suddenly been hiring SRAM and DRAM designers across the industry this year. It is part of the fast evolving field of doing inference efficiently. This has been all the rage in several Electronics conferences this year.
Please don't rely on my [inferior] explanation and search for yourself (start here for insance: https://www.google.com/search?q=what+is+compute+in+memory+an...). Asking about a new field is much better done with AI these days, because you can get it to explain just the interests and questions you personally have, rather than a generic and boring explanation.
In short, better than HBM is not having to move data in and out of memory at all or at least not as much. The compute part in inference is much simpler than the data hauling part.
Couple of examples: Check out Axelera's Europa board (upcoming) or their Metis board (existing). Or check out Mythic.ai which FINALLY managed to raise funds in Nov / Dec 2025. Ironically, her PhD thesis had been gathering dust before that.
Not sure if you're joking, but I go back and forth between this thought. Finance is not my forte, far from it for sure, but there's a part of me that hopes a collapse can at least open the door for future opportunity. A "reset" if you will. The younger generations are up against a massive wall when it comes to acquiring wealth (or even a reasonable means of living at this point), it would be nice to give them an equal chance. I know this is very likely a naive take, but it's the only hopeful aspect of a collapse I can accept.
Not quite. Poor people suffer more in real terms, but rich people suffer more in nominal (dollar) terms. Nominal inequality gets reset.
Don't let the term "nominal" undersell this: it's nominal inequality that locks working people out of assets and imposes upon them the need to service the (otherwise) exponentially growing profit expectations of their economic complements. At no point in the cycle is it better to be poor than rich, but the contractionary quadrant is the one where the gap shrinks.
Inequality declined temporarily during the recession, but reached new highs during the recovery.
2008 decreased inequality for a very short time, but inequality increased overall. The rich have the available assets to profit from instability and are able to ride out unemployment, for the poor a crash and losing their job can be existential.
Why would it? The wealthy people who haven’t allocated their capital to those assets that are depressed from a recession can reallocate to the depressed assets and end up even wealthier on the rebound. People with no money at all don’t have that opportunity to invest.
The stock market is $80T, cash is $20T. The former cannot "weather the storm" in the latter in aggregate, even though I'm sure there are individuals who successfully timed the market.
> At no point in the cycle is it better to be poor than rich, but the contractionary quadrant is the one where the gap shrinks.
Your anecdote about getting lucky doesn’t answer the question, sorry. Rich people have money to buy cheap assets when shit hits the fan, unemployed people do not.
There's not much incentive for institutional change when everyone's making money. Yeah, it'll hurt folks a great deal short term. But may be better for our kids long term.
That's what people said in 2008, instead, wealth was incinerated, the most vulnerable got hurt the most, while the already wealthy got bailed out and bought back assets at bargain bin prices. The wealth owning class would love a collapse.
Oddly enough, 2008 is exactly what inspired my comment and it's based off my exact experience back then. I couldn't afford investing in the market, I couldn't afford a home, and the interest on car loans were higher. All of that changed after the 2008 collapse. First I should mention that I was laid off and unemployed during some of it, so there was a huge negative impact for sure. What followed after though was amazing. I was able to invest in some $1-$5 stocks in the market that were previously not obtainable to me. This investment actually took me/my wife from being in debt living with my in-laws to completely out of debt and into our own place. Once I finally got employed again, I was able to save up enough just in time to buy a home at near the bottom with low interest. Car loans were also low interest. It was life changing and for the better in my situation.
This is actually kind of inspiring. Obviously, I still feel concerned about the parallels between the 2008 housing crisis and the current tech bubble bursting. But as someone who also wants to get into investing but feels to broke to do so, now I know I just have to wait until the world is burning (kidding, lol). All jokes aside, this is still interesting. Especially as someone who will live through both.
The inflation being caused by all the "crowding-out" caused by AI overinvestment is currently incredibly harmful.
That really needs to unwind.
However much potential energy has been stored in it, is going to turn into kinetic energy in the subsequent correction/crash.
The best time for this to happen is as soon as possible, causing the least amount of damage.
I pretty much expect the damage to be immense, though, but that is going to be unavoidable at this point. However big the bubble is, it needs to pop.
In retrospect, we will find that there were truly idiotic decisions made in blowing up the bubble, and in the aftermath the wrong people will almost certainly get hurt, because that is just what we do these days.
Not comparing to Qwen3.8 27B gives cherry-picked benchmark comparison energy. Still, Ripple-65B outscores Qwen3.8 27B, according to the reported benchmarks.
We all know who Trump is. This behavior, from Trump, should shock no one by now. I'm equally upset with all those who enable him. Midterms are here, time to do the one thing we are still allowed to. Be certain, Trump will cry foul on the elections unless they go his way.
It's less about who is doing it rather than that a US president is doing it at all. Obviously, once you find the right person, things can change quickly. Finding the right person when the other two branches of government are controlled by the same party, you can speed run the end of democracy. This is the part that's really shameful to me more so than just a single megalomaniac POTUS. The fact Congress has just capitulated its duties while overtly corrupt members of SCOTUS flaunt jurisprudence is something I thought we'd never have to see.
Congress didn't capitulate, it facilitated by obstructing any resistance. And we all saw this coming with SCOTUS as far back as the Obama administration. It's certainly horrifying to see it play out, but we've seen the warning signs since the W Bush admin.
I think it's a combo of both really. McConnel denying Obama's rightful SCOTUS nomination was not capitulating, but Johnson's rolling over for this administration is. Clearly, the situation we find ourselves is not the result of a single action. I think the speed run really started back with Speaker Gingrich.
The trend of ignoring convention and pushing the boundaries of what is legal certainly seems to stem from Gingrich but from an outsider view it seems to have its origins with the Nixon administration
At a certain point we just have to consider them all participants in a single oligarchic conspiracy to overturn democracy. If we cannot get justice through the system then it will have to be done by the masses themselves.
Yes, the reactionary movement has been very successful at abusing real criticisms and frustrations to motivate their supporters, while doing nothing to actually address those problems (and often even shamelessly leaning into exploiting them for personal gain). It's a one-two punch of directly making the problems worse, while arbitraging away the political capital that had built up around trying to reform them.
Congress is capitulating it's duties at least partially because anyone who tries to block Trump as a republican gets voted out. Oh sure, they stirred this shit up for 50 years and just reaping what they sew, but the train is free-running now and they can't really stop it.
The Voters want a Trump King. A government cannot ignore it's own people forever.
If the voters reward corrupt and horrific behavior, and punish law and order behavior, what the hell can you do about that?
With congress I feel like they have been capitulating their duties for atleast a few decades now. They don't care at all about their job, they only care about the personal power and wealth and benefits that getting elected provides. In which case it was only a matter of time before someone like Trump comes along. With the only saving grace being that he is an utter moron.
I think that's a bad deal for Vance. He wants to run in 2028 for a four year term. Becoming POTUS and inheriting all the baggage for 2 years would harm his chances.
He actually distances himself from a lot of stuff very carefully. Like we all know he was against the Iran war. He said he wasn't going to watch the execution broadcast. Etc.
Hate to burst your bubble, but behind Trump there are quite a few people that are ready to take his place, with no real chance of voting ever being able to stop them. Don't get your hopes up that voting blue matters. Everyone had the chance in 2024, half the eligible population did not vote. Now we get to live with those consequences.
In this day and age, 100% of all presidential acts need to be documented publicly. It's no longer enough to wave a piece of paper around and say "see, it has his signature." Random cabinet secretaries and white house staffers running papers through the autopen should be a capital crime and the only sentence should be hanging.
Is this really something that has been happening, or just some nonsense that has been thrown out to see what sticks? Yes, using the autopen should be limited to the mass signing of trivial correspondence like annual christmas cards or form letter responses to anything received from the citizens that used a stamp. Has there been any one seriously concerned about legislation or executive order type of documents being signed this way?
It's hard to know. People have opinions that it might be happening, which is why I call for presidential action to be public, and not in the form of final signed papers. I want to be able to see the president making the decisions and taking the actions that affect everyone in the country.
I wasn't aware of this supposedly. I had assumed that the EO signed covered it in a single signature. Not sure which is worse here, my assumption or your supposedly.
Looking more into this, it looks like you're correct. It was a single action which resulted in that ~1,600 pardons, not 1,600 individual documents. My bad.
Grump will cry foul on anything, because that's what he does. Normally for someone at his point in life, this would be confined to yelling at nursing home staff for the food being too cold and having the wrong color skin (because their family certainly wouldn't be visiting). But unfortunately, there are way too many gullible fools in this country who felt validated by his crying.
While Im not going to dissuade people from voting, everyone should be prepared for the following reality: true and fair elections in US very like to be a thing of the past.
There are 3 big factors in play
* 2020 attempted coup gave the Republicans valuable information on what to do this time around. Basically, the game is to put US into legal limbo and remain in power. They know nobody on the democrat side is going to think about using armed forces, and they are not going to use armed forces to keep their public image and keep economy from panicking, so they are going to just declare some emergency and keep power under the pretense of fixing that emergency. Reminder that Supreme Court is on his side.
* Trump has shown that he has no issue with having a private army operating with extrajudicial authority in public. Now imagine with what he is ok doing with a non-public army. You should fully expect people going against him to get "arrested" under some made up charges.
* Even with Trump gone, there are smarter, younger, non senile conservatives ready to take his place and grab power and do the same things, with way less mistakes. Vance is right up there with him.
As such, even if everyone gets out and votes blue, in the end its all pointless. Trump can get impeached, convicted, and either Supreme Court says nah, or he just won't leave. In 2028, he (or Vance) will declare election fraud again and do it successfully this time to remain in power.
And even if somehow Dems win the house and presidency, and manage to pack supreme court to take control of all the branches, the thing is the will be left with a insanely shitty situation to clean up that will result in economic downturn, and the idiots in US will vote republican again in 2032.
I think Citizens United isn't even the problem any more. We now have near-trillionaires who don't require a corporation to buy elections. They can do it personally.
There's no way I would be able to detect if this was AI from the examples alone. If I got a phone call from a malicious agent using this tech, I probably wouldn't realize it. My plan is to ask a challenge question about a shared memory with people I personally know, if there's something suspicious about a call. I don't know how else to prevent it. It sucks to be this suspicious, but I can't help it.
There's so many potential scenarios.
One scenario: An AI voice trainer trains on someone's social media video posts and get a pretty perfect copy. Then SIM jacks the target's phone number and calls pretending to need help. AIs could be used to mock ransom people, request bail money, ask for a change on a production server, etc.
People with high public visibility are likely targets, especially if they have money and or power. Impersonating them to subordinates would be an easy means of a social engineering attack.
"There's no way I would be able to detect if this was AI from the examples alone."
The hallucination in the second sample - that Bryan Singer was involved in Superman IV: The Quest for Peace - would have rung alarm bells. It just seemed to be free associating on words in the conversation.
well, I wrote a reply, twice, and deleted it. I don't think a human would make this mistake, but explaining why is kinda long winded, so I let my words stand as self-explanatory. But here goes.
The AI talks about the movies like they are familiar with Singer's work. But if they were... they would known he was up-and-coming in the 90s, a decade too late to have helmed a blockbuster whose flop would have killed his career? They would have known that Singer made superhero movies _before_ Nolan not just after like the conversation suggests?
Even bringing up Superman IV is weird; it was such a dud it never gets shown, so unless they old enough to see it at the time -like me- (so would notice the 20 year gap!) or were an avid fan (so would know more about the movies!) it wouldn't come up.
On the other hand, for machines all things are equally obscure, they all happened yesterday, and are relevant if cosine similarity says they are.
can a model like this be used to replicate a loved one’s voice? isn’t it a model trained on audio instead of text? So synthesizing another voice would involve rewriting the weights?
I know the doomerism of robots takin R jobs get repetitive, but this seems like it would work very well in call centers. I get frustrated talking to AI call center agents, but that's often because they are less capable and prone to bad logic errors. To be fair, speaking to humans in call centers can be annoying too. If a call could be answered without waiting in a queue for 30 minutes by a competent AI agent, I think I would prefer that.
That probably explains why there were so many competitors around withing days of the Jev announcement. They are not starting with a moat, and there doesn't seem to be any moat in sight. Just buzzword recognition because everything is comparing to "jev".
There will always only be a very small percentage of people who want to discover and build things, even with llms, its a very small subset of people though, and most people want off the shelf solutions.
Also Jevs purpose isnt to become its own thing. It will get aquired in 18 months by one of Andressen Horowitz's incestuous circle of companies and everyone will make money, and the person who buys it wont necessarily care if Jev itself makes them a ton of money. They're just passing chips around the table.
Jev is the known idea, but with a slick website with grandiose claims and an impressive Doom demo on. It's also a catchy name - it caught on instantly, but mostly as a shorthand: it's easier to say "Jev" and "like Jev" than "classifier models" (or rather "<descriptive explanation of a specific shape of> classifier models").
Curious, what hosted VPS services people are using these days. I am using hostinger, but I don't intend to continue as 63%-70% discount eventually runs out. Then the real cost hits. Its the lock-in and migration costs that make people shell out the uncomfortable renewal price. Looking for an affordable option without the introductory rug-pull.
I just bought my first VPS plan after deciding not to renew my shared hosting contract.
Racknerd looked to be the preferred option after Hetzner raised their prices based on reading some of the forums/reddit.
I ended up going with "Server Host" based on ram and price.
4gb ram, 28 dollars for the year, and renews annually for that price (no discount expiring games). They initially provisioned it in the wrong region, I sent a support ticket in, and they fixed it same day. So far, so good.
i have used racknerd for years - no fancy features like a real cloud provider, but you get a stable VM for very competitive prices, and they're not super overprovisioned like some cheap providers
I swear people forget about inference providers that serve open weight models. It is hard to beat their prices. They are usually barely more expensive than electricity, so running local inference barely wins on cost (if you don't factor in the upfront hardware costs).
reply