Hacker Newsnew | past | comments | ask | show | jobs | submit | onlyrealcuzzo's commentslogin

> If Nvidia's next CEO is smart, they'd buy up a bunch of these companies that "burn" weights to silicon,

Models are getting significantly better every 4-8 weeks with post training now.

I don't think there'd be much demand for this.

~80% of the total cost of inference is chip depreciation. If inference is 10x more efficient, that only drops your running cost by about 5% absolute tops, and that's assuming the chips cost the same and not more for this. That's also assuming the chips have the same lifecycle, which they wouldn't.

No one in the world is going to want Gemini 3.5 Flash at a 5% discount 1 year in the future. You've taken a 3-year chip amo, turned it into a 1-year, and that's 80% of the cost.

Hard pass.


> Nothing seems functional nowadays

It also wasn't functional before-a-days [=


Now we can make even less functional code much more quickly! All it costs us is some dignity, poor people's electricity rates going up and massive, massive amounts of cash set on fire

Such a deal.

Now we have the added benefit of nobody understands it.

> Now we have the added benefit of nobody understands it.

You should peak inside some old COBOL codebases running some of the most important software in the world [=


> I've yet to see anyone with expertise in medical research express optimism that AI will cure major diseases like cancer in the next several years.

Depending on "several years" -> it is almost by definition impossible. The trial periods are too long.

A lot of major breakthroughs have happened recently and are already in the pipeline, looking promising.

There's a lot of progress on this stuff already. Compared to 10-20-30 years ago, a lot of diseases already look "cured", even if they aren't completely.

Near immediate death sentences have become 5-10+ years of life expectations, etc.

I don't see any reason why AI wouldn't help speed things up in the future.

But we won't see any of that for "several years" regardless.


The trials argument is a good one, but if a good cure is found, trials can be sped up. A lot of medication today has an impact that's hard to measure, so large and long trials are necessary. If a cure is so good that improvements can be seen immediately, I can imagine that they are greenlighted faster, especially if the alternative for patients is death, since what side effect could be worse than death.

> This should be fine for caching.

When launching a swarm of smaller models, they can theoretically share cache amongst themselves, but not with the larger model (that already has it cached). They have different architectures.

Further, it wouldn't really make sense for them to share the same cache anyway! The swarm, that is, they'd be working on independent things...


Pretty big Gemini fan, but my initial results with Hydrogen and Carbon are disappointing.

They are trading improvements on pass@1 pointless benchmarks for worse disasters at p90/99 that you're going to hit every week in agentic workflows (if not daily):

overreach (doing more than asked), overwork (when it should have failed fast), harm (doing the opposite of what was asked), orthogonal work (doing something completely unrelated to what was asked), etc.

Google doesn't seem to be the only lab making this trade...

The set of benchmarks they released are disappointing. 10 mostly random benchmarks. Really?


No one on HN seems to get that agentic workflows are not the only name in the game. Everyone doing agentic development is either on a plan or with a custom enterprise offering, either way using higher-performing models. These entry level models are (also) for building apps on top of while you are paying API prices.

> It strikes me that if their models were good enough for recursive self improvement

I just can't imagine this is true when their overreach problem (doing more than you ask), hallucination problem (lying), redefinition problem (doing something completely orthogonal to what you asked), and harm problem (doing something that is exactly the opposite of what you asked) are all far too high at this point, and by most measures - all of the recent models are worse on most (or all) of these metrics.

They are giving up here in RLHF to benchmaxx the metrics people are looking at to pretend like they're making huge gains, when they're largely running in circles.

They are getting better at pass@1 at the expense of far worse p90s on real agentic tasks.


Didn't everyone already know that China was buying Nvidia GPUs?

Is the problem that Nvidia was not making it as hard as it should have?

Realistically, how much does that even matter?


Now legislators demonstrated how much that matters. I don't have the knowledge to evaluate the national security concerns. But from the outcome, it's a matter they'll firmly push as a long term strategy, even at the cost of one of the world's most visionary CEOs.

Because the government, empowered by the people, have decided it matters, as a matter of national security.

There's is no argument to be had about this specifically. You can argue whether this is true or not, but that's not relevant to this subject. If Nvidia still decides to ignore the government, it'd be not only completely, absolutely fair, to nationalize the corporation, but the country itself has a duty to its citizens to do such thing.


> Because the government, empowered by the people, have decided it matters, as a matter of national security.

The government, empowered by the people, never decided to put Megaspeed on a blocklist though.


They and their shareholders are about to find out how much it matters.

> Things have radically changed since then.

No, AI is still absolutely terrible at design.

It doesn't matter if they are good at implementation.

If you ask for a car and they build you an awesome surfboard, it's basically worthless.

Sure, if you're building rapid prototypes where it doesn't matter if anything is coherent or works, AI crushes it.

If it's a 99% derivative small greenfield project, AI crushes it.

For anything real, it is still a painfully awful experience to extract juice from the squeeze.


Which game did this steal content from exactly? Basically everything is derivative...

I'm not familiar enough with gaming to know where this crossed the line.

Rainbow Six? Call of Duty? Battlefield? Counterstrike?


This is exactly why this is so evil. Someone makes a porn using your face and your brother’s body does not make it any better.

What if SNL makes a skit by dressing up a comedian as you that kisses Ryan Gosling playing your brother’s body and airs it on national television?

This is a disingenuous argument and you know it.

I don't know it. Could you specify how this FPS is a derivative work while the mentioned games are not?

The one thing I do really like about Claude / Anthropic is that Claude.ai docs (especially its ability to create HTML docs) seems substantially better than Gemini or ChatGPT.

These seem like natural extensions that I'm sure will be very useful.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: