> Yes it kind of does or it’s not what we were promised/sold.
No one ever promised this, and in fact, quite the opposite.
> A tool has to work reliably
They work reliably for what they do. You make a request and it returns text. What you _do_ with that text is a question of engineering and process. That are plenty of unreliable steps in business and industrial processes that people _engineer around_. A huge amount of computer chips are just _thrown away_ because of reliability problems in the factories that make them, for example.
> I don’t want a calculator that’s correct most of the time.
An LLM is not a calculator and if you're trying to use it for that, that is a you problem.
> An LLM is not a calculator and if you're trying to use it for that, that is a you problem.
I’m talking about another tool. An actual calculator. I would never accept a calculator that is correct “most of the time.” I don’t want an LLM that only meets that bar as well.
It's correct, by some definition of "correct", essentially all the time. It always produces text that matches the probable token distributions that it was trained on. You seem to want it to be an oracle. Your job as an engineer that works with them is to figure out how to make what it _actually_ does useful.
That’s just a lot of words to say “if you don’t like the results that’s your problem” which is, quite frankly, ridiculous.
AI gets all these passes while also apparently being this amazing perfect 10x productivity multiplier. If you squint yeah you can see it maybe. But you can’t squint all the time and I won’t pretend I’m not squinting.
They are never working with irrational numbers here, any finite decimal representation of an irrational number is a _rational approximation_ of an irrational number. And moreover, any rational number is an approximation of an infinite number of irrational numbers.
This is more or less about the properties of rational approximations of badly approximable numbers in general, which is a much larger class than phi, but not “all irrational numbers”
What is interesting about phi in particular is that phi is badly approximable at even the smallest truncations, so it produces a good spacing immediately. You could take _any_ irrational number, and replace it’s usual continued fraction representation after a certain point with all 1s, like phi, and with enough seeds, the placement would start to look like phi’s.
Even something like 1/4th, if you just tweak it a _little_ bit can start having this property after millions or billions of seeds.
Okay, but let's ask why there might have been missing knowledge/competencies/people, leading to "stupidity": the current US government has deliberately massively decreased the value of positions in public service. It's only reasonable to assume that the best people left, considering their job security was more reliant on the opinion of unqualified "hackers" and ChatGPT than on their own job performance.
We just had a full ground stop of all flights, and a major banking outage yesterday, following a major microsoft outage. I am starting to have doubts about them not being related.
There's a simpler explanation for the stock price drop here. The price had almost gone up 5x in five years, and bad news caused people to stop and take profits. You don't have to assume their business model is bullshit or that the AI bubble is popping or that there is fraud to justify a 10% pull back after a run up like that.
There's so much projection and wishful thinking about completely normal price movements in hyped stock.
> You don't have to assume … that the AI bubble is popping
I’m not saying it is, but what is a bubble popping, if not a bunch of people saying “oh this might be the highest we go for now, I’m gonna take my profits”, which causes downward pressure for those who come slightly later who also want to take profits, etc?
The question is just if enough people stop to take profits to trigger that chain reaction. After all, it’s basically the same as saying that the seller thinks the current value in cash is more valuable than the future value of the company, otherwise people don’t really sell
Because people think the stock is worth holding 150 (or 140, or wherever it bounces from) but not at 180. It doesn't need to go _all the way down_. A normal overshoot and correction is not a "bubble".
A bubble would be if there's nothing backing it, it's not the same as the price temporarily overshooting, which happens _all the time_.
People who don't watch stocks desperately want to tell a story about what this stock price is telling them. If you watch tech stocks, this kind of thing is completely normal when a stock is on a bull run. Just look at the huge swoon nvidia had last year when it dropped from 140 down to 100.
Humans can’t explain how humans think. We can tell you what we thought. And how it felt to think it. But we can’t explain the mechanics.
LLMs will be able to explain how they think or come up with their conclusions. Once that information is pulled into their data model. And it recognizes that the how LLMs think info usurps the decades of computers can’t think reality of the past.
reply