You're correct, the base (non-Pro, non-Max) chips are still not great for local LLMs. M5 and M6 both improved prefill speed/time-to-first-token over prior gens, but bw is still a bottleneck.
There's rumored to be no M6 Pro or M6 Max coming, i.e. the higher bandwidth chips will skip a gen. M7 is also rumored to have better memory bandwidth across the range.
To the best of my recollection, the GeForce 256 was the first one that was marketed as a “GPU” and began to popularize that term in the industry.
Specifically because it did transformation and lighting calcs in (non-programmable until GeForce 3) hardware, instead of in software on the main CPU.
Yes, NVIDIA made 3D accelerators before the GeForce line. I have many of them in my collection. But (IIRC) it did not market them as “GPUs”. That term wasn’t really used yet.
Funnily enough, I already “found” that term in my brain and then decided to write “non-programmable” instead, in the hopes of being a bit clearer to readers who don’t know this space and its specialized terms already.
Got it. Well, to be honest the marketing distinction isn't terribly interesting. But it would still be cool to see how the early GPUs (even if not called that) evolved.
Doing all those calculations in hardware (the distinction the marketing was based on) seemed like a pretty big deal at the time, at least within the context of consumer PC graphics cards. (It had long existed in the high-end workstation space, SGI etc. but the workstation and consumer PC ecosystems were more separated than they are these days.)
There were many periods in the 80s and 90s where console graphics hardware was kinda ahead of (even high-end/enthusiast) PC graphics hardware in certain ways that mattered for games of the time. Hasn't really been the case for a couple decades now, I guess.
I was gonna say hey that isn't true, the PS3 had hardware that was ahead of PC graphics hardware, and then I realized that was a couple decades ago. Oof.
Yeah, Cell was a disaster, and it showed Sony leadership at the time was actually clueless about big reasons the PSX and PS2 were so successful (it's the developers dummies!)
Really the PS3's only saving grace was it was a great deal for a Blu-ray player.
I read those tutorials as well! Around the same age, in '96 or '97, when I first got online, in the UK. And it might have been someone's "translation" of them into C, although I do recall reading the Pascal originals as well.
Namedropping another contemporary reference, I probably downloaded them from the Hornet Archive or a mirror.
They were a major step along the short but satisfying road to my first 3D starfield using Borland C++ (acquired via a magazine coverdisc). I felt so l33t.
??? - My comment doesn't even look like an LLM wrote it.
> It’s against the guidelines.
To be clear:
I wRoTe
- E V E R Y - w o r d -
by [picture ASCII art of "human hand" here]⠀
Do not accuse me of using an LLM as a substitute for thinking.
I do not use LLMs to write any of my Hacker News comments, and I never have.
I have used LLMs to help me search for information, but I have never once in my life posted the outputs of an LLM into a post verbatim as my own. That's laziness.
I'm not dismissing LLMs here. They produce better writing than a lot of humans. They are fantastic tools for constructing media, for getting work done, and for furthering your own capabilities.
But I curate my thoughts and craft my arguments. That sort of wanton dismissal of my comments is worse than using an LLM as a substitute for thinking. That's real "human slop".
There's rumored to be no M6 Pro or M6 Max coming, i.e. the higher bandwidth chips will skip a gen. M7 is also rumored to have better memory bandwidth across the range.