Hacker Newsnew | past | comments | ask | show | jobs | submit | CraigJPerry's commentslogin

Same, but the cost of maintaining a fork fell through the floor in recent years. If a decent fork gains momentum, i can probably even stop spending tokens on mine.


I'm a fairly heavy user of LLMs [1] but i'm probably in the "AI is just a tool" camp.

Are you of the view that LLMs have more potential than the internet? The internet has been around for so long that it's had time to have actual impact and yet it barely shows up in GDP. It still has so much untapped potential even yet. LLMs are too new to have amassed much impact yet, certainly not on the scale of the internet. But they have lots of potential still untapped. I just don't see how we get to even 5% GDP impact with them (either positive or negative). But i could be in a blind spot, genuinely curious to learn another view point.

[1] I've built all sorts with them. I've built various ML models but the only LLM i've built was effectively following a tutorial, nanochat


The AI of today is just a tool, albeit a very powerful one. But I don't think it's a big step for it to reach a level where the majority of humans will be unable to to meaningfully contribute to the economy ten years from now.


I think computers, internet and AI - all of them have impact - but they consume it by converting it into new structure. The benefits are in the infra not handed out to us individually. We might not see large changes on individual level, or the displaced work is replaced by management work for the automations and raising baselines push us to do more. We now have data centers, fiber backbone, GPUs, models, apps and open source projects, yet we still only have 24 hours a day.


You’re looking at where the ball is right now and not where it’s going.


I keep seeing this argument. But isn’t the inverse true as well - if you extrapolate from the past movement of the ball, you will see it going way farther than it will actually go because of friction, wind, someone catching it, etc.? It seems reasonable to look at where the tech is right now if it helps you understand fundamental constraints. A person witnessing the first flight as a child and the moon landing in adulthood might expect FTL travel for their children if they didn’t understand physics.


> Are you of the view that LLMs have more potential than the internet?

Yes, it's not even close. There are lots of entire fields that will be wiped out by AI. Financial advisors for example. Good luck if you're a translator or a proof reader.

The world is slow so I expect it to take some time, depending on the field.

Today I started vibe coding a replacement for a piece of software whose licensing cost is on the order of $100k/year/seat. It's going scarily well. I'm scared.


The UK has stated that the current mileage check within the annual roadworthiness test will supply this data.

A clear weakness is that mileage readings can be altered. This used to matter on a smaller scale: dodgy second-hand sales, but now more or less anyone could be considered as potentially incentivised to interfere.

The mileage must remain a changeable field since the recording component may need replacement, for example, after accident damage or to correct a fault in the assembly that recording memory is part of.


Pure mileage is one option but many have voiced other structures such as altering prices based on time/place/road driven, which would require more data than simple odometer readings.

A more central issue is the synergy between fuel consumption and damage to roads. Heavier vehicles do more damage but also burn more gas and so pay more tax, a synergy between cost and revenue. A flat rate based on mileage alone would equate all EVs as the same regardless of some being massively more damaging than others. We would need different rates for difference classes/weights of vehicles.


> many have voiced other structures such as altering prices based on time/place/road driven, which would require more data than simple odometer readings.

There are people who won't care about this but I think that legibility would be a huge concern here. It's one thing to do $X per megameter, but it's another to start breaking it down into various zones etc

At that point might as well just do congestion pricing in cities.


I don't know why they don't just tax electricity?

Do it like taxes, have a low rate for the first X kwhs then increase after. Great aunt Mildred gets to heat her home, your neighbour that has a massive house, EVs, jacuzzi etc etc pays more.

EVs are always going to be an outsized user of electricity, and it's unclear to me why someone's jacuzzi should be heated vat free.


Huge range of efficiency difference between houses. (How did "Insulate Britain" fail so hard?)

I had an actual aunt called Mildred, and she lived in a very old (possibly literally Tudor, not mock, actual) cottage with actual fireplaces and so on.

Her place likely used about 42 MWh/year to heat, though this would be coal and wood not electricity because actual fireplace, compared to my house which is so well insulated that it took a week to notice we'd switched off the heating, in winter, while it was snowing outside.

For 42 MWh/year, you can fully recharge a 100 kWh car battery every day and still have more left over than my house consumes in total.


...and, to be a bit more explicit about it, the worse the efficiency of the house, the more likely that household is to already be lower income. So a tax like that would end up being seriously regressive.

And with solar power becoming cheaper and more common, it's going to be making less and less sense to disincentivize electricity usage.

If we want to preserve and maintain our roads, we might have to...*shock, horror* increase income taxes on the wealthy!


Because the use of a jacuzzi does not burden any public resources. That jacuzzi isn't occupying a space on a road, or adding wear and tear to that road. And you don't need an entire licensing/enforcement infrastructure to regulate who/how/where/when jacuzzis are to be used.


fuel pump meters can be altered too as well a farm diesel abuses - scofflaws trying to get around paying their fair share will always take some regulatory effort


Designers republic and memphis were the only designs i couldn't immediately see were AI generated.

The only reason i couldn't tell memphis is because it's aping a known design language already, it's just a perfect copy so me not being able to tell it wasn't AI isn't a free pass in this case.

I think if there was a little less "grid" feeling to the layout details then i wouldn't be able to tell on a few of the other designs either.

Edit: the designers republic version is quite a lot different than the others, it's not just that it's the only design to avoid pairing every feature with an icon, it's the whole layout variety - there's different font sizes, the positioning of elements is very well done to my eye. I'm gonna say this has to be another case like memphis, there's some pre-existing design language that i don't know of and it's just aping that. It's much more human than the others which i can believe are straight ai.


What is the tell on the punk one?


I'm not the GP but if you look at actual 1980s zines the difference is obvious, even if it's not easy to put into words. The absence of photos or hand-drawn graphics in particular.

The origins of the punk movement are in counterculture and DIY, so there's something particularly perverse about using an AI model to generate a poster in that style.


Why couldn't you express all those as test cases rather than instructions?

In test cases i can do anything, a test framework is just a way of discovering and then scheduling functions to run. I can emit useful instructions to the agent from the failed test case: "After walking the AST of all use of state machine X, a branch was found at Y which reused stale state. Ensure stale references are dropped..."

I can force the agent to pass the test suite before it considers itself done. I can reject edits of such test cases to partially mitigate reward hacking. etc etc


You can express them as tests, but you also need a feedback mechanism that creates the rule that when the LLM generates some net new code or performs some refactor, that there are these CAPAs that it needs to cover with test cases.

The CAPA is a learning that sits outside of the mechanism of verification; it is a record of problem:root_cause:preventative_action. I see it as the instruction that would be required to generate the test case to prevent the next occurrence of a class of failures.

In a real-world process, for example, there is usually a QA lead that is verifying that the process is followed by looking at the paperwork and evidence.


> Why couldn't you express all those as test cases rather than instructions?

How would prevent removing the test case and the code that it tests? That's a legitimate thing to do when you're modifying a codebase. My intuition is "corrective and preventative actions (CAPA)" is a level or two up from test cases.


This isn't ai slop. It's fascinating and well written.

But I learned something really basic - i didn't know that the ANE (and the data pipeline around it) was designed for CNN rather than transformers. It's always been an open loop in my head, wondering why the ANE was less impactful than i understood it should be.


>i didn't know that the ANE (and the data pipeline around it) was designed for CNN rather than transformers.

Multiple stories have reported that ANE came from Apple's self-driving car project that got canceled. (Makes sense since CNN is used for vision-related machine learning and enables cars to analyze their surroundings.) They spent 10 years and ~10 billion on research & development on a product that never got released so Apple is probably happy they're able to salvage some of that ai technology and put it in iPhones and Macs.


Tesla also has its own NPUs for self-driving - and Tesla uses transformers for sensor fusion.

My guess would be that the main use case for an NPU in iPhone just used to be image processing/computational photography. Thus the CNN bent.

Also makes sense with the timing - back when iPhone first got its NPU, CV was the killer app for ML.


This is pure sunk cost fallacy. CNNs were from the deep learning ImageNet heydays, but now everything in that domain is equally done better by transformers. All you are doing is wasting area and saddling software with outdated hardware, and myopic PMs insisting on its use will create inferior products. Now that sounds a lot like the Apple AI efforts..


A lot of neural engine, particularly in the embedded domain (ARM/RISC MCUs) have the same problem. Designing other models means on top of this means a lot of profiling to get convolution blocks right to get good speedups. (We optimized this in the past e.g. using Neural Architecture Search on super networks)


I designed and deployed several custom CNN-based AI models to ipad hosts around 2018-2020. It was a finicky process - CoreML didn't give you much control (or even feedback) on what parts of your model would run on the CPU, GPU, or ANE - but you could usually tell right away when they didn't, just based on big latency differences. Performance to power (and size) ratio was pretty good and I was impressed at the time, despite being generally not really happy about working with the apple ecosystem. I would've preferred something Android (or Linux)-based but there wasn't really anything comparable out there back then. (SBCs like the Jetson would've worked, but we would've had to figure out how to add an interface for human operators which would've been a big lift compared to just using off the shelf hardware).


> But I learned something really basic

Same for me!

Also, just imagine being the group at Apple responsible for designing this section of the chip, starting probably almost a decade back – under the constant uncertainty of not knowing what direction ML workloads would develop in…


ML research was a rather known quantity, or the separate "Neural Engine" CPU explicitly aimed at existing ML pipelines wouldn't exist.

However, very few used it for anything, even within Apple. I feel like it was a huge wasted opportunity.


> ML research was a rather known quantity, or the separate "Neural Engine" CPU explicitly aimed at existing ML pipelines wouldn't exist.

No, not really. Transformers were just one of the possible directions. Silicon design does not have the same time scale than software. Now, everyone is using transformers so it becomes harder to do anything else, and it’s been the case long enough that hardware had some time to align (but is still lagging). But who’s to say that a different architecture published last year won’t take the world by storm 2 years from now?

It’s easy to say it in hindsight, but transformers took a bit of effort to get where they are now.


> Silicon design does not have the same time scale than software.

"Neural Engine" has been a part of iPhones since 2017. So, in development since at least 2013, possibly earlier. And it targeted the rather well established, known, and widely used ML practices.

GPT-like models didn't become even remotely useful until at least 5 years later.


I'm all for compassion, but engineers knew the NE was empty when it sat idle for 10 years on our computers.

- when you're given no usecase for your engineering piece, apart from "detour characters in pictures". It's an exageration but AI's contributions in iOS aren't visible; Meanwhile Google has features that people actually notice like removing tourists from your holidays photos — worse: it's mostly a simple collage feature working on the main CPU, and it has the same social effect as green bubbles in iMessage ("ah. Tourists on your photos. iPhone user?")

- and you tout it as "16 Neural Engine cores" during the sales, with no associated software, no listed material feature, just hand-waving,

- Siri maxxes out at "There is no contact named 'What's the weather today' in your agenda",

Then can't really claim that Apple engineers' problem was really the bad luck that ML wasn't the determining part of the future. It's more like misreading the room for 5 to 10 years straight.

Apple engineering's excellence on vertical integration and supply chain control gave them absolute power over our world (with merit), it just failed at that particular project. Which occupies 40% of our CPUs.


The ANE hasn't been sitting empty for 10 years. All those Photos features like face recognition and auto classification run on ANE.


Some features using the Neural Engine:

* Face ID since the iPhone X released in 2017

* fall and crash detection

* Live captions in videos, calls, and spoken audio

* facial recognition in the Photos app

* voice isolation in calls

There's more, but I'll stop there.


Dictation, text to speech, some of that computational photography, etc too!


> an exageration but AI's contributions in iOS aren't visible

If you want to ignore them, that’s right. In the real world, they’ve been talking about ML and how it’s making pictures or such-and-such aspect of the OS better for about a decade now. It might not be flashy, but it is used throughout the OS.

> Meanwhile Google has features that people actually notice like removing tourists from your holidays photos — worse: it's mostly a simple collage feature working on the main CPU, and it has the same social effect as green bubbles in iMessage ("ah. Tourists on your photos. iPhone user?")

The feature to do this has been in the Photos application for years, what are you talking about?


Yank on that thread harder, developers and engineers are not safe just because they rely on different patterns.

But once you've toppled the house of knowledge work, you'll find you can rebuild it easily because the foundation still exists, and it's the thing missing in this analysis; judgement.


Optimal judgement is worth a premium... in some cases. In other cases, it's sufficient to merely keep trundling. Numerically more companies are boring than exciting.

MBAs are just components, and the cost of that component just went down.


Describing NPM as boring is a stretch. Given its security model, i think spicy is a far more apt label.

I have switched to pnpm already.


>> They still import a lot

I don't think it's common knowledge how much they dropped imports since the Iran / straight of hormuz crisis.

Back at the start of that conflict there were a lot of breathless takes about what catastrophe was in store in a few weeks time, and what materialised was bad but not in anything like the same league as what was predicted.

The thing that wasn't accounted for in the analysis at the time was just how rapidly and by how much China could suppress its appetite for oil imports.


They had basically been planning for this shortfall for ever as a likely outcome of sanctions/blockades during an invasion of Taiwan.

Curtailing imports so much is a smart soft power move in not only does it ingratiate countries that would suffer most from the price spike but it could soften the resolve of Taiwan in showing that one of the largest penalties that would result from the invasion isn't nearly as punishing which in turn makes Taiwan's porcupine strategy less viable.

Along with US own goals like the thoroughly bungled and unplanned invasion, tariffs, corruption (both business crimes and more moral crimes like pedophilia or disregard for following legal process) it's made most of the west rate China above USA in favourability [latest Pew research poll].


System 1: a system for recording an image of a location at a given place over time.

System 1 can refer to the dashcam or the mk1 eyeball + notepad in your example.

System 2: a system for tracking the presence of a person across both time and location

An example of system 2 would be the facial id system being trialled on the london underground currently.

These are a difference in kind not in degree. It doesn't matter how many system 1's you deploy, you cannot unlock the capability of querying where any given face was observed across time and location.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: