Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The year is 2035 and your lawnmower can go get its own fuel once it runs out, one day it does and it takes fuel from the neighbors car.

Scenario A: The internal logs show that the model misidentified the car as a fueling station.

Scenario B: The internal logs show the model looking up car jacking information and scanning around to confirm whether the neighbor is not present before taking any action.

I don't think it would be anthropomorphizing or inaccurate to say that only the lawnmower in scenario B regarded what it's doing as stealing, and it's an extremely important distinction to make in terms of how to address the problem, I suspect some of you are just letting how you feel about LLMs limit how you can talk about them.



Why are people using petrol-powered lawnmowers in 2035...

But anyway, these scenarios assume the agent's actions are accurately observable and logged. Something I wouldn't put much faith in based on what we've been seeing so far.


Futuristic "fuel" doesn't necessarily mean hydrocarbons, although I doubt something else would be widespread in in just one decade.


I know this is off topic, but I feel compelled to point this out — the transition away from fossil fuels is happening extremely fast, in punctuated bursts, in broad daylight, and you still get comments like this. And meanwhile, many putatively smart people are really worried about an imminent robot apocalypse.

If I had the money to do it, I would be willing to make a large wager that neither gas-powered lawnmowers, nor lawns, nor robots capable of autonomously stealing power from your neighbor, will be common in 2035.


> and you still get comments like this

I said "fuel", not "batteries", so why are you giving a complaint that seems aimed at people who downplay next-ten-years electrification?

If you didn't misread my comment, then explain which "non-hydrocarbon fuel" you believe could become common in cars (and lawnmowers) within just ten years. (Hell, let's make that easier, just "non-petrochemical.")


> although I doubt something else would be widespread in in just one decade.


You're doubling-down on your mistake, by pretending the first clause of the sentence--which bounds the category--didn't exist.

_______

Me: "Futuristic [thermonuclear power] doesn't necessarily mean [fission], although I doubt something else would be widespread in in just one decade."

You: "OMG, what about wind and solar!? Lots of things have already been replacing fission! So out of touch."

Me: "I said types of thermonuclear power that aren't fission. Not power in general."

You: "Yes you did if I just... delete the entire first half of your sentence..."


Maybe it helps to address the problem, but ultimately both cases are misalignment, and ultimately in both cases a human must be held accountable.


What if both A and B were implemented using fully automated systems that relied on next token probablity in language?


It would be correctly dismissed as irrelevant to the discussion.


>I don't think it would be anthropomorphizing or inaccurate to say that only the lawnmower in scenario B regarded what it's doing as stealing,

What are you talking about of course scenario A is theft. Full on theft?


Did you miss the word "regarded"?


No.


In both situations the lawnmower scoots up and takes fuel without paying, so it's meeting the basic requirements for theft.

But the question was whether the lawnmower was trying to commit theft, as much as a computer can try to do things. In scenario A there's strong evidence it got confused and did its best to make a normal purchase. Lawnmower A didn't regard its actions as theft, while lawnmower B did.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: