While you can't necessarily prove it, you can say whether the data was in the training set at all.
You can also do something like a release of a GPT-OSS v2, where you actually release training data and checkpoints, and do an experiment where you have some held out math problem dataset, then demonstrate how much training it takes on solutions (or partial solutions) to that dataset before the model saturates that test. While of course that would be a test on a much smaller model, it would cost a tiny fraction of the training on your big model, and it could be used to demonstrate just how much effect data contaminaiton like this could have, especially if you did the same experiment on a few different sized of model to show the scaling laws involved.
But you can say (with the cooperation of the parties involved, of course) if any of the preliminary work that the other researchers did was part of the dataset. It is possible to be more transparent than you are being.
Even better would be more research and tools to help determine the impact of particular training data on models. Right now, proprietary LLM providers get to hide a lot behind "we just train it, we don't know what inputs affect the outputs," and that can be a problem, both because of lack of traceability of factual informaiton as well as lack of traceability of things like this, where the model itself may have had unpublished work in its training set.
Why can't they rule it out? Is even OpenAI unable to track the provenance of all of their training data?
This is one of the major problems with these enormous closed models, and even most open-weights models, which don't disclose their training process or training data. You can never be sure what went into its training. Did it come up with an idea originally, or is it just plagiarising its training data? Are there malicious inputs being used to train in particular behaviors when given certain trigger phrases? What are the characteristics of the RLHF data and what kind of biases are those embedding in the models?
With proprietary closed models, or even open weights models that don't have open training datasets, you just can't answer these questions.
To truly prove some incidental usage data made no difference we'd have to (a) identify any of their de-identified data that came from their usage of ChatGPT, (b) train a bunch of expensive giant models, and (c) ask them all to solve the Navier-Stokes Millenium problem until hitting some level of statistical significance. It's just not feasible to run experiments like this to prove whether a piece of data has an effect on model behavior.
As a parallel example, can we prove the phase of the moon had no impact on the NS solution? No, not without a bunch experiments run at different phases of the moon.
There's no reason to believe that anything they did in ChatGPT led to our solution; it's just impossible for us to truly prove it. And knowing most of the recipes we use, there's really no reason to think such contamination happened. I've asked the team to make a clearer, less-lawyerly statement here - let's see what happens.
So, one way to prove that the data played no part is to trace and show that it wasn't used in the training process at all. If the data was never used in training, then it couldn't have played a part in the training process.
You're right; if the data was used in training, then it gets much trickier; it would be very difficult to show whether some particular data had a significant effect on the outcome.
This is one of the big problems with giant models like these; it becomes nearly impossible to discern what is and isn't plagiarism, or copyright violation.
It would in theory be possible to have things like n-gram databases or rolling hashes of training data, somewhat similar to OLMoTrace (https://arxiv.org/abs/2504.07096), which would allow for detecting whether particular documents ended up in the training data or not (you'd have to keep this for every model used in the whole training chain, as synthetic data generated by earlier models could be influenced by training data that wasn't included in later models). I'm sure there are practical issues with providing such a tool, but I think that it's necessary if you want to be able to categorically say "no, this document has never been present in the training data of this model."
Or look at it the other way: if your model wasn't influenced by things in your training data, why include them in the first place? Clearly, you train on all of these documents because they influence the model. Yes, it's hard to trace the exact influence of each one. But if they're not affecting the output, then why not just stop training on them? You could just not train on any private documents; only train on public, traceable data.
But instead, you choose to train on these private documents, so you have to admit, your model and its outputs are influenced by them.
> As a parallel example, can we prove the phase of the moon had no impact on the NS solution? No, not without a bunch experiments run at different phases of the moon.
That reads as incredibly dismissive and condescending. What makes you think you’re in a position to communicate like that when engaging on such a sensitive topic?
I intended no dismissiveness or condescension. My hope was to explain why it's hard to prove whether something affects model behavior. In the case of the moon, we have a strong prior belief that it makes no real difference. But it's hard to prove, because what if there's an unexpected impact from tides, cosmic rays, grid voltages, holiday traffic, etc. Models trained under slightly different conditions could have slightly different weights and behave slightly differently when solving math problems. Similarly, I have a strong expectation that, for example, a thumbs up signal from a ChatGPT chat will not meaningfully affect long-horizon mathematics work in our latest model, but it's always possible that it could. I think the plausibility of the ChatGPT route is higher than the tides, but still incredibly low. I respect Tristan and Levant a great deal and I'm bummed that this controversy has erupted (I acknowledge this will ring hollow if you think it's our fault). It reminds me a bit of the Frontier Math controversy, where people on the internet boldly claimed over and over again that we had trained on the Frontier Math evaluation set, even though we had not.
We aren’t dummies, we know it’s hard to prove exactly how significant of an impact that would have on the result. Nobody expect you to do that. There are a lot of steps and things that are possible to check _before_ the need for such a strict definition of „proof“
You seem to jump over the principal issue of whether any data from the researchers used to train or otherwise affect the model which produced the OpenAI proof.
We can judge for ourselves the impact and degree of that wrongdoing, but it seems OpenAI is confirming: yes, that is what happened, but with more words.
I think there is a much easier way to prove that the ChatGPT usage of Tristan Buckmaster and Levent Alpöge (possibly also the ChatGPT usage of Córdoba and Martínez-Zoroa, if they use it) had no influence on OpenAI solving the Navier-Stokes problem.
If the internal OpenAI model is as capable as you claim (being able to solve a Millenium problem without using unpublished insights built on years of work from mathematicians), then it should be able to demonstrate this capability again.
How about OpenAI solves another Millenium problem within the next two weeks, that doesn't coincide with the parallel discovery/solution of other teams of mathematicians, using ChatGPT for preliminary proofs & write-ups.
I have no idea if their data was trained on. For example, if they used ChatGPT, asked a math question, and clicked the thumbs up button, that could have provided a small reward signal. I highly doubt this sort of feedback made a difference to a problem like Navier-Stokes, but it's not something that's feasible for us to prove one way or the other.
Edit: Also, if they opted out of training, then we didn't train on it.
> it's not something that's feasible for us to prove one way or the other.
This kind of question is exactly what a company named _Open_AI and founded as a nonprofit is supposed to be doing; open research on AI that helps inform, rather than obscure.
Anyhow, you do have the data available about the documents in the user's accounts, what they opted into (or were forced into via non-negotiable ToS), and whether they pressed a "thumbs up" button. You can answer whether the data entered the training pipeline or not. Yes, how much influence it had is an open question, and one that would be good to have research on and better tools for exploring, but I'll accept that it can't currently be answered precisely.
But whether the data entered the trianing pipeline can be answered. And how to provide better tools for quantifying and tracing this kind of thing is exactly what should be studied.
I think it should be incredibly easy to verify this. Just look at the training data and see if it contains any of the chats. It should be trivial for a company with tens of thousands of super-genius agents at their disposal.
(1) We'd have to identify their chats. How would we do this? We'd need them to share their chats with us so we could look for matches.
(2) We'd have to prove those chats changed model behavior. How would we do this? We'd need to retrain many models with those specific chats removed, and ask those models to solve the Navier-Stokes problem many times, and keep doing this until reaching the desired level of statistical significance.
#1 requires their cooperation and a bit of work on our side. #2 is extremely expensive and not really feasible.
> (1) We'd have to identify their chats. How would we do this? We'd need them to share their chats with us so we could look for matches.
According to the statement by Tristan Buckmaster, he was in communication by email and calls several times over the past week with you (OpenAI that is, not you personally), asked about whether his chats were trained on, and was declined an answer (https://cims.nyu.edu/~tristanb/statement.pdf).
However, it seems like there was great pressure to hurry the release to compete with Anthropic's recent release, so he was unable to get an answer in time.
The mealy mouthed statement in the release "We (the researchers and the agents) did not see any of their work through any means until they released it publicly — in particular, no specific user data was accessed in order to solve this problem. While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models ." is realy not much. If OpenAI had wanted to be transparent about this, you could have worked with him to identify if his data was used in the training of your new model, and actually made a somewhat more certain statement on that basis. But you have chosen not to; it was more important to scoop Anthropic on this than it was to be transparent about your training data.
> (2) We'd have to prove those chats changed model behavior. How would we do this? We'd need to retrain many models with those specific chats removed, and ask those models to solve the Navier-Stokes problem many times, and keep doing this until reaching the desired level of statistical significance.
Just the information from step (1) would improve transparency. Yes, you still can't prove one way or another how much the effect of the training is. But if it's included in the training data, it provided some effect.
> we'd have to prove that firing the gun caused the murder. how would we do this? we'd need to redo the murder many times, with and without my client firing his pistol. that's extremely expensive and not really feasible. therefore, we must acquit.
#2 (prove those chats changed model behavior) is pretty straightforward if the anonymized data from chats can be actively searched by a model. In fact, it could be very clear if the provenance of context is traced. If anonymized data from chats leak into the context of an actively running model it would clearly influence the answer.
Just because something is in the training data, doesn't mean it is the root of an LLMs output.
Turn off web search and ask a model what a random redditor said about a random topic in 2015. You will only get hallucinations at best, even though that comment is definitely in the training set.
Sure. But it's possible to say: if the document isn't in the training data, it isn't the cause of the output. If it is in the training data, the question gets more complicated.
What they're saying, and I think this was the clear implication of the blog post too, is that the training data definitely would contain these chats and the only question is whether it got encoded into the weights.
I wouldn't expect poking at millennium problems to be that rare in ChatGPT. They were uniquely successful - but it's probably not easy to check de-identified data for the presence of any of their work on the problem because it would blend into a haystack of less successful work on the problem.
Thanks for the details, it's definitely believable, but if the user had not consented to have their conversations used for training, then shouldn't it be straightforward to state that their conversations were never used for training?
If you need to do a whole series of extensive experiments to check in that scenario, it implies there are pathways for your conversations to end up in training even though you opted out of that setting.
Of course, this is assuming that the toggle was set to not consent to training. I can't know that of course, but if this is considered a possibility even after using an enterprise account or toggling off data retention, it's a bit concerning.
(a) identify any of their de-identified data that came from their usage of ChatGPT.
You don't need his login information, you just need to identify if anyone was approaching the NS problem using his method. Nobody else on earth (presumably) besides him, his team, and at best OpenAI were approaching the problem this way.
Why wouldn't contamination be possible? I can believe the data is de identified so you couldn't simply prompt the model to "follow this guy's approach", but it's entirely plausible that there is a very tiny amount of data about this approach in your dataset, and it comes precisely from this researcher.
It is, perhaps worth considering that the reputational community might not care about the difficulty for the AI builder to verify pedigree.
If OpenAI's answer to this problem is "We can't know," then the rational conclusion may very well be "If I seek to have my reputation attached to the discovery of the solution, it is not sane to use the AI as an assistive tool, lest it scoop me on my own work using my own work. After all, they don't know it doesn't do that..."
That's such a shit parallel example that it borders on dishonest.
There are hundreds of incredibly strong scientific priors that would have to be disproven for the moon to contribute to the solution.
If a model was trained on this data, even if it was trained using methods that lead you to believe it unlikely to have learned details about the proof (e.g., maybe it was only used to train some kind of reward model, which played a minor role in the overall training and would thus be very unlikely to transfer details of a proof), you wouldn't have to disprove large swathes of known science to be wrong.
If the model has access to the "anonymized" data from chats, and the model is capable of building its own context from data that it can search through, including this data. Then it looks pretty damning. An independent review of the data traces from CoT and tool use involved in producing the result should make it clear one way or the other. Seems like discovery in a civil lawsuit could be very productive.
> As a parallel example, can we prove the phase of the moon had no impact on the NS solution? No, not without a bunch experiments run at different phases of the moon.
The _gall_ to say something like this. Do you perhaps think we are all stupid?? This very blogpost claims not to know if their work was used as input for this model. I don't even understand how that is possible, surely you can know if something is part of the training data, even if you are in the dark about what impact it actually made, qualitatively. The moon....
> Knowing most of the recipes we use, there's really no reason to think such contamination happened.
Yeah sorry but I don't trust you. I don't trust people or companies that have shown themselves to be dishonest before. Especially when the previous paragraph is comparing plagiarism and training data contamination with, _the phases of the moon_.
Might even be you're actually telling the truth, but the boy that cried wolf and all that.
-----
As an aside, I would bet very good money at how most (all?) these companies are flouting their ZDR.
One of the wild things about how these models work is how often things that aren't sampled directly end up a variable in the model via secondary signal.
They aren't keying queries by phase of the moon. But if, for example, more people talk about camping outdoors when the moon is full, and they're using conversation topic and timestamp as signal in what eventually becomes training data, it's not impossible the model has learned something about moon-phases.
That's the kind of thing that's hard to prove had no impact on an answer.
A careful reading of "we cannot rule out that de-identified data derived from their usage of our products helped improve our models" could be saying that yes they trained on it but they don't know if that training data resulted in an "improvement" to the model. That is, they can't rule out that the only reason the model found this solution was because it had been trained on this approach.
The term ruled out is very open ended and gives them significant flexibility of meaning. They may have the information to determine exactly what happened, but they haven't looked so they can't "rule it out".
> Why can't they rule it out? Is even OpenAI unable to track the provenance of all of their training data?
Probably? I have a few hundred TB of training data for various small scale models and I can attest that I have _no idea_ what's in them. As in, literally zero. Half is scraped from GitHub and other hosting sites, other than that, I couldn't tell you anything else.
At OpenAI's scale their entire pipeline is likely 100% automated.
But that doesn't preclude being able to index and track what the sources of data are. For your data sets, I would hope you are including source information for where the data came frome. And at OpenAI's scale, I would presume they are doing some amount of rolling hashing or similar to weed out duplication, training on too much duplicate data can cause problems.
AllenAI have at least attempted to add some amount of traceability to their models with OLMoTrace (https://arxiv.org/abs/2504.07096), by letting you find n-gram matches from the outputs in their training data. It's not the most useful, there's a reason that LLMs use full fledged attention mechanisms and not just n-grams, a lot of times the n-gram matches it finds aren't all that related to the given output, it might be better to supplement this index with a vector search or other ways of keeping track of what training data would have most influenced particular parts of the output.
But anyhow, this is something that is an important question, and the big labs should be working on to make their products more trustworthy. Instead, they are hiding information about how they train, hiding their reasoning traces, and just producing output with no information on what might have influenced the training.
Attributing training data seems pointless for trustworthiness. The way you trust a model is the same way you trust a human; you ask it to:
1. Provide a chain of reasoning from agreed premises. These days LLMs can even do this airtight with proof assistants.
2. Cite data sources for non-agreed premises. I don't care where the model learned a fact. It might not have ever read a document directly from the primary source. I want it to link directly to either widely agreed facts (e.g. standard textbooks, and if necessary school syllabi demonstrating that the text is standard) or primary sources (e.g. datasets).
Training provenance is irrelevant. It's neither necessary nor sufficient to deal with truth.
The question is not "does OpenAI know", it's "can OpenAI attest that the usage of their products for confidential data is not going to cause that sensitive data to become known to their models". And right now the answer I'm reading is that OpenAI can't attest to that.
Aye, but do they train on user data in these circumstances or not? If they do, then almost certainly the model was influenced by the input of the allegedly plagiarised material.
OAI could check whether those accounts enabled training data. If "yes", OAI could trace whether that data was used in any related training process. If either of those answers comes out to be "no", then that's sufficient to conclude training data independence.
We wouldn't need a full ablated re-training and solution attempt, contra tedsanders in a sibling comment.
If the model includes unique data from a person then that person can identify the data - the allegedly plagiarised material - and so re-identify it. There doesn't need to be a privacy breach to close that loop as it requires the person to identify the information is associated with them first.
At the scale at which these models are now, regardless of whether they are proprietary or open weight or list their training datasets, there are hundreds of billions of works that have gone into trillions of parameters, each one providing tiny perturbations in some tiny fraction of the weights. It is probably impossible to attribute provenance to any specific input (which is also why the courts' finding of Fair Use is reasonable.)
> The risk with IP, however, is a lot more grave. You may not even need to memorize the details of the IP verbatim, just the broad idea may be enough. It may lurk encoded in the weights forever, just waiting to be activated by the right prompt to start a chain of thought that unlocks further details. Heck, it may even appear as if the model suggested the idea itself.
However, from a quick skim of the timelines, the specific discoveries, and all the he-said-she-said, so far it seems unlikely that OpenAI's model cribbed from the NYU / Anthropic pair, even if it would be impossible to prove.
Maybe what might help is a timeline of when the other two were using Codex for their work, whether they had opted out, and how long it takes for user data to make it to the training of their internal models. That last bit may be considered sensitive information however, as it could give away a lot about their internal processes.
Yep, the last part in my post was suggesting some ways we could determine if "item X was in the training data" (as well as some potential blockers for that from OpenAI's perspective.)
I think you just have to be smart enough that when the administration calls up and says "amazon, the nsa, and half a dozen other companies say we have a problem" your response isn't "well, actually we don't."
Their previous model, K2 Think V2, was release with fully open training data and recipe, so I would imagine that they are committed to that, but yeah, the repos for this new model are still just placeholders.
It's the training code that is not up yet, but this group has a history of publishing code so I would expect it, though of course you can never count on it until posted.
Software developers, unfortunately, have been convinced that they don't need to unionize, so have no collective bargaining power for dealing with situations like this.
Personally, I just can’t find it in me to be that self-interested. It’s how other people oppose buildings near them because it blocks their view. I really don’t want to stop other people from writing software. If they want to use AI to do it so be it.
That’ll be somewhat detrimental to me perhaps (which isn’t certain), but that’s okay. I’d rather attempt to adapt to a changing world.
I don't know that unions would necessarily negotiate for no use of AI. The SAG-AFRA deals don't preclude all use of AI; they just requre consent and negotiation in certain cases.
A union doesn't give you unilateral power; it just gives you a better seat at the bargaining table. Capital pools its resources to negotiate better as a single bloc; why shouldn't labor as well?
I don't have a voice or likeness in my code. Sure, I have a very specific style in all the code I wrote for the past couple of decades, but you can achieve the same outputs with completely orthogonal styles as well. (like AoS vs SoA) so what would I even negotiate for when everything I ever thought of got distilled into neural network weights to be high-pressure sprayed to the masses?
> so what would I even negotiate for when everything I ever thought of got distilled into neural network weights to be high-pressure sprayed to the masses?
For your unique approach to the problems at hand. Yes, 90% of the code written is CRUD, but when it's not, how it's solved matters.
This is why we have grown with id Software games. They solved the problems, created new paths and methods for limited hardware for their time.
This is why we praised DivX and XviD back in the day. They solved problems again which are caused by the limits of the computers.
The way one solves problems matter, makes one valuable. This is why we do research and create new ways to do things.
In short, your creativity is being sold/sprayed to masses.
Then do it. Hypothetically claiming the job can be automated as an excuse to pay people less is older than everyone alive today. Lying to exploit workers is nothing new.
Until you actually remove the need for a human, you have to pay full price for human labor. Which if you used AI is never really going to happen. Someone has to evaluate what AI creates to make sure it does what was asked. This trend of not prosecuting crimes conducted by AI cannot last forever. The CEO would be the only one arrestable as the CEO is the only person with decision power in the company.
This is the first time I've heard someone argue that unionizing is a self-interested pursuit. It's called "collective bargaining" for a reason; workers who cooperate in negotiations with their employers have more leverage than those who negotiate individually. The entire point is to work together for the betterment of the group!
See current situation where the Carpenters' Union in California is pushing hard against an initiative that would make it much easier to build more housing in the state because it would also reduce requirements for union labor.
Unions are very much an in-group vs out-group phenomenon (and in many cases, the benefits are specifically to the more senior union members vis a vis the less senior ones.)
> Unions are very much an in-group vs out-group phenomenon (and in many cases, the benefits are specifically to the more senior union members vis a vis the less senior
In the US. In the UK all the major unions I know don't require membership and fight for all employees in the industries they represent. E.g. as a software developer on a research project at a University I got all the negotiated benefits of the academic Union.
In Italy too. We have national contracts that are negotiated by unions for the whole indistry and are valid for all workers of the same industry, not only members.
They've also been proven to increase wages for people in the same industry who are not even in the union due to raising the floor in general for what good labor should cost
> See current situation where the Carpenters' Union in California is pushing hard against an initiative that would make it much easier to build more housing in the state because it would also reduce requirements for union labor
If you're talking about AB 1751 (Missing Middle Townhome Ownership Act) I think you have this exactly backwards.
> Unions are very much an in-group vs out-group phenomenon
As opposed to what? You and the GGP phrase this as a dichotomy, but I'm really curious what the other side of this is, because "not being in a union" doesn't erase your self interest or all the many many groups of people doing the same that don't feel like they're apparently being overly self interested by forming corporations, governments, non-profits, advocacy groups, etc, etc, etc
I can't speak for the OP, but I don't think their point was that they're against the self-interested nature of unionizing.
I read it more like they're against trying to stop, hinder, or prevent the use of new technology, simply because it's personally threatening.
And I feel the same way. If I was part of a union, I would believe in the collective bargaining power, but I wouldn't necessarily believe we should use that to pursue every single possible agenda that might benefit us. And I've personally pooled my capital with others in the past in order to achieve certain outcomes. And in those situations I also didn't attempt to reach so far as to limit the totally valid freedoms of others just because I knew it might be better for me.
Acting in the interest of a collective doesn't mean one must also abandon the ethics they usually employ when acting in their solo self interest.
Have you ever not been able to send your kids to school for weeks (or years in the case of COVID) because the teachers refused to work? Have you ever been unable to get timely medical treatment because nurses refused to work? Have you ever been unable to work yourself because the transit workers refused to work?
People have this right to take better jobs at other companies. This is how we get better working conditions: competition between employers. Tech has figured this out. I’ve never felt the need to go on strike.
Unions can be a deterrent to this. If you have sectoral bargaining, you can’t get a better deal anywhere because everyone pays the same. Or even if it’s within a single company, you’re just stuck with whatever scheme the union bosses agreed to.
But also, unions are a deterrent to new employers since fewer people want to start companies in industries where unions have taken over. They’re a nightmare to deal with. Fewer employers means less competition means worse services.
We have a dynamic economy with lots of competition. It’s easy to switch jobs and find a better place to work. We should not want to give this up.
"Competition is universally good" is what has decimated American manufacturing since Reagan. It's hollowed out the US middle class, which affects what the country can build, purchasing power, and innovation. Free trade policies have destroyed cities, eliminated millions of well-paying jobs, cut social services, and ripped the social fabric from communities. There were no alternatives to just "take a job at a better company"; most manufacturing jobs that left had no alternatives.
It was cynically selfish and short-sighted. The US from 1980–2020 is a perfect example of how much more complex systems, economies, worker dynamics, and second/third/nth order effects are.
Just to add to that "Competition" is no longer even a thing when the unchecked capitalistic game is played to the extent we are at, with extreme consolidation and duo/triopoly cartels running most services and playing all the dirty tricks in the bag (regulatory capture, rent extraction, lobbying for deregulation and weakening of labour and environmental norms, ...)
Competition is generally good for the consumer, but Americans need to wake up to the fact that it's not built into the system, it's to be regulated into it, and competing is only good so far as it doesn't turn into a race to the bottom (which again, is a matter of a regulator setting the bar).
You realize his examples are public sector unions. Which mean the “employer” you are referring to is the citizens? Not some evil corporation, government mandated monopolies which then get taken over to serve their union members.
I don’t have any objection to voluntary unions. Meaning people can join them for support or collective bargaining, but that citizens can just opt to not employ anyone in the union. Unions could be support structures for workers, instead they are mafia bosses.
Well… yeah. But I didn’t blame the employees, I blamed the employer who must have seen the writing on the wall for a long time and yet let it come to this.
Where do I say that nurses shouldn’t have good working conditions or good pay? Most of us have figured this out already: you can take a job at another company that’s better to work for. Most nurses do have pretty good working conditions and get paid well. Competition among employers is the solution here. Walking out and putting customers (or patients in this case) in a precarious position is not.
The average nurse in the southern US is paid roughly ~$30 an hour. Given their responsibilities, long shifts, and overall stress, do you think that's a fair wage?
>Walking out and putting customers (or patients in this case) in a precarious position is not.
Sometimes the system needs to grind to a hault to get peoples attention.
So she doesn't enjoy her job and only works there because you can't make up the $15 hour difference between her working in a book store for minimum wage vs her working for $30 an hour? Why don't you take a part time job on the weekend to lighten her load? There are many people who become a nurse because its a calling.
>So she doesn't enjoy her job and only works there because you can't make up the $15 hour difference between her working in a book store for minimum wage vs her working for $30 an hour?
She loves being a nurse and couldn't do anything else. But that doesn't mean it isn't exhausting for her.
>There are many people who become a nurse because its a calling.
And that excuses the shit pay and unsafe working conditions for nurses?
as an art enjoyer, i do not feel that having less media written, drawn, or voiced by a computer is a loss.
a computer can never be sad or horny or have taste. it can only make product. i also think artists should be paid living wages with good working conditions.
thank you SAG-AFTRA, WGA, IATSE, AEMI and Teamsters.
Nope. That is what's called a rhetorical question and a pretty good one because obviously it stirred some emotion in you.
Was your question supposed to be profound? Surely someone has explained to you that record players don't compose music.
Perhaps you could be a little more charitable and less toxic here and answer my obviously non-rhetorical question: Why shouldn't I enjoy things that were created through an automatic process? Hmm?
> Nope. That is what's called a rhetorical question and a pretty good one because obviously it stirred some emotion in you.
I guess if your goal is just to get any reaction, it was good, since it definitely stirred up annoyance in me? Unfortunately it also showed that you're fundamentally misunderstanding the arguments brought against AI media, be it willfully or accidentally. Either way, it gives me zero reason to want to discuss the topic with you.
> Was your question supposed to be profound? Surely someone has explained to you that record players don't compose music.
No, it's a stupidly simple question. GP is equivocating two things that obviously show fundamental qualitative differences, but did not give any reasons why this equivocation is supposed to make sense.
When I see comments where the only interpretation I can see has major and obvious logical gaps, I sometimes ask the obvious question in the hopes that they can show me a perspective I haven't properly encountered before. Because surely all of us are capable of recognizing how weak arguments based on "two topics look vaguely similar once you strip all nuance", when you can do the same with almost any two things?
> I guess if your goal is just to get any reaction, it was good, since it definitely stirred up annoyance in me?
Do you think that my goal is only to get a reaction and not to try and make any other point? I think someone who was "just" trying to get a reaction probably would just curse at you or do something else. Reactions are signals though and annoyance in particular is a very useful signal, hopeful to the one who experiences it. More importantly though, why, when you responded to me the first time, did you not address the very obvious non-rhetorical variant of my question though and instead, decide to appeal to me with sarcasm about the profundity of the rhetorical variant?
I'm trying to engage here and not put my trauma on display so I'll try to be as straightforward as I can. I am sincerely trying to respond in kind to you by telling you the truth and I will be glad to explain, in detail, my point of view. So, let me do that:
> GP is equivocating two things...but did not give any reasons why...
Yes. And I had hoped to correct that equivocation by pointing out the many random and/or automated processes that produce beautiful or otherwise enjoyable things. I wasn't agreeing with GP, I was improving the position. And I did, because very many useful things are created without any human interaction.
> fundamentally misunderstanding the arguments brought against AI media
Okay and you haven't engaged with the point that I'm making at all. It's different than the GP's. You also haven't given me any reasoning to backup your point that I am fundamentally misunderstanding the arguments brought against AI media. You want reasons why and I want reasons why. Let's engage in a civil manner.
The point that we're engaging on, really, is not the GP's. It's what computerliker said about how "a computer can never be sad or horny or have taste. it can only make product" and that "having less media [created] by a computer is a loss".
Nothing to misunderstand there and I disagree strongly on both the implications of the first and the conclusion of the second quote. That's what I'm attempting to address and not every possible argument ever made about AI creations.
So, do you still think that I'm misunderstanding something? Also, what about my point? Do we really want fewer things created by random and/or automated processes simply because a human didn't create them? I don't think so.
People also forget the role they play in protecting and helping corporations. Without unions as a legal and negotiating intermediary you get things like factory workers burning down the factories when they are overly exploited.
Sorry, but I don't think that makes sense. Any mutiny-preventing deal that a union negotiates could instead have been offered voluntarily by the employer to all employees from the outset, no union required.
I'm unsure how you reach the conclusion of "self-interest". Unions are about collective bargaining power, reaching (ideally) what's best for most of the people it represents, even if it's detrimental to you specifically.
>Personally, I just can’t find it in me to be that self-interested
Caring about your ability to pay your bills, and support your family is "self-interested" in the same way that choosing to not drive into oncoming traffic is "self-interested".
Has it occurred to you that it isn't only self-interest but concern for others that drives collective bargaining? It's essentialy a way for the little guys to stand up to the 1% to fight against the unending series of abuses and diminishment of the average person's ability to earn a livable wage and work under fair conditions.
Yes. But there's a clear difference between, say, stealing someone's voice, identity or intellectual property, and preventing someone from using automation to do labor.
The former is obviously unfair to the person whose identity is stolen. The latter is sour grapes from people who want to control the future.
I also can't bring myself to get incensed over someone using a robot to write code. It's literally the modern equivalent of smashing knitting looms.
You keep framing it as getting incensed over other people using ai to write code; but that isn't what it's about. A dev union would not attempt that; it would attempt to ensure quality of life for your class of people (and their families) as much as possible. It isn't about policing entire industries or other entities; it is about DEFENDING those who they would, do, and always have exploited when binding contracts or legislation don't prevent them from doing so.
Union = a group of people defending their rights and that includes the right to a life that isn't at the utter mercy of perpetual enshittification due to the infinite mechanical plodding of heartless (by definition) megacorporations that would never hesitate to eradicate peoples' livelihoods and treat humans as material for the orphan grinder if they could get away with it.
> it would attempt to ensure quality of life for your class of people (and their families) as much as possible.
What is “your class of people”, and why is it threatened by what other people do with coding robots?
You can try to dress it up as an intellectual argument, but at root it’s the same thing that the luddites were trying to do: defending your preferred lifestyle from technological advances.
We, the ditch diggers of the world, support your unqualified resistance to the use of steam shovels! Fewer holes, slower!
Your argument boils down to the idea that human life is not worth defending, even when capital actively undermines it by undercutting honest people's honest efforts to work for a living.
Thank you for outing yourself as a low-empathy, capital-aligned individual who makes bad-faith arguments, I'll know not to engage you from now on.
> Personally, I just can’t find it in me to be that self-interested.
Yes, exactly. Do not advocate for yourself and your colleagues by joining them in a united front. Your voice does not matter. You will continue to adapt to widening wage disparities.
You will accept a pay cut and increased productivity goals and be happy to continue adapting as your cost of living keeps on climbing.
Right, but in your apathy there is a well organised group of capitalists who are vying to instrumentalise your existence. A union is just levelling the playing field.
You may be surprised to know that residential areas in San Francisco are height limited, sometimes as short as 4 stories. They're not exactly anti-progress.
Ok SF needs somewhat higher-density housing. But wanting something good for yourself and your peers isn't anti-progress. If the benefits accrue to only a few people, it's not progress.
Thats great, although understand that unionizing protects the more vulnerable of also the software engineered. You not advocating for your rights also means weakening others. Is it still self interested to unionized from that perspective?
>The union demanded clear protections to ensure that recordings of actors’ performances could not be copied without consent and compensation.
>California’s legislation passed AB 2602 and AB 1836 in September 2024, prohibiting media companies from using AI to replicate actors’ performances without their consent.
it's a very reasonable law, but it is not the win you seem to believe it to be. the actors who refuse to consent will simply be passed over in favor of those who don't. no law will ever be passed to force companies to employ humans over machines, and if it were, the industry would move elsewhere. this is not without precedent :)
speech models have got so good so quickly that you can already replace a VA -- even an AAA prima donna -- with a teenager from Fiverr, who will simply bruteforce the right inflection.
If they still have to pay an actual person though to license their likeness then they are much more likely to actually employ that person directly to get a better result. And in the cases where quality is not needed the person still gets paid for their AI likeness.
In the 21st century, the only professions that can successfully unionize are those you can't replace with workers from a non-unionized country.
If your students are in Oklahoma, your teachers also have to be in Oklahoma. If the Oklahoma teachers unionize, you have no option but to hire those unionized teachers if you want your students taught. If your bank is in Oklahoma, you can hire programmers in London or buy a SaaS from a company based in Geneva.
Programmers also have much less of a reason to unionize, as "quit and go work somewhere else" is often a realistic option. This is usually not the case for teachers, where the only employer seeking their skills in the area is the government, whose idea of what teacher salaries should be is not based on market forces.
I don't think software developers need to unionize - but to form French style co-ops.
e.g a lot of video game studios even the AAA ones could be co-ops. same as a lot of SAAS software companies. Linear - just announced a tender offer. I don't see a reason - why linear couldn't work as a co-op.
I think I sit somewhere between these two descriptions. I've always supported unions and other "for the common good" type machinery. At the same time, I desperately also don't want to end up doing something the equivalent of barring the use of calculators just so I can toil away at a 9-5 crunching numbers more slowly instead. If AI really does replace all of the meaningful jobs we can do... great - I'd rather we make sure the spoils of that production are distributed than try to cling to preventing the technology from being used.
Inexplicably for the current moment, AI has so far actually meant I have even more to do instead of less. I expect that to change eventually... but man, is it a bit of whiplash to go from wondering if my job will be around in 10 years to starting the work day and being more backed up than ever. Doubly so since the rate of change does not seem to be very evenly distributed by tech role.
Agreed, but I must've severely messed up my message if that was supposed to be a spoiler. To be clearer: I think the unions, economic policy, and such should help with that part rather than us wield the very same to hide from replacing the work we do with something much easier. I.e., don't be ashamed to work towards that, just come together to ensure we all share the spoils.
> it's hilarious to see some people here go on about how they're proud to work so that they can be replaced
To be fair, most of us spent our entire career trying our best to automate ourselves away one way or another, and always seen that as our job description.
No, that is just nerd heroism lore that indeed has always shown up in comments, that part is definitely true.
Some people dislike automation altogether and like the computational aspect. Most people seem to enjoy constructing virtual worlds and Rube Goldberg machines.
I thought HN was mostly people who hated doing 'the thing' and would procrastinate until they build a system that does 'the thing' and then they would work tirelessly to never do 'the thing' themselves ever again.
I agree with your point, but I don't think it's funny at all. The whole field is changing because of this. The career, except for those ones lucky enough to have jobs where they're valued and they can decide how to use AI tools, is turning into shit because of this and software engineers have become a lot less valuable as management is trying to turn them into reverse centaurs.
What options do you have? If you're the 10x engineer you'll be a 100x one and do just fine. Otherwise what can you do besides holding on as long as you can or start searching for a new career.
In my experience this is what almost everyone thinks, right up to the point where it starts happening to them.
And it isn't just an individual blind spot, organizations suffer from the same thing in the sense that many companies will be happy to automate away all their labor to avoid paying the "human tax" without giving much thought to the fact that the need for the company itself will also be automated away soon after.
If you can replace nearly all of your workers with some cheap tokens and prompts, everyone else who previously would have been a customer can replace your whole company with the same thing.
Because software developers enjoyed scarcity for most of the fields existence and could barter themselves better conditions instead of falling back to unionized fixed incomes.
In any case, the overwhelming majority of jobs is non-unionized and I don't think that software developers can stop technological changes by unionizing.
My objection has always been that advocates either can't or don't care to explain how such a thing would actually work from the perspective of a unionized engineer.
Software engineers and VFX workers also tried to unionise back in the day and there was a giant wage fixing and anti competitive hiring scandal that was majorly illegal. Perpetuated by some of the biggest names in tech.
They settled for a large undisclosed sum out of court. But largely won unfortunately as unionisation efforts failed
Yeah, the problem is, someone has to start the union. It takes work. You have to get the whole workforce to vote on it. A lot of software engineers believe (or believed) that they were too smart and professional to need a union. And of course, if management gets wind of it while you are working on setting up the vote, they may do all kinds of trickery, legal or illegal, to block it.
It is possible. But it's quite uncommon in this industry in the US.
And given the current administration, it is hard to trust you'd get fair enforcement of labor laws if the company did illegal things to block unionization.
Now, they cannot prevent offshoring or AI use or replacements. Very very rarely if ever.
But they can negotiate a large layoff and give better pay/conditions during work etc. This view that unions can prevent anything... when so many jobs have gone to east EU (all amazing and good at what they do but lets face it, it is due to pay) so yea there wont be any union preventing AI...
Half of them are from India or China. Racial diversity is known to be detrimental to unionization. In fact, Amazon used this exact strategy to bust nascent Somali unions.
Tried out the simulator and was surprised to find that the movement keys are ZQSD; then realized that's the equivalent of WASD on an AZERTY keyboard. Checked and sure enough, Pollen Robotics is a French company.
They may want to at least add a preference for keyboard layout, pretty sure that QWERTY and QWERTZ are much more common worldwide than AZERTY.
As a French guy who grew up playing CS 1.6 on an AZERTY keyboard, I have a feeling that the people who made this website are either a generation above or below Millenials.
Because it doesn't make sense: you don't make a website in English, with prices in USD... while expecting users to have an AZERTY keyboard.
I'm a millenial and can say you can absolutely make a site with i18n + currency conversion without knowing what keyboards people use. Especially Americans, who are much less familiar with "other markets", because companies can stay within US customers for so long.
It is a bit weird. As someone from Belgium (we also use our own variety of Azerty) you are very frequently reminded that you're on a weird keyboard. At least for someone who games, you wouldn't make ZQSD the default. It's the first thing you do in every game, change WASD to ZQSD
Another Belgian here, the first thing I did when I started working is switch to International English keyboards. Some employers wanted me to use local keyboards but I always managed to convince them to let me get another one in the end.
When I started out playing Quake 1 many moons ago, when I complained about how to reach keybindings as I was using the arrow keys, a veteran player on the server told me patiently to use ESDF like a normal person. So I did, and learned, and it stuck with me. It wasn't until years later I realized that was more a rarity and people usually use WASD. I kept ESDF because I was used to it, and because it's nice have those two extra left keys as additional bindings.
All that's to say, if they'd used ESDF this wouldn't be an issue. You've been vindicated, kind hero.
Given the amount of controls that modern games have, I'd propose RDFG for movements instead, so we have all the new QWEAS on the left-hand side for even more keys available, together with TYHJ on the right side. Shortcuts galore :)
Interestingly, the 10-lines-of-basic competition, which has been running the last 15 years (https://itch.io/profile/bunsen), has this covered in the rules:
15. If the game is controlled with the keyboard, use "O" for left, "P" for right, "E" for up and "D" for down if possible; this takes into account the most important keyboard layouts (no disadvantages for emulator users with QWERTZ, QWERTY or AZERTY keyboards)
Huh, when I tried it WASD didn't work like I expected, hence I went back and checked and saw that it was ZQSD. Looks like they might have fixed it now since I posted. Either that or the lagginess caught me up; it takes a second before it starts moving forward, it might be I got caught up by that, went back to look at the instructions and noticed the ZQSD, then went back and used the arrow keys since that was easier.
edit: just checked the code, and they cover both layouts by using the physical key code rather than the character. And that was committed before I tried it. So it must have been the fact that it was a bit slow to respond that got me.
They should do a deal: “We fix this for QWERTY users, and in return American web devs vow to stop filtering out Shift in numeric fields, which is fine on QWERTY but prevents AZERTY users from typing top-row digits because those digits require Shift.”
Having tried (and failed) to use Issac to do the same thing, the fact that their simulator actually works out of the box, "batteries included", is a big deal for home hobbyists.
They do, which is why WASD (or whatever the positional equivalent in your layout is) work despite the text saying to press ZQSD. This only solves the input though, it doesn't let the page know ahead of time what letter it should tell you to press for those 4 positional inputs.
Chromium based browsers support navigator.keyboard.getLayoutMap() to tackle this exact problem. Safari and Firefox do not due to concerns over fingerprinting. Still, it wouldn't hurt to add this second half for those users https://caniuse.com/?search=navigator.keyboard.getLayoutMap%...
Nvidia releases some of the most open open weights models, Nemotron 3, which have the full training code open, and most but not all of the training datasets.
Nvidia is a big company. They are good about some things and bad about others.
I think they really do like open weights because they make some of the best hardware for training, and the more open weights models there are, the more people are training and fine-tuning them, mostly on Nvidia hardware.
I feel like Nvidia is one of the better choices for buying Huggingface. Not perfect, but definitely far from the worst.
The worry is not that Nvidia isn’t open about their models.
The worry is that Nvidia is trying to control the way you run those models. Trying to bake CUDA assumptions into model design, and pushing the software ecosystem to be as Nvidia first as they can.
Just to explain because not everyone is necessarily a native English speaker or gets the reference.
This is a reference to a dog whistle. Above 25kHz are sounds that dogs can hear but humans generally can't.
The term dog whistle is used to refer to phrases that racists use to indicate their racism, while sounding plausibly deniable. The idea is that it's a phrase that will make other racists realize that you are one of them, while not sounding openly racist to others.
DHH himself has gone beyond dog whistles. He's directly compared what he considers undesirable ehtnic populations to wolves who need to be shot. He's just openly calling for ethnic cleansing by now.
But support for Omarchy itself can be seen as a dog whistle. It's widely known that DHH is a fascist, but you have some plausible deniability by donating to Omarchy because you're just politically neutral and think it's cool tech, or something like that.
> DHH himself has gone beyond dog whistles. He's directly compared what he considers undesirable ehtnic populations to wolves who need to be shot. He's just openly calling for ethnic cleansing by now.
Let me prefix this with that DHH's opinions suck, not sure what he's going through but clearly something, and that blog post you're referencing is terrible in lots of ways. But he's not openly calling for ethnic cleansing, you're doing speaking against him a disservice by not providing an accurate view of what shit thing he said. It's still terrible, the verbatim quotes (https://news.ycombinator.com/item?id=49448148), but deporting isn't the same as "ethnic cleansing". Even people we disagree with vehemently should be disagreed with honestly.
Then that blog post is just one of many where he've essentially gone of the rails in terms of hardline authoritarianism and fascist ideas, which makes it kind of weird he's getting the financial support he's getting. But then some just don't care about what viewpoints others have, I suppose that's a valid stance too even if I disagree with it.
> but deporting isn't the same as "ethnic cleansing".
I’m sorry, but forcibly deporting people because of their ethnic background is the very definition of ethnic cleansing.
In general, if people use violence on the population as a way to either kill or forcibly expel them, there would be a strong case to call it a genocide.
> forcibly deporting people because of their ethnic background is the very definition of ethnic cleansing
I agree, but I think if this is what you think he's arguing for, you either need to re-read the blog post, or you're not discussing that post honestly, which again does us all a disservice, regardless of how much we disagree with him or not.
He uses a word that is a slur for the Romani, an ethnic minority in many European countries. He never discusses nationality.
He also compares deporting them (to where, you might ask) to shooting wolves.
It's also not his only post on the topic. He has previous ones where he complains of how horrible London is because white British people no longer constitute a majority. He calls for not just ends to immigration and closing borders, but "remigration".
It is very clear from these posts that he strongly believes that non white ethnic groups should be removed from European countries.
If that's not ethnic cleansing, I don't know what is.
I'm not just trying to score points about whether he sucks, but specifically point out the types of policies that he advocates for, and there are a number of people in this thread trying to claim somehow that he doesn't advocate for policies that he clearly has been.
So I'm curious, what makes you think that what he calls for isn't ethnic cleansing?
From Wikipedia (and please, fill me in if you have a better definition):
"Ethnic cleansing is the systematic forced removal of ethnic, racial, or religious groups from a given area, with the intent of making the society ethnically homogeneous."
From DHH:
Calling for the deportation (forced removal) of a specific ethnic group (also note the violent analogy to wolves): "When wolves get out of control, you shoot them. When gypsies take over public spaces, you deport them."
Calling for the forced removal of millions of people of various ethnic groups he considers undesirable from Europe: "Because the sacred cow here is not just that mass migration must stop going forward. It's also that millions who are already in Europe must go. Remigration has gone from a fringe concept to the mainstream discourse in record time on account of that realization. The Overton window is swinging wide open, but the cow is still there."
Talking about how much he wanted to move to London but that he no longer has that desire due to its ethnic diversity: "As soon as I was old enough to travel on my own, London was where I wanted to go.... That was then. Now, I wouldn't dream of it. London is no longer the city I was infatuated with in the late '90s and early 2000s. Chiefly because it's no longer full of native Brits. In 2000, more than sixty percent of the city were native Brits. By 2024, that had dropped to about a third. A statistic as evident as day when you walk the streets of London now.... Recently, a projection that Danes would be a minority in their own country by 2096 caused an enormous stir in Denmark. Politicians across the spectrum decried what a catastrophe that would be for this world's oldest continuous monarchy. But a demographic nightmare worse than that has already enveloped London!"
As you can see, DHH is explicitly calling for the force removal (deportation and "remigration") of ethnic groups, because he is afraid of the results of the population becoming less ethnically homogeneous. I don't know how you could argue that what he's calling for is anything other than ethnic cleansing.
Also, note that none of this is due to any actualy on the ground experience; he lives in LA, he's lived in the US for over 20 years. This is purely an exercise in ideology. In fact, LA has a smaller percentage of the population that is white Anglo-American than London does of white British people.
Anyhow: I have laid out in detail the arugment for calling what he calls for "ethnic cleansing". Do you have any argument that it isn't ethnic cleansing that he's calling for? It seems pretty clear to me, so I'm confused why you have kept on insisting "if this is what you think he's arguing for, you either need to re-read the blog post", because I've read all three of these posts of his and more, and it all points towards him advocating for ethnic cleansing.
Something like "mass expulsion and killing of one ethnic or religious group in an area by another ethnic or religious group in that area" I suppose, but also, I really don't have any energy left to discuss something I don't care about. I don't like that guy, I don't like his views, and I don't want to argue against others who also don't like him.
Hope your text helped someone, enjoy the rest of your day!
You can also do something like a release of a GPT-OSS v2, where you actually release training data and checkpoints, and do an experiment where you have some held out math problem dataset, then demonstrate how much training it takes on solutions (or partial solutions) to that dataset before the model saturates that test. While of course that would be a test on a much smaller model, it would cost a tiny fraction of the training on your big model, and it could be used to demonstrate just how much effect data contaminaiton like this could have, especially if you did the same experiment on a few different sized of model to show the scaling laws involved.
reply