What I wonder then is...is it going to be the final word on the evolution of software development? AI has been trained on practices that were developed by people, by professionals and amateurs, by discussions on discussion boards, at tech events, through written books and then disseminated across open source projects. If no one writes code anymore then how to write and build software projects will never evolve beyond the 2022 state of affairs.
That data goes into pretraining the initial model. The agentic post-training relies on the model making stochastic exploration. So in a sense it learns via trial and error. By the accounts I have read, this second stage is the dominant reason we have seen the increase in model capabilities in the past year. It is still not clear how innovative the models can be, but they are not just relying on static data.
Also, a lot of things are true but what truths you choose to broadcast can tell us what you care about. E.g it's also true that we'd all be richer if sam altman shared is wealth with us, lets take a few seconds to think why he's not saying this truth, after all it's an objectively true fact.
You can think whatever you want about the guy, but when you willfully misinterpret his words because it fits with your view of what he secretly believes anyway, I think that's still a bad thing for you to do.
How is this different from when you join a company and learn your corner of the codebase? In a sufficiently large enough codebase no one had the whole mental model in their head even before AI. What you did was find and ask that one person who knew enough about some part of the project to answer your questions. Now you can ask a model.
> How is this different from when you join a company and learn your corner of the codebase?
Because most AI generated code is incredibly verbose and noisy. This can be true for any codebase, but it is especially egregious in AI codebases. It is hard to prevent that by just saying "be concise" because knowing exactly where to be concise is the measure of true skill/intelligence.
Every time I have success with AI coding, it is because whatever I need done can work as a pure function, where the probability I have to return to it is very very low.
Making sense of a codebase is like putting together a puzzle. A purely AI generated codebase is like trying to put it together without a picture on the pieces.
This is more like ALL the developers have just joined a company where no other devs work and can pass along institutional knowledge. You know, the thing that makes all that complexity wieldy.
Anti Europe propaganda has ramped up on HN in the past few years. The right in the US is destroying their country so they need to point at and lie about other systems to appease their base.
reply