We already have tools to generate boilerplate, and they work exceptionally well. The LLM just produces nondeterministic boilerplate.

I also don't know what work you do, but I would not characterize the codebases I work in as "small bits of novelty" on boilerplate. Software engineering is always a holistic systems undertaking, where every subcomponent and the interactions between them have to be considered.