Yeah this is not really news to anyone that has played with ChatGPT or understands how it was trained. It was optimised for plausibility not truth. Of course it's going to bullshit.

I'm sure there are many smart people working on making it bullshit less, and I don't see any reason to think it is an insurmountable problem.

Also there are many many useful applications where the bullshit doesn't really matter that much.