You’re saying that if the LLMs were right, humans would have been correct in trusting the machine for things they didn’t know?

The point is that LLMs aren’t right, and the people who took the test were probably reminded of that.

Would people have trusted the textbook you’re mentioning if there was a big red warning on each page that said “this book may contain errors”.

The willingness to trust AI even though it may be wrong and even though there’s money on the line is intersting enough as a study imo