If they’re reaching the same results across a variety of the most popular public... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

rco8786 6 months ago | parent | context | favorite | on: AI overly affirms users asking for personal advice

If they’re reaching the same results across a variety of the most popular public models, it doesn’t seem like that big a deal to know if it was Opus 4 or Opus 4.5

hn_throwaway_99 6 months ago [–]

Reproducibility is (supposed to be) a cornerstone of science. Model versions are absolutely critical to understand what was actually tested and how to reproduce it.

joaogui1 6 months ago | [–]

The models get deprecated after 1-2 years, so reproducibility is pretty hard anyway (but as others pointed out the paper does list the model versions)

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact