Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I thought the same thing when I started using locals, but the reality is that - for a given context depth - the token generation speed doesn't change whether it's 128 or 8000, it just lengthens the benchmark run time.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: