Pretty cool. The tokens are highlighted based on the activation? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

vpj on June 10, 2024 | parent | context | favorite | on: Show HN: We've open-sourced our LLM attention visu...

Pretty cool. The tokens are highlighted based on the activation?

xcodevn on June 10, 2024 [–]

Yes, you're correct. The tokens are highlighted based on the neuron activation value, which is scaled to a range of 0 to 10.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact