Transformers learn residuals, as you can see in the figure. y = x + f(x). | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

toxik on March 15, 2025 | parent | context | favorite | on: Transformers Without Normalization

Transformers learn residuals, as you can see in the figure. y = x + f(x).

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact