Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
cellularmitosis
75 days ago
|
parent
|
context
|
favorite
| on:
Maximizing the value of your Claude Code sessions
Maybe switching effort routes you to a different rack of gpu’s which don’t have the cache
janalsncm
75 days ago
[–]
The KV cache is probably offloaded to RAM after a generation is complete. Then it is pulled back into any rack in the data center that has the model you’re using.
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
