I'm no python expert but it looks like this does happen in memory: https://githu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

keuriGPT on Jan 3, 2023 | parent | context | favorite | on: Infinite AI Array

I'm no python expert but it looks like this does happen in memory: https://github.com/ianb/infinite-ai-array/blob/main/iaia/mag...

I can't imagine it's too hard to serialize the `existing` python dict so subsequent runs are deterministic

wging on Jan 3, 2023 [–]

It is also caching requests on-disk. See for instance https://github.com/ianb/infinite-ai-array/blob/main/iaia/gpt...

The problem* is that if a prompt changes slightly then it won't be a cache hit.

* okay, one problem.

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact