Which is a smaller model, that gives good output and that works best with this. I am looking to run this on lower end systems.

I wonder if someone has already tried https://github.com/jzhang38/TinyLlama, could save me some time :)