One thing you can do to combat the issue is use a templating framework that is multithreaded like mine: http://github.com/spullara/mustache.java It spreads all the requests work over multiple cores so single request latency doesn't suffer when you have a lot of cores.