Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
skhameneh
9 months ago
|
parent
|
context
|
favorite
| on:
A guide to local coding models
ik_llama is almost always faster when tuned. However, when untuned I've found them to be very similar in performance with varied results as to which will perform better.
But vLLM and Sglang tend to be faster than both of those.
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
But vLLM and Sglang tend to be faster than both of those.