Tag: llama.cpp
-
Debugging Local LLM Benchmarks: Aider, llama.cpp, and Runaway Output
A practical account of building a fair local-agent benchmark, debugging reasoning-model serving, fixing greedy-decoding loops, and adding an exact-repetition circuit breaker to llama.cpp.
Read more about Debugging Local LLM Benchmarks: Aider, llama.cpp, and Runaway Output