Ferrox: Building a Rust Inference Engine That Matches llama.cpp
www.fratepietro.com
Why I built Ferrox, a pure-Rust GGUF inference engine, and what it took to match llama.cpp’s performance on real models — with receipts, not vibes.