[v0.16.0] Qwen3 30B A3B Q40 on 4 x Raspberry Pi 5 8GB · b4rtaz distributed-llama · Discussion #255
github.com
qwen3_30b.mov Setup Device: 4 x Raspberry Pi 5 8GB Distributed Llama version: 0.16.0 Model: qwen3_30b_a3b_q40 Benchmark Evaluation Prediction 4 x Raspberry Pi 5 8GB 14.33 tok/s 13.04 tok/s b4rtaz@r...