Unsloth has quants for both
- Unsloth Qwen3 Next guide
- unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF
- unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
This was a great day to check the news. I also saw that vllm has just added support for strix-halo.
Unsloth has quants for both
This was a great day to check the news. I also saw that vllm has just added support for strix-halo.
Fast ddr5 /strix halo would probably be passable for a patient single-user but yeah not really the target audience here for sure.