HumanEval on a MacBook: 81.7% pass@1, Wi-Fi off
Qwen 3 Coder 30B (8-bit MLX) scored 81.7% pass@1 on HumanEval running on a single M5 Max MacBook with the Wi-Fi off. Real run, all 164 problems, 14 minutes wall-clock. The first published number for this variant on this hardware.
HumanEval on a MacBook: 81.7% pass@1, Wi-Fi off Read Post »










