NVIDIA gave away a 30B model that sees, hears, and reasons. The catch: only its text half ran on Apple Silicon. I ported the vision and audio towers to MLX, verified them against NVIDIA’s own code, and open-sourced it.
Antirez shipped ds4, a hand-tuned C+Metal inference engine for DeepSeek V4 Flash. Three architectural decisions worth understanding, and why the math just changed for compliance-sensitive devs.
Antirez (the Redis guy) shipped ds4, a hand-tuned C inference engine for DeepSeek V4 Flash. Same prompt, three engines, one MacBook. Local DeepSeek beat cloud Claude on wall-clock time.
I Just Watched One Hacker Catch Up to a Trillion-Dollar Data Center Read Post »
Qwen 3 Coder 30B (8-bit MLX) scored 81.7% pass@1 on HumanEval running on a single M5 Max MacBook with the Wi-Fi off. Real run, all 164 problems, 14 minutes wall-clock. The first published number for this variant on this hardware.
HumanEval on a MacBook — 81.7% pass@1, Wi-Fi off Read Post »
M5 Max with 128GB unified memory: the first laptop that holds a frontier-class coding agent in RAM. 30B Qwen 3 Coder, 55 tok/s, Wi-Fi off, $0/month. What it actually unlocks for legal, medical, code, and agent work.
M5 Max + 128GB = a 30B AI Coding Agent Running Locally. Wi-Fi Off. Read Post »
Over three weeks I burned $2,976 of API-equivalent Claude usage. I paid $100. Why Anthropic is subsidizing power users 40x — and what I built on the side.
Pulling 10x My Subscription Value Out of Claude — While Quietly Building the Backup Plan Read Post »
Glossary for the post-Rectangle era. The Rectangle, Off-Screen Work, Hand-Off Computing, To Airgap, The Two-Slab Posture, Backpack Supercomputer, The Ambient Stack, To Whisper-Code, The Cloned-Voice Loop, Hot-Tub Coding, Local-First AI.
A Field Guide to Ambient Computing — The Words for the Thing Thats Coming Read Post »
Hands-free coding sessions where Apples on-device speech engine listens and a cloned-voice TTS replies. Two-second loop, fully on-device, qualitatively different from screen-and-keyboard.
What Its Actually Like to Code By Voice — With the AI Replying In My Own Cloned Voice Read Post »
Ambient computing — work that happens around you instead of in front of you — is no longer hypothetical. The pieces ship today. Here is what the new shape of working with computers actually looks like.
The Era of Hunched-Over-A-Screen Computing Is Ending — Heres Whats Replacing It Read Post »
Most small practices use cloud AI on patient text. Under HIPAA that requires a Business Associate Agreement most practices have not signed. On-device AI fixes the compliance posture entirely.
