Qwen3.8-27B is running locally on an M1 MacBook with just 16GB of unified memory. No cloud API. No external GPU. Just an older Apple Silicon laptop running a 27B model with aggressive quantization. Here are the reported numbers: Model: Qwen3.8-27B Quantization: UD-Q2_K_XL Model size: 9.15GB Hardware: M1 MacBook, 16GB unified memory GPU acceleration: Full Metal offload Time to first token: ~850ms P...

Qwen3.8-27B is running locally on an M1 MacBook with just 16GB of unified memory. No cloud API. No external GPU. Just an older Apple Silicon laptop running a 27B model with aggressive quantization. Here are the reported numbers: Model: Qwen3.8-27B Quantization: UD-Q2_K_XL Model size: 9.15GB Hardware: M1 MacBook, 16GB unified memory GPU acceleration: Full Metal offload Time to first token: ~850ms P...

🌐 链接: https://x.com/Oluwaphilemon1/status/2110147850315108627
🏷️ 分组: X｜为你推荐
🕒 时间: 2026-10-14 07:17:06

X (formerly Twitter)

FHILY👑 (@Oluwaphilemon1) on X

Qwen3.8-27B is running locally on an M1 MacBook with just 16GB of unified memory.

No cloud API. No external GPU. Just an older Apple Silicon laptop running a 27B model with aggressive quantizatio…