FRAMEWIREIndonesiaUpdated Aug 20Live wire
0:00 / 0:00

Very quick comparison between Ornith 1.5 35B MoE and Qwen 3.8 27B Dense.

📣 Clearly it's not a fair one, but let's in any case see how it went. 397B download in progress! In the Videos below: - Brick SA -> Qwen 3.8 - Lego Streets -> Ornith 1.5 Context: - Pi agent used in both

Ivan Fioravanti ᯅAug 2037
0:00 / 0:00

MLX guys, do we have some good quants for Qwen 3.8 27B to run on MBP Pro MAX4?

Its time to replace my Gemma in Hermés. Would love to have local power of almost Opus 4.6 while preserving the speed. Any tips?

dorsianAug 20
0:00 / 0:00
0:00 / 0:00

INSANE. Qwen 3.8 27B is now running locally on an RTX 4060 with just 8GB VRAM.

64,000 token context window using Unsloth's new IQ4_XS quant, only 14.6GB on disk. Prefill hits 150 tokens/sec, decode at 5 tokens/sec via native MTP. Just 25 GPU layers offloaded to stay inside

CyrilXBTAug 2087