I have Qwen3.8 Flash Next running on my m4 mac mini with 16 gigs of ram.
Here is the video. my server will be available for purchase soon. then you will be able to run it local. This is my original app. but the new one will be available soon. if you buy my
I got 20% improvement in token/second with Qwen 3.8 Flash Next.
The caviat it's my custom fork. I added mtp support but I'm trying to improve vanilla first.
Qwen 3.8 27B
Thinking vs Code Some say this model thinks a lot... 🤣
Qwen 3.8 27B running locally on an RTX 5090 beats Opus 4.8 in personal benchmarks at up to 200 tokens…
Qwen 3.8 27B running locally on an RTX 5090 beats Opus 4.8 in personal benchmarks at up to 200 tokens per second with no internet, subscription or API required and is now powering a Hermes agent working 24/7 for free.
You have reached the end of the archive
All of qwen38