Run Gemma 4 locally with Gemma-4 Omni-Desktop. A free, offline AI agent optimized for RTX 30xx & 8GB Macs. Features native vision, voice & OpenClaw support. Gemma 4 31B Abliterated — ...
Fork of llama.cpp with fused TurboQuant flash attention — the FA kernel reads raw TBQ4_0 K/V blocks directly from global memory and dequants via centroid lookup in the FWHT-rotated domain. No separate ...