Gemma 4 QAT Collection Gemma 4 QAT (Quantization-Aware Training) for 3x less memory use and near original accuracy. • 16 items • Updated 2 days ago • 57
HauhauCS/Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced Image-Text-to-Text • 25B • Updated 25 days ago • 195k • 147
view post Post 8668 Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.You can run and train the model via Unsloth Studio.GGUF: unsloth/gemma-4-12b-it-GGUFGuide: https://unsloth.ai/docs/models/gemma-4 See translation 4 replies · 🔥 43 43 👍 13 13 🤗 2 2 + Reply
JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M Text Generation • 12B • Updated 4 days ago • 8.6k • 14