MongoDB - Build AI That Scales
Mini toolsHuihui 4 8B A4B
By HuiHui ai
Huihui4-8B-A4B is the original lightweight MoE conversational release in the Huihui4 line. The model card says it is optimized from Gemma-4-26B-A4B-it by pruning the expert pool from 128 to 32 while keeping 8 active experts per token, then applying supervised fine-tuning on 500+ high-quality dialogue samples extracted from code preference data. It is positioned for code conversation assistants, lightweight planning, local deployment, and MoE pruning research, with smooth conversational behavior and consumer-GPU-friendly deployment.
New
Multimodal
Gen 3
Overview
Huihui4-8B-A4B is a lightweight pruned MoE conversational model based on Gemma-4-26B-A4B-it. It is built for consumer-grade hardware and code-related conversational tasks, using expert pruning plus supervised fine-tuning to cut compute cost while preserving core reasoning and interaction ability.
Tools using Huihui 4 8B A4B
No tools found for this model yet.
Last updated: April 28, 2026
