Qwen/Qwen3.5-0.8B-GGUF
NewAlibaba Qwen3.5 sub-1B multimodal model. Text+image+video understanding with 262K context. Apache 2.0. Built for lightweight agentic assistants.
multimodalultra-smalllong-context
Analytics loading...
Similar Models
unsloth/Qwen3.5-0.8B-GGUF
NewAlibaba Qwen3.5 sub-1B via Unsloth Dynamic 2.0. 256K context, Apache 2.0. Optimized for lightweight function-calling agents and document parsing workflows.
ultra-smalllong-contextfunction-calling
Qwen/Qwen3.5-2B-Instruct-GGUF
NewAlibaba Qwen3.5 2B edge model. Hybrid architecture, 256K context, Apache 2.0. Verified GGUF quantizations via Unsloth for local inference.
agenticverifiedtool-calling
Qwen3.5-2B (Edge Agentic Specialist)
Qwen/Qwen3.5-2B-GGUF
Alibaba Qwen3.5 2B edge-optimized model. Hybrid Gated DeltaNet+Attention architecture, 256K context, Apache 2.0. Built for tool-calling agents and multimodal workflows.
How to Use
To get started, install the `transformers` library:
pip install transformersThen, use the following snippet to load the model:
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "Qwen/Qwen3.5-2B-GGUF"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
# Your inference code here...Available Versions
Model Details
Teacher Model
Qwen3.5-9B
Distillation Method
Knowledge Distillation (Logits)
Training Dataset
Flickr30k (Conceptual)
Primary Task
Multimodal Generation
Performance Metrics (Example)
| Metric | Student Model | Teacher Model |
|---|---|---|
| Model Size | 1.8GB | 8.5GB |
| BLEU Score | 28.5 | 30.1 |