deepseek/r1-distill-qwen-7b
NewA 2026-native reasoning model distilled from R1. Specialized for agentic "Chain of Thought" logic on local hardware.
reasoningagenticdistilled
Analytics loading...
Similar Models
Distil-Qwen3-4B-Text2SQL
distil-labs/distil-qwen3-4b-text2sql-gguf
Task-specialized 4B model for natural-language-to-SQL conversion. Distilled from DeepSeek-V3. Quantized GGUF for local database agents.
How to Use
To get started, install the `transformers` library:
pip install transformersThen, use the following snippet to load the model:
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "distil-labs/distil-qwen3-4b-text2sql-gguf"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
# Your inference code here...Available Versions
Model Details
Teacher Model
DeepSeek-V3
Distillation Method
Knowledge Distillation (Logits)
Training Dataset
Flickr30k (Conceptual)
Primary Task
Multimodal Generation
Performance Metrics (Example)
| Metric | Student Model | Teacher Model |
|---|---|---|
| Model Size | 3.1GB | 8.5GB |
| BLEU Score | 28.5 | 30.1 |