Similar Models

GPT-OSS-20B (Community Edge Model)

openai-community/gpt-oss-20b-GGUF

OpenClaw-compatible open-weight 20B model. 64K+ context, Apache 2.0. Balanced performance for tool-use, memory persistence, and multi-channel agentic workflows.

How to Use

To get started, install the `transformers` library:

pip install transformers

Then, use the following snippet to load the model:

from transformers import AutoTokenizer, AutoModelForCausalLM

model_id = "openai-community/gpt-oss-20b-GGUF"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)

# Your inference code here...

Available Versions

Tag / VariantSizeFormatDownload
openai-community/gpt-oss-20b-GGUF:Q4_K_M14.2GBGGUFLink
openai-community/gpt-oss-20b-GGUF:Q5_K_S16.8GBGGUFLink

Model Details

Teacher Model

Llama-3.1-70B

Distillation Method

Knowledge Distillation (Logits)

Training Dataset

Flickr30k (Conceptual)

Primary Task

Multimodal Generation

Performance Metrics (Example)

MetricStudent ModelTeacher Model
Model Size14.2GB8.5GB
BLEU Score28.530.1