Skip to main content

Available Models

ATLAS provides pre-trained teacher models optimized for different tasks. All models are 8B parameters and trained using the GRPO algorithm with adaptive dual-agent objectives.

Teacher Models

ATLAS-8B-Thinking

View on Hugging Face

Optimized for mathematical and logical reasoning tasks
Best for:
  • Mathematical problem solving
  • Logical reasoning
  • Abstract thinking tasks
  • Scientific analysis
Usage:
Training:
  • Base model: Qwen2.5-7B-Instruct
  • Training method: SFT → GRPO
  • Specialization: Reasoning-heavy tasks

ATLAS-8B-Instruct

View on Hugging Face

Optimized for code generation and technical instruction
Best for:
  • Code generation
  • Technical documentation
  • System administration
  • API integration
Usage:
Training:
  • Base model: Qwen2.5-7B-Instruct
  • Training method: SFT → GRPO
  • Specialization: Instruction-following and coding

Model Selection Guide

Choose the appropriate teacher model based on your task:

Compatible Student Models

ATLAS teachers can enhance any instruction-following LLM: Tested Student Models:
  • Qwen/Qwen3-4B-Instruct (4B)
  • meta-llama/Llama-3.2-8B-Instruct (8B)
  • mistralai/Mixtral-8x7B-Instruct-v0.1 (47B)
  • OpenAI GPT-4 (API)
  • Anthropic Claude (API)
Requirements:
  • Instruction-following capability
  • Context window ≥4K tokens
  • Support for system prompts (preferred)

Memory Requirements

Estimated VRAM usage for inference:

Model Versioning

All models follow semantic versioning:
  • Latest stable: No suffix (recommended for production)
  • Experimental: -experimental suffix
  • Specific versions: -v1.0, -v1.1, etc.
Check model cards on Hugging Face for:
  • Training data details
  • Performance benchmarks
  • Known limitations
  • Update changelog

Custom Model Training

To train custom teacher models, see:

License and Usage

All ATLAS models are released under Apache 2.0 license for both research and commercial use. Responsible Use:
  • Verify outputs for critical applications
  • Monitor for potential biases
  • Respect base model licenses
  • Cite ATLAS in publications

Next Steps

Quickstart

Start using ATLAS models

Datasets

Training and evaluation data

Custom Training

Train your own models