Available Models
ATLAS provides pre-trained teacher models optimized for different tasks. All models are 8B parameters and trained using the GRPO algorithm with adaptive dual-agent objectives.Teacher Models
ATLAS-8B-Thinking
View on Hugging Face
Optimized for mathematical and logical reasoning tasks
- Mathematical problem solving
- Logical reasoning
- Abstract thinking tasks
- Scientific analysis
- Base model: Qwen2.5-7B-Instruct
- Training method: SFT → GRPO
- Specialization: Reasoning-heavy tasks
ATLAS-8B-Instruct
View on Hugging Face
Optimized for code generation and technical instruction
- Code generation
- Technical documentation
- System administration
- API integration
- Base model: Qwen2.5-7B-Instruct
- Training method: SFT → GRPO
- Specialization: Instruction-following and coding
Model Selection Guide
Choose the appropriate teacher model based on your task:Compatible Student Models
ATLAS teachers can enhance any instruction-following LLM: Tested Student Models:- Qwen/Qwen3-4B-Instruct (4B)
- meta-llama/Llama-3.2-8B-Instruct (8B)
- mistralai/Mixtral-8x7B-Instruct-v0.1 (47B)
- OpenAI GPT-4 (API)
- Anthropic Claude (API)
- Instruction-following capability
- Context window ≥4K tokens
- Support for system prompts (preferred)
Memory Requirements
Estimated VRAM usage for inference:Model Versioning
All models follow semantic versioning:- Latest stable: No suffix (recommended for production)
- Experimental:
-experimentalsuffix - Specific versions:
-v1.0,-v1.1, etc.
- Training data details
- Performance benchmarks
- Known limitations
- Update changelog
Custom Model Training
To train custom teacher models, see:- GKD Training - Fast distillation (4-8 hours)
- GRPO Training - Full RL training (24-48 hours)
- Training Configuration - Parameter reference
License and Usage
All ATLAS models are released under Apache 2.0 license for both research and commercial use. Responsible Use:- Verify outputs for critical applications
- Monitor for potential biases
- Respect base model licenses
- Cite ATLAS in publications
Next Steps
Quickstart
Start using ATLAS models
Datasets
Training and evaluation data
Custom Training
Train your own models