What the posting requires
- Required
- Transformers
- Python
- PyTorch
- Distributed training
- Distributed data processing
- Moe
- Multimodal
- Sequence models
- Scaling laws
- Training dynamics
- Preferred
- LLM
- Agentic systems
- Data curation
- Pre-training
- SFT
- RLHF
These tags are our reading of the posting. They can miss something; the original posting is the reference.