What the posting requires
- Required
- Python
- PyTorch
- vLLM
- Latency
- Request routing
- Quantization-aware training
- Distillation
- SGLang
- Throughput
- Distributed scheduling
- Preferred
- CUDA
- Open-source
- Cache-aware request routing
- GPU communication
- Triton
- NCCL
These tags are our reading of the posting. They can miss something; the original posting is the reference.
