Software Engineer- Inference Platform
AI · 57 roles open
- Location: San Francisco
- Pay: $180k–$360k a year
- Experience: 3+ yrs
- Posted: Posted
About the role
The team develops and operates the core system for running large-scale AI model inferences. The engineer contributes to all parts of the platform, ensuring deployed models perform well, are dependable, and are economical to run.
Our summary of the posting; the original is on the Baseten careers page.
What the posting requires
- Required
- Profiling
- Debugging
- Learning
- Tracing
- Performance
- Languages
- Capacity planning
- Reliability
- Frameworks
- Preferred
- LLM inference engines
- Kubernetes
- Service meshes
- Observability tooling
- vLLM
- Operators
These tags are our reading of the posting. They can miss something; the original posting is the reference.
Do you qualify?
Each requirement checked against your resume, in about a minute. No account. Your resume is deleted when the verdict appears.