Software Engineer, Model Runtime
OpenAI · Scaling
- Location
- San Francisco, California, United States · Remote
- Metro
- San Francisco Bay Area
- Workplace
- Hybrid
- Level
- Unspecified
- Type
- Full-time
- Pay
- $266K–$445K/yr (published by employer)
- Posted
- 2 months ago
- Source
- Ashby
Read the full posting & apply ↗
What the posting covers
About the Team
OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for the unique demands of advanced AI workloads. Building on efforts like Jalapeño, the team is developing future generations of AI-native silicon and tightly integrated…
About the Role
You will build the model runtime within the inference engine that executes complex, frontier models at scale on OpenAI’s custom silicon. The runtime will sit between models running on the hardware and the upper layers of the cluster serving software stack,…
In this role, you will
Design and implement the LLM inference runtime for frontier models running on custom silicon. Build scheduling, continuous batching, memory management, KV-cache management, and execution orchestration for high-performance inference. Develop distributed…
You might thrive in this role if
Have strong systems programming experience in C++, Rust, Python, or comparable performance-oriented environments. Have built or optimized runtimes, distributed systems, compilers, kernels, model-serving infrastructure, or adjacent systems software. Understand…
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our…
Excerpts only. The employer’s page has the complete posting.