Software Engineer, Data Infrastructure - Research
OpenAI · Scaling
- Location
- San Francisco, California, United States
- Metro
- San Francisco Bay Area
- Workplace
- Unspecified
- Level
- Unspecified
- Type
- Full-time
- Pay
- $250K–$380K/yr (published by employer)
- Posted
- 13 months ago
- Source
- Ashby
Read the full posting & apply ↗
What the posting covers
About the Team
The Workload team is responsible for designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive scale. Our systems unify how researchers train and serve models, abstracting away the complexity of…
About the Role
We are looking for an engineer to design and implement the dataset infrastructure that powers OpenAI’s next-generation training stack. You will be responsible for building standardized dataset interfaces, scaling pipelines across thousands of GPUs, and…
In this role, you will
Design and maintain standardized dataset APIs, including for multimodal (MM) data that cannot fit in memory. Build proactive testing and scale validation pipelines for dataset loading at GPU scale. Collaborate with teammates to integrate datasets seamlessly…
You might thrive in this role if you
Have strong engineering fundamentals with experience in distributed systems, data pipelines, or infrastructure. Have experience building APIs, modular code, and scalable abstractions, while recognizing that abstractions ultimately serve the users and UX is an…
Bonus points if you
Have background knowledge in data math, probability, or distributed data theory. Have worked with GPU-scale distributed systems or dataset scaling for real-time data
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our…
Excerpts only. The employer’s page has the complete posting.