Member of Technical Staff - ML Performance
Modal · Engineering
- Location
- new york, new york, United States · San Francisco, California, USA
- Metro
- New York City, San Francisco Bay Area
- Workplace
- Unspecified
- Level
- Senior
- Type
- Full-time
- Pay
- $200K–$350K/yr (published by employer)
- Posted
- 6 months ago
- Source
- Ashby
Read the full posting & apply ↗
What the posting covers
About Us
AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined…
The Role
We are looking for strong engineers with experience in making ML systems performant at scale. If you are interested in contributing to open-source projects and Modal’s container runtime to push language and diffusion models towards higher throughput and lower…
Requirements
5+ years of experience writing high-quality, high-performance code. Experience working with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT). Familiarity with Nvidia GPU architecture and CUDA. Experience with ML performance…
Excerpts only. The employer’s page has the complete posting.