← Search

Member of Technical Staff - ML Performance

Modal · Engineering

Location
new york, new york, United States · San Francisco, California, USA
Metro
New York City, San Francisco Bay Area
Workplace
Unspecified
Level
Senior
Type
Full-time
Pay
$200K–$350K/yr (published by employer)
Posted
6 months ago
Source
Ashby

Read the full posting & apply ↗

LinuxCUDA

What the posting covers

About Us

AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined…

The Role

We are looking for strong engineers with experience in making ML systems performant at scale. If you are interested in contributing to open-source projects and Modal’s container runtime to push language and diffusion models towards higher throughput and lower…

Requirements

5+ years of experience writing high-quality, high-performance code. Experience working with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT). Familiarity with Nvidia GPU architecture and CUDA. Experience with ML performance…