Member of Technical Staff - Research, Inference
Modal · Engineering
- Location
- new york, new york, United States · San Francisco, California, USA
- Metro
- New York City, San Francisco Bay Area
- Workplace
- Unspecified
- Level
- Unspecified
- Type
- Full-time
- Pay
- $150K–$350K/yr (published by employer)
- Posted
- 4 months ago
- Source
- Ashby
Read the full posting & apply ↗
What the posting covers
About Us
AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined…
The Role
Most of the value of owning a model shows up at serving time. We're building a platform that covers the whole life of an LLM -- train it, deploy it, observe it -- and inference is where teams feel the difference every day. We already run elastic inference,…
What you'll do
Own end-to-end inference research bets: speculative decoding, disaggregated prefill/decode, quantization (FP8, INT4), KV-cache and memory management, autoscaling for spiky serverless traffic, and whatever else the research agenda calls for. Train custom…
Requirements
A research-leaning or systems background in LLM inference, with work you can point to. Fluency in the LLM serving stack, from kernels and quantization up to schedulers and autoscaling. A record of shipping research or systems that other people build on,…
Excerpts only. The employer’s page has the complete posting.