Software Engineer, Model Routing & Inference
Cursor · Engineering
- Location
- New York, NY, United States · San Francisco, CA, United States
- Metro
- New York City, San Francisco Bay Area
- Workplace
- On-site
- Level
- Unspecified
- Type
- Full-time
- Posted
- 7 months ago
- Source
- Ashby
Read the full posting & apply ↗
What the posting covers
About the company
Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense.…
About the Role
As a Software Engineer on the Model Routing & Inference team at SpaceXAI, you'll build the inference platform that powers every AI interaction in the product. This team owns the full inference path: making Cursor's AI faster, more reliable, and more…
Example projects include...
Building and evolving our inference gateway, a single abstraction over every provider's API semantics, so model onboarding becomes a config change. Designing intelligent cross-provider failover so no single provider outage causes user-visible degradation.…
You may be a fit if
You have deep experience building high-throughput, low-latency distributed systems, especially in inference serving, traffic routing, or real-time data pipelines. You're comfortable reasoning about cost/performance tradeoffs at scale (GPU utilization,…
Excerpts only. The employer’s page has the complete posting.