Member of Technical Staff, Model Efficiency
Cohere · Modeling
- Location
- New York, New York, United States · San Francisco, California, United States · Toronto, Ontario, Canada · Montreal, Quebec , Canada · Remote
- Metro
- New York City, San Francisco Bay Area, Toronto, Montréal
- Workplace
- Remote
- Level
- Senior
- Type
- Full-time
- Pay
- CA$250K–CA$535K/yr (published by employer)
- Posted
- 12 months ago
- Source
- Ashby
Read the full posting & apply ↗
What the posting covers
About the company
Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises…
Role Overview
Our team is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve how models execute in production, driving lower latency, higher…
Job Responsibilities
As an engineer on this team, you’ll work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations. You’ll collaborate closely with modeling and systems…
Qualifications
5+ years of experience writing high-performance, production-quality code Strong programming skills in C++ or Python (Rust/Go also welcome) Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang,…
Full-Time Employees at Cohere enjoy these Perks
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch. Full health and dental benefits, including a separate budget for mental health. RRSP matching, 401K, Pension Scheme. 100% Parental Leave top-up for up to 6 months, for either…
How and Where We Work
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon. For those in the office: a daily lunch program, plenty of snacks, and regular community and social…
Excerpts only. The employer’s page has the complete posting.