Site Reliability Engineer, Inference Infrastructure
Cohere · Inference
- Location
- Toronto, Ontario, Canada · San Francisco, California, United States · New York, New York, United States · Montreal, Quebec , Canada · Remote
- Metro
- Toronto, San Francisco Bay Area, New York City, Montréal
- Workplace
- Remote
- Level
- Unspecified
- Type
- Full-time
- Pay
- $160K–$260K/yr (published by employer)
- Posted
- 9 months ago
- Source
- Ashby
Read the full posting & apply ↗
GoC++AWSGCPAzureKubernetesLinuxLLMs
What the posting covers
About the company
Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises…
Why this role?
Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for a Site Reliability Engineer to join…
As a Site Reliability Engineer you will
Build self-service systems that automate managing, deploying and operating services. This includes our custom Kubernetes operators that support language model deployments. Automate environment observability and resilience. Enable all developers to…
You may be a good fit if you have
5+ years of engineering experience running production infrastructure at a large scale Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters Experience with Kubernetes dev and production coding…
Full-Time Employees at Cohere enjoy these Perks
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch. Full health and dental benefits, including a separate budget for mental health. RRSP matching, 401K, Pension Scheme. 100% Parental Leave top-up for up to 6 months, for either…
How and Where We Work
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon. For those in the office: a daily lunch program, plenty of snacks, and regular community and social…
Excerpts only. The employer’s page has the complete posting.