Senior ML Systems Engineer, Frameworks & Tooling

Cohere · Modeling

Location: London, London, United Kingdom · San Francisco, California, United States · New York, New York, United States · Paris, France · Toronto, Ontario, Canada · Montreal, Quebec , Canada · Remote
Metro: London, San Francisco Bay Area, New York City, Paris, Toronto, Montréal
Workplace: Remote
Level: Senior
Type: Full-time
Pay: CA$250K–CA$535K/yr (published by employer)
Posted: 11 months ago
Source: Ashby

What the posting covers

About the company

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises…

Role Overview

We’re looking for a senior engineer to help build, maintain and evolve the training framework that powers our frontier-scale language models. This role sits at the intersection of large-scale training, distributed systems, and HPC infrastructure. You will…

Key Responsibilities

Build and own the training framework responsible for large-scale LLM training. Design distributed training abstractions (data/tensor/pipeline parallelism, FSDP/ZeRO strategies, memory management, checkpointing). Improve training throughput and stability on…

Qualifications

Strong engineering experience in large-scale distributed training or HPC systems. Deep familiarity with JAX internals, distributed training libraries, or custom kernels/fused ops. Experience with multi-node cluster orchestration (Slurm, Ray, Kubernetes, or…

Full-Time Employees at Cohere enjoy these Perks

A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch. Full health and dental benefits, including a separate budget for mental health. RRSP matching, 401K, Pension Scheme. 100% Parental Leave top-up for up to 6 months, for either…

How and Where We Work

Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon. For those in the office: a daily lunch program, plenty of snacks, and regular community and social…

Excerpts only. The employer’s page has the complete posting.