← Search

Member of Technical Staff, Training Performance Engineer

Cohere · Modeling

Location
London, London, United Kingdom · New York, New York, United States · Paris, France · Toronto, Ontario, Canada · Montreal, Quebec , Canada · Remote
Metro
London, New York City, Paris, Toronto, Montréal
Workplace
Hybrid
Level
Unspecified
Type
Full-time
Pay
CA$250K–CA$535K/yr (published by employer)
Posted
20 months ago
Source
Ashby

Read the full posting & apply ↗

PythonPyTorchJAXCUDALLVM

What the posting covers

About the company

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises…

Role Overview

As a Performance Engineer in the Pre-Training team you will be responsible for optimizing the performance of our advanced language models and systems. Their primary focus is on improving key model training metrics, such as training throughput, ensuring high…

Key Responsibilities

Design and write high-performant and scalable software for training. Understand architectural modifications and design choices and their effects on training throughput and quality. Write low-level CUDA, triton kernels to squeeze every last bit of performance…

Qualifications

Extremely strong software engineering skills. Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR. Experience writing kernels for GPUs using CUDA, triton, etc Experience using large-scale distributed training strategies.…

Working location

This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement. We care most about hiring exceptional people regardless of locations, though please check the location…

Full-Time Employees at Cohere enjoy these Perks

A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch. Full health and dental benefits, including a separate budget for mental health. RRSP matching, 401K, Pension Scheme. 100% Parental Leave top-up for up to 6 months, for either…

How and Where We Work

Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon. For those in the office: a daily lunch program, plenty of snacks, and regular community and social…