Senior Staff Applied AI Engineer - Context Retrieval
Databricks · Engineering
- Location
- Mountain View, California; San Francisco, California
- Metro
- San Francisco Bay Area
- Workplace
- Hybrid
- Level
- Staff+
- Type
- Unspecified
- Pay
- $229K–$343K/yr (estimated from posting text)
- Posted
- 6 months ago
- Source
- Greenhouse
Read the full posting & apply ↗
What the posting covers
About the company
P-1549 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the…
The Mission
Databricks agents are only as good as the context they can retrieve. Whether an agent is answering a question about last quarter's revenue, debugging a failing job, generating SQL against a 10,000-table lakehouse, or summarizing a Wiki page, its quality is…
What You Will Do
Build the full retrieval stack from scratch. Own the end-to-end system: query understanding, content understanding and indexing, hybrid retrieval, ranking, and evaluation. Make the architectural calls that will define how Databricks agents access context for…
What You Will Do
Build search subagents that reason about retrieval. Design the agentic layer that decides what context is needed, which sources to query, how to decompose and route the search, and — critically — whether the retrieved content is actually sufficient to answer…
What We're Looking For
10+ years of software engineering experience, with significant time spent building production retrieval, search, or RAG systems at scale. Deep Information Retrieval (IR) expertise: lexical retrieval (BM25, Lucene/Elasticsearch/OpenSearch), dense retrieval…
Nice to Have
Experience building retrieval over enterprise SaaS sources (permissions, freshness, multi-tenancy, ACL-aware indexing). Background in agentic systems, tool use, or multi-turn retrieval for LLM agents. Contributions to open-source IR/search projects, or…
Why This Role
Foundational impact. Retrieval is the single biggest lever on agent quality. The stack you build will sit underneath every Databricks agent and every customer-built agent on our platform. Greenfield with scale. You get the rare combination of starting from a…
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation…
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps,…
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on…
Excerpts only. The employer’s page has the complete posting.