Databricks · , Mountain View, California · San Francisco, California
$229k–$343k a year · On-site · Lead & above
High competition (est.)
Filed H-1B · FY25Filed 67 H-1B LCAs in FY2025
Posted 24 days ago
Hands-on experience in a production environment with retrieval: chunking, embeddings, hybrid search, re-ranking, metadata filtering, and the failure modes of each. Working knowledge of grounding techniques that anchor generated answers in retrieved evidence (citation and quote extraction, faithfulness and refusal evals, post-hoc consistency checks).
Strong prompt-engineering practice: zero-shot, few-shot, and many-shot patterns; example selection and ordering; in-context learning and chain-of-thought.
Comfort with structured output and validation in production (provider-native structured outputs, Instructor, Pydantic-AI, Outlines, or a comparable approach).
Disciplined evaluation practice. You do not rely on subjective review to decide whether a system is ready.
Experience in standing up local models and creating and testing closed local model solutions.
Strong written and verbal communication. You can explain an architectural trade-off to an executive and to a junior engineer in the same week.
You are comfortable using AI coding tools heavily in your implementation workflow while you own problem framing, design choices, and verification. We measure your output by working systems delivered, not lines of code written.
Nice to Have:
Advanced retrieval experience: GraphRAG, agentic retrieval, evaluation-driven retrieval tuning, and hybrid retrieval at scale.
Direct or transferable experience with safety, privacy, and policy constraints in user-facing AI. K-12 or other regulated-domain experience is a strong plus.
Experience with prompt-optimization frameworks (DSPy, TEXTGRAD, AdalFlow) where they paid off in production.
A public repo, package, gist, or technical write-up of meaningful AI work, or a representative project you can describe in detail under your confidentiality constraints.
Open-source contributions to AI tooling (frameworks, agents, evals, MCP servers).
Sponsorship data shows employers' past filings in public US government records (DOL, USCIS, E-Verify) and is not a promise that any job will be sponsored. Immigration rules change. Verify your situation with your DSO or an immigration attorney.