Senior Applied AI Engineer
Handshake is hiring for Senior Applied AI Engineer in San Francisco, CA. Senior level. First seen November 18, 2026; open as of November 19, 2026. Jobs taken straight from company career pages — no aggregator in between.
Save to applyFree forever. No commitment, no card required.
- Company
- Handshake
- Where
- San Francisco, CA
- Type
- Full-time
- Level
- Senior
- First seen
- November 18, 2026
- Listed via
- Ashby
- Open for
- Less than a day, as of November 19, 2026
About this job
Handshake seeks a Senior Applied AI Engineer in San Francisco to create an Evals platform that evaluates and enhances expert human and synthetic data quality for leading AI labs. This role entails leading initiatives from initial problem definition to production launch, collaborating with researchers and clients, and applying rigorous experimental methods. Candidates need over five years of experience and strong expertise in agentic workflows and applied AI.
Responsibilities
- Develop a top-tier evals platform, collaborating with operators, researchers, and labs to transform vague quality needs into quantifiable results and reusable tools
- Create and launch production agents, constructing agentic workflows for data generation, review, investigation, and enhancement with proper tool usage, coordination, human supervision, and error handling
- Quantify quality by developing graders, programmatic checks, and reward signals aligned with expert assessments across LLMs, agents, multimodal models, and RL settings
- Drive the improvement cycle: build eval datasets, benchmarks, and agent harnesses; examine traces, identify failure patterns, and execute tests until performance advances
- Lead and elevate standards: manage projects from concept to deployment with product, design, operations, and research; define technical strategy, mentor engineers, and foster technical excellence across the team and broader engineering organization
Requirements
- Accumulate over five years of professional experience
- Demonstrate a history of building and maintaining high-quality software, making full-stack decisions, and refining products based on user feedback
- Show advanced proficiency in agentic workflows and applied AI, with production agent development covering tool use, context handling, orchestration, retrieval, human oversight, and reliability compromises
- Exhibit solid engineering skills: strong Python, scalable services, APIs, data pipelines, rigorous testing, debugging, and system architecture
- Adopt an evaluation-driven mindset: select relevant metrics, build representative datasets, validate graders, separate genuine gains from noise, and refine until outcomes improve
- Stay current with frontier AI: modern models, agent frameworks, benchmarks, evaluation methods, and the impact of training data and post-training techniques on model behavior
- Apply technical judgment and ownership: design systems, balance tradeoffs, and convert vague problems into dependable solutions in a dynamic setting
- Communicate collaboratively with low ego: engage effectively with engineers, researchers, domain specialists, operators, and clients, enhancing team productivity
- Prove capability through shipped products, open-source work, benchmarks, datasets, or other substantial technical achievements
Nice to have
- Possess research or applied expertise in reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems
- Have experience creating LLM or agent benchmarks, reward models, evaluation methods, annotation systems, or data-quality frameworks
Benefits
- Receive equity in a rapidly expanding organization
- Access a 401(k) match, competitive pay, and financial advisory services
- Obtain medical, dental, and vision insurance
- Utilize mental health resources and a $500 wellness allowance
- Take paid parental leave, fertility assistance, and parenting guidance
- Use a $2,000 yearly education allowance
- Enjoy flexible time off, 15 holidays, and 2 additional flexible days
- Get internet, commuting subsidies, and complimentary meals and gym access at our San Francisco location
- Participate in team activities and refreshments
Read more and apply on Handshake's site
Questions about this job
When was this Senior Applied AI Engineer job at Handshake posted?
Destava first saw it on November 18, 2026, on Handshake's own careers page (Ashby).
Is Handshake still accepting applications for it?
It was open on Handshake's own site when Destava last read it, on November 19, 2026. When the company takes it down, this page says the job has closed.
How do I apply for Senior Applied AI Engineer at Handshake?
On Handshake's own site, at jobs.ashbyhq.com: open the posting. Destava does not take the application. Save the job to your Destava board to track it, see how well you fit and tailor your résumé to it.
Is this Handshake job posting legit?
Destava read it on Handshake's own careers page at jobs.ashbyhq.com, run on Ashby, not on a job board. First seen November 18, 2026. Apply on the company's own site, and never pay to apply for a job.
What other jobs is Handshake hiring for?
Handshake has 77 open postings on its own site: see all jobs at Handshake.
How many software developers jobs are open in San Francisco Bay Area?
5,137 open, 654 of them new this week, at 1,110 companies: see them all.
More jobs like this
Internship-Generative AI developer
Save to applySoftware Engineer III, Apple
Save to applyCustomer Application Engineer
Save to applySoftware Engineer, Backend - Government Products
Save to apply
See all 5,137 Software Developers jobs in San Francisco Bay Area
A search agent finds the jobs this list misses: the ones that mean the same without the same words. Have Destava watch for senior applied ai engineer jobs in San Francisco, CA, new matches every morning on your own account.
Applying to this one?
See how well you fit, before you apply
Save it to your board. Add your résumé once, and Destava shows where you are strong, what is missing and how to pitch yourself, then tailors your résumé to this posting.
- Found it
- Save it
- See your fit
Free forever. No commitment, no card required.
With Destava: Save to apply · Tailor my résumé · Write a cover letter
This page includes information from the O*NET 31.0 Database by the U.S. Department of Labor, Employment and Training Administration (USDOL/ETA). Used under the CC BY 4.0 license. O*NET® is a trademark of USDOL/ETA.