Software Engineer - Inference Performance
Baseten is hiring for Software Engineer - Inference Performance in San Francisco. Mid level. First seen October 6, 2026; open as of November 10, 2026. Jobs taken straight from company career pages — no aggregator in between.
With Destava: How well do you fit? · Tailor my résumé · Write a cover letter
- Company
- Baseten
- Where
- San Francisco
- Level
- Mid
- First seen
- October 6, 2026
- Listed via
- Ashby
What the posting says
THE ROLE We're looking for inference performance engineers who want to make the world's most demanding AI workloads run faster and more efficiently. You'll work across the stack, from the inference engine and runtime through scheduling, serving, and routing. Along the way you'll apply techniques like prefill/decode disaggregation, speculative decoding, and KV-cache management. You'll reason from first principles about where time and memory go, find what's holding performance back, and close the gap. Your work directly impacts how fast our customers' models run and how efficiently we serve…
Read more and apply on Baseten's site
More jobs like this
Software Engineering Technical Leader
Save to applyStaff Software Engineer, Applied AI
Save to applyFull Stack Software Engineer
Save to applySenior HRSD Developer-ServiceNow supporting Nvidia
Save to apply
See all 2,321 Software Developers jobs in San Francisco Bay Area
A search agent finds the jobs this list misses: the ones that mean the same without the same words. Have Destava watch for software engineer - inference performance jobs in San Francisco, new matches every morning on your own account.
This page includes information from the O*NET 31.0 Database by the U.S. Department of Labor, Employment and Training Administration (USDOL/ETA). Used under the CC BY 4.0 license. O*NET® is a trademark of USDOL/ETA.