Senior Software Engineer - Model Performance
Inference is hiring for Senior Software Engineer - Model Performance in San Francisco. Senior level. First seen August 6, 2026; open as of November 10, 2026. Jobs taken straight from company career pages — no aggregator in between.
With Destava: How well do you fit? · Tailor my résumé · Write a cover letter
- Company
- Inference
- Where
- San Francisco
- Level
- Senior
- First seen
- August 6, 2026
- Listed via
- Ashby
What the posting says
You'll work across the full inference stack—from CUDA kernels to serving frameworks—to find and eliminate bottlenecks. This role reports directly to the founding team. You'll have the autonomy, a large compute budget, and technical support to push the limits of what's possible in model serving. Key Responsibilities - Implement and productionize optimization techniques including quantization, speculative decoding, KV cache optimization, continuous batching, and LoRA serving - Deep dive into inference frameworks (vLLM, SGLang, TensorRT-LLM) and underlying libraries to debug and improve…
Read more and apply on Inference's site
More jobs like this
A search agent finds the jobs this list misses: the ones that mean the same without the same words. Have Destava watch for senior software engineer - model performance jobs in San Francisco, new matches every morning on your own account.