Member of Technical Staff - ML Systems & Inference
Gimlet Labs is hiring for Member of Technical Staff - ML Systems & Inference in San Francisco, CA. Staff level. First seen August 6, 2026; open as of November 10, 2026. Jobs taken straight from company career pages — no aggregator in between.
With Destava: How well do you fit? · Tailor my résumé · Write a cover letter
- Company
- Gimlet Labs
- Where
- San Francisco, CA
- Level
- Staff
- First seen
- August 6, 2026
- Listed via
- Ashby
What the posting says
You will work on the systems that determine how inference executes across that pipeline: how requests are batched and scheduled, how stages are placed and scaled, how KV cache and intermediate state move between accelerators, and how the system balances latency, throughput, and utilization across different hardware characteristics. You will work across model serving, batching, scheduling, concurrency, KV cache management, and memory placement. You will help bring up models on novel hardware. You will support new model architectures and inference techniques, improve performance under real…
Read more and apply on Gimlet Labs' site
More jobs like this
A search agent finds the jobs this list misses: the ones that mean the same without the same words. Have Destava watch for member of technical staff - ml systems & inference jobs in San Francisco, CA, new matches every morning on your own account.