Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco
Plaud is hiring for Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco in San Francisco, CA. Mid level. First seen August 6, 2026, posted 2 times; open as of November 11, 2026. Jobs taken straight from company career pages — no aggregator in between.
With Destava: How well do you fit? · Tailor my résumé · Write a cover letter
- Company
- Plaud
- Where
- San Francisco, CA
- Level
- Mid
- First seen
- August 6, 2026
- Postings
- 2
- Listed via
- Ashby
What the posting says
YOU MAY BE A GOOD FIT IF YOU: - Have hands-on experience building and deploying high-throughput, ultra-low-latency inference engines for large language models or foundational speech models. - Understand the intricate tradeoffs between latency, throughput, and Time-To-First-Token (or Time-To-First-Audio) in real-time streaming environments. - Have practical experience with continuous batching, KV cache management (e.g., PagedAttention), and stateful connections necessary for real-time conversational AI. - Possess a deep understanding of GPU architectures (NVIDIA Ampere/Hopper) and the memory…
Read more and apply on Plaud's site
More jobs like this
Data Product Analyst
Save to apply2027 Summer Intern, Machine Learning, MS/PhD, Simulation Realism (World Model)
Save to applyData Scientist, Clinical Outcomes
Save to applyManager, Data Science
Save to apply
See all 487 Data Scientists jobs in San Francisco Bay Area
A search agent finds the jobs this list misses: the ones that mean the same without the same words. Have Destava watch for machine learning engineer, inference & serving (speech llm) - san francisco jobs in San Francisco, CA, new matches every morning on your own account.
This page includes information from the O*NET 31.0 Database by the U.S. Department of Labor, Employment and Training Administration (USDOL/ETA). Used under the CC BY 4.0 license. O*NET® is a trademark of USDOL/ETA.