Destava

ML Infrastructure Engineer - New Grad

SambaNova is hiring for ML Infrastructure Engineer - New Grad in Austin, Texas, United States; San Jose, California, United States. Junior level. First seen October 28, 2026; open as of November 11, 2026. Jobs taken straight from company career pages — no aggregator in between.

Save to applyRead more and apply on SambaNova's site

With Destava: How well do you fit? · Tailor my résumé · Write a cover letter

Company
SambaNova
Where
Austin, Texas, United States; San Jose, California, United States
Level
Junior
First seen
October 28, 2026
Listed via
Greenhouse

What the posting says

You'll help bring features like speculative decoding, prompt caching, and tool calling into production on the RDU, and add accuracy and regression tests that catch problems before customers do. Responsibilities Implement inference features on the RDU such as speculative decoding, constrained decoding, tool calling, prompt caching, and long-context inference Adapt vLLM and related serving frameworks to the RDU architecture Build and maintain endpoints in the public inference API Write accuracy verification and regression tests for inference features Debug latency, throughput, and reliability…

Read more and apply on SambaNova's site

This page includes information from the O*NET 31.0 Database by the U.S. Department of Labor, Employment and Training Administration (USDOL/ETA). Used under the CC BY 4.0 license. O*NET® is a trademark of USDOL/ETA.