Distributed LLM Inference Engineer
Anyscale is hiring for Distributed LLM Inference Engineer in San Francisco. Mid level. First seen August 6, 2026; open as of November 11, 2026. Jobs taken straight from company career pages — no aggregator in between.
With Destava: How well do you fit? · Tailor my résumé · Write a cover letter
- Company
- Anyscale
- Where
- San Francisco
- Level
- Mid
- First seen
- August 6, 2026
- Listed via
- Ashby
What the posting says
As part of this role, you will - Iterate very quickly with product teams to ship the end to end solutions for Batch and Online inference at high scale which will be used by open-source Ray users and customers of Anyscale - Work across the stack integrating Ray Data and LLM engine providing optimizations achieving low cost solutions for large scale ML inference - Integrate with Open source software like vLLM, work closely with the community to adopt these techniques in Anyscale solutions, and also contribute improvements to open source - Follow the latest state-of-the-art in the open source…
Read more and apply on Anyscale's site
More jobs like this
A search agent finds the jobs this list misses: the ones that mean the same without the same words. Have Destava watch for distributed llm inference engineer jobs in San Francisco, new matches every morning on your own account.