Destava

Staff Software Engineer, LLM Inference Platform

Zenlayer is hiring for Staff Software Engineer, LLM Inference Platform in Not specified. Staff level. First seen October 29, 2026; open as of November 14, 2026. Jobs taken straight from company career pages — no aggregator in between.

Save to applyRead more and apply on Zenlayer's site

With Destava: How well do you fit? · Tailor my résumé · Write a cover letter

Company
Zenlayer
Where
Not specified
Level
Staff
First seen
October 29, 2026
Listed via
BambooHR

What the posting says

As the technical lead for inference performance , you will own end-to-end responsibility for the platform's Token Performance. For models ranging from hundreds of billions to trillions of parameters (including MoE ), you will continuously reduce cost per million tokens and increase per-GPU Goodput while meeting TTFT/ TPOT SLOs, and prove the gain from every optimization with reproducible data. What You Will Work On 1. End-to-End Performance Attribution and Benchmarking - Establish a unified Token Performance metrics framework (TTFT, TPOT, Goodput, GPU utilization , per-token cost), and build…

Read more and apply on Zenlayer's site

This page includes information from the O*NET 31.0 Database by the U.S. Department of Labor, Employment and Training Administration (USDOL/ETA). Used under the CC BY 4.0 license. O*NET® is a trademark of USDOL/ETA.