Destava

Principal AI Engineer

Rapid7 is hiring for Principal AI Engineer in US - CA - Remote. Remote, Staff level, $221k–$299k a year stated. First seen November 15, 2026; open as of November 19, 2026. Jobs taken straight from company career pages — no aggregator in between.

Save to applyFree forever. No commitment, no card required.

Company
Rapid7
Where
US - CA - Remote
Arrangement
Remote
Level
Staff
Pay stated
$221k–$299k a year
First seen
November 15, 2026
Listed via
Workday
Open for
4 days, as of November 19, 2026

About this job

Principal AI Engineer at Rapid7, remote in US-CA, guiding technical strategy for LLM and agentic AI systems. Focus on architecture, model selection, fine-tuning, inference optimization, and team mentorship. Compensation ranges from $221,000 to $299,000 annually.

Responsibilities

  • Set the architecture and technical roadmap for LLM and agentic AI systems in Detection and Response and Exposure and Remediation
  • Drive model selection strategy for frontier or open-source options, including fine-tuning, distillation, or post-training decisions
  • Fine-tune, distill, and post-train open-source LLMs on security data from data curation to deployment
  • Define engineering standards for context engineering, inference optimization, and evaluation across teams
  • Enhance LLM inference at scale with speculative decoding, KV-cache management, continuous batching, quantization, and custom kernels
  • Make evaluations the mandatory release gate for every AI system shipped
  • Lead design reviews and resolve the most challenging technical trade-offs
  • Remain hands-on by prototyping and building critical model, training, and inference code
  • Mentor Staff and Senior engineers and influence product and platform investment decisions

Requirements

  • Over 12 years in software or ML engineering, with 2+ years shipping production LLM or agentic AI systems
  • Proven delivery of scalable, production-grade AI solutions adopted across teams or products with enterprise-wide impact
  • Solid grasp of transformer internals, attention, tokenization, positional encodings, and model training/serving fundamentals
  • Advanced PyTorch expertise covering custom model code, training loops, mixed precision, and distributed training (e.g., FSDP, DeepSpeed)
  • Practical experience with full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, plus distillation and preference/RL methods (e.g., DPO, GRPO)
  • Skilled in context engineering for retrieval, memory, and context management in long-running agent workflows
  • In-depth knowledge of prefill/decode, KV-cache management (e.g., PagedAttention, prefix caching), continuous batching, speculative decoding, FlashAttention, quantization, and serving via vLLM, SGLang, or TensorRT-LLM
  • Expertise in designing evaluation strategies and benchmarks for LLM and agent systems
  • Strong predictive AI and classical ML background, with sound judgment to select between them and LLMs based on accuracy, latency, and cost
  • Robust distributed systems and Python fundamentals
  • Accountability for major technical outcomes across multiple teams, with proactive risk identification and mitigation
  • Excellent communication to convey technical trade-offs to engineering, product, and leadership
  • Builds effective cross-functional partnerships with Engineering, Product, and other groups
  • Translates customer needs and business priorities into technical decisions, weighing value, cost, and trade-offs of AI solutions
  • Demonstrates core values to promote a culture of excellence

Nice to have

  • Prior work in pre-training or training LLMs from the ground up
  • Hands-on GPU kernel development (CUDA or Triton) and GPU performance profiling
  • Security background in detection engineering, SOC/MDR operations, or vulnerability management
  • Proven experience deploying AI workloads on AWS at scale
  • Relevant publications, patents, or open-source AI contributions

Benefits

  • Annual base pay of $221,000-$299,000 USD, adjusted by geographic location
  • Eligibility for variable/incentive pay, equity, and standard benefits where offered

Read more and apply on Rapid7's site

Questions about this job

When was this Principal AI Engineer job at Rapid7 posted?

Destava first saw it on November 15, 2026, on Rapid7's own careers page (Workday).

Is Rapid7 still accepting applications for it?

It was open on Rapid7's own site when Destava last read it, on November 19, 2026, 4 days after we first saw it. When the company takes it down, this page says the job has closed.

How do I apply for Principal AI Engineer at Rapid7?

On Rapid7's own site, at mymoose.wd1.myworkdayjobs.com: open the posting. Destava does not take the application. Save the job to your Destava board to track it, see how well you fit and tailor your résumé to it.

Is this Rapid7 job posting legit?

Destava read it on Rapid7's own careers page at mymoose.wd1.myworkdayjobs.com, run on Workday, not on a job board. First seen November 15, 2026. Apply on the company's own site, and never pay to apply for a job.

What does this job pay?

The posting states $221k–$299k a year.

How many computer and information research scientists jobs are open?

3,629 open, 771 of them new this week, at 1,180 companies: see them all.

Applying to this one?

See how well you fit, before you apply

Save it to your board. Add your résumé once, and Destava shows where you are strong, what is missing and how to pitch yourself, then tailors your résumé to this posting.

  1. Found it
  2. Save it
  3. See your fit

Free forever. No commitment, no card required.

Or apply on Rapid7's own site

With Destava: Save to apply · Tailor my résumé · Write a cover letter

This page includes information from the O*NET 31.0 Database by the U.S. Department of Labor, Employment and Training Administration (USDOL/ETA). Used under the CC BY 4.0 license. O*NET® is a trademark of USDOL/ETA.