Pune · On-site
Staff AI Engineer (Lead)
- Salary
- Not disclosed
- Experience
- 8 years
- Eligible batches
- 2020
- Degree
- Master's, PhD
- Location
- PuneOn-site
- Apply by
- 28 Feb 2027
About the role
Rapid7 India is expanding its AI Engineering team and seeks a senior AI engineer to lead the design, development and delivery of large‑language‑model (LLM) and agentic AI solutions for its security platform. Based in Pune, the role combines deep technical expertise with cross‑functional leadership, guiding architecture, mentoring engineers and translating customer requirements into production‑grade AI services.
Responsibilities
- Architect and build end‑to‑end LLM and agentic AI systems for detection, response, vulnerability prioritisation and remediation.
- Define model strategies, select frontier or open‑source models, and oversee fine‑tuning, distillation and post‑training pipelines.
- Implement context‑engineering, retrieval and memory mechanisms for long‑running agent workflows.
- Optimise inference performance, latency and cost using techniques such as KV‑cache management, speculative decoding and quantisation.
- Lead design reviews, resolve technical trade‑offs and establish evaluation gates for AI releases.
- Mentor engineers, collaborate with product and platform teams, and communicate complex concepts to both technical and non‑technical audiences.
Free interview prep
Prepare for the interview
Eligibility
- 8+ years of software or machine‑learning engineering experience.
- At least 6 years of experience with an advanced degree (M.Tech/M.Sc) or 3+ years with a PhD.
- Proven track record of delivering scalable, production‑grade AI systems used across multiple products.
Skills
- Advanced PyTorch proficiency, including custom model code, mixed‑precision and distributed training (FSDP, DeepSpeed).
- Hands‑on experience fine‑tuning and post‑training open‑weight LLMs (LoRA, QLoRA, DPO, GRPO).
- Strong understanding of transformer architecture, attention mechanisms, tokenisation and positional encodings.
- Expertise in inference optimisation, pre‑fill/decode strategies, continuous batching and serving frameworks such as vLLM, SGLang or TensorRT‑LLM.
- Solid foundation in predictive AI, classical machine learning, distributed systems and Python.
- Excellent communication and cross‑functional collaboration abilities.
Resume keywords
- PyTorch
- Python
- LLM
- Transformer
- Fine-tuning
- Distributed training
- Context engineering
- Inference optimization
- ML
- AI
Benefits
- Opportunity to shape the next generation of AI‑driven cybersecurity products.
- Leadership role with influence over technical direction across multiple teams.
- Access to cutting‑edge research, open‑source ecosystems and a collaborative engineering culture.
- Competitive compensation and comprehensive employee wellness programs.
You'll apply on mymoose.wd1.myworkdayjobs.com
Apply link checked by CareersAt.Tech and re-tested nightly. You never pay to apply. Report listing
About Rapid7 India Technologies
Rapid7 is a global cybersecurity company that provides AI‑powered security platforms and managed services to protect enterprises. It serves over 11,500 customers worldwide and has opened a new office in Pune, India to expand its product and AI work.
Founded 2000 · 1001-5000 employees · HQ Boston, Massachusetts, United States
More about Rapid7 India TechnologiesSimilar roles
More AI / ML jobsData Scientist - AILSEG · Hybrid
Agentic AI Engineer – Mainframe ModernizationKyndryl · Bengaluru, PuneGenAI Developer/ EngineerCapco · Pune
Data ScientistAirbus India · Bangalore AreaML AI Platform EngineerCapco · Pune, Bengaluru, Mumbai +3
AI Full Stack Engineer – Service TechnologyCaterpillar · Chennai