New job, posted less than a week ago!
Job Details
Posted date: May 05, 2026
There have been 5 jobs posted with the title of Principal Engineer all time at Amazon.Location: Bellevue, WA
Estimated salary: $235,350
Range: $200,100 - $270,600
Description
We are looking for a Principal Engineer with deep ML engineering expertise to lead the ML and science engineering effort across the AI Platforms organization at AWS. This is a cross-cutting leadership role spanning the full breadth of our ML development platform: data preparation, model evaluation, model deployment and customization, and agentic AI development experience.In this role, you will be responsible for building production-grade 1P agents, designing comprehensive evaluation frameworks (including LLM-as-Judge), creating recommendation systems for model benchmarking and selection, and driving the science-engineering interface to deliver superior developer experiences at AWS scale. You will work closely with world-class science teams to translate innovative research into production systems and establish the technical strategy for ML engineering across the organization.
You are not just an architect — you are a hands-on builder who can prototype alongside scientists, write production code, and review designs across multiple teams. You bring a rare combination of ML depth, systems thinking, and the ability to influence without authority at a global scale.
Key job responsibilities
• Design and build production-grade 1P agent architectures including memory management, prompt optimization, tool use, and agentic orchestration systems
• Define and own the evaluation strategy for AI Platforms, including LLM-as-Judge frameworks, automated benchmarking, and model quality assessment pipelines
• Build ML-driven recommendation systems for model benchmarking, selection, deployment, and customization from Model Hub
• Establish data quality evaluation pipelines and synthetic data generation infrastructure to support model training and fine-tuning at scale
• Drive requirements and technical roadmap with the science team; translate research prototypes into engineering specifications and production systems
• Define the ML engineering technical strategy across AI Platforms, establishing best practices for agent development, model evaluation, and science-to-production pipelines
• Mentor senior engineers across the organization; conduct design reviews, technical deep-dives, and bar-raising interviews
• Present technical strategy and roadmap to VP-level stakeholders; represent AI Platforms ML engineering in cross-organizational technical forums
Qualifications
• Experience in software development with a significant focus on ML engineering or applied AI systems• Experience designing and shipping production-grade ML systems or AI agents that operate at scale (not just prototype or research systems)
• Experience with model evaluation, benchmarking, or quality assessment of ML/AI systems in a production environment
• Experience with recommendation systems, retrieval systems, or similar ML systems running in production
• Demonstrated ability to work across multiple teams as a technical leader, influencer, or architect
Extended Qualifications
• Master’s or PhD in Machine Learning, Artificial Intelligence, Computer Science, or a related quantitative field• Experience building production LLM-powered agents including memory management, prompt optimization, tool use, and multi-step reasoning
• Experience with LLM-as-Judge, automated evaluation methodologies, or building evaluation infrastructure for generative AI systems
• Experience with prompt engineering and prompt optimization at scale (beyond single-model, to fleet-scale optimization)
• Experience with synthetic data generation, data quality evaluation, or data labeling pipelines for ML model training
• Track record of driving science-engineering collaboration: working with research scientists, interpreting research outputs, and translating findings into production systems
• Experience leading technical strategy across multiple engineering teams or sub-organizations
• Publications, patents, or significant open-source contributions in ML/AI (NeurIPS, ICML, ICLR, KDD, RecSys, EMNLP, ACL, or equivalent venues preferred)
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, BELLEVUE - 200,100.00 - 270,600.00 USD annually