New job, posted less than a week ago!
Job Details
Posted date: Mar 20, 2026
There have been 2700 jobs posted with the title of Principal Software Engineer all time at Microsoft.There have been 2700 Principal Software Engineer jobs posted in the last month.
Category: Software Engineering
Location: Mountain View, CA
Estimated salary: $222,050
Range: $139,900 - $304,200
Employment type: Full-Time
Work location type: Fully on-site
Role: Individual Contributor
Description
OverviewWe are looking for a Principal Software Engineer to lead the design and development of next-generation agent architectures, model deployment systems, and training infrastructure for large-scale AI systems.
In this role, you will partner closely with applied scientists, product teams, and platform engineers to build robust, scalable, and production-grade systems that power intelligent, agentic experiences. You will play a critical role in shaping how large language models are trained, deployed, and orchestrated to deliver real-world impact.
This is a high-impact, cross-functional role requiring deep technical expertise, strong system design skills, and the ability to drive end-to-end execution across modeling and infrastructure.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
Lead agent architecture design for LLM-based systems, including multi-agent orchestration, tool use, and planning frameworksOwn model deployment infrastructure, enabling reliable, scalable, and low-latency serving of large models across diverse scenariosDrive improvements in model training infrastructure, including data pipelines, training workflows, and evaluation systemsPartner with applied scientists to bridge modeling and production, ensuring efficient iteration from research to deploymentDesign and implement end-to-end systems spanning retrieval, reasoning, execution, and feedback loopsOptimize systems for latency, cost, reliability, and quality at scaleEstablish best practices for experimentation, evaluation, and monitoring of AI systems in productionMentor engineers and contribute to technical strategy and roadmap for AI platform and agent systems
Qualifications
Required Qualifications:
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.Preferred Qualifications:
8+ years of experience in software engineering, with a strong focus on distributed systems and large-scale infrastructureProven experience designing and building production-grade systems for ML/AI or data platformsSolid programming skills in languages such as Python, C++, Java, or similarExperience with model serving, distributed training systems, or large-scale data pipelinesDeep understanding of system design, scalability, and reliability principlesAbility to work across disciplines and drive execution in ambiguous, fast-moving environments#GXP
Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.