New job, posted less than a week ago!
Job Details
Posted date: Aug 19, 2025
There have been 1101 jobs posted with the title of Senior Software Engineer all time at Microsoft.There have been 1101 Senior Software Engineer jobs posted in the last month.
Category: Software Engineering
Location: Redmond, WA
Estimated salary: $188,900
Range: $119,800 - $258,000
Employment type: Full-Time
Travel amount: 25.0%
Work location type: Up to 50% work from home
Role: Individual Contributor
Description
We are the AI Frameworks team at Microsoft, part of the CoreAI organization, and we are at the forefront of driving innovation in large-scale AI. Our mission is to enable state-of-the-art large language model (LLM) training and inference through deep optimization across the full software and hardware stack. We work across PyTorch, ONNX, and other open AI frameworks, pushing the boundaries of performance, scalability, and efficiency on a wide range of hardware accelerators.This position is part of a highly specialized sub-team focused on building the end-to-end software stack for Microsoft’s first-party (1P) AI accelerators. Our work is foundational to Microsoft’s long-term AI infrastructure strategy, powering next-generation models and services across Azure and Microsoft products. We collaborate closely with hardware architects, compiler teams, and model experts to co-design software solutions that unlock the full potential of custom silicon. The work is deeply technical and impactful—advancing AI systems used at global scale.
If you are passionate about AI systems, low-level performance optimization, and solving hard cross-discipline engineering problems, we invite you to join us and help shape the future of AI at Microsoft.
Implement and optimize components of the AI software stack targeting Microsoft’s 1P AI accelerators.Collaborate with hardware, compiler, and model teams to develop high-performance solutions.Contribute to framework integration work for PyTorch and ONNX with custom hardware backends.Analyze performance bottlenecks and propose optimizations across framework, runtime, and hardware layers.Write clean, maintainable, and well-tested code, and participate in design/code reviews.Stay informed on emerging AI framework and accelerator technologies.
Qualifications
Required Qualifications:
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.Proficiency in C++ and/or Python, with solid understanding of software engineering fundamentals.Experience with modern large language model (LLM) serving technologies, including distributed execution and inference optimization.Strong problem-solving skills and ability to collaborate across teams.
Preferred Qualifications:
Experience with deep learning frameworks such as PyTorch, TensorFlow, or ONNX.Experience with GPU computing (CUDA programming, GPU kernel optimization, performance tuning).Familiarity with AI accelerator software stacks, graph compilers, or kernel libraries.Understanding of large-scale distributed training or inference systems for LLMs.Exposure to performance profiling and optimization tools.Contributions to open-source AI frameworks or compilers.Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications and processes offers for these roles on an ongoing basis.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Check out other jobs at Microsoft.