logo
AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

Overview
The Foundry Inferencing & Training organization is building the AI infrastructure and platforms that power large-scale model training, fine-tuning, and inference for Microsoft products and Azure AI Foundry customers. Our AI Infrastructure team manages one of the world’s largest GPU fleets and operates highly reliable, efficient AI supercomputing environments across Azure and Microsoft partner clouds.
 
As a Software Engineer, you will contribute to infrastructure and tools that support large-scale AI workloads on the latest NVIDIA and AMD GPUs. You will collaborate with experienced engineers and AI researchers, build your skills in distributed systems, Kubernetes, and GPU infrastructure, and take increasing ownership of reliable services operating at massive scale.
 
In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
 
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
 
 
#EiP


Responsibilities
  • Designs, develops, tests, and maintains services and tools that support large-scale AI training and inference workloads.
  • Writes reliable, maintainable code using languages such as Go, Rust, Python, C++, or C#.
  • Contributes to infrastructure deployed across large-scale Kubernetes and GPU clusters in Azure and partner clouds.
  • Collaborates with engineers and AI researchers to understand requirements, troubleshoots issues, and improves the workload experience.
  • Monitors production systems, investigates reliability and performance issues, and implement fixes with guidance from experienced engineers.
  • Participates in code reviews, designs discussions, testing, deployment, and operational support.
  • Applies engineering best practices and AI-assisted development tools to improve system quality, security, reliability, and efficiency.


Qualifications

Required Qualifications:

  • Bachelor’s degree in Computer Science or a related technical field and technical engineering experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Rust, or Python;
  • Or equivalent experience.

 

Preferred Qualifications: 

  • Experience with distributed systems, Kubernetes, containers, or cloud infrastructure.
  • Experience developing software in Go, Rust, Python, C++, or C#.
  • Familiarity with Linux, automated testing, CI/CD, monitoring, or production operations.
  • Familiarity with AI/ML platforms, GPU infrastructure, large-scale training, or inference systems.
  • Experience collaborating with others to deliver software and resolve technical issues.

 

#AIINFRA



Software Engineering IC2 - The typical base pay range for this role across the U.S. is USD $85,400 - $168,100 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $111,100 - $183,700 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

  • Role Software Engineer
  • Experience 3-4 years
  • Education Bachelor Degree, or equivalent experience
  • Salary 85K - 168K Yearly
  • Work type Hybrid
  • Location United States
Check my match (free)
Microsoft
Hardware & Semiconductors · 500+ Members · Redmond, WA, United States

Microsoft builds Windows, Azure, Office and the Copilot family of AI assistants, and operates one of the largest AI training and inference fleets in the world. Microsoft Research and the AI platform teams work across foundation models, systems for large-scale training, and applied ML in every product line.

Founded in 1975 and headquartered in Redmond, Washington, the company is also OpenAI's principal compute partner and ships AI tooling for developers through GitHub, VS Code and Azure AI.

All jobs at Microsoft
Job Overview
Salary
85K - 168K Yearly
Eligibility
United States Right to work in the United States required.
Workplace
Hybrid
Job Posted:
23 hours ago
Job Type
Full Time
Education
Bachelor Degree, or equivalent experience
Experience
3-4 years

Share This Job: