logo

AI Job Summary

Design and implement AI platform capabilities for Windows Server in on-premises and hybrid environments, including usage tracking, observability pipelines, and management layers for inference toolchains. Requires a bachelor's degree in computer science and 4+ years of technical engineering with languages like C, C++, C#, Java, JavaScript, or Python. Preferred experience includes 5+ years of software engineering, server administration, AI model catalogs, systems architecture, and observability. Base pay ranges from $119,800–$234,700 annually, or $160,200–$261,000 in San Francisco Bay Area and New York City.

Written from this posting by Neural Jobs AI. The full description is below.

AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

Overview

Core OS is responsible for the foundational technologies that underpin Windows and Windows Server, providing the trusted platform on which customers run their most critical workloads. Our team combines deep systems engineering with modern AI innovation to bring the next generation of intelligent capabilities to enterprise environments.

We are hiring a Senior Software Engineer to build new Artificial Intelligence (AI) platform capabilities for Windows Server across on-premises and hybrid customer deployments. You will be at the forefront of AI inference in a novel environment, and your work will infuse cutting edge AI concepts into existing Server platforms and workflows.  

AI has thus far remained in the cloud, and you will translate those cloud-connected ideas to air-gapped, on-premises and hybrid environments. You will work at the intersection of AI models, agents, identity, and management surfaces on our most hardened OS platform. Experience or demonstrated interest in operating system fundamentals is a plus; experience with existing AI inference toolchains is valued.  

At Microsoft, our mission—to empower every person and every organization on the planet to achieve more—guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress—people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.



Responsibilities
  • Design and implement how we track usage, policy and efficiency for artificial intelligence capabilities.  
  • Build observability pipelines through telemetry insights, diagnostics, and health signals needed to measure how this on-prem infrastructure is performing. 
  • Define and develop the management layer for AI inference toolchains from model lifecycles and catalogs to language and protocol gateways.  
  • Design and implement validation plans to assess the quality of this infrastructure and evaluate the end to end workflows and life cycle experiences of such a solution. 
  • Coordinate with security and compliance teams to ensure this toolchain meets or exceeds platform release requirements.  


Qualifications

Required Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Preferred Qualifications

  • 5+ years of professional software engineering experience with coding in one or more languages such as C, C++, C#, Java, JavaScript, Python, Rust, or TypeScript, including designing automated tests and validation for the software you ship.
  • Demonstrated knowledge of Server administration and management features.  
  • Familiarity with Server deployment and usage strategies in air-gapped or on-premises environments.
  • Understanding of AI model catalogs, model servers, protocols and inference layers.
  • Familiarity with the current state of the art around observability and diagnostics.
  • Experience with systems software development, deep systems architecture, driver development, and code architecture/design for complex software systems.

#W+DJOBS



Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

  • Role Senior Software Engineer
  • Experience 5-7 years
  • Education Bachelor Degree, or equivalent experience
  • Salary 120K - 235K Yearly
  • Work type Hybrid
  • Location United States
Check my match (free)
Microsoft
Hardware & Semiconductors · 500+ Members · Redmond, WA, United States

Microsoft builds Windows, Azure, Office and the Copilot family of AI assistants, and operates one of the largest AI training and inference fleets in the world. Microsoft Research and the AI platform teams work across foundation models, systems for large-scale training, and applied ML in every product line.

Founded in 1975 and headquartered in Redmond, Washington, the company is also OpenAI's principal compute partner and ships AI tooling for developers through GitHub, VS Code and Azure AI.

All jobs at Microsoft
Job Overview
Salary
120K - 235K Yearly
Eligibility
United States Right to work in the United States required.
Workplace
Hybrid
Job Posted:
1 day ago
Job Type
Full Time
Education
Bachelor Degree, or equivalent experience
Experience
5-7 years

Share This Job: