New

Software Engineer II, AI Data Platform (CoreAI)

Microsoft
$100,600.00 - $199,000.00 / yr
United States, Washington, Redmond
Jan 14, 2026
Overview TheGenAI Infrastructure and Solutionsteamis building large-scale GenAI training infrastructure,LLM-basedsolutionsand tools.We providethe infrastructure for teams inCoreAIand other Microsoft Groupstofine-tune LLMsandserveagenticworkloadfor their own scenarios. As a Software EngineerII,you will workon the infrastructureand toolsto supportlarge scale model fine-tuning,evaluation, and inference. Microsoft's mission is to empower every person and every organization on the planet to achieve more. Asemployeeswe come together with a growth mindset, innovate to empower others, and collaborate to realizeour shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positivelyimpactour culture every day. Responsibilities As a team member of our team, you willparticipatein developing innovative solutions acrossAIPlatform. Responsibilities include the following. Collaborate with senior engineers and researchers to build andoptimizetraininginfrastructure and toolsfor LLMs, SLMs, multimodal, and code-specific models. Design, build and improvethe serviceswith high scalability and reliability. Contribute to the deployment and monitoring ofservicesin production environments. Participate intheefforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Requirements: Abilityto meet Microsoft, customer and/or government security screening requirementsarerequiredfor this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will berequiredto pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Preferred Qualifications: 2+ years of software development experience in C#, C++, Python, or similar languages. 1+yearof experience with containerization tools (e.g., Docker, Kubernetes). Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring. 2+ years designing, developing, and shipping high quality software. 1+ years of experience with distributed systems and cloud-based infrastructure. 1+ year of experience with DevOps practices (CI/CD, automated testing, deployment, etc.). Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.