New 
Senior Applied Scientist - Metrics
 Microsoft | |
 United States, Washington, Redmond | |
 Sep 14, 2025 | |
|
OverviewThe CoreAI Speech Group brings together talents in the areas of signal processing, speech modeling, statistical modeling and deep learning to develop and deliver robust, natural and scalable speech technologies, across a rich set of scenarios and languages. Our interdisciplinary team of scientists and developers work on all aspects of end-to-end speech technologies, including model training and evaluation, data collection, infrastructure, and service deployment. We are looking for a Senior Applied Scientist who is passionate about advancing the next generation of speech experiences by developing innovative tools and metrics for comprehensive evaluation of Azure AI services. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positivelyimpactour culture every day.
ResponsibilitiesInnovate and develop novel benchmarking metrics to advance state-of-the-art speech technologies for real world user scenarios. Specifically, you will: Develop metrics highly correlated to human experience for model quality. Develop experimentation systems to assess system performance. Collaborate with engineering team to scale offline and online measurement system. Utilize diverse feedback channels (e.g., A/B testing, flight experiments, and log analysis) to assess the performance and reliability of speech systems in dynamic environments. Stay updated with the latest trends in speech technologies, large language models (LLM), and evaluation techniques, and apply knowledge to ongoing projects. | |