APPLE INC has the following available in Cupertino, California and various unanticipated locations throughout the USA. Architect, design and development of test tools, frameworks, automation and services to evaluate the machine learned user experience across all Apple hardware supporting Siri virtual assistant. Lead the qualification of Siri's perception software and machine learning models by developing evaluation tools, infrastructure and methodologies for current and future Apple hardware platforms, collaborating with world class cross functional teams across the company. These include design and development of automation frameworks and methodologies for simulation and evaluation of user experiences for machine learning-based products, evaluation of personalization, and scalability of the frameworks across locales and device types and configuration. Define and track user impact and user success metrics. Participate in Apple's Artificial Intelligence/Machine Learning future products roadmap decisions, contribute insights and recommendations derived from the in-depth understanding of the current success metrics of Artificial Intelligence/Machine Learning products.