AIML - Data Scientist, Evaluation

Overview

Sunnyvale, California, United States. Machine Learning and AI. Do you get excited by driving product impact via measurement and evaluation for products and services used by hundreds of millions of people globally? Within the evaluation organization, the Data Science and Insights team guides product development, decisions and directions through principled evaluation and rigorous use of data. You will partner with various engineering teams to improve search quality and guide feature development with data, delivering amazing search experiences across iPhone, iPad, HomePod, Mac, Watch, tv, across dozens of languages.

Responsibilities

• Research and develop evaluation methods to improve the quality of Apple user facing products, such as Siri and Apple Intelligence.
• Collaborate with evaluation/experimentation engineering teams to translate methodological developments into technologies that product engineering will use daily.
• Work with large, complex data sets and solve difficult, non-routine analysis problems, applying advanced analytical methods as needed, including prompt engineering and building LLMs as judges.
• Conduct analysis that includes data collection and quality control, requirements specification, processing and presentations.
• Build and prototype analysis pipelines iteratively to provide insights at scale.
• Develop comprehensive knowledge of product data structures and metrics, advocating for changes where needed for product development.
• Partner closely with product engineering teams on core machine learning algorithms and user experience evaluations.
• Demonstrate passion for building outstanding products and engage in a wide variety of skills and innovation.

Minimum Qualifications

• 5 years of relevant work experience. Advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or similar quantitative field.
• Proficiency in data science, machine learning, and analytics, including statistical data analysis. Experience crafting, conducting, analyzing, and interpreting experiments and investigations, especially on data quality, evaluation and risk assessment.
• Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala).
• Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data. Strong communication skills and the ability to naturally explain difficult technical topics (especially causal topics) to everyone from data scientists to engineers to business partners.

Preferred Qualifications

• Proven ability to collaborate effectively across functions and work well within a team.
• Capable of driving projects of varying sizes and scopes - some will take months and some weeks — and you will need to know when to dive deep.
• Worked with methods that address accuracy and variability in human annotation data.
• Ability to learn new technology and skills to accommodate changing working requirements.

Compensation and Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. You’ll also receive benefits including comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. This role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Equal Opportunity

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.