Senior Software Engineer, ML System Evaluation Engineering
Cupertino, California, United States
Machine Learning and AI
Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something!
As part of Apple Intelligence, this team is at the forefront of the next revolution in machine learning and Generative AI. We are dedicated to creating groundbreaking conversational assistant technologies for both large-scale systems and new client devices, building upon our legacy of intelligent assistant solutions that already assist millions of users worldwide. Does the opportunity to play a part in building groundbreaking technology for large-scale systems, natural language and artificial intelligence excite you? Do you want to expand the experience of Siri and other AIML products to new products that will help millions get things done, across the globe? Join the ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AIML products, that will delight and inspire millions of people!
Description
We are looking for a talented and motivated Software Developer to join our Data and Privacy MLSEE team. In this role, you will design, build, and maintain automation environments to evaluate the instrumentation of our AI assistant products at scale with a focus on user privacy.
You will create tools and frameworks for instrumentation and privacy evaluation, ensuring that our AI products meet their privacy promises and are instrumented for trustworthy measurement. Your work will involve collaborating closely with our engineering team to provide evaluation methodologies and automation frameworks within a micro-services architecture.
We are seeking someone with a strong background in software development, a passion for quality, and an interest in creating scalable evaluation systems. If you feel this is you, we'd love to hear from you!
Minimum Qualifications
- 7+ years of experience designing, implementing, and optimizing large-scale data and compute-intensive frameworks, APIs, services, and tools.
- Strong skills in system design, development, testing, debugging, release, and maintenance.
- Proficient in Swift, with Python experience being highly valued.
- Deep understanding of automated software testing methodologies, including integration testing, component mocking, and dependency injection.
Key Qualifications
Preferred Qualifications
- Strong attention to detail and the proven ability to delve into data, uncover hidden patterns, and conduct comprehensive error/deviation analysis.
- Experience building and deploying applications with Kubernetes.
- Knowledge of statistics-based evaluation approaches, ML training pipelines, and techniques for enhancing the accuracy of ML systems.
- Excellent communication and leadership skills. You thrive in a collaborative team environment, are a strong problem solver, critical thinker, and self-starter.
- BS/MS in Computer Science, Engineering, or a related field.
Education & Experience
Additional Requirements
Pay & Benefits
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.