AI/ML Data Infrastructure Engineer, Machine Learning Platform & Technology

Apple, Inc.
Washington, DC
Sep 28, 2022
Sep 30, 2022
Engineer, IT, QA Engineer
Full Time
Summary Posted: Sep 8, 2022 Role Number: 200384124 The Data Infrastructure team within the Machine Learning Platform and Technologies organization powers analytics, experimentation and ML feature engineering to power the Siri we all love in our Apple devices. The mission of the Data Infrastructure org is to provide our engineers and data scientists a cutting edge, reliable and easy to use infrastructure for ingesting, storing, processing and interacting with data and ultimately help the teams that build data intensive applications be successful. You will work with many cross functional teams and lead the planning, execution and success of technical projects with the ultimate purpose of improving the Siri experience for Apple customers. We are looking for engineers who want to bring their passion for infrastructure to build world class infrastructure products. Are you a passionate about building scalable, reliable, maintainable infrastructure and solving data problems at scale? Come join us and be part of the Data Infrastructure journey. Key Qualifications Passionate about Data Processing and Analytics Technologies and building large backend systems 3 years of experience configuring, scaling, and troubleshooting data processing and analytics infrastructure (Druid, Pinot, Airflow, etc) Experience with alerting, monitoring and remediation automation in a large scale distributed environment Programming experience in Java, Python, or similar languages Excellent communication and collaboration skills Experience with AWS and EKS Description You will be responsible for the backend infrastructure that powers the AI / ML Data team's applications and workflows for analytics and machine learning. Our infrastructure supports millions of users at 100 PB scale. To run our environment efficiently, we drive for proper monitoring, alerting, automation and evolution. The teams goal is to ensure the reliability and performance at the highest level and to evolve the platform infrastructure to meet our customers needs. Responsibilities include: - Manage and operate our data infrastructure hosted in AWS - Collaborate across AI/ML teams to analyze and optimize infrastructure for different forms of data needs - Evolve and modify data platform and tools to meet scalability needs - Diagnose, fix, improve, and automate complex issues across the platform to ensure maximum uptime and performance - Establish SLAs for all indexing and search use cases in production - Write code, documentation, participate in code reviews, and mentor other engineers Education & Experience BS, MS, or PhD degree in Computer Science or equivalent experience Additional Requirements