About the position
APPLE INC has the following available in Seattle, Washington. Design and develop reusable libraries and frameworks for common functions using Scala. This includes libraries to perform data transformations, io operations and various other functions. Design and develop Scalable big data pipelines leveraging Airflow to process and analyze large datasets. Schedule, maintain, and monitor production data pipelines and ensure data quality/integrity of data. Work with analysts to gather requirements and translate them into data engineering tasks, e.g. enable support for a new feature within any existing dataset by leveraging new fields and tables. Understand and apply new technologies to optimize projects, e.g. Iceberg, Snowflake and Trino. Each technology enhances and improves the efficiency of the overall platform, e.g. Iceberg is a data storage format which introduces enhanced support for data versioning, time travel and rollback operations. Peer review other engineers work. 40 hours/week. At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $135,400 - $204,000/yr and your base pay will depend on your skills, qualifications, experience, and location.
Responsibilities
- Design and develop reusable libraries and frameworks for common functions using Scala.
- Design and develop scalable big data pipelines leveraging Airflow to process and analyze large datasets.
- Schedule, maintain, and monitor production data pipelines and ensure data quality/integrity of data.
- Work with analysts to gather requirements and translate them into data engineering tasks.
- Understand and apply new technologies to optimize projects, e.g. Iceberg, Snowflake and Trino.
- Peer review other engineers work.
Requirements
- Master’s degree or foreign equivalent in Data Science, Computational Data Science, Computer Science or related field.
- 2 years of experience in the job offered or related occupation.
- 2 years of experience with utilizing Java and Scala to work on multi-language codebases.
- 2 years of experience using Spark and Flink to design, maintain and optimize existing data processing jobs.
- 2 years of experience using SQL and Distributed Relational Databases to analyze and profile data models.
- Experience troubleshooting data discrepancies and performing pipeline optimizations.
- Experience working on cloud infrastructure and with Kubernetes.
- Experience designing and implementing ETL pipelines, leveraging a DAG tool like Airflow or Azkaban.
- Experience using data visualization tools, including Tableau or Superset, to create dashboards for datasets.
- Experience leading and driving partner teams towards successful implementation of the full data solution.
Benefits
- Comprehensive medical and dental coverage.
- Retirement benefits.
- A range of discounted products and free services.
- Reimbursement for certain educational expenses, including tuition.
- Opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs.
- Eligibility for discretionary restricted stock unit awards.
- Ability to purchase Apple stock at a discount through Apple’s Employee Stock Purchase Plan.
- Potential for discretionary bonuses or commission payments.
- Relocation assistance.
