material bankposted 16 days ago
Full-time • Mid Level
Hybrid • New York, NY
Furniture, Home Furnishings, Electronics, and Appliance Retailers

About the position

Material Bank is a fast-paced, high-growth technology company and created the world's largest material marketplace for the Architecture and Design industry, providing the fastest and most powerful way to start and manage a design project. Learn more about us at www.materialbank.com or see below.

Responsibilities

  • Design and architect robust data integration pipelines and APIs, ensuring high reliability and performance at scale, with a focus on both stream and batch processing.
  • Take ownership of end-to-end integration workflows and serve as the subject matter expert on data integration jobs, with a continuous focus on improving reliability and operational efficiency.
  • Analyze and understand existing integration workflows, including their upstream data sources and downstream dependencies.
  • Develop and maintain a comprehensive monitoring framework to track the health and performance of integration jobs.
  • Collaborate with business users to gather requirements and understand how they interact with the data platform, ensuring the delivery of high-quality, reliable solutions.
  • Stay up to date with emerging technologies and proactively upskill in data frameworks and tools aligned with evolving organizational needs.

Requirements

  • 5+ years of experience in data engineering, software engineering, or integration engineering, with a strong focus on building APIs and data pipelines (batch and stream).
  • Strong proficiency in at least two of the following programming languages: Go, Java, and Python.
  • Experience with orchestration frameworks such as Apache Airflow for managing and monitoring complex data workflows.
  • Hands-on experience building streaming data integration jobs using Kafka, including Kafka Connect, Kafka Streams, and ksqlDB.
  • Experience in building and maintaining REST APIs.
  • Proficiency in SQL and working knowledge of relational and cloud-based data warehouses.
  • Familiarity with containerization technologies such as Docker and Kubernetes for deploying and scaling workloads.

Nice-to-haves

  • Experience working with cloud platforms, particularly AWS.
  • Experience developing integration jobs using Talend.
  • Familiarity with ELT workflows using dbt (Data Build Tool).
  • Knowledge of dimensional data modeling and medallion architecture.

Benefits

  • Generous PTO, Sick Days, Paid National Holidays, and even more.
  • Health Benefits: Contribution to medical, dental, vision and short-term/long-term disability plans.
  • 401(k) eligible after your first 90 days employed.
  • Time off to give back to the community through sponsored events.
  • Flexible Work Schedules with a hybrid working model.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service