General Motorsposted 2 days ago
$134,000 - $219,400/Yr
Full-time • Senior
Austin, TX

About the position

The GM Energy Data Engineering team is on the lookout for a talented Senior Software Engineer with a strong track record in building large-scale data streaming platforms. The ideal candidate will play a key role in developing and maintaining systems that support high-throughput data streams, data curation, storage and file system architectures, data security and governance, as well as real-time inferencing and AI-driven algorithms.

Responsibilities

  • Creating and maintaining robust pipelines to collect, process, and store data from various enterprise sources, IoT devices, and sensors.
  • Design and develop a scalable data platform to support growing data volume and complexity.
  • Implementing logic to clean, filter, and transform raw device data into formats suitable for downstream analytics or storage.
  • Maintain and enhance infrastructure for efficient data ingestion, transformation, and delivery.
  • Implement rigorous data validation, governance, and quality assurance to ensure data integrity.
  • Monitoring data flows, handling errors, and implementing retry mechanisms to ensure reliable and accurate data ingestion.
  • Setting up monitoring tools and dashboards to track pipeline health, diagnose issues, and optimize performance.
  • Mentor and support junior engineers through guidance, coaching, and learning opportunities.
  • Stay current with industry trends and best practices in data management, ODS technologies, and API development.

Requirements

  • Bachelor's in Software Engineering, Computer Science, Information Technology, or a related field or equivalent experience.
  • 8+ years software engineering experience, with a focus on data engineering and proficiency in Java frameworks (Spring Boot, Quarkus).
  • Minimum of 5 years of experience with streaming technologies such as Kafka, Spark, etc.
  • Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure - preferred, AWS, GCP).
  • Experience with Databricks and/or Snowflake and/or other cloud-based data platforms required.
  • Experience in Python and PySpark preferred.
  • Strong interpersonal and communication skills and demonstrated working experiences with cross-function product teams.
  • Experience with data visualization tools to effectively communicate insights is preferred.
  • Solid problem-solving skills and the ability to translate business questions into data-driven solutions.
  • Excellent communication skills to present findings and collaborate across teams.
  • Good understanding and experience with CI/CD practices.
  • Ability to prioritize and manage multiple tasks and projects at once without sacrificing quality.
  • Strong problem-solving and analytical skills.
  • Excellent teamwork skills, with a proven ability to collaborate effectively.

Nice-to-haves

  • Snowflake Expertise
  • IoT Data Engineering
  • OCPP Protocol expertise

Benefits

  • Medical, dental, vision insurance
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Employee assistance program
  • GM vehicle discounts
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service