Experian-posted 3 days ago
Full-time • Senior
Madison, MS
Craft a resume that recruiters will want to see with Teal's resume Matching Mode

We are looking for an experienced Senior Software Engineer with expertise in AWS and Big Data technologies. You will have a track record in designing, developing, and implementing scalable software solutions using AWS cloud services and Big Data platforms.

  • Design, develop, and deploy scalable software solutions on AWS cloud infrastructure.
  • Collaborate with teams to gather requirements, define architecture, and implement solutions.
  • Use AWS services such as EC2, S3, Lambda, API Gateway, DynamoDB, RDS, EMR, to build reliable distributed applications.
  • Develop data processing pipelines using Big Data technologies like Hadoop, Spark, Kafka, and Hive.
  • Develop Batch applications using Spark, Scala, or PySpark.
  • Optimize performance of data processing applications that are running on Athena, Presto and Spark frameworks.
  • Design, develop, and maintain complex data pipelines and workflows using Apache Airflow.
  • Configure and manage Airflow environments, including scheduling, monitoring, and troubleshooting workflow execution.
  • Implement monitoring, logging, and alerting solutions to ensure system reliability and availability.
  • Develop custom operators and sensors to extend Airflow functionality and support specific use cases.
  • Conduct code reviews, provide technical guidance, and mentor junior team members.
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 5+ years experience developing cloud-based applications.
  • Experience with AWS services and infrastructure, including compute, storage, networking, security, and serverless computing.
  • Proficiency in programming languages such as Java, Python, or Scala, and familiarity with modern software development practices and tools.
  • Understanding of Big Data concepts, technologies, and architectures, with practical experience building Batch and Streaming applications.
  • Experience with Big Data frameworks like Hadoop, Spark, Kafka and Athena, and related tools such as Hive, HBase, and Presto.
  • Great compensation package and bonus plan
  • Core benefits including medical, dental, vision, and matching 401K
  • Flexible work environment, ability to work remote, hybrid or in-office
  • Flexible time off including volunteer time off, vacation, sick and 12-paid holidays
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service