Software Engineer — Infrastructure

About the position

We’re on a mission to democratize AI by building the definitive AI data development platform. The AI landscape has gone through incredible change between 2016, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler! As a Software Engineer on the Infrastructure team, you'll accelerate the Snorkel AI team and our customers by improving our developer platform and services for user and data management across the stack. You’ll work closely with other engineers, researchers, and product management to align on the highest leverage improvements for CI/CD, cloud infrastructure, deployment, security, authentication/authorization, and more.

Responsibilities

• Design, build, and maintain services and deployment for Snorkel’s enterprise platforms
• Design, build, and improve observability and alerting for Snorkel’s enterprise platforms
• Contribute to Snorkel’s in-house fleet management software for installation and upgrades of deployments for Snorkel’s enterprise customers
• Build and improve Snorkel’s production and staging infrastructure; own our k8s and cloud strategy
• Work closely with various engineering teams in defining test strategies and build infrastructure to execute the same
• Deploy and optimize CI/CD pipelines across multiple environments and continuously improve development and deployment best practices
• Collaborate with enterprise customers to understand product use cases and translate into engineering specifications, and deliver high-quality solutions
• Participate in on-call responsibilities in rotation with the engineering team
• Work a hybrid schedule with three days per week in our Redwood City HQ or the SF office

Requirements

• Bachelor's degree in Computer Science or related field, or equivalent demonstrated experience
• Strong development and debugging skills in Python
• 3+ years of experience in software development (including academic experience)
• Understanding of Kubernetes ecosystem

Nice-to-haves

• Extremely well versed in building and managing cloud infrastructure for enterprise platforms on (AWS, GCP, Azure) and services like EC2, EKS, VPC etc
• Experience in one or more of the build tools like Bazel, Gradle, Make etc.
• Familiarity in developing and releasing infrastructure software for SaaS products
• Hands on experience in CI/CD and test infrastructure for very large and complex code bases
• Experience with large scale distributed computing systems for ML Training or Serving, eg: Ray, Spark, Tensorflow etc
• Hands-on experience in creating and maintaining metrics and dashboards on observability platforms such as New Relic, DataDog, Chronosphere, or similar tools
• Experience building services and infrastructure for Machine learning and AI Systems

Benefits

• Comprehensive medical, dental, and vision plans for Snorkelers and their families
• Yearly wellness stipend
• 401k program
• Parental leave program allows new parents to take up to 20 weeks of paid time off
• Workstation setup allowance