Staff Software Engineer, Vector Storage

About the position

The position is a mix of software engineering and cloud engineering; a lot of the time, we are writing software to implement important workflows that automate the operation of our vast production infrastructure. We also work with our product teams to make the underlying Storage technologies work better for Reddit’s main workloads, including defining and improving the application’s data models and data access patterns, and lots of times, this also involves data-driven analysis and tuning of the Storage stack to make step function improvements to the end-to-end data path. There is a substantial amount of troubleshooting and analysis to understand the real problems we face as we scale, and our customer’s workloads change.

Responsibilities

• Design and implement reliable, efficient workflows to automate a wide range of operational tasks critical to managing Reddit’s core storage infrastructure.
• Design, write, and deliver software to improve the availability, scalability, latency, and efficiency of Reddit’s products in Go, C++ and sometimes Python.
• Contribute to the design and implementation of a high-performance, large-scale distributed vector store to power search and machine learning applications.
• Collaborate closely with engineering teams and stakeholders to integrate vector storage capabilities into broader storage infrastructure and use cases across Reddit.
• Mentor and guide other engineers on how to design, build and evangelize vector storage services across Reddit.

Requirements

• 7+ years of experience building internet-scale software, preferably with a focus on machine learning storage infrastructure.
• Software development experience in one or more general purpose programming languages; Golang, Python, C++, Java.
• Prior experience with Vector storage technologies is a huge plus (Milvus, Pinecone, OpenSearch, ElasticSearch, Weaviate, Pgvector).
• Prior experience with operating a large scale critical infrastructure system with a focus on automation and workflow development is a plus, especially in a role where they were required to be on call.
• Excellent communication skills to collaborate with a service-oriented team and company.

Benefits

• Comprehensive Healthcare Benefits and Income Replacement Programs
• 401k Match
• Family Planning Support
• Gender-Affirming Care
• Mental Health & Coaching Benefits
• Flexible Vacation & Reddit Global Days off
• Generous paid Parental Leave
• Paid Volunteer time off