Staff Software Engineer, Observability

About the position

We are seeking a highly skilled and experienced Staff Software Engineer to join our Observability Engineering team to design and enhance our observability tooling, enabling engineers to understand application behavior effectively. In this role, you will shape the direction and architecture of our observability platform, focusing on developer enablement, best practices, and system reliability. You will also be responsible for developing infrastructure as code solutions and managing data pipelines to ensure seamless data collection and processing. If you are a seasoned engineer who excels at the intersection of software development and infrastructure, we encourage you to apply.

Responsibilities

• Design, write, and maintain software that enables developers to efficiently interact with our observability platform.
• Work closely with cross-functional teams to understand requirements and design solutions that are intuitive, efficient, scalable, and reliable.
• Provide technical leadership for the Observability team to design and implement strategies for improving observability standards, optimizing costs, and enabling product teams.
• Lead the development of software solutions to enable engineers to seamlessly use metrics, monitors, traces and logs.
• Identify opportunities for automation and process improvement to enhance developer productivity.
• Collaborate with engineers and vendors to integrate solutions seamlessly into cloud environments.
• Conduct code reviews and provide constructive feedback to other team members.
• Stay up-to-date with the latest trends and technologies in observability and software engineering.

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.
• 7+ years of software development experience.
• Expertise in enterprise observability best practices and curating monitoring and logging tools at scale (Datadog, Elastic, Splunk, etc).
• Familiarity with continuous integration/continuous deployment (CI/CD) pipelines and related tools (e.g. ArgoCD, Jenkins, Gitlab CI/CD).
• Proficiency in programming languages such as Python, Java or similar.
• Strong experience with infrastructure as code (IaC) tools and practices (e.g. Terraform).
• Demonstrated ability to tackle complex technical challenges and deliver innovative solutions that align with business goals.
• Ability to influence and drive technical strategy within a team and across departments.
• Experience leading large-scale projects with significant impact.
• Excellent verbal and written communication skills, with the ability to convey complex technical concepts to a variety of audiences.

Nice-to-haves

• Experience developing observability automation.
• Familiarity with LLM observability tools, techniques, and methodologies.
• Experience with Open Telemetry and Open Telemetry collectors.
• Experience with security and compliance in cloud environments.

Benefits

• Base pay range: $153,600.00 - $264,000.00
• Eligible for a bonus and long-term incentives.
• Comprehensive and competitive benefits.