Software Engineer I - LLMOps

About the position

Our LLMOps team in Atlanta is dedicated to building and optimizing the infrastructure that powers our advanced AI solutions. We are looking for an individual who will complete advanced end to end engineering tasks by designing, developing, analyzing, configuring, testing, debugging, troubleshooting, documenting, health monitoring and alerting of the systems. You will deliver solutions based on user or system specifications, consulting with users to determine hardware, software or system functional specifications, manage interactions between the systems and other technical support areas, and define technical requirements and coordinate team resources to solve problems.

Responsibilities

• Develop, implement, and maintain scalable and efficient systems for deploying and managing large language models.
• Collaborate with data scientists, software engineers, and other stakeholders to optimize model performance and deployment processes.
• Implement monitoring and logging solutions to ensure the reliability and performance of AI systems.
• Troubleshoot and resolve issues related to model deployment and operations.
• Contribute to the continuous improvement of our LLMOps practices and infrastructure.
• Stay up to date with the latest advancements in AI and machine learning technologies.
• Perform analysis, assessment and resolution for defects and incidents of advanced complexity and escalate appropriately.
• Work independently to tackle well-scoped and loosely scoped problems.
• Seek opportunities to expand technical knowledge and capabilities.
• Perform other duties as assigned.

Requirements

• Bachelor's degree in computer science or a related field.
• Two or more years of professional programming/development experience (Python, AWS, JavaScript, Node.js etc.).
• Hands-on experience with AI infrastructure, including deploying LLM inference servers using Kubernetes.
• Intermediate delivery skills including the ability to estimate accurate timelines for tasks and deliver work at a steady, predictable pace.
• Demonstrated track record of domain expertise including understanding technical concepts necessary to do the job effectively.
• Strong problem solver who ensures solutions are built for the long term.
• Strong communicator who possesses the ability to articulate information clearly and concisely.

Benefits

• Health Insurance: Employees and their eligible family members are eligible for coverage from the first day of employment.
• Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum.
• Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
• Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals.
• Volunteer Encouragement: Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.