Software Engineer I - LLMOps

Company: The Travelers Companies, Inc.
Location: Atlanta
Posted on: May 24, 2025

Job Description:

Who Are We?

The full job description covers all associated skills, previous experience, and any qualifications that applicants are expected to have.

Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 160 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you do and where you do it.

Compensation Overview

The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive awards.

Salary Range

$96,400.00 - $159,100.00

Target Openings

1

What Is the Opportunity?

Our LLMOps team in Atlanta is dedicated to building and optimizing the infrastructure that powers our advanced AI solutions. We are looking for an individual who will complete advanced end to end engineering tasks by designing, developing, analyzing, configuring, testing, debugging, troubleshooting, documenting, health monitoring and alerting of the systems. You will deliver solutions based on user or system specifications, consulting with users to determine hardware, software or system functional specifications, manage interactions between the systems and other technical support areas, and define technical requirements and coordinate team resources to solve problems.

What Will You Do?

Develop, implement, and maintain scalable and efficient systems for deploying and managing large language models.
Collaborate with data scientists, software engineers, and other stakeholders to optimize model performance and deployment processes.
Implement monitoring and logging solutions to ensure the reliability and performance of AI systems.
Troubleshoot and resolve issues related to model deployment and operations.
Contribute to the continuous improvement of our LLMOps practices and infrastructure.
Stay up to date with the latest advancements in AI and machine learning technologies.
Perform analysis, assessment and resolution for defects and incidents of advanced complexity and escalate appropriately.
Work independently to tackle well-scoped and loosely scoped problems.
Seek opportunities to expand technical knowledge and capabilities.
Perform other duties as assigned.

What Will Our Ideal Candidate Have?

Bachelor's degree in computer science or a related field.
Two or more years of professional programming/development experience (Python, AWS, JavaScript, Node.js etc.).
Hands-on experience with AI infrastructure, including deploying LLM inference servers using Kubernetes.
Delivery - Intermediate delivery skills including the ability to estimate accurate timelines for tasks and deliver work at a steady, predictable pace to achieve commitments, contribute to the software design strategy and methodologies used to best meet the system requirements, consider and build for many different use cases, avoid over engineering, and ensure automation, deliver complete solutions but release them in small batches, and identify important tradeoffs and negotiate them.
Domain Expertise - Demonstrated track record of domain expertise including understanding technical concepts necessary to do the job effectively and aware of industry trends, demonstrate willingness, cooperation, and concern for business issues and priorities, and possess in depth knowledge of immediate systems worked on and some knowledge of adjacent systems.
Problem Solving - Strong problem solver who ensures solutions are built for the long term, can resolve new issues, recognizes mistakes using them as learning and teaching opportunities and consistently breaks down large problems into smaller, more manageable ones.
Communication - Strong communicator who possesses the ability to articulate information clearly and concisely with the business, document work in a clear, easy to follow manner, collaborate well with team members, take in vague requirements and ask the right questions to ensure clarification, offer feedback appropriately and effectively, seek out and receives constructive criticism well, listen when others are speaking and make space for colleagues to share their thoughts.

What is a Must Have?

Bachelor's degree or its equivalent in work experience.
One year of programming/development experience.

What Is in It for You?

Health Insurance: Employees and their eligible family members - including spouses, domestic partners, and children - are eligible for coverage from the first day of employment.
Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum. If you have student loan debt, you can enroll in the Paying it Forward Savings Program. When you make a payment toward your student loan, Travelers will make an annual contribution into your 401(k) account. You are also eligible for a Pension Plan that is 100% funded by Travelers.
Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals and caregiving needs. In addition, our mental health program provides access to free professional counseling services, health coaching and other resources to support your daily life needs.
Volunteer Encouragement: We have a deep commitment to the communities we serve and encourage our employees to get involved. Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.

Employment Practices

Travelers is an equal opportunity employer. We value the unique abilities and talents each individual brings to our organization and recognize that we benefit in numerous ways from our differences.

In accordance with local law, candidates seeking employment in Colorado are not required to disclose dates of attendance at or graduation from educational institutions.

If you are a candidate and have specific questions regarding the physical requirements of this role, please send us an email so we may assist you.

Travelers reserves the right to fill this position at a level above or below the level included in this posting.

To learn more about our comprehensive benefit programs please visit http://careers.travelers.com/life-at-travelers/benefits/.

0

Keywords: The Travelers Companies, Inc., Macon , Software Engineer I - LLMOps, IT / Software / Systems , Atlanta, Georgia