Software Engineer, Metrics, GenAI Model Evaluation

About the position

The AI Evaluation team is the main line of defense in ensuring customer safety. Working alongside our AI team, you will design metrics that utilize fleet data and run on large inference clusters to help drive key decisions about end-to-end model architecture, data integrity, and exported model performance. Your work will directly impact FSD v12 customers. A strong candidate will have a computer science, ML or robotics engineering background, strong attention to detail, self-driven attitude, and passion to make an impact.

Responsibilities

• Design metrics to evaluate model predictions and vehicle motion across every scenario human drivers will ever encounter
• Create vector space visualizations to help analyze real-time data values for model prediction and perception
• Work with AI researchers to evaluate & compare end-to-end FSD models
• Drive projects from inception to completion and present projects to org leadership

Requirements

• Bachelor's Degree in Computer Science, Physics or Robotics Engineering, or proof of exceptional skills in related field
• Strong Python coding abilities
• Exposure to utilizing NumPy and Pandas for data manipulation

Nice-to-haves

• Experience with computer vision systems
• Experience with ADAS features
• Experience with path-planning
• Experience with real-time embedded systems
• Experience with sensor calibration
• Experience with C++ and/or CAN

Benefits

• Aetna PPO and HSA plans > 2 medical plan options with $0 payroll deduction
• Family-building, fertility, adoption and surrogacy benefits
• Dental (including orthodontic coverage) and vision plans, both have options with a $0 paycheck contribution
• Company Paid (Health Savings Account) HSA Contribution when enrolled in the High Deductible Aetna medical plan with HSA
• Healthcare and Dependent Care Flexible Spending Accounts (FSA)
• 401(k) with employer match, Employee Stock Purchase Plans, and other financial benefits
• Company paid Basic Life, AD&D, short-term and long-term disability insurance
• Employee Assistance Program
• Sick and Vacation time (Flex time for salary positions), and Paid Holidays
• Back-up childcare and parenting support resources
• Voluntary benefits to include: critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insurance
• Weight Loss and Tobacco Cessation Programs
• Tesla Babies program
• Commuter benefits
• Employee discounts and perks program