Software Engineer III - AI/ML Solutions

About the position

This role is focus on AWS Cloud, EKS, ECS, Databricks ML feature development, ML model training, ML model deployment, Gen AI LLM approaches such as RAG and Agent. You will join the AI/ML Platform & Solutions Engineering team within our Consumer & Community Banking (CCB) division. In this role, you will assist our technical partners and data science teams by focusing on traditional AI/ML and Generative AI platform enablement to support line-of-business (LOB) machine learning use cases.

Responsibilities

• Hands on code development to enable our AI/ML platform, ensuring robustness, scalability, and high performance.
• Adopt the best practices in software engineering, machine learning operations (MLOps), and data governance.
• Ensure compliance with data privacy and security regulations relevant to AI/ML solutions.
• Maintain consistent code check-ins every sprint to ensure continuous integration and development.
• Platform engineering to enable the Gen AI platform and develop the Gen AI Use cases, LLM finetuning and multi agent orchestration.
• Communicate technical concepts and solutions effectively across all levels of the organization.

Requirements

• Master's/Bachelor's degree in a STEM field and at least 5 years of experience in designing and managing large-scale AI & ML platforms and supporting systems.
• Extensive practical experience with AWS cloud services, including EKS, EMR, ECS, and DynamoDB.
• Hands-on experience in Databricks ML lifecycle development.
• Advanced knowledge in software engineering, AI/ML, machine learning operations (MLOps), and data governance.

Nice-to-haves

• Understanding of large language model (LLM) approaches, such as Retrieval-Augmented Generation (RAG) and agent-based models, is a plus.
• Real-time model serving experience with Seldon, Ray, or AWS SM is a plus.