About the position
This role will be responsible for creating and scaling the AI Feedback & Optimization Platform that powers continuous learning and improvement of our AI Agents. This leader will lead product strategy & vision for the AI Assistant Conversation Sampling, Annotation, and Labeling Tooling shaping how we capture high-quality data signals to train and refine our AI agents and build Observability, Feedback, and Optimization Systems.
Responsibilities
- Inputs to product strategy with cross-functional stakeholders consistent with the shared vision for the product.
- Implements the architectural roadmap that balances innovative design and technical implementation, while balancing regulatory requirements, time-to-market, meeting customer needs and product profitability.
- Controls for the customer experience and customer needs in product requirements and as an input to decision making.
- Monitors metrics that inform the success of products including usability studies, research and market analysis.
- Manages one or more workstreams to include analytics, customer discovery, market research and competitive analysis to drive data-driven decision-making.
- Monitors product profitability measures, including budget.
- Participates in operational mechanisms that drive execution and accountability including Product Reviews, Operating Reviews, and Business Reviews.
- Interfaces with product leadership as needed.
- Partners with content developers, data scientists, product designers and user experience researchers.
Requirements
- Minimum of 8 years of relevant work experience and a Bachelor's degree or equivalent experience.
Nice-to-haves
- Experience with human-in-the-loop ML, labeling strategies, annotation pipelines, or quality assurance for AI systems.
- Familiarity with Performance Measurement & observability tools (e.g., metrics dashboards, tracing) and ML Ops platforms.
- Passion for AI/LLMs, agentic applications, and building ethical, transparent systems.
- Prior experience working in Tech, Fintech, or high-trust domains a plus.
Benefits
- Flexible work environment
- Employee shares options
- Health and life insurance
- Annual performance bonus
- Equity
