AI Product Data Analyst - Drive AI Impact at MEDvidi

Description At MEDvidi, we are transforming mental healthcare by making it more accessible and affordable across the United States.

Our mission is to remove barriers to mental health support and ensure that everyone can access the care they need.

As our AI initiatives scale, high-quality analytics becomes a critical bottleneck - and this role is designed to solve it.

About the Role We are hiring a Data Analyst to play a key role within the AI product team, ensuring data-driven accuracy in decision-making while evaluating, improving, and scaling AI-powered solutions in production.

This is a highly strategic, fast-paced role focused on measuring the real impact of AI agents and LLM-based systems, turning ambiguous problems and incomplete data into accurate decisions Requirements 3+ years of hands-on experience as a Data Analyst working with product or platform data Strong proficiency in Python for analytical work and ability to independently investigate data on the level of datapoints, build structural analyses, and present results Confident SQL skills with experience working on complex queries Experience building production-grade dashboards in BI tools, preferably in Tableau Clear understanding of how LLM-based systems operate, including their limitations, failure modes, and trade-offs Strong problem-solving and ownership mindset: you take responsibility for analytical outcomes, not just task execution Ability to work in fast-changing, ambiguous environments and quickly learn new AI-related technologies Proven experience linking product quality metrics to business impact and decision-making Fluent Russian; English level B2 or higher Ability to work CET-overlapping hours Nice to Have Experience evaluating or analyzing AI / ML / LLM products Experience with dialog systems or conversational agents Understanding of model quality metrics and evaluation approaches Responsibilities Analyze the performance and impact of AI initiatives already running in production Develop and maintain dashboards that provide transparency into AI agent performance Investigate issues, inconsistencies, and performance drops across automated user journeys Design and implement evaluation approaches to measure system quality and user experience Identify opportunities where automation improves outcomes, as well as areas where it introduces friction Track adoption and effectiveness of automation across the product and support its further evolution Partner closely with Product, Engineering, and QA teams to support data-informed decisions Why Join Us Work on a modern AI product where quality is a strategic function, not a formality Real influence on product direction and engineering practices High-impact work in a product-driven medical tech company Startup environment: fast iteration, high ownership, minimal bureaucracy Competitive compensation and growth opportunities Benefits Health insurance after probation period Sports & wellness compensation Fully remote, long-term B2B collaboration 19 working days of vacation per year 3 additional wellness days per year Paid sick leave for the first 5 working days Gifts to employees for important events Career Development Personalized English lessons via Preply Ready to make an impact? Send us your profile - let’s build something meaningful together.