Text
AI Product Analyst - AI Receptionist Team | MEDvidi
#job #vacancy #AI #ProductAnalytics #LLM #AIagents #DataAnalytics #Startup #remote #MEDvidi #telehealth
MEDvidi is a fast-growing US telehealth company building AI-powered systems across patient and operational workflows.
We’re looking for an AI Product Analyst to help us evaluate, monitor, and improve AI agents and LLM-powered workflows running in production.
This role is focused on understanding how AI systems actually behave in real environments - identifying failure patterns, measuring AI quality, and helping teams make product decisions under ambiguity.
What you’ll work on:
- Analytics for AI agents and LLM-powered workflows
- Investigation of hallucinations, inconsistencies, and AI failure modes
- Analysis of logs, conversations, raw outputs, and operational datasets
- AI quality evaluation and monitoring
- Building dashboards and monitoring systems for AI performance
- Measuring AI impact on product, operations, and user experience
- Partnership with Product, Engineering, QA, and Operations teams
What we expect:
- 3+ years in Product / Data / AI Analytics
- Strong Python and SQL skills
- Understanding of LLM limitations, hallucinations, and AI evaluation challenges
- Experience with complex production systems or automation platforms
- Strong analytical and ownership mindset
- Experience with conversational AI or AI agents is a plus
- Fluent Russian and English B2+
- CET-overlapping working hours
Why join MEDvidi:
- Work on real AI systems in production
- High ownership and direct product impact
- Fast-moving startup environment
- Fully remote long-term B2B collaboration
- Health insurance, wellness compensation, paid vacation & sick leave
- Personalized English lessons via Preply
Apply here: https://medvidi.com/careers/co/poland/29.56C/ai-product-data-analyst/all?coref=1.10.s93_B66