ADHYA
DAGAR
San Francisco, CA
Experienced Product Manager specializing in AI/ML model evaluation and generative AI. Proven ability to design and implement evaluation systems, drive product development strategies, and foster cross-functional collaboration. Adept at transforming research into usable and reliable products, with a focus on building the foundation for the agent-driven economy.
Scroll to explore
Experience
My professional journey and the amazing teams I've been part of
Product Manager, Model Evaluations, Adobe Firefly
Adobe
Sep 2025 — PresentCurrent
Leading Firefly Enterprise Evaluations - Built human and automated evaluation systems for image, video, and audio generation models across video reframe, vectorization, image and video editing, and custom LoRAs models.
Partnered with creative professionals and enterprise customers to define production-quality standards, translating expectations into measurable rubrics determining model readiness and launch decisions.
Driving cultural transformation toward evaluation-driven product development – training PMs, standardizing eval study templates, launching enablement playbooks and embedded quality gates across Adobe’s generative AI workflows.
Scaling Agentic Evaluation & Improvement – Built evaluation frameworks and test harnesses to assess and improve agentic capabilities across multimodal workflows.
Built human and automated evaluation systems for image, video, and audio generation models.
Defined production-quality standards in partnership with creative professionals and enterprise customers.
Launched enablement playbooks and embedded quality gates across Adobe’s generative AI workflows.
Built evaluation frameworks and test harnesses to assess and improve agentic capabilities.
Product Manager (Research & Evaluations), Pareto.AI
Pareto.AI
Mar 2024 — Aug 2025
Designed and deployed agent evaluation infrastructure creating programmatically verifiable RL environments across 15+ professional domains (e.g., Data Science, Healthcare Operations, Finance) and 10+ OSS tools (e.g., OpenEMR, SuiteCRM, Metabase) to evaluate multi-step agent workflows, tool use, and complex reasoning, leading 20-member team to establish new standards for real-world agent performance assessment.
Designed a comprehensive legal eval framework from proof of concept to deployment, alongside legal domain experts, strengthening frontier model legal reasoning across contract review, regulatory analysis, and case law.
Built an automated data quality engine with a comprehensive evaluation taxonomy including LLM judges (instruction following, complexity), statistical checks (preference distribution, semantic similarity), and fraud detection reducing manual QA from 100% to 20%.
Drove new frontier lab partnerships by researching emerging evaluation needs, scoping pilots, and designing 10+ tailored proposals that converted into long-term collaborations and revenue growth for Pareto.
Designed and deployed agent evaluation infrastructure across 15+ professional domains and 10+ OSS tools.
Led a 20-member team to establish new standards for real-world agent performance assessment.
Designed and deployed a comprehensive legal evaluation framework.
Built an automated data quality engine, reducing manual QA from 100% to 20%.
Secured 10+ tailored proposals that converted into lon...
?token=pk_cbQTqhuzT2OyDtYy16C0LA){kind=logo}
Product Manager
BitClass (Live cohort-based learning app)
Jan 2022 — May 2022
Drove 170% user acquisition growth from 78K to 210K monthly registrations through quick-checkout system that streamlined purchase flows, while launching short-form video content feature repurposed from recorded live sessions that boosted user retention by 60% across 1.3M user base.
Optimized user experience through data-driven redesign using A/B testing and conversion funnel analysis to improve course discovery, home screen navigation, and checkout flows, delivering measurable increases in user engagement and purchase conversion rates.
Drove 170% user acquisition growth.
Boosted user retention by 60% across 1.3M user base.
Launched short-form video content feature.
Optimized user experience through data-driven redesign.
Delivered measurable increases in user engagement and purchase conversion rates.
Education
Where I built the foundation of my expertise
Carnegie Mellon University
Master of Science in Artificial Intelligence and Innovation
Class of 2024
Vellore Institute of Technology
Bachelor of Technology in Computer Science Engineering
Class of 2020
Links
No links provided