Senior Product Manager, Multilingual AI and Evals

Multilingual AI Quality Evaluation

• Enhance the quality gate of the agentic pipeline — the evaluation agent that decides whether a translation is good enough to auto-publish.
• Own the trade-off between automation coverage and risk across content tiers. When the gate gets something wrong systematically rather than as a one-off, diagnose the root cause and drive the fix back into the agent.

AI Driven Localization Testing

• Build an AI-driven product testing tool that automatically detects localization defects that translation review cannot catch — truncation, layout breakage, hardcoded strings, unlocalized images, wrong number/date/currency formats.
• Ship the MVP that scans mobile/web apps to accelerate localization auditing, then drive the long-term vision of integrating localization tests into internal product testing infrastructure, so they run automatically before features go live.

Evaluation & Annotation Infrastructure

• Build the backbone that makes quality measurable and improvable: golden datasets, annotation tooling with error classification, automated evaluation, a metrics/dashboard layer, and the feedback loop that turns human evaluations into agent fine-tuning.
• Own annotation workflow integration so linguists can annotate in a standardized, real-time way.

• Localization/translation domain background — terminology & glossary management, TMS tools (Phrase, Smartling), internationalization (ICU/CLDR)
• Bilingual or multilingual (Chinese and/or European languages)
• Crypto, fintech, or other high-compliance / regulated domain experience