Quantitative UX Researcher, Customer Engagement

• Define and measure quantitative UX goals and metrics in collaboration with designers, qualitative researchers, data scientists, engineers and program managers.
• Design and analyze human and synthetic evaluation systems for multi-agent workflows, applying crossed rater/item statistical models to calibrate routing quality and mitigate rater bias.
• Design, analyze, and interpret A/B experiments to measure the impact of product changes on user behavior and key metrics.
• Partner with designers, qualitative researchers, data scientists, engineers, and program managers to define user-centered success metrics and ensure appropriate data instrumentation.
• Translate complex findings into actionable insights and communicate them effectively to cross-functional stakeholders to drive research that improves the user experience.

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 6 years of experience in product research in an applied research setting, or similar.
  
• Experience in programming languages used for data manipulation and computational statistics (e.g., Python, R, MATLAB, C++, Java, or Go).
• Experience applying statistical modeling, including mixed-effects and item response modeling, to behavioral data.
• Experience in experimental design and survey research instrument design for evaluating systems.

Preferred qualifications:

• Master's degree or PhD in Human-Computer Interaction, Cognitive Science, Statistics, Psychology, Anthropology, or related field.
  
• 5 years of experience conducting UX research on products and working with executive leadership (e.g., Director level and above).
  
• 3 years of experience managing projects, and working in a large, matrixed organization.
  
• Experience analyzing user behavior in Business-to-Business (B2B) contexts, enterprise software, Customer Relationship Management (CRM) platforms, or support tooling.
• Experience evaluating multi-agent architectures, agentic workflows, orchestrators, or subagent routing systems.

• Bachelor's degree or equivalent practical experience.
• 6 years of experience in product research in an applied research setting, or similar.
  
• Experience in programming languages used for data manipulation and computational statistics (e.g., Python, R, MATLAB, C++, Java, or Go).
• Experience applying statistical modeling, including mixed-effects and item response modeling, to behavioral data.
• Experience in experimental design and survey research instrument design for evaluating systems.