Senior UX Quantitative Researcher, Agentic AI

• Define, plan, and conduct quantitative research to evaluate user behavior on platforms, and Independently define, plan, and conduct quantitative research to evaluate user behavior on CE platforms.
  
• Apply statistical methods (e.g., statistical inference, regression modeling, experimental design) to analyze large-scale log data, survey data, and other behavioral data.
• Partner with product managers, engineers, and designers to identify research opportunities, define user-centered success metrics, and ensure appropriate data instrumentation.
• Evaluate, analyze, and interpret A/B experiments to measure the impact of product changes on user behavior and key metrics.
• Develop and analyze human and synthetic evaluation systems, applying crossed rater/item statistical models and Bradley-Terry preference frameworks to calibrate agent routing quality.

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 6 years of experience in product research in an applied research setting.
• Experience in programming languages used for data manipulation and computational statistics (e.g., Python, R, MATLAB, C++, Java, or Go).
• Experience applying statistical methods (e.g., significance testing, regression, experimental design) to behavioral data.
• Experience designing and executing human evaluation frameworks (crowdsourced raters, domain experts) and auditing or validating automated rating systems.

Preferred qualifications:

• Master's degree or PhD in Human-Computer Interaction, Cognitive Science, Statistics, Psychology, Anthropology, or related field.
• 5 years of experience conducting UX research on products and working with executive leadership.
• 3 years of experience managing projects, and working in a large, matrixed organization.
• Experience analyzing user behavior in B2B contexts, enterprise software, CRM platforms, or support tooling, and evaluating multi-agent architectures or workflows, built on Experience analyzing user behavior in B2B contexts, enterprise software, CRM platforms, or support tooling.
• Direct experience evaluating multi-agent architectures, agentic workflows, orchestrators, or complex subagent routing systems.

• Bachelor's degree or equivalent practical experience.
• 6 years of experience in product research in an applied research setting.
• Experience in programming languages used for data manipulation and computational statistics (e.g., Python, R, MATLAB, C++, Java, or Go).
• Experience applying statistical methods (e.g., significance testing, regression, experimental design) to behavioral data.
• Experience designing and executing human evaluation frameworks (crowdsourced raters, domain experts) and auditing or validating automated rating systems.