logo

AI Job Summary

Design and implement evaluation frameworks, task definitions, and data collection protocols to measure robot capabilities across real-world scenarios. You'll develop teleoperation workflows, analyze performance gaps, and build the infrastructure connecting evaluation and learning systems. The role requires 3+ years in ML/CS with a PhD or Master's plus 4+ years experience, proficiency in Python, C++, or Java, and background in algorithms, optimization, or high-performance computing. Based in New York, the position offers $172,400–$223,400 annually.

Written from this posting by Neural Jobs AI. The full description is below.

AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance.
You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection.
The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems.

Key job responsibilities
- Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios
- Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies
- Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs
- Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection
- Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection
- Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack
- Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches
- Lead technical projects from conception through production deployment
- Mentor junior scientists and engineers

About the team
Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces.
We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products.
Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful.
At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build.
If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.

Basic qualifications

- 3+ years of building models for business application experience
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

Preferred qualifications

- Experience using Unix/Linux
- Experience in professional software development

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.



USA, NY, New York - 172,400.00 - 223,400.00 USD annually
Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

  • Role Applied Scientist, Fauna
  • Experience 3-4 years
  • Education Any
  • Work type On-site
  • Location United States
Check my match (free)
Amazon
Consumer Apps & Media · 500+ Members · Seattle, WA, United States

Amazon operates a broad portfolio spanning online retail, third-party marketplaces, logistics, cloud computing, advertising, devices, entertainment, and subscription services. Its consumer businesses include Amazon stores and Prime, while Amazon Web Services provides cloud infrastructure, databases, analytics, and AI services. The company also develops products such as Alexa and Kindle, produces and distributes media, and runs fulfillment and delivery networks. Amazon serves consumers, sellers, developers, enterprises, creators, and public-sector customers through interconnected commerce and technology platforms.

All jobs at Amazon

48 more Applied Scientist roles in New York

Job Overview

Approx. salary range

263K – 393K

Our estimate — this employer did not publish a salary

Our estimate, not the employer’s. Worked out from the middle half of 93 comparable roles on Neural Jobs that did publish a salary, in the same field, country and experience band. The real figure for this job may be different.

Eligibility
United States Right to work in the United States required.
Workplace
On-site
Job Posted:
1 day ago
Job Type
Full Time
Education
Any
Experience
3-4 years

Share This Job: