Director of Product
Braintrust is the agent observability platform. By actively applying intelligence to agent traces and automatically surfacing the most critical patterns, Braintrust gives teams the visibility to understand how agents behave in production and the tools to improve them.
Teams at Notion, Stripe, Box, OpenAI, and Cloudflare use Braintrust to trace their agents, find the issues in their observability data, and run evals that tell them how to improve.
We're looking for a product engineer who is passionate about building tools that users love and use every day. You'll work on the core product, hang out with users (developers, product managers, and designers working in AI), and play a key role in shaping the roadmap.
Under the hood, Braintrust is a high performance, local-first, visualization-heavy UI built with modern Typescript and React. Our users work at some of the world's best technology companies and expect our product to be lightning fast, reliable, and intuitive.
Core responsibilities:
Ensuring our customers always have a frictionless experience for enabling AI observability in their systems.
Contribute to foundation UI architecture that focuses on performance and efficient data loading patterns.
Build the user-facing pieces of Braintrust, such as:
A first-class prompt playground experience supporting multiple models across thousands of user inputs.
A system for prompt management, configuration, and versioned comparisons.
A fully multiplayer, scalable human review system.
LLM output analysis and comparison across arbitrarily large datasets.
Expert-level understanding of Typescript, React, HTML, CSS, SQL, NextJS
Previous experience founding or working at startups is a plus
Has written prompts / tinkered with GPT models and apps
Medical, dental, and vision insurance
Daily lunch, snacks, and beverages
Flexible time off
Competitive salary and equity
Wifi & cellphone stipend
Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
Sign in and we will show how your role, experience, salary and location line up against what this employer asked for.
Check my match
Braintrust provides observability and evaluation software for teams building AI agents and applications. It captures production traces, helps developers inspect agent behavior, organizes datasets and experiments, and measures changes to prompts, models, and application logic. The platform connects live observability with repeatable evaluation, allowing teams to turn production failures and recurring patterns into tests. Braintrust is used to compare models, detect regressions, understand quality and latency, and improve AI systems through an evidence-based development loop.
181K – 261K
Our estimate — this employer did not publish a salaryOur estimate, not the employer’s. Worked out from the middle half of 18 comparable roles on Neural Jobs that did publish a salary, in the same field, country and experience band. The real figure for this job may be different.
United States
Right to work in the United States required.On-site
Search by role, company, or anything a posting mentions.
