logo

AI Job Summary

Build and refine evaluations to measure generative AI model performance across diverse workloads, then drive quality improvements through systematic testing. You'll develop modular solutions integrated across Google product areas while collaborating with engineers, product managers, and data scientists. Requires a bachelor's degree in computer science, machine learning, or related field, three years of Python or C++ software development, and experience with ML frameworks like PyTorch, TensorFlow, or JAX plus model evaluation work.

Written from this posting by Neural Jobs AI. The full description is below.

AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

  • Build rigorous evaluations to systematically measure model performance across various workloads and drive continuous quality hillclimbing.
  • Develop modular, adaptable solutions that enable seamless integration across multiple Google product areas.
  • Collaborate cross-functionally with Eng, PM, and Data Science partners to translate product requirements and feedback into model quality improvements.

Minimum qualifications:

  • Bachelor's degree in Computer Science, Machine Learning, a related technical field, or equivalent practical experience.
  • 3 years of experience with software development in Python or C++.
  • Experience with ML frameworks (e.g., PyTorch, TensorFlow, JAX), crafting model evaluations and hillclimbing model performance.

Preferred qualifications:

  • Advanced degree (Master's or PhD) in Machine Learning, Computer Science, or a related technical field.
  • 2 years of experience designing benchmark suites and advancing model quality.
  • Experience with Large Language Model (LLM) orchestration, routing, or multi-agent workflows.
  • Strong cross-functional leadership and communication skills to effectively work across engineering, research, and product teams.
  • Bachelor's degree in Computer Science, Machine Learning, a related technical field, or equivalent practical experience.
  • 3 years of experience with software development in Python or C++.
  • Experience with ML frameworks (e.g., PyTorch, TensorFlow, JAX), crafting model evaluations and hillclimbing model performance.
Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

  • Role Research Engineer, GenAI, Info Task, DeepMind
  • Experience 3-4 years
  • Education Any
  • Work type On-site
  • Location United States
Check my match (free)
Google
AI Research Lab · 500+ Members · Mountain View, CA, United States

Google builds internet, software, cloud, and AI products used by consumers, developers, and organizations. Its portfolio includes Search, YouTube, Android, Chrome, Maps, Gmail, Workspace, Google Cloud, advertising platforms, devices, and Gemini AI products. The company develops large-scale computing infrastructure and research that power information retrieval, communication, productivity, media, navigation, and machine learning. Google is the largest operating business within Alphabet and earns a substantial share of its revenue from digital advertising.

All jobs at Google
Job Overview

Approx. salary range

263K – 393K

Our estimate — this employer did not publish a salary

Our estimate, not the employer’s. Worked out from the middle half of 93 comparable roles on Neural Jobs that did publish a salary, in the same field, country and experience band. The real figure for this job may be different.

Eligibility
United States Right to work in the United States required.
Workplace
On-site
Job Posted:
3 days ago
Job Type
Full Time
Education
Any
Experience
3-4 years

Share This Job: