logo

AI Job Summary

Lead a performance engineering team optimizing Transformer and Mixture-of-Experts inference on accelerators. You'll set technical direction, develop reports, and use hardware profiling and roofline analysis to eliminate bottlenecks across ML frameworks, compilers, kernels, and serving infrastructure. Requires eight years in software development, five years managing teams, and five years in technical leadership roles.

Written from this posting by Neural Jobs AI. The full description is below.

AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

  • Set the technical roadmap for a team of performance engineers, support and develop direct reports and drive prioritization across competing optimization opportunities — staying in the highest-leverage problems.
  • Leverage roofline analysis, hardware-level profiling, and systems analysis to identify and eliminate performance bottlenecks across ML frameworks, compilers, custom kernels, and serving infrastructure on hardware accelerators.
  • Apply a first-principles understanding of Transformer and Mixture-of-Experts model components to identify and prioritize opportunities to optimize their execution efficiency and memory footprint.
  • Collaborate with research teams early in the development lifecycle to evaluate inference implications, modeling how architectural choices impact latency, memory footprint, and serving costs.
  • Guide and contribute to the development of custom kernels and serving optimizations. Conduct deep performance profiling using hardware tracing tools to analyze accelerator utilization, memory bandwidth saturation, and interconnect latency across large-scale topologies.

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience in a people management, supervision/team leadership role.
  • 5 years of experience in a technical leadership role and overseeing projects.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 5 years of experience working in a complex, matrixed organization.
  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience in a people management, supervision/team leadership role.
  • 5 years of experience in a technical leadership role and overseeing projects.
Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

  • Role Tech Lead, Gemini Inference Performance, DeepMind
  • Experience 5-7 years
  • Education Bachelor Degree, or equivalent experience
  • Work type On-site
  • Location United Kingdom
Check my match (free)
Google
AI Research Lab · 500+ Members · Mountain View, CA, United States

Google builds internet, software, cloud, and AI products used by consumers, developers, and organizations. Its portfolio includes Search, YouTube, Android, Chrome, Maps, Gmail, Workspace, Google Cloud, advertising platforms, devices, and Gemini AI products. The company develops large-scale computing infrastructure and research that power information retrieval, communication, productivity, media, navigation, and machine learning. Google is the largest operating business within Alphabet and earns a substantial share of its revenue from digital advertising.

Job Overview
Eligibility
United Kingdom Right to work in the United Kingdom required.
Workplace
On-site
Job Posted:
2 days ago
Job Type
Full Time
Education
Bachelor Degree, or equivalent experience
Experience
5-7 years

Share This Job: