Software Engineer III, Agent Quality and Efficiency Optimization

Google

Warsaw, Poland

Apply Now

AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

Design, build, and ship agent optimization systems that turn multiple sources of insights (like eval results, production traces, etc.) into persistent improvements, auto-formed skills, recipes for prompt and tool tuning, per-task cost and quality telemetry, smart model routing, durable and deferred execution, and continuous optimization, across the Agent Development Kit and Vertex AI serving stack.
Measure quality, cost, and latency per task, and use that data to drive engineering work.
Shape the team's optimization roadmap, and help set technical direction for how enterprise agents get better and cheaper over time.
Build benchmark optimization techniques on both open source benchmarks and real first-party and enterprise agent workloads to prove quality and efficiency wins hold up together.

Minimum qualifications:

Bachelor’s degree or equivalent practical experience.
2 years of experience with software development in one or more programming languages such as Go, C++ or Python, or 1 year of experience with an advanced degree.
2 years of experience with machine learning, large language models (LLMs), or applied AI.

Preferred qualifications:

Master's degree or PhD in Computer Science, Machine Learning, or a related technical field.
Experience building, deploying, or optimizing LLM applications or agentic frameworks (e.g., Agent Development Kit, LangGraph, LangChain).
Experience with one or more of the following: model serving optimization, inference caching, model routing or LLM cost and latency profiling.
Experience instrumenting, benchmarking, or evaluating ML systems in production.
Experience with technical leadership, mentoring engineers, or driving cross-team engineering initiatives.

Bachelor’s degree or equivalent practical experience.
2 years of experience with software development in one or more programming languages such as Go, C++ or Python, or 1 year of experience with an advanced degree.
2 years of experience with machine learning, large language models (LLMs), or applied AI.

Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

Role Software Engineer III, Agent Quality and Efficiency Optimization
Experience 3-4 years
Education Any
Work type On-site
Location Poland

Check my match (free)

Google

AI Research Lab · 500+ Members · Mountain View, CA, United States

Google builds internet, software, cloud, and AI products used by consumers, developers, and organizations. Its portfolio includes Search, YouTube, Android, Chrome, Maps, Gmail, Workspace, Google Cloud, advertising platforms, devices, and Gemini AI products. The company develops large-scale computing infrastructure and research that power information retrieval, communication, productivity, media, navigation, and machine learning. Google is the largest operating business within Alphabet and earns a substantial share of its revenue from digital advertising.

All jobs at Google

40 more Software Engineer roles in Warsaw

Job Overview

Eligibility

Poland Right to work in Poland required.

Workplace

On-site

Job Posted:

2 weeks ago

Job Type

Full Time

Education

Any

Experience

3-4 years

Software Engineer III, Agent Quality and Efficiency Optimization

Job Description

Minimum qualifications:

Preferred qualifications:

Share This Job:

Related Jobs

AI jobs by city