Senior Staff Software Engineer, AI Agent Platform, Vertex

• Architect, develop, and maintain robust, horizontally scalable APIs and backend infrastructure tailored specifically for Generative AI workloads.
• Optimize the routing, load balancing, quota management, and data plane mechanisms that connect user API requests to backend ML serving clusters across massive fleets of TPUs and GPUs.
• Prototype and launch new API products rapidly in a fast-paced, highly collaborative environment, rapidly to expose the latest advancements in Google's foundation models.
• Collaborate closely with ML researchers, ML serving teams, and product managers to translate complex AI capabilities into intuitive, highly reliable enterprise-grade APIs.
• Define and implement best practices for API security, high availability, fault tolerance, and comprehensive observability across distributed systems.

Minimum qualifications:

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience in systems architecture and large-scale serving infrastructure.
• Experience delivering technical solutions in a changing environment.
• Experience working in multinational or internationalised (i18n) organisations on global initiatives.

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures and algorithms.
• 5 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a complex, matrix organisations involving cross-functional, cross-timezone or cross-business projects.
• Experience in serving Generative AI models using inference frameworks or hardware accelerators (e.g., GPUs, TPUs).

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience in systems architecture and large-scale serving infrastructure.
• Experience delivering technical solutions in a changing environment.
• Experience working in multinational or internationalised (i18n) organisations on global initiatives.