logo

AI Job Summary

Define and own the architecture for next-generation ML compute IP and acceleration blocks across the entire product lifecycle, from concept through production silicon. This role requires 15 years in computer architecture or ML accelerator design, with demonstrated experience leading architectural specifications for silicon IP blocks and expertise in performance modeling and hardware-software co-design. You'll partner with AI research and compiler teams to evaluate compute dataflows, numerical formats, sparsity, and specialized mechanisms like KV cache optimization.

Written from this posting by Neural Jobs AI. The full description is below.

AI Resume Tailoring Sign in to use this AI Cover Letter Sign in to use this

Job Description

  • Lead the architectural definition, modeling, and specification of next-generation, high-performance ML compute IP and acceleration blocks for Cloud AI silicon.
  • Own the ML IP architecture specification throughout the entire product lifecycle: concept exploration, cycle-accurate modeling, implementation, silicon bring-up, and production.
  • Partner closely with leading AI research and algorithm teams (e.g., Google DeepMind, Gemini research teams) and software compiler teams (XLA, PyTorch) to explore architectural trade-offs and define hardware requirements for emerging model architectures.
  • Drive comprehensive architecture studies, evaluating compute dataflows, numerical formats, sparsity, and specialized acceleration mechanisms such as key-value (KV) cache optimization.
  • Drive performance, latency, power efficiency, and silicon area projections across model topologies and workload configurations.

Minimum qualifications:

  • Bachelor's degree in Computer Engineering, Electrical Engineering, Computer Science, a related field, or equivalent practical experience.
  • 15 years of experience in computer architecture, ML accelerator design, or high-performance processor architecture.
  • Experience leading architectural definition and authoring architecture specifications for silicon or compute IP blocks.
  • Experience with performance modeling, workload profiling, and hardware-software co-design.

Preferred qualifications:

  • Master's degree or PhD in Electrical Engineering, Computer Engineering, or Computer Science with an emphasis on computer architecture or ML hardware systems.
  • 5 years of experience leading the architectural definition and microarchitecture of AI/ML accelerators from concept through production.
  • Deep knowledge of modern deep learning workloads (Transformers, MoE, Diffusion, Generative AI inference) and their system bottlenecks (memory capacity, KV cache bandwidth, interconnect scaling).
  • Strong understanding of high-performance memory subsystems (custom SRAM architectures, high-bandwidth memory hierarchies, caching schemes).
  • Experience working with modern ML frameworks (PyTorch, JAX, TensorFlow) and ML compilers/runtimes (XLA, TVM, Triton).
  • Bachelor's degree in Computer Engineering, Electrical Engineering, Computer Science, a related field, or equivalent practical experience.
  • 15 years of experience in computer architecture, ML accelerator design, or high-performance processor architecture.
  • Experience leading architectural definition and authoring architecture specifications for silicon or compute IP blocks.
  • Experience with performance modeling, workload profiling, and hardware-software co-design.
Do you match this job?

Here is what this employer asked for. Sign in and we will fill in your half.

  • Role ML Hardware Achitect
  • Experience 3-4 years
  • Education Bachelor Degree, or equivalent experience
  • Work type On-site
  • Location Israel
Check my match (free)
Google
AI Research Lab · 500+ Members · Mountain View, CA, United States

Google builds internet, software, cloud, and AI products used by consumers, developers, and organizations. Its portfolio includes Search, YouTube, Android, Chrome, Maps, Gmail, Workspace, Google Cloud, advertising platforms, devices, and Gemini AI products. The company develops large-scale computing infrastructure and research that power information retrieval, communication, productivity, media, navigation, and machine learning. Google is the largest operating business within Alphabet and earns a substantial share of its revenue from digital advertising.

All jobs at Google

51 more Hardware Engineer roles in Tel Aviv

Job Overview
Eligibility
Israel Right to work in Israel required.
Workplace
On-site
Job Posted:
3 days ago
Job Type
Full Time
Education
Bachelor Degree, or equivalent experience
Experience
3-4 years

Share This Job: