Senior Staff Software Engineer, TPU Performance

Job summary

MINIMUM QUALIFICATIONS: - Bachelor’s degree or equivalent practical experience. - 8 years of experience in software development. - 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).

Benefits

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience with design and architecture; and testing/launching software products.
• Experience in Python and C++ programming.
• PREFERRED
• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures and algorithms.
• 5 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a matrixed organization involving cross-functional, or cross-business projects.
• Experience in performance analysis and debugging, including for systems that span multiple interconnected hosts.
• Experience in contributing to PyTorch or JAX.

Responsibilities

• Identify and maintain ML training and serving benchmarks that are representative to Goo*** production and the broader ML industry.
• Achieve performance for customer launches, and in case of third-party/OSS models, for engaged benchmark submissions (ML Commons, InferenceX, etc).
• Use the benchmarks to identify performance opportunities and drive both near-term state of the art (e.g.
• custom kernels) and out-of the box performance (compiler/runtime optimizations, agentic tooling, auto-sharding) directly and in collaboration with partner teams.
• Participate in algorithmic innovations exploiting new TPU hardware features and model-preserving optimizations (speculative decoding, sparsity, quantization, LoRA, etc).
• Participate in co-designing models that are TPU-friendly to showcase model quality at performance excellent to OSS models typically designed on GPUs.
• Goo*** is proud to be an equal opportunity workplace and is an affirmative action employer.
• We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
• We also consider qualified applicants regardless of criminal histories, consistent with legal

Skills

Degrees

Industry

Company size

Contract length