Staff Software Engineer, Vertex GenAI Evaluation Service

Job summary

MINIMUM QUALIFICATIONS: - Bachelor's degree or equivalent practical experience. - 8 years of experience in software development. - 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.

Benefits

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (e.g., language modeling, computer vision).
• PREFERRED
• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 5 years of experience with LLM evaluation, machine learning algorithms and
• See also Goo***'s EEO Policy and EEO is the Law.
• If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Responsibilities

• Operate as a technical expert and leader within the Cloud AI Quality Evaluation team.
• Drive high-quality, scalable evaluation frameworks and

Skills

Degrees

Industry

Company size

Contract length