Senior Software Engineer, Quantized Inference

Job summary

We are now looking for a Senior Software Engineer for Quantized Inference! NVI*** is seeking software engineers to accelerate the discovery and deployment of efficient inference recipes for LLMs. A recipe defines which operators are transformed into low-precision or sparsified variants — unlocking throughput and latency gains without regressing accuracy or verbosity.

Benefits

Qualifications

• Experience with ML accelerators with a basic understanding of how certain ML layers affect execution time
• Experience reading, modifying, or contributing to a large open-source codebase
• MS/PhD in Computer Science or related field, or equivalent experience.
• with strong written and verbal communication
• Ways to stand out from the crowd:
• Experience contributing to inference serving frameworks (vLLM, TRT-LLM, SGLang) or Triton kernel development
• Track record of debugging numerical issues across mixed-precision boundaries
• Deep experience with model compression techniques: PTQ, QAT, structured/unstructured sparsity
• Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.
• You will also be eligible for equity and

Responsibilities

• What you'll be doing:

Skills

Degrees

Work schedule

Industry

Company size