Staff Machine Learning Engineer - LLM Quantization & Deployment

XPENGSanta Clara, California, United States · Posted 15 days ago

Full-timeEst. 289,800 USD

Description

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.

Our mission is to build strong foundation for LLM deployment and quality sign-off for next-gen XPENG Turing AI chip. This includes and is not limited to: LLM model fine tuning, PTQ, QAT, on-vehicle inference and related fields.

Key Responsibilities

Develop VLA inference models, ensure numerical consistency with training models, and productionize LLM quantization methods, including PTQ, QAT, mixed-precision inference, INT8, FP4, and lower-bit techniques.
Develop production-quality Python code with strong testing, observability, reproducibility, and failure handling.
Build robust model export, calibration, benchmarking, validation, and deployment pipelines.
Engage early with the VLA model research team to establish performance estimates and prove model feasibility.
Curate evaluation datasets and establish a comprehensive metric suite to systematically benchmark VLA performance.
Analyze numerical errors, accuracy regressions, and performance trade-offs.
Develop PTQ and QAT orchestration workflows.
Serve as the primary interface with field-testing and simulation teams for issue triage and autonomous driving performance sign-off.
Collaborate with the in-vehicle software team on latency analysis and issue triage.
Collaborate with the training infrastructure team to develop QAT and model distillation.

Basic Qualifications

Master in CS/CE/EE, or equivalent, with 3-5 years of industry experience.
Strong understanding of Transformer architectures and LLM inference.
Hands-on experience quantizing or deploying deep learning models in production.
Proficiency with PyTorch and at least one inference or compilation stack.
Strong Python programming and software engineering skills.
Ability to work effectively across research, systems, infrastructure, and product teams.
Excellent communication and problem-solving skills, with the ability to thrive in a fast-paced and collaborative environment.

Preferred Qualifications

Experience with weight-only, activation, KV-cache, dynamic, static, or mixed-precision quantization.
Experience with AWQ, GPTQ, SmoothQuant, or related methods.
Strong numerical analysis and systems engineering skills.
Experience with one or more LLM runtimes, such as TensorRT-LLM, vLLM, SGLang, llama.cpp, ONNX Runtime, TVM, MLIR, or custom runtimes.
Experience deploying LLMs on resource-constrained or heterogeneous hardware.
Contributions to model optimization, inference, compiler, or serving projects.
Publications at NeurIPS, ICML, ICLR, ACL, or related conferences.

What We Provide

A fun, supportive and engaging environment.
Infrastructures and computational resources to support your work.
Opportunity to work on cutting edge technologies with the top talents in the field.
Opportunity to make a significant impact on the transportation revolution by the means of advancing autonomous driving.
Competitive compensation package.
Snacks, lunches, dinners, and fun activities.

The base salary range for this full-time position is $215,280 - $364,320, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.

We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.

XPENGSanta Clara, California, United States

Est. 235,200 USD

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…

Full-time

Staff Machine Learning Engineer - Foundation ModelJan 15, 2025

XPENGSanta Clara, California, United States

Est. 289,800 USD

Full-time

Staff Machine Learning Engineer - AI Foundation5 months ago

XPENGSanta Clara, California, United States

Est. 289,800 USD

Full-time

Senior Machine Learning Engineer - Foundation ModelJan 15, 2025

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Machine Learning Engineer - AI Foundation5 months ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Staff Machine Learning Engineer – Autonomous Driving Foundation Models5 months ago

XPENGSanta Clara, California, United States

Est. 328,650 USD

Full-time

Senior Staff Research Engineer – Reinforcement Learning for AI Agents5 months ago

XPENGSanta Clara, California, United States

Est. 328,650 USD

Full-time

Senior Staff AI Engineer3 months ago

XPENGSanta Clara, California, United States

Est. 328,650 USD

Full-time

Senior Staff AI Data Infrastructure/Pipeline Engineer4 months ago

XPENGSanta Clara, California, United States

Est. 273,875 USD

Full-time

Senior Machine Learning Data Curation Engineer1 month ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior AI Data Infrastructure/Pipeline Engineer2 months ago

XPENGSanta Clara, California, United States

Est. 196,000 USD

Full-time

Senior Staff Physical AI Data Algorithm Engineer3 months ago

XPENGSanta Clara, California, United States

Est. 273,875 USD

Full-time

AI Infra Onboard Performance Intern2 months ago

XPENGSanta Clara, California, United States

Est. 120,000 USD

Full-time

Senior Machine Learning Engineer – Predictive World Model16 days ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Staff Technical Program Manager25 days ago

XPENGSanta Clara, California, United States

Est. 169,050 USD

Full-time

Staff Machine Learning Engineer4 days ago

XPENGSanta Clara, California, United States

Est. 241,500 USD

XPeng Motors is one of China’s leading smart electric vehicle (EV) companies. We design, develop, and manufacture smart EVs that are seamlessly integrated with advanced Internet, AI and autonomous driving technologies. W…

Full-time

Senior Staff Digital World System Engineer3 months ago

XPENGSanta Clara, California, United States

Est. 273,875 USD

Full-time

Senior Software Engineer, Agentic Platforms23 days ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Staff Machine Learning Engineer2 months ago

XPENGSanta Clara, California, United States

Est. 241,500 USD

Full-time

Senior Data Infrastructure Engineer1 month ago

XPENGSanta Clara, California, United States

Est. 196,000 USD

Full-time

AI Engineer (Managed Services)2 months ago

AvePointSingapore, Singapore

We are looking for a highly skilled AI Engineer specializing in Large Language Models (LLMs) and Agentic AI. You will architect, build, and deploy production-grade LLM applications — from intelligent knowledge bases and…

Full-time

Senior Staff/ Principal Research Scientist – Dexterous Manipulation4 months ago

XPENGShenzhen, China

Full-time

Senior Reinforcement Learning Engineer - Robotics1 month ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Research Engineer, LLM Training & Post-Training16 days ago

Lightning AIRemote

Est. 237,500 USD

Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…

Full-timeRemote

Staff Robotics Engineer / Tech Lead – Whole-Body Control & Robot Learning3 months ago

XPENGSanta Clara, California, United States

Est. 289,800 USD

Full-time

AI Infrastructure Engineer, Model Serving PlatformJan 28, 2025

Scale AISan Francisco, California, United States

Est. 202,500 USD

As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and production systems, supportin…

Full-time

AI Researcher - Efficient AI (Contractor)1 month ago

LG ElectronicsSanta Clara, California, United States

Est. 91,200 USD

Step into the innovative world of LG Electronics. As a global leader in technology, LG Electronics is dedicated to creating innovative solutions for a better life. Our brand promise, 'Life's Good', embodies our commitmen…

Full-time

Backend/ML Engineer10 days ago

LG ElectronicsSanta Clara, California, United States

Est. 175,000 USD

Full-time

Staff/Principal DevOps Engineer, AI Inference1 month ago

Lila SciencesCambridge, Massachusetts, United States

Est. 232,000 USD

Your Impact at LILA The Staff/Principal DevOps Engineer - AI Inference will drive the design, implementation, and optimization of infrastructure purpose-built for serving machine learning models at scale. This role bridg…

Full-time

Campus AI Research Engineer - Deep Learning (Intern)1 month ago

Jump TradingChicago, Illinois, United States

Est. 125,000 USD

Jump Trading Group is committed to world class research. We empower exceptional talents in Mathematics, Physics, and Computer Science to seek scientific boundaries, push through them, and apply cutting edge research to g…

Full-time

Staff Machine Learning Engineer - LLM Quantization & Deployment

Description

Key Responsibilities

Basic Qualifications

Preferred Qualifications

What We Provide

Similar jobs