Senior Machine Learning Engineer - Foundation Model

XPENGSanta Clara, California, United States · Posted Jan 15, 2025

Full-timeEst. 235,200 USD

Description

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.

We are looking for a full-time Machine Learning Engineer / Research Scientist to drive the modeling and algorithmic development of XPENG’s next-generation Vision-Language-Action (VLA) Foundation Model — the core brain that powers our end-to-end autonomous driving systems.

You will work closely with world-class researchers, perception and planning engineers, and infrastructure experts to design, train, and deploy large-scale multi-modal models that unify vision, language, and control. Your work will directly shape the intelligence that enables XPENG’s future L3/L4 autonomous driving products.

Key Responsibilities

Design and implement large-scale multi-modal architectures (e.g., vision–language–action transformers) for end-to-end autonomous driving.
Develop pretraining and fine-tuning strategies leveraging massive labeled and unlabeled fleet data (images, video, LiDAR, CAN bus, maps, human driving behaviors, etc.).
Research and integrate cross-modal alignment (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.
Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks (FSDP, DDP, etc.).
Conduct systematic ablation, evaluation, and visualization of model behavior across perception, reasoning, and planning tasks.
Contribute to model deployment optimization, including quantization, export, and latency–accuracy trade-offs for onboard execution.

Minimum Qualifications

Master’s degree or higher in Computer Science, Electrical/Computer Engineering, or related field, with 3+ years of experience in deep learning research or productization.
Strong proficiency in PyTorch and modern transformer-based model design.
Experience in large-scale pretraining or multi-modal modeling (vision, language, or planning).
Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
Familiarity with distributed training (DDP, FSDP) and large-batch optimization.

Preferred Qualifications

PhD in CS/CE/EE or related field, with 1+ years of relevant industry experience.
Publication record in top-tier AI conferences (CVPR, ICCV, NeurIPS, ICLR, ICML, ECCV).
Prior experience building foundation or end-to-end driving models, or LLM/VLM architectures (e.g., ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies).
Familiarity with RLHF/DPO/GRPO, trajectory prediction, or policy learning for control tasks.
Proven ability to collaborate cross-functionally with infra, perception, and planning teams to deliver production-ready models.

What do we provide:

A collaborative, research-driven environment with access to massive real-world data and industry-scale compute.
An opportunity to work with top-tier researchers and engineers advancing the frontier of foundation models for autonomous driving.
Direct impact on the next generation of intelligent mobility systems.
Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving.
Competitive compensation package.
Snacks, lunches, dinners, and fun activities.

The base salary range for this full-time position is $174,720 - $295,680, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.

We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.

XPENGSanta Clara, California, United States

Est. 289,800 USD

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…

Full-time

Senior Staff Machine Learning Engineer – Autonomous Driving Foundation Models5 months ago

XPENGSanta Clara, California, United States

Est. 328,650 USD

Full-time

Senior Machine Learning Engineer - AI Foundation5 months ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Staff Machine Learning Engineer - AI Foundation5 months ago

XPENGSanta Clara, California, United States

Est. 289,800 USD

Full-time

Senior Machine Learning Engineer – Predictive World Model16 days ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Staff AI Data Infrastructure/Pipeline Engineer4 months ago

XPENGSanta Clara, California, United States

Est. 273,875 USD

Full-time

Senior AI Data Infrastructure/Pipeline Engineer2 months ago

XPENGSanta Clara, California, United States

Est. 196,000 USD

Full-time

Senior Staff Research Engineer – Reinforcement Learning for AI Agents5 months ago

XPENGSanta Clara, California, United States

Est. 328,650 USD

Full-time

Staff Technical Program Manager25 days ago

XPENGSanta Clara, California, United States

Est. 169,050 USD

Full-time

Senior Machine Learning Engineer - LLM Quantization & Deployment15 days ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Staff Physical AI Data Algorithm Engineer3 months ago

XPENGSanta Clara, California, United States

Est. 273,875 USD

Full-time

Staff Machine Learning Engineer4 days ago

XPENGSanta Clara, California, United States

Est. 241,500 USD

XPeng Motors is one of China’s leading smart electric vehicle (EV) companies. We design, develop, and manufacture smart EVs that are seamlessly integrated with advanced Internet, AI and autonomous driving technologies. W…

Full-time

Staff Machine Learning Engineer - LLM Quantization & Deployment15 days ago

XPENGSanta Clara, California, United States

Est. 289,800 USD

Full-time

Senior Staff AI Engineer3 months ago

XPENGSanta Clara, California, United States

Est. 328,650 USD

Full-time

AI Infra Onboard Performance Intern2 months ago

XPENGSanta Clara, California, United States

Est. 120,000 USD

Full-time

Senior Machine Learning Data Curation Engineer1 month ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Data Infrastructure Engineer1 month ago

XPENGSanta Clara, California, United States

Est. 196,000 USD

Full-time

Staff Machine Learning Engineer2 months ago

XPENGSanta Clara, California, United States

Est. 241,500 USD

Full-time

Senior Staff Digital World System Engineer3 months ago

XPENGSanta Clara, California, United States

Est. 273,875 USD

Full-time

Senior Software Engineer, Agentic Platforms23 days ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Reinforcement Learning Engineer - Robotics1 month ago

XPENGSanta Clara, California, United States

Est. 235,200 USD

Full-time

Senior Staff/ Principal Research Scientist – Dexterous Manipulation4 months ago

XPENGShenzhen, China

Full-time

Staff Robotics Engineer / Tech Lead – Whole-Body Control & Robot Learning3 months ago

XPENGSanta Clara, California, United States

Est. 289,800 USD

Full-time

Lead Machine Learning Engineer9 days ago

May MobilityRemote

Est. 245,000 USD

May Mobility is transforming cities through autonomous technology to create a safer, greener, more accessible world. Based in Ann Arbor, Michigan, May develops and deploys autonomous vehicles (AVs) powered by our innovat…

Full-timeRemote

Staff Machine Learning Engineer - Vision-Language Foundation Models1 month ago

WaymoMountain View, California, United States

Est. 280,500 USD

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The…

Full-time

Senior Machine Learning Engineer, End-to-End Planning1 month ago

Lucid MotorsNewark, California, United States

Est. 188,100 USD

About Lucid At Lucid, we are creating exceptional mobility experiences through innovation to drive the world forward. Built on Lucid’s proprietary technology and software-defined vehicle architecture, our award-winning v…

Full-time

ML Engineer, Foundation Model Infrastructure23 days ago

WaymoMountain View, California, United States

Est. 195,000 USD

Full-time

Applied Scientist / Machine Learning Engineer1 month ago

WayveSunnyvale, California, United States

Est. 340,925 USD

About us Founded in 2017, Wayve is the leading developer of Embodied AI technology. Our advanced AI software and foundation models enable vehicles to perceive, understand, and navigate any complex environment, enhancing…

Full-time

Senior Machine Learning Engineer, Perception LLM/VLM8 months ago

WaymoMountain View, California, United States

Est. 231,500 USD

Full-time

Foundation Model Data, Software Engineer2 months ago

WaymoMountain View, California, United States

Est. 238,000 USD

Full-time

Senior Machine Learning Engineer - Foundation Model

Description

Key Responsibilities

Minimum Qualifications

Preferred Qualifications

Similar jobs