Algorithm Engineer, Reinforcement Learning
Bot AutoHouston, Texas, United States · Posted 2 months agoDescription
Company Introduction
At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a startup and the wisdom of seasoned experts, our team has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create groundbreaking solutions that propel the future of transportation. Join us and transform your ideas into reality.
Role Overview
We are seeking a ML/RL Engineer to join our Algo team and drive the development of our unified behavioral architecture. In this role, you will help bridge the gap between simulation and the real world by developing a scalable policy framework that represents both our L4 ego-policy and a diverse population of simulated agents. You will work at the intersection of Multi-Agent Reinforcement Learning (MARL) and safety-critical system design to ensure our autonomous semi-trucks navigate highways with superhuman safety and precision.
Key Responsibilities
- Behavioral Modeling: Develop and train diverse, conditioned policies that simulate realistic driving behaviors to stress-test and validate our autonomous driving stack.
- Safety-Constrained Learning: Lead the research and implementation of advanced RL algorithms to ensure safety metrics are treated as primary constraints in the learning process.
- Reward & Objective Design: Collaborate with cross-functional teams to design robust reward functions and evaluation metrics that balance safety, progress, and comfort.
- Scalable Training Pipelines: Contribute to the optimization of our large-scale, high-throughput training environments to enable rapid iteration on complex multi-agent scenarios.
- Model Architecture: Advance our state-of-the-art neural architectures to improve spatial reasoning, long-horizon planning, and interaction modeling.
- Cross-Team Collaboration: Work closely with Simulation and Planning teams to integrate research-grade models into production-quality, safety-critical software.
Required Qualifications
- Professional RL Experience: Proven track record of training and deploying deep RL algorithms (e.g., PPO, SAC) for complex, real-world robotic or autonomous systems.
- Technical Mastery: Expertise in Python and PyTorch; strong understanding of modern deep learning architectures and optimization techniques.
- Academic Background: MS or PhD in Computer Science, Robotics, or a related quantitative field.
- Scientific Intuition: Ability to diagnose and solve fundamental challenges in RL training, such as variance management and distribution shift.
Preferred Qualifications
- Safe RL Specialization: Experience with constrained optimization or safety-critical learning frameworks.
- Multi-Agent Systems: Background in MARL training stability, including self-play and decentralized execution strategies.
- Autonomous Driving Domain: Familiarity with vehicle dynamics and behavior planning, particularly for long-haul highway environments.
Additional Information
- Compensation: Competitive salary based on experience, with opportunities for performance bonuses and equity.
- Benefits: Comprehensive health insurance, paid time off, and the opportunity to work at the forefront of the autonomous trucking industry.
Similar jobs
Est. 175,000 USD
Company Introduction At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a startup…
Est. 140,000 USD
Company Introduction At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a startup…
Est. 124,000 USD
Company Introduction At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up…
Est. 141,000 USD
Company Introduction At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up…
Est. 124,000 USD
About the Role At Bot Auto, we are revolutionizing the transportation of goods through autonomous trucking. With the agility of a startup and the experience of a team that has achieved numerous industry firsts, we build…
Est. 144,000 USD
Company Introduction At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up…
Est. 328,650 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 241,500 USD
XPeng Motors is one of China’s leading smart electric vehicle (EV) companies. We design, develop, and manufacture smart EVs that are seamlessly integrated with advanced Internet, AI and autonomous driving technologies. W…
Est. 144,000 USD
About the Role We are building the next generation of autonomous trucking technology to make freight transportation safer, more efficient, and more scalable. Our Simulation team develops the virtual environments, testing…
Est. 80,000 USD
About Bot Auto Bot Auto is revolutionizing autonomous trucking by combining start-up agility with the wisdom of seasoned experts. We are looking for MS/PhD interns to join our core AI team for a 3-6 month internship to t…
Est. 141,000 USD
Apptronik is a human-centered robotics company developing AI-powered robots to support humanity in every facet of life. Our flagship humanoid robot, Apollo, is built to collaborate thoughtfully with people, starting with…
Est. 124,000 USD
Company Introduction At Bot Auto, we build autonomous trucks to transform the way goods are transported and improve the quality of life for communities worldwide. With a start-up spirit yet long-established experience, B…
Est. 141,000 USD
Apptronik is a human-centered robotics company developing AI-powered robots to support humanity in every facet of life. Our flagship humanoid robot, Apollo, is built to collaborate thoughtfully with people, starting with…
Est. 300,000 USD
Figure is an AI robotics company developing autonomous general-purpose humanoid robots. Our goal is to build embodied AI systems that can perceive, reason, and act in the real world. Figure is headquartered in San Jose,…
Est. 245,000 USD
Apptronik is a human-centered robotics company developing AI-powered robots to support humanity in every facet of life. Our flagship humanoid robot, Apollo, is built to collaborate thoughtfully with people, starting with…
Est. 328,650 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 115,000 USD
Company Introduction At Bot Auto, we build autonomous trucks to transform the way goods are transported and improve the quality of life for communities worldwide. With a start-up spirit yet long-established experience, B…
Est. 235,200 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 293,660 USD
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the wo…
Est. 273,110 USD
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the wo…
Est. 235,200 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 200,000 USD
Company Overview At Skild AI, we are building the world's first general purpose robotic intelligence that is robust and adapts to unseen scenarios without failing. We believe massive scale through data-driven machine lea…
Est. 250,000 USD
Figure is an AI Robotics company autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in th…
Est. 200,450 USD
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the wo…
Est. 200,000 USD
Company Overview At Skild AI, we are building the world's first general purpose robotic intelligence that is robust and adapts to unseen scenarios without failing. We believe massive scale through data-driven machine lea…
Est. 242,540 USD
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the wo…
Est. 289,800 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 249,050 USD
About the Company At Torc, we have always believed that autonomous vehicle technology will transform how we travel, move freight, and do business. A leader in autonomous driving since 2007, Torc has spent over a decade c…
Est. 225,000 USD
Figure is an AI Robotics company autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in th…
Est. 180,000 USD
AI Engineer – Agentic AutomationLocation: RemoteCompensation: $150,000 – $210,000Join a rapidly growing company disrupting the trucking industry! Cargomatic is the #1 technology platform and digital marketplace for power…