Lead Test Engineer - Scenario Coverage & Evaluation Datasets
AvrideAustin, Texas, United States · Posted 9 days agoDescription
Lead Test Engineer — Scenario Coverage & Evaluation Datasets
About the team
Avride builds autonomous driving technology for vehicles and delivery robots. Our QA organization measures how well that technology drives, largely in simulation — and an evaluation is only as good as the data behind it. So we build our own datasets, keep track of what they cover, and keep widening that coverage as the technology takes on more of the road.
About the role
You will own test coverage for the autonomous driving stack, end to end. Scenario areas are owned by individual QA engineers. You own the whole: what our evaluation dataset must contain for a release decision to be trustworthy, where the gaps are that nobody working inside a single area can see, and how those gaps keep surfacing without you being the one who finds them.
Coverage is a data problem before it is a testing problem. A scenario that exists on paper is not covered until there are real scenes behind it, and closing that distance is the craft of this role: metric-driven search across driving data, VLM-assisted retrieval and clustering, criticality-based selection, variation in simulation, and structured capture in the field. You will use that toolkit yourself before you ask anyone else to, and turn what works into something the whole QA team can run without you.
You will lead through process first building it, and delivering through the QA engineers and operational resources already around you and grow a team of your own as the scope demands it.
What you'll do
- Own the evaluation dataset. What is in it, what is missing, and what it lets us claim about autonomous driving quality.
- Own the coverage model. Our scenario taxonomy and ODD parameter space have to stay accurate as the technology matures and the operating environment changes. You own that: spotting where the model no longer describes what our vehicles actually meet, and working with the QA engineer who owns each category to keep it current.
- Close the distance between scenarios and scenes. For each thin area, choose the method that will actually produce the scenes you need — mining, simulation or the field — and know what it costs before you spend it.
- Set the mining agenda for the QA team. Decide what each area owner should be looking for next, review what comes back, and keep a regular rhythm for collecting their feedback.
- Be the internal customer for our mining tooling. Use it yourself, turn what you learn into requirements for the development and analytics teams, and keep the feedback loop between QA and engineering running so the tooling keeps pace with what we ask of it.
- Bring in what works elsewhere. Track how other AV programs, research groups and vendors solve coverage, edge-case curation and data selection, and turn what is worth having into concrete proposals.
- Work through the teams you depend on. Coverage is only visible once scenes are labeled and only measurable when the right metrics exist, which makes labeling and analytics standing partners rather than occasional ones. Give them clear priorities and specific, actionable feedback, and stay close enough to see early when something you depend on is at risk.
- Report coverage and readiness. Put them in a form a release decision can be made on — clear about confidence and about blind spots.
What you’ll need
- 8+ years in software testing or test engineering, including 2+ years owning the test strategy for a full system rather than a feature area.
- Coverage as a first-class problem. You can talk about equivalence classes, parameter spaces, risk-based prioritization, and what would have to be true for a dataset to be enough.
- Hands-on with data. SQL and Python at the level where you pull, join and sanity-check a metrics dataset yourself rather than filing a ticket.
- Fluent use of LLMs as a working tool — log search, triage, scenario generation, report drafting, quick analysis scripts.
- Strong written communication. Your reports are read by engineering leads and by our safety organization.
- Ability to reason precisely about US road rules and real-world driver behavior — or to get there quickly.
Nice to have
- Experience hiring QA engineers — screening, interview loops, and hire/no-hire calls you stand behind, whether into your own team or a partner team.
- Autonomous vehicles, robotics, ADAS — or another safety-critical domain (aerospace, medical devices, rail, industrial automation).
- Familiarity with scenario-based testing frameworks: ODD taxonomy (ISO 34503), scenario-based safety evaluation (ISO 34501/34502), and the SOTIF (ISO 21448) known/unknown × safe/unsafe framing.
- Experience with data mining, active learning or data-selection loops over large sensor/log datasets.
- Experience specifying internal tooling and working with a platform team.
- Experience with vehicle dynamics or sensor modalities (LiDAR, radar, cameras).
#LS-MS1
Candidates are required to be authorized to work in the U.S. The employer is not offering relocation, sponsorship, and remote work options are not available.
Avride is an equal opportunity employer and committed to providing reasonable accommodations to qualified applicants and employees with disabilities to ensure they have equal access to employment opportunities. Avride complies with the Americans with Disabilities Act (ADA), if you need a reasonable accommodation to assist with the application or hiring process, or to perform the essential functions of a job, please email jobs@avride.ai.
Similar jobs
Est. 141,000 USD
About the team Our team develops the core software and data processing systems that power motion planning and decision-making in autonomous vehicles. We work at the intersection of machine learning, large-scale data infr…
Est. 140,000 USD
About the team Our team is responsible for understanding how our technology performs and turning that understanding into confident decisions. We bring together simulation data, real-world driving data, structured test re…
Est. 141,000 USD
About the role We're hiring an experienced ML engineer to work on the models that see. You'll own problems end to end: deciding what data you need, getting it, training on it, proving the result is actually better, and g…
Est. 85,000 USD
About the team Our team is responsible for assessing the safety of our autonomous vehicles. We work with real-world driving data, simulation, and engineering teams to answer questions like: Is our autonomy safe enough to…
Est. 144,000 USD
About the team Our team sits at the core of Avride's self-driving stack. We build and own the foundational pipeline framework responsible for executing autopilot code with a relentless focus on reliability, reproducibili…
Est. 85,000 USD
About the Role Our autonomous vehicles encounter a wide variety of real-world situations on city streets. These situations need to be identified, categorized, and described in a structured way so they can be analyzed and…
Est. 124,000 USD
About the team Our team owns the safety assurance argument for our autonomous vehicles — the structured case that says, with evidence, that our vehicles are safe to operate in their intended environment. We translate the…
Est. 118,000 USD
About the team Our team is dedicated to advancing the future of autonomous driving technology by developing the metrics and evaluation frameworks that ensure the safety, performance, and readiness of self-driving systems…
Est. 144,000 USD
About the role We are seeking a Lead Software Engineer to drive the technical evolution of Avride's core Control System. This role is roughly 80% hands-on engineering and 20% technical leadership — you'll spend most of y…
Est. 124,000 USD
About the team The Embedded Tools Team develops and supports infrastructure for embedded software development. Our responsibilities include developing and supporting continuous integration/continuous delivery (CI/CD) pip…
Est. 52,000 USD
About Avride Avride is a U.S.-based autonomous vehicle company headquartered in Austin, TX, with additional R&D hubs around the world. Our company develops and operates both autonomous cars and delivery robots that s…
Est. 144,000 USD
About the team We develop the core simulation infrastructure that powers testing, validation, and debugging of our autonomous driving system. Our simulations are used daily across the company: by QA engineers verifying c…
Est. 124,000 USD
About the Team We build the foundational system software and embedded Linux platform that run our autonomous vehicles and delivery robots. Modern autonomous platforms are essentially rolling, edge data centers: high-thro…
Est. 144,000 USD
About the team Avride is a rapidly developing company in the autonomous vehicle and delivery robot industry. We develop autonomous vehicle technology from scratch, leveraging the strong technical background of our core t…
Est. 144,000 USD
About the team Our team is responsible for building the internal systems for the whole engineering team. Our goal is to help engineers navigate across all produced data, investigate problems, and create ad hoc analytics.…
Est. 124,000 USD
About the Team: The Sensors and System Software team is crucial to autonomous driving, developing the core software that allows our vehicles to perceive and understand the world around them. Join our team and directly co…
Est. 52,000 USD
About Avride Avride is a U.S.-based autonomous vehicle company headquartered in Austin, TX, with additional R&D hubs around the world. Our company develops and operates both autonomous cars and delivery robots that s…
Est. 115,000 USD
About the team Avride is a leading developer in the autonomous vehicle and delivery robot industry. Our dynamic team, composed of a few hundred engineers develops and operates autonomous cars and delivery robots across t…
Est. 124,000 USD
About the team Our Simulation team is responsible for building the foundational infrastructure that powers large-scale simulations critical to autonomous system development. We work at the intersection of cloud computing…
Est. 55,000 USD
Shift This is a full time, 40 hour a week role. Working hours/days are Monday-Wednesday, 4:00pm to 12:00am and Sunday 10am-12am. About Avride Avride is a U.S.-based autonomous vehicle startup headquartered in Austin, TX,…
Est. 137,500 USD
May Mobility is transforming cities through autonomous technology to create a safer, greener, more accessible world. Based in Ann Arbor, Michigan, May develops and deploys autonomous vehicles (AVs) powered by our innovat…
Est. 124,000 USD
About the team Our team develops the core software and data processing systems that power motion planning and decision-making in autonomous vehicles. We work at the intersection of machine learning, large-scale data infr…
Est. 175,000 USD
About the Team Our team is at the core of Avride's self-driving stack. We build the base infrastructure layer that powers all autopilot code. It includes a C++ framework for implementing autonomy components, execution gr…
Est. 55,000 USD
About Avride Avride is a U.S.-based autonomous vehicle startup headquartered in Austin, TX, with additional R&D hubs around the world. Our company develops and operates both autonomous cars and delivery robots that s…
Est. 45,000 USD
About the Team Since 2017, Avride has been building expertise in autonomous technologies to create solutions that address current needs and anticipate future demands. We are a U.S.-based autonomous vehicle startup headqu…
Est. 144,000 USD
About the team We’re a fast-moving team of engineers building the Remote Control system that powers teleoperation and fleet management for autonomous cars and delivery robots. Our tools enable operators to assist vehicle…
Est. 55,000 USD
About Avride Avride is a U.S.-based autonomous vehicle startup headquartered in Austin, TX, with additional R&D hubs around the world. Our company develops and operates both autonomous cars and delivery robots that s…
Est. 85,000 USD
About the Team At Avride, we are a rapidly growing company at the forefront of autonomous vehicle and delivery robot technology. We develop cutting-edge autonomous vehicle solutions from the ground up, leveraging the rob…
Est. 45,000 USD
About the Team Since 2017, Avride has been building expertise in autonomous technologies to create solutions that address current needs and anticipate future demands. We are a U.S.-based autonomous vehicle startup headqu…
Est. 45,000 USD
About the Team Since 2017, Avride has been building expertise in autonomous technologies to create solutions that address current needs and anticipate future demands. We are a U.S.-based autonomous vehicle startup headqu…