Senior Engineer, AV Behavior Evaluation

Mission Summary:

The AV Behavior Design and Evaluation Team is responsible for owning the design and assessment of the AV behavior utilizing the concept of AV behavior competencies. The team relies on systematic decomposition of AV behavior along with data driven assessment utilizing data from on-road and simulation test modalities. We are responsible for building and operating robust, large-scale evaluation systems, alongside sophisticated simulation workflows and insightful diagnostic tools. By combining expert human judgment with advanced data driven techniques, we evaluate the system behavior performance.

As the team is looking to scale to support more and more behavioral competencies, we are looking for passionate Engineers to help build a robust framework to leverage the best of agile systems engineering and data driven performance assessment to achieve our ambitious goals in scaling our system design and evaluation processes. We are looking to work with people who are driven to design robust systems and transform complex data into measurable progress toward a safer, smarter transportation future.

This person will get to build relationships with the team as well cross-functional across organization to help build a cohesive understanding AV performance as applicable to the Behavioral Competencies.

What you'll be doing:

Propose behavioral expectations on AV capabilities

Support standardization of metrics used in performance evaluation for AV Capabilities to ensure consistency

Effectively utilize existing metrics and propose the need for new metrics to evaluate AV performance in large scale simulation testing

Propose soft/hard targets for metrics using statistical methods and back them up with driving data

Propose and implement ideas to analyze simulation, resimulation and public road testing results for stakeholders in Systems, Autonomy, Safety etc.

Deliver strategic insights and recommendations on projects regarding scenario-based testing

Build meaningful visualizations and templates for the team to utilize

Focus on automating result analysis processes and gaps, removing manual processes where applicable

Support the development, execution, and analyses of test strategy for features validation

Communicate test results to development teams and management and facilitate resolving of technical issues

What we're looking for:

Bachelor's degree and 2 years of experience in Engineering, Computer Science, Data Science OR equivalent experience in in relevant industry

Strong understanding of Autonomous Vehicle architecture and functions of key subsystems such as perception, planning, prediction etc.

Experience with analyzing simulation and real world data for robotic systems, preferably autonomous vehicles

Fluency in SQL or similar languages

Fluency in data visualization techniques

Experience in building python based projects for data analysis and insights

Excellent interpersonal skills to build relationships with other teams

Excellent communication skills; effective in communicating complex concepts and driving resolutions