Building trust in autonomous vehicles

Problem: trust and adoption of avs are limited by ONE-SIZE-FITS-ALL APPROACHes to HUman-AI COMMUNICATION.

Solution: We Aim to improve human-autonomous vehicle interaction through personalized, context-aware, and goal-based communication INSTEAD OF taking a one-size-fits-all approach.

FOR AUTONOMOUS VEHICLES (“SELF-DRIVING CARS”) TO ENGENDER APPROPRIATE LEVELS OF TRUST, THEY MUST BE RESPONSIVE TO THE PRAGMATIC, INFORMATIONAL, AND EMOTIONAL NEEDS OF THEIR PASSENGERS.

 

Theoretical Framework: Supporting Human-AV Communication with Cognitive Theory

We proposed a systems framework that integrates cognitive theories of joint action and situational awareness as a means to tailor communications that meet the criteria necessary for goal success. This framework can be used to design future AV communications that meet the informational needs and goals of diverse groups and in diverse driving contexts.

 

Study 1: Predicting Trust From Personal Traits Using Machine Learning

Can we use machine learning to predict a person’s trust, concerns with vehicles, and adoption attitudes based on their traits and experiences?

In this study, we used survey to develop a comprehensive profile for a person, then used machine learning and explainability techniques (SHAP value regression) to derive insights on most important factors predicting a person’s trust profile.

Our models were highly accurate (90% or better) and show several traits and specific concerns with AV that can be used by AV designers to tailor interventions to build trust.

Example factors used as input into the ML model.

 

Study 2: Learning to Race From an AI Driving Coach - A Study of Information Content and Modality

Can we build an AI driving coach to teach novices to drive a race car?

Full-motion driving simulator at Toyota Research Institute in Los Altos, CA.

In a pre-post mixed-methods experiment (n = 41), we tested the impact of an AI Coach’s explanatory communications modeled after performance driving expert instructions. We compare how different explanatory techniques impact driving performance, cognitive load, confidence, expertise, and trust via observational learning. Through interview, we delineate participant learning processes.

Results show AI coaching can effectively teach performance driving skills to novices. Efficient, modality-appropriate explanations should be opted for when designing effective HMI communications that can instruct without overwhelming. Differences in how successfully participants learned are attributed to how information directs attention, mitigates uncertainty, and influences overload experienced by participants.

 

Study 3: Autonomous Vehicle Errors, Context, and Personalization

What happens when autonomous vehicle communications mess up?

We developed a custom, state-of-the-art driving simulator and used it to test how AV explanation errors, driving context characteristics, and personal traits affect a person’s comfort relying on the AV, preference for control, confidence in the AV's ability, and explanation satisfaction (n = 232).

Results emphasize the need for accurate, contextually adaptive, and personalized AV explanations to foster trust, reliance, satisfaction, and confidence. We conclude with design, research, and deployment recommendations for trustworthy AV systems.

Custom-built VR Driving Simulator.

 

Publications that have come out of this research agenda:

Kaufman, R., Costa, J., Kimani, E. (2024). Effects of Multimodal Explanations for Autonomous Driving on Driving Performance, Cognitive Load, Expertise, Confidence, and Trust. Nature: Scientific Reports. PDF

Kaufman, R., Kirsh, D., Weibel, N. (2024). Developing Situational Awareness for Joint Action With Autonomous Vehicles. ArXiv. PDF

Kaufman, R., Lee, E., Bedmutha, M., Kirsh, D., Weibel, N. (2024). Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learning. ArXiv. PDF

Kaufman, R., Broukhim, A., Kirsh, D., Weibel, N. (2024). What Did My Car Say? Impact of Autonomous Vehicle Explanation Errors and Driving Context On Comfort, Reliance, Satisfaction, and Driving Confidence. ArXiv. PDF