Research Project

Human-Machine Teaming: NASA Mars and Europa Missions

(Speed Dating Trust: Examining the Critical Human-Machine Teaming Behaviors Linked to Mission Success)

Research Team

Lead Researchers:

  • Thomas Chan, Social and Behavioral Sciences*
  • Nhut Ho, Professor, Mechanical Engineering

Collaborators:

  • So Young Kim-Castet, Ph.D*
  • Basak Ramaswamy, Ph.D*
  • Scott Davidoff, Ph.D

Student Team:

  • Alex Christoforatos, Psychological Sciences*
  • Dana Bellinger, Psychology*
  • Eli Bonilla, Systems Graphics Design, UX/UI*
  • Jackie Marie Hunt, Psychological Sciences*
  • Jared Carrillo, Mechanical Engineering*
  • Jodee Ann Conui, Psychology*
  • Jacksen Smith, Medical Sciences*
  • Jeremy Argueta
  • Ana Patino
  • Jazlyn Armendariz
  • Giovanna Blanco
  • Gerard Andrei

Note: names marked with an asterisk (*) indicate current team

Funding

  • Funding Organization:
  • Funding Program:

SYNOPSIS

  • UX encompasses a user’s perceptions, emotions, and responses that result from their interaction with a particular product or service.
  • It involves understanding users’ needs and behaviors, conducting user research, creating user personas, and designing interfaces that optimize the overall experience based on the research and data collected.
  • Research and Strategy – Design – Wireframe – Prototyping – Interaction/Visuals Testing – User Usability – Feedback – KPI Audit

Abstract

Tactful coordination on Earth between hundreds of operators from diverse disciplines and backgrounds is needed to ensure that Martian rovers have a high likelihood of achieving their science goals while enduring the harsh environment of the red planet. The operations team includes many individuals, each with independent and overlapping objectives, working to decide what to execute on the Mars surface during the next planning period. The team must work together to understand each other’s objectives and constraints within a fixed time period, often requiring frequent revision. This study examines the challenges faced during Mars surface operations, from high-level science objectives to formulating a valid, safe, and optimal activity plan that is ready to be radiated to the rover. Through this examination, we aim to illuminate how planning intent can be formulated and effectively communicated to future spacecrafts that will become more and more autonomous. Our findings reveal the intricate nature of human-to-human interactions that require a large array of soft skills and core competencies to communicate concurrently with science and engineering teams during plan formulation. Additionally, our findings exposed significant challenges in eliciting planning intent from operators, which will intensify in the future, as operators on the ground asynchronously co-operate the rover with the on-board autonomy. Building a marvellous robot and landing it onto the Mars surface are remarkable feats – however, ensuring that scientists can get the best out of the mission is an ongoing challenge and will not cease to be a difficult task with increased autonomy.

VR On Mars View: Adobe Firefly Text Prompt AI
Source: Generated, PAR-D Lab Team 2024
Edits & Modifications 2024: PAR-D Lab Team, Adobe .psd Version: 2025

Motivation/Research Problem

Humans and autonomous systems need to understand and trust each other to make for effective mission teaming. Humans and machines are both complex, and we are examining the fundamental behaviors and interactions that make current missions successful and unsuccessful.

Alignment, Engagement and Contributions

NASA MIRO, JPL STEM Education Directorate, NIH Building Bridges to Doctorates

Research Questions and Research Objectives

Task: To investigate different augmented reality (AR) systems and
how they compare.

Goal: The user experience will provide a more efficient method to
assess AR technology as well as discover potential areas for
improvement in contemporary AR devices. This will ultimately
improve human systems integrations.

Research Methods

We interviewed approximately 15 participants at a time per day (N = 45).
Conversation and verbal decisions relating to planning and their context
were documented. The research team then coded key words and categorized
them in groups and their sub-soft skills:

  • Corporate Knowledge Gluer: to fill in knowledge gaps

  • Bridge Builder: to create collective understanding between teams

  • Efficiency Optimizer: streamline tasks

  • Vibe Dispatcher: assess/conduct actions based on team emotions

Research Deliverables and Products

Products | Immersive Headsets Used: Microsoft Hololens II & Apple Vision Pro

Research, Results, & Observations:

  • Visual Challenges: Off-set peripheral visuals, impaired visual depth of field when interacting with display.

  • Off-Balance/Mobility: Potentially connected to the visual problems & device calibration. Users where aware of wearing the device and displayed extra cautionary movements.

  • Situational Awareness: Issues with vertical adjustments and readjusting to a digital and real-world environment.

  • User Experience/Physical: Lag in interactions and movements and overdramatized motions.

Commercialization and/or Social Impact Opportunities

Healthcare & Rehabilitation:

  • The precision and realism required could translate to advancements in AR/VR-based rehabilitation and mental health treatments.

  • AR/VR environments could inform us about the psychological and social effects of isolation, confinement, and the challenges.

  • AR/VR research drives innovations in healthcare, including AR/VR-assisted surgeries, medical training, and mental health treatments like exposure therapy for PTSD, anxiety, and phobias.

Training & Remote Collaboration Tools:

  • This technology is invaluable for sectors such as architecture, engineering, medicine, and education, as it pushes forward collaborative tools that allow scientists, engineers, and other industries to interact with remote environments in real time.

  • AR/VR research is widely applied in training programs for industries like aviation, military, and healthcare. By offering immersive, risk-free.

Research Timeline

On-going data collection and analyses.

Research Team

Lead Researchers:

  • Thomas Chan, Social and Behavioral Sciences*
  • Nhut Ho, Professor, Mechanical Engineering

Collaborators:

  • So Young Kim-Castet, Ph.D*
  • Basak Ramaswamy, Ph.D*
  • Scott Davidoff, Ph.D

Student Team:

  • Alex Christoforatos, Psychological Sciences*
  • Dana Bellinger, Psychology*
  • Eli Bonilla, Systems Graphics Design, UX/UI*
  • Jackie Marie Hunt, Psychological Sciences*
  • Jared Carrillo, Mechanical Engineering*
  • Jodee Ann Conui, Psychology*
  • Jacksen Smith, Medical Sciences*
  • Jeremy Argueta
  • Ana Patino
  • Jazlyn Armendariz
  • Giovanna Blanco
  • Gerard Andrei

Note: names marked with an asterisk (*) indicate current team

Funding

  • Funding Organization:
  • Funding Program: