Skip to Main Content

LEARNER: Mixed-reality environment aims to advance emergency training

Image: Courtesy of Ranjana Mehta

What if you could provide emergency responders with technology that could not only potentially save lives, but make their work more precise and efficient at the same time through the use of novel human augmentation technologies? This concept — called LEARNER — is on its way to becoming a reality thanks to an award from the National Science Foundation (NSF).

LEARNER (Learning Environments with Augmentation and Robotics for Next-gen Emergency Responders) is a mixed-reality learning environment with physical, augmented and virtual reality components for users to learn to work effectively with nascent human augmentation technologies. This new learning environment will feature powered exoskeletons and head-worn augmented reality interfaces to augment responders’ physical and cognitive capabilities.

“LEARNER is a personalized learning platform that will incorporate physiological, neurological and behavioral markers of learning into real-time emergency response scenario evolution that can be accessed via tiered hardware-based learning experiences, ranging from laptops/desktops, to VR (virtual reality) and AR (augmented reality) headsets at field houses, to haptic suits at in-situ emergency response training at national training centers,” said Ranjana Mehta, principal investigator on the two-year, $5 million project and associate professor in the Wm Michael Barnes ’64 Department of Industrial and Systems Engineering at Texas A&M University and director of the NeuroErgonomics Lab.

The project is funded through the NSF’s newly formed Convergence Accelerator program, which integrates use-inspired, team-based science, cross-cutting partnerships and multidisciplinary efforts to produce impactful solutions toward national-scale societal challenges.

“Convergence Accelerator is producing true innovation,” said Douglas Maughan, NSF Convergence Accelerator program head. “All 2019 cohort teams worked hard to further develop their initial concepts, strengthen their teams, and engage with customers and partners; however, Phase II is where we expect to see high-impact deliverables.” “Throughout the process, especially in our evaluation and assessments, we are poised toward staying focused, practical and user/customer-centric, by closely working with the LEARNER advisory board that includes leaders from core technology development companies (e.g., Ford, Boeing), stakeholders and trainers from emergency response organizations, and decision-makers from government agencies (e.g., Federal Emergency Management Agency, National Fire Protection Association),” said Mehta.