In many dynamic situations or complex control tasks humans
rely on machine components to extend their sensory-motor capabilities.
Through the use of such extensions (also known as prostheses),
people are able to fly aircraft, drive automobiles and control
processes in industrial plants. Mishaps, however, can occur
when the machine or the human loses situation awareness due
to missing sensory information or misunderstanding of available
IHMC researchers develop multi-sensory prostheses to help
humans maintain situation awareness in complex activities.
Providing a multi-modal interface between the pool of available
information and the human operator provides a partial solution.
In a complete system, the machine (or process) under control
makes use of multi-modal interpretation of operator intent
New man-machine systems will employ robust, bi-directional
multi sensory interaction. These systems will exploit each
component's unique capabilities to adaptively reduce cognitive
load and ambiguity while improving situation awareness for
both the human and automation portions of the total system.