Human Performance

Given the nature, thrust, objectives and scope of the discipline of human factors engineering (HFE), how is it applied in the context of system design and development to improve human performance? What are the unique methods and techniques that support the design for and assessment of human performance?

The methodology of HFE as it is concerned with human performance is distinguished by: 1) its process, 2) its reliance on research, 3) its assessment of human performance through test and evaluation; and 4) its reliance on simulation and modeling.

Carlow Experience in Human Performance Research

Transportation Systems

• Carlow International conducted controlled research investigations for the U.S. DOT National Highway Traffic Safety Administration and the Insurance Institute for Highway Safety to reduce the rate of errors resulting in rear end collisions of automobiles, which accounted for 25% of all accidents. Through application of HFE technology (a single, center, high-mounted brake light) it was demonstrated that the error rate leading to rear end accidents was reduced by 54%, and the impact of there errors, measured in extent of damage to involved vehicles, was also reduced by 38%.

• Carlow conducted a series of investigations for the FAA, the Airline Pilots Association, and USAir, directed at reducing a specific type of human error in aircraft operation, altitude deviations, defined as instances where the pilot is flying the aircraft at an altitude other than the altitude ordered by air traffic controllers, which puts the aircraft in jeopardy of a mid-air collision. The approach toward reducing altitude deviation errors was to enhance the awareness and appreciation for such errors among pilots and air traffic controllers, including the reconstruction of altitude deviation incidents in a USAir flight simulator. Carlow personnel measured the altitude deviation error rates (defined as number of altitude deviations per 100,000 departures) before and after application of altitude awareness enhancement procedures. The rate prior to the altitude awareness enhancement was 2.23 errors per 100,000 departures. The rate subsequent to the altitude awareness enhancement was 1.10, a reduction of 50.7%.

• Evaluation of concepts for Airborne Data Link Cockpit Management and Display in use by data link system developers in designing information services and pilot-display interfaces. The models and analyses will support assessment of the implications of candidate designs and services for air crew information requirements, workload, and task performance.

• Development of a Crew Resource Management (CRM) Evaluation Expert System to automate a critical part of the CRM evaluation process through the development of a CRM evaluation expert system prototype that will lead to a more automated and standardized CRM evaluations of Line Oriented Flight Training (LOFT) sessions. Such a prototype can be integrated with the instructor's tasks and the debriefing process. For the FAA.

• Conduct of a field test of the effectiveness of daytime running lights, Department of Transportation, National Highway Transportation Safety Administration.

Back to Top

Maritime Systems

• Support to PMS 501 in the application of HSI to the Littoral Combat Ship (LCS). This involves preparation of the HSI Plan; assessment of HSI risks; development of experimentation plans to mitigate risks; development of HSI metrics; development of HSI design concepts; preparation of HSI inputs to ship acquisition documentation; and identification of HSI T&E requirements.

• Support to PMS 377 in application of HSI to LHA(R), ioncluding preparation of the HSI Plan; development of HSI risks; and preparation of HSI inputs to ship acquisition documentation.

• Support to NAVSEA 03 in the conduct of HSI reviews of acquisition programs, and automation of the review checklists.

• Participation in an update to ASTM 1166 for NAVSEA 03.

• Preparation of a template for conducting a top down requirements analysis in support of an HSI application to system acquisition, a template for an HSI Plan, and standard HSI inputs to the Capability Development Document (CDD), for NAVSEA 03.

• Evaluation of human machine interfaces, human performance and safety, for drilling operations on drill ships and deep water offshore platforms for BP/AMOCO.

• In collaboration with the National Biodynamics Laboratory at the University of New Orleans, assessment of the potential for seasickness and motion-induced interruptions as a result of ship motions, and development of criteria for reducing the adverse effects of these motions.

• Development of the Human Performance System Plan (HPSP) Manual for preparation of an HPSP, which will replace the NTSP and TRPPM, for N00T.

• Assessment of HSI aspects of technology being considered for the Littoral Combat Ship (LCS), for PEO(S).

• Application of human systems engineering to the reduction of workload and manpower, and enhancement of human performance, safety and quality of life for the Navy's DD 21 and DD(X) ship acquisition programs, for PEO(Strike) and the Naval Sea Systems Command.

• HSI top down requirements analysis for JCC(X), N00178-98-D-2023, 2002.

• Human Systems Integration evaluation of the Electromagnetic Aircraft Launch System, Naval Air Systems Command.

• Development of tools for rapid analysis of HSI requirements including function and task analysis and assessment of workloads, under the NAVSEA SBIR program.
Function analysis and allocation to define the roles of humans, and determination of techniques to reduce workload in the operation of the LHA(R) class of ships, NSWC Carderock.

• Application of HSI principles, methods and data to the Collaborative Engineering Environment of the Chief Engineer in the office of the Assistant Secretary of the Navy for Research, Development and Acquisition (ASN/RDA).

• Development of a HFE and system safety process for integration into the Coast Guard's system acquisition process, with special attention on the process to design and evaluate human-computer interfaces in Coast Guard systems, U.S. Coast Guard Office of Safety, Security, and Environmental Health, Human Factors Division.

• HFE tools for evaluating and enhancing the affordability and competitiveness of shipping in Europe, through improved training, reduced human error, and reduced manning. Aristotle University of Thessaloniki, and the European Union DG VII Waterborne Transport.

• Evaluation of human machine interface concepts for providing humans with sensor data from unmanned spaces in a reduced manning ship, under the RSVP (Reduced Staffing through Virtual Presence) Program.

• Evaluation of design concepts for improved aircraft carrier Landing Signal Officer (LSO) control station, for the Naval Air Warfare Center Aviation Division Lakehurst.

• Development of an automated tool, and associated human computer interface, for Visualization of faults and human errors for the U.S. Navy Surface Warfare Center, Dahlgren.

• Evaluation of decision support systems technology requirements in the Navy's Human Engineering R&D Program, for Chief of Naval Operations, N1.

• Development and evaluation of human performance capability with wearable electronics in support of workload reductions in aircraft cockpits and CV flight deck, NAVAIR.

• Evaluation of human performance in the application of touch screen technology to the multi-modal watchstation, for SPAWAR Systems Center.

• Evaluation of concepts for the Integrated Engineering Plant (IEP) based on selected mission/operational scenarios and assessment of alternate strategies for human performance and automation to accomplish IEP functions.

• Developed Navy Science and Technology (S&T) requirements for a research program addressing robotics, automation and advanced control for transporting and handling munitions and cargo aboard aircraft carriers.

• Development and assessment of HFE technology in the Feasibility Design Phase of the Mid-Term Fast Sealift Technology Variant ships to ensure that HFE issues are addressed at the Feasibility Design Phase of Sealift ship design, and to provide the HFE tools and data to address the issues. Specific objectives include: a) identifying the HFE requirements for Sealift vessels that will enhance operability, safety, human performance and mission success, in a reduced manning environment; b) providing design concepts and criteria for integrated single operator consoles, reduced manning and human-machine interfaces (HMI) for ship services such as food service, and HMI for maintenance; and c) revising training curricula for operation and maintenance. U.S. Naval Sea Systems Command.

• Assessment of shipboard combat systems and systems personnel performance problems in cold environments, with particular emphasis on effects of extreme cold on combat system operator cognitive performance, and development of design and training solutions to problems, NAVSEA Combat Systems Survivability Office.

Back to Top

Medical Systems/Provisions for the Aged and Disabled

• Development of requirements to conduct controlled evaluations of assistive technology to be used in the homes of elders and persons with disabilities in the Information Age Town of Ennis, County Clare, Ireland with particular attention to design for usability, for Shannon Development.

• Evaluation of recommended interventions in the care of Alzheimers patients in special care facilities, for the National Institute on Aging (NIA).

• HFE Design Guidelines for Aged and Disabled Passengers and Crew on Cruise Ships and Ferries, for the Irish Nautical Enterprise Centre, and European Union DG VII Waterborne Transport.

• Evaluation of human performance with improved computer screens and human computer interfaces used in sterilizer process control, for Ethicon Incorporated, a Division of Johnson and Johnson.

• Evaluation of existing Medication Memory Aids for elderly users.
Information Systems

• Evaluation of graphical user interface (GUI) design guidelines for Internal Revenue System advanced information processing systems.

• Assessment of automated tools and data to support the development of C4I operator-machine interface design concepts and prototypes incorporating high definition systems technology, Space and Naval Warfare Systems Command and Advanced Research Projects Agency (ARPA).

• Conduct of empirical research to develop design guidelines for the human-machine interfaces, with emphasis on color, symbology, and graphic displays, for Naval warfare systems, specifically the AEGIS Combat System Upgrade, the DARPA High Definition Display System, and the Space and Naval Warfare Systems Command.

• Evaluation of concepts and criteria for advanced display applications, including hypermedia and virtual reality, to spacecraft control center design, NASA Goddard Space Flight Center.

• Assessment of human error potential and the adequacy of user-computer interface design implementation in command and control systems in terms of requirements to maintain data security, for the Space and Naval Warfare Systems Command (SPAWAR).

• Development of human performance enhancement requirements, design concepts and a functional specification for user-computer interfaces of the integrated communications management subsystem (ICMS) of the Army's TACFIRE system.

• Evaluation of user-computer interface design concepts and criteria for spacecraft data capture facilities, Goddard Space Flight Center,.

• Evaluations of control rooms at 38 separate nuclear power plants, for 21 utilities in the United States and Japan. This includes the review of nine plants for seven utilities, conducted for the Nuclear Regulatory Commission; evaluation of control rooms for 25 plants conducted for 11 United States utilities; and the review of four plants for three Japanese utilities.

• Development of an R&D program Plan for the development of soldier-robot interface concepts and criteria, and to support the application of HFE design principles for the supervisory control of Army robotic systems, for the U.S. Army Human Engineering Laboratory.

• Design of an expert system for assisting in the allocation of system functions to human operator extra-vehicular activity (EVA), to remotely-controlled teleoperated systems, or to automated robotic systems, to support the performance of Space Station missions, for NASA Johnson Space Center.

• Evaluation of the extent to which human factors engineering and operator training contributed to the accident at Three Mile Island, Nuclear Regulatory Commission.

Back to Top