29
3 Introductory Human Factors, Reliability, and Error Concepts
3.1 introduction
Over the years considerable new developments have taken place in the areas of human factors, reliability, and error. Human factors, reliability, and error have become rec- ognizable disciplines in the industrial sector in many parts of the world. There are many standard documents on human factors that directly or indirectly cover human reliability and error as well. These standard documents are often cited in the design specification of complex engineering systems [1].
More specifically, the new system design must satisfy requirements specified in these documents. Thus, nowadays it is not uncommon to come across human fac- tors specialists (who cover human reliability and error as well) working alongside design engineers during the design and development of engineering systems, for use in areas such as nuclear power generation and aviation. These specialists use various human factors, reliability, and error-related concepts to produce effective systems with respect to humans [2, 3].
This chapter presents various introductory human factors, reliability, and error concepts considered useful for application in the areas of engineering maintenance, taken from published literature.
3.2 Human Factors oBJectives and man–macHine system tyPes and comParisons
There are many objectives of human factors. They may be categorized under four distinct classifications as follows [4]:
Classification I: Fundamental Operational Objectives.
• These are basi-
cally concerned with improving system performance, increasing safety, and reducing human errors.
Classification II:
• Objectives Affecting Operators and Users. These are concerned with improving the work environment, increasing aesthetic appearance, increasing user acceptance and ease of use, and reducing fatigue, physical stress, boredom, and monotony.
Classification III:
• Objectives Affecting Reliability and Maintain- ability. These are concerned with improving reliability, increasing maintainability, reducing the manpower need, and reducing training requirements.
Classification IV:
• Miscellaneous Objectives. These are concerned with items such as reducing equipment and time losses and increasing produc- tion economy.
Although there are many types of man-machine systems, they may be grouped under the following three categories [5]:
Category I: Automated Systems.
• These systems carry out operation-re-
lated functions including processing, sensing, decision making, and action.
The majority of these systems are of the closed-loop type and normally the basic human functions associated with such systems are monitoring, maintenance, and programming.
Category II:
• Mechanical or Semiautomatic Systems. These systems contain well-integrated parts, such as various types of powered machine tools. Normally, in these systems the machines provide the power and the humans typically carry out the control function.
Category III:
• Manual Systems. These systems contain hand tools and other aids along with the human operator who controls the overall opera- tion. The operator makes use of his or her own physical energy as a power source, and then transmits/receives from the tools a significant amount of information.
Some of the important comparisons between humans and machines (in parenthe- ses) are as follows [6]:
Humans have excellent memory (machines are remarkably costly to have
•
the same capability).
Humans have relatively easy maintenance needs (machines’ maintenance
•
problems become serious with the increase in complexity).
Humans are subjected to social environments of all kinds (machines are
•
independent of social environments of all types).
Humans’ performance efficiency is affected by anxiety (machines are
•
quite independent of this shortcoming).
Humans are very flexible with respect to task performance (machines are
•
relatively inflexible).
Humans have high tolerance for factors such as ambiguity, vagueness, and
•
uncertainty (machines are quite limited in tolerance in regard to factors such as these).
Humans are limited to a certain degree in channel capacity (machines
•
have unlimited channel capacities).
Humans are poor monitors of events that do not occur frequently (machines
•
possess options to be designed to reliably detect infrequently occurring events.
Humans are subjected to stress because of interpersonal or other difficul-
•
ties (machines are completely free of such difficulties).
Humans are unsuitable for performing tasks such as amplification, data
•
coding, or transformation (machines are extremely useful for performing tasks such as these).
Humans have rather restricted short-term memory for factual matters
•
(machines can have unlimited short-term memory but its affordability is a limiting factor).
Humans are subjected to factors such as motion sickness, disorientation,
•
and Coriolis effects (machines are completely free of such effects).
Humans are often subjected to departure from following an optimum
•
strategy (machines always follow the design strategy).
Humans are subjected to deterioration in performance because of bore-
•
dom and fatigue (machines are not affected by factors such as these, but their performance is subjected to deterioration because of wear or lack of calibration).
Humans are very capable of making inductive decisions under novel con-
•
ditions (machines possess very little or no induction capabilities at all).
3.3 Human sensory caPacities and tyPical Human BeHaviors and tHeir corresPonding design considerations
Humans possess many useful sensors: touch, sight, taste, hearing, and smell. A clear understanding of their sensory capacities can be quite useful in reducing the occurrence of human errors in engineering maintenance. Thus, some of the human sensory-related capacities are described below [3, 7].
3.3.1 toucH
The sense of touch is related to humans’ ability in interpreting visual and auditory stimuli. The sensory cues received by muscles and the skin can be used for send- ing messages to the brain, thus relieving the ears and the eyes of the workload, to a certain degree.
3.3.2 sigHt
This is stimulated by the electromagnetic radiation of certain wavelengths, often referred to as the visible portion of the electromagnetic spectrum. The spectrum’s various areas, as seen by the human eyes, appear to vary in brightness. For example, in the day light, the human eyes are very sensitive to greenish-yellow light with a wavelength of about 5500 Angstrom units [7].
Moreover, the human eyes perceive all colors when they are looking straight ahead but as the viewing angle increases, the color perception begins to decrease.
Also, the human eyes see differently from different angles.
3.3.3 vibration
Past experiences indicate that the presence of vibration could be quite detrimental to the performance of mental and physical tasks by humans such as maintenance personnel. There are numerous vibration parameters including frequency, velocity, acceleration, and amplitude. More specifically, large amplitude and low frequency vibrations contribute to various problems including headaches, eyestrain, fatigue, motion sickness, and interference with the ability to read and interpret instruments properly [7].
Furthermore, high frequency and low amplitude vibrations can also cause fatigue to a certain degree.
3.3.4 noise
Noise may simply be described as sounds that lack coherence and human reactions to noise extend beyond the auditory systems (e.g., irritability, fatigue, or boredom).
Excessive noise can lead to problems such as adverse effects on tasks requiring a high degree of muscular coordination and precision or intense concentration, reduc- tion in the workers’ efficiency, and loss of hearing if exposed for long periods.
Over the years, various human behaviors have been observed by researchers in the field. Some of the typical human behaviors and their corresponding design con- siderations are presented in Table 3.1 [2].
taBle 3.1
typical Human Behaviors and their corresponding design considerations
no. typical Human Behavior corresponding design consideration 1 Humans often tend to hurry Develop design such that it properly takes into
consideration the element of human hurry 2 Humans get easily confused with unfamiliar
items/things
Avoid designing totally unfamiliar items/things
3 Humans often use their sense of touch for exploring or testing the unknown
Give careful attention to this factor during design, particularly to the product/item handling aspect
4 Humans frequently regard manufactured items as being safe
Design products such that they become impossible to be used incorrectly 5 Humans have become accustomed to certain
color meanings
During design strictly observe existing color coding standards
6 Humans normally expect to turn on the electrical power, the switches have to move upward, or to the right, etc.
Design such switches as per human expectations
7 Humans always expect that faucets/handles will rotate counter-clockwise for increasing the flow of gas, steam, or liquid
Design such items as per human expectations
3.4 Human Factors–related Formulas
Over the years, researchers have developed various types of mathematical formulas for estimating human factors–related information. Four of these formulas considered useful for application in engineering maintenance are presented below.
3.4.1 FormulaFor estimating insPector PerFormance
This formula is concerned with estimating inspector performance with respect to inspection tasks. Thus, the inspector performance is expressed by [3, 8]
θi tr
p ie
T n n
= − (3.1)
where qi is the inspector performance expressed in minutes per correct inspection, np
is the total number of patterns inspected, nie is the total number of inspector errors, and Ttr is the total reaction time expressed in minutes.
3.4.2 FormulaFor estimating rest Period
When humans perform lengthy or strenuous tasks, the incorporation of proper rest periods is considered essential. Thus, this formula is concerned with estimating the length of scheduled or unscheduled rest periods. The length of the required rest period is expressed by [9]
T T E E
E RL
rp w a s
a a
= −
−
( )
( ) (3.2)
where Ttr is the required length of the rest period expressed in minutes, Tw is the work- ing time expressed in minutes, Ea is the average energy cost/expenditure expressed in kilocalories per minute of work, Es is the kilocalories per minute adopted as stan- dard, and RLa is the approximate resting level expressed in kilocalories per minute (usually, the value of RLa is taken as 1.5).
3.4.3 FormulaFor estimating cHaracter HeigHt
As usually the instrument panels are located at a viewing distance of 28 inches for the comfortable performance and control of adjustment-oriented tasks, this formula is concerned with estimating the character height at the viewing distance of 28 inches.
Thus, the character height is expressed by
C C D
h= s ν
28 (3.3)
where Dn is the specified viewing distance expressed in inches, Ch is the character height at the specified viewing distance, Dn, expressed in inches, and Cs is the stan- dard character height from a viewing distance of 28 inches.
Example 3.1
Assume that maintenance workers have to read a meter from a distance of 70 inches and the standard character height at a viewing distance of 28 inches is 0.50 inches.
Estimate the height of numerals for the stated viewing distance.
By substituting the given data values into Equation (3.3), we get Ch=
=
( . )( ) .
0 50 70 28 1 25 inches
Thus, the height of numerals for the stated viewing distance of 70 inches is 1.25 inches.
3.4.4 FormulaFor estimating glare constant
Various types of human errors can occur in maintenance work due to glare. The value of the glare constant can be estimated by using the following formula [9]:
α λ β
=( 0 8. ) (µ1 6. )
Lg 2 (3.4)
where a is the glare constant, Lg is the general background luminance, l is the solid angle subtended at the eye by the source, μ is the angle between the direction of the glare source and the viewing direction, and b is the source luminance.
3.5 useFul Human Factors guidelines and data collection sources
Over the years, researchers working in the area of human factors have developed many useful human factors-related guidelines for application in engineering system design. Some of these guidelines are as follows [2, 6]:
Review system objectives with respect to human factors.
•
Obtain all appropriate human factors-related design reference documents.
•
Develop an effective human factors-related checklist for use during
•
system design and operation phases.
Use the services of human factors experts as considered appropriate.
•
Conduct field tests of the system design prior to its approval for delivery
•
to customers.
Review final production drawings in regard to human factors.
•
Make use of mock-ups for “testing” the effectiveness of user-hardware
•
interface designs.
There are many sources for collecting human factors-related data. Some of the important ones are as follows [10, 11]:
Test reports.
• These reports contain data obtained from testing manufac- tured items or goods.
User experience reports.
• These reports contain data reflecting experi- ences of users with the system/equipment in the field use environment.
Published standards.
• These documents are published by various organi- zations including professional societies and government agencies.
Published literature.
• This includes items such as journals, technical reports, and conference proceedings.
System development phase.
• This is a good source for collecting various
types of human factors-related data.
Previous experience.
• This is a quite good source for obtaining data from similar cases that have occurred in the past.
3.6 Human PerFormance eFFectiveness and oPerator stress cHaracteristics
Over the years, various researchers have studied the relationship between human performance and stress. They conclude that such relationship basically follows the shape of the curve shown in Figure 3.1 [12, 13].
The curve shows that stress to a moderate level is necessary to achieve optimal human performance effectiveness. Otherwise, at a very low stress, the task will become dull and unchallenging, and consequently human performance effectiveness will not be at its highest point.
High
Low Human performance effectiveness
stressLow Moderate
stress High stress
Stress Figure 3.1 Human performance effectiveness versus stress curve.
In contrast, stress beyond a moderate level will cause deterioration in human per- formance because of factors such as fear, worry, or other kinds of psychological stress. It simply means that the probability of human error occurrence will be higher under high stress than under moderate stress.
Human operators perform various types of tasks in diverse engineering areas. In performing such tasks, they may have certain limitations. Past experiences indicate that when these limitations are violated, probability for the error increases quite significantly [14]. This probability can be reduced significantly by carefully consid- ering operator limitations or characteristics during the system design. Some of these characteristics are as follows [14]:
Performing task steps at high speed
•
Poor feedback information in determining the correctness of actions taken
•
The requirement for prolonged monitoring
•
Having rather short decision-making time
•
Performing tasks that require a very long sequence of steps
•
Requirement to operate more than one control simultaneously at high
• speed
Requirement to make quick comparisons of two or more displays
•
Requirement to make decisions on the basis of data collected from diverse
• sources
3.7 occuPational stressors and general stress Factors The occupational stressors may be classified under the following four categories [12]:
Category I: Workload-related stressors.
• These stressors are concerned
with work under load or work overload. In the case of work under load, the present duties being carried out by the individual fail to provide suf- ficient stimulation. Some examples of work under load are the lack of any intellectual input, task repetitiveness, and the lack of opportunity to use acquired expertise and skills of the individual. In contrast, in the case of work overload the job requirements exceed the ability of the individual to satisfy them in an effective manner.
Category II:
• Occupational change-related stressors. These stressors are concerned with factors that disrupt cognitive, behavioral, and physi- ological patterns of functioning of the individual.
Category III:
• Occupational frustration-related stressors. These stres- sors are concerned with the problems related to occupational frustration.
The problems include the lack of proper communication, poor career development guidance, and the ambiguity of one’s role.
Category IV:
• Miscellaneous stressors. These stressors include all other stressors that are not incorporated into the above three categories. Some examples of the miscellaneous stressors are poor interpersonal relation- ships, too much or too little lighting, and too much noise.
Over the years, various researchers in the area of human engineering have pointed out that there are many general factors that considerably increase stress on an indi- vidual, in turn leading to a significant deterioration in his or her reliability. Some of these general factors are as follows [15]:
Poor health
•
Possibility of redundancy at work
•
Having to work with individuals with unpredictable temperaments
•
Serious financial difficulties
•
Working under extremely tight time pressures
•
Lacking the proper expertise to perform the ongoing job
•
Experiencing difficulties with spouse or children or both
•
Poor chances for promotion
•
Excessive demands from superiors at work
•
3.8 Human PerFormance reliaBility and correctaBility Functions Both these functions are derived below, separately.
3.8.1 Human PerFormance reliability Function
Although all the tasks performed by humans are not in continuous time, from time to time humans do perform time-continuous tasks such as scope monitoring, missile countdown, and aircraft maneuvering. In situations such as these, human perfor- mance reliability is a very important parameter.
Thus, in time-continuous tasks the probability of occurrence of human error in the finite time interval Δt is expressed by [16–19]
P B A( / )=λ ∆( )t t (3.5) where A is an errorless performance event of duration time t, B is an event in which the human error will occur in time interval (t, t + Δt), and l(t) is the time-dependent error rate.
Thus, the joint probability of the errorless human performance may be expressed as follows:
P B A P A( / ) ( )=P A( )−P B A P A( / ) ( ) (3.6) where P(A) is the probability of occurrence of event A, and B is the event that human error will not occur in time interval [t, t + Δt].
Equation (3.6) may be rewritten as follows [16–19]:
HR t( )−HR t P B A( ) ( / )=HR t( + ∆t) (3.7) where HR(t) is the human reliability at time t and HR(t + Δt) is the human reliability at time t + Δt.
It is to be noted that Equation (3.6) denotes an errorless human performance prob- ability over time intervals [0, t] and [t, t + Δt].
By substituting Equation (3.5) into Equation (3.7), we obtain HR t t HR t
t t HR t
( ) ( )
( ) ( ) +∆ − = −
∆ λ (3.8)
In the limiting case, Equation (3.8) becomes dHR t
dt( ) t HR t ( ) ( )
= −λ (3.9)
By rearranging Equation (3.9), we get 1
HR t dHR t t dt
( ) ( )= −λ( ) (3.10)
By integrating both sides of Equation (3.10) over the time interval [0, t], we obtain
1
1 HR t dHR t 0 t dt
HR t t
( ) ( ) ( )
∫
( ) ⋅ = −∫
λ (3.11)because at t = 0, HR (0) = 1.
After evaluating the left-hand side of Equation (3.11), we get ln HR t t dt
t
( )= −
∫
0λ( ) (3.12)Thus, from Equation (3.12), we obtain
HR t( )=e− ∫t0λ( )t dt (3.13) Equation (3.13) is the general expression for computing human reliability, irre- spective of whether the human error rate is constant or nonconstant. More specifi- cally, it holds when time to human error is described by statistical distributions such as normal, gamma, exponential, Weibull, and Rayleigh.
Example 3.2
Assume that the time to human error of a maintenance worker follows Weibull dis- tribution. Thus, his or her time-dependent error rate is expressed by
λ β
θ
β
( )t = tβ−1 (3.14)
where t is time, b is the distribution shape parameter, and q is the distribution scale parameter. Obtain an expression for the maintenance worker’s reliability.
By substituting Equation (3.14) into Equation (3.13), we get HR t e
e
t t
dt
t
( )=
=
− ∫
−
( )
− 0
β β1 θβ β θ
(3.15)
Thus, Equation (3.15) is the expression for the maintenance worker’s reliability.
3.8.2 Human PerFormance correctability Function
This is concerned with the human capacity to correct self-generated human errors and is defined as the probability that an error will be corrected in item t subject to stress constraint inherent in the nature of the task and its associated environment [18]. Mathematically, the correctability function is defined as follows [18, 19]:
CP t( )= −1 e− ∫t0α( )t dt (3.16) where CP(t) is the probability that an error will be corrected in time t and a(t) is the time-dependent rate at which tasks are corrected.
It is to be noted that Equation (3.16) holds whether the task correction rate is constant or nonconstant. More specifically, it holds for any time to task correction probability distribution.
Example 3.3
Assume that the time to error correction of a maintenance worker follows exponen- tial distribution. Thus, his or her error correction rate is defined by
α( )t =α (3.17)
where a is the constant error correction rate of the maintenance worker. Obtain an expression for the maintenance worker’s correctability function.
Substituting Equation (3.17) into Equation (3.16) yields
CP t e
e
t dt
t
( )= −
= −
− ∫
−
1 1
0α
α (3.18)
Thus, Equation (3.18) is the expression for the maintenance worker’s correctabil- ity function.
3.9 Human error occurrence reasons, consequences, ways, and classiFications
Past experiences indicate that there are many reasons for the occurrence of human errors. Some of the important ones are poor training, poor equipment design, poor motivation, complex task, poorly written equipment operating and maintenance pro- cedures, inadequate lighting in the work area, poor management, improper work
tools, crowded workspace, poor work layout, poor verbal communication, and high noise and temperature in the work area [20].
The consequences of a human error can range from minor to very severe, for example, from insignificant delays in system performance to a very high loss of lives.
Furthermore, they may vary from one situation to another, from one task to another, or from one piece of equipment to another. In particular, with respect to equipment, the human error consequences may be grouped under three classifications: equipment operation is stopped completely, equipment operation is delayed quite significantly but not stopped completely, and delay in equipment operation is insignificant.
There are many ways in which a human error can occur. The common ones are shown in Figure 3.2 [21].
Human errors in engineering may be grouped under various classifications. The seven commonly used classifications are as follows [20, 22–24]:
Maintenance errors
•
Operator errors
•
Design errors
•
Assembly errors
•
Inspection errors
•
Handling errors
•
Contributory errors
•
Additional information on the above errors is available in Refs. [20, 22–24].
3.10 Human reliaBility and error data collection sources and quantitative data
Human reliability and error data are the backbone of any human reliability/error predic- tion. These data are collected through means such as expert judgments, experimental studies, field experiences, self-made error reports, and published literature [3, 25–26].
Making an incorrect decision in response to
a problem
Failure to recognize a hazardous situation
Poor timing and inadequate response to
a contingency
Failure to carry out a required function
Performing a task that should not be accomplished Common
ways
Figure 3.2 Common ways human error occurs.
There are many data banks for obtaining human reliability and error-related information [3, 26]. Some of these are Data Store [27], Nuclear Plant Reliability Data System [28], Safety Related Operator Action (SROA) Program [29], Aerojet General Method [30], Bunker-Ramo Tables [31], Air Force Inspection and Safety Center Life Sciences Accident and Incident Reporting System [32], and Aviation Safety Reporting System [33].
Human reliability and error data for some selective tasks, directly or indirectly related to engineering maintenance, are presented in Table 3.2 [3].
3.11 ProBlems
1. Discuss three types of man-machine systems.
2. Discuss at least ten comparisons between humans and machines.
3. What are the four main classifications of human factors objectives?
4. List at least six typical human behaviors.
5. Assume that maintenance workers have to read a meter from a distance of 60 inches and the standard character height at a viewing distance of 28 inches is 0.50 inches. Estimate the height of numerals for the stated viewing distance.
6. Discuss at least five sources for collecting human factors-related data.
7. Describe the human performance effectiveness versus stress curve.
8. What are the important reasons for the occurrences of human errors?
9. Discuss five common ways in which a human error can occur.
10. What are the common classifications of human errors in engineering?
taBle 3.2
Human reliability and error data for some selective tasks
no. error/task description
Performance reliability
error rate per million operations 1 Turning rotary selector switch to certain
position
0.9996 —
2 Finding maintenance (scheduled) approaches in maintenance manual
0.997 —
3 Failure to tighten nut and bolt — 4800
4 Reading gauge incorrectly — 5000
5 Installing o-ring incorrectly — 66700
6 Closing valve incorrectly — 1800
7 Connecting hose incorrectly — 4700
8 Failure to install nut and bolt — 600
9 Procedural error in reading instructions — 64500
10 Incorrect adjustment of mechanical linkage
— 16700
reFerences
1. MIL-H-46855, Human Engineering Requirements for Military Systems, Equipment, and Facilities, Department of Defense, Washington, D.C., May 1972.
2. Woodson, W.E., Human Factors Design Handbook, McGraw-Hill Book Company, New York, 1981.
3. Dhillon, B.S., Human Reliability: With Human Factors, Pergamon Press, New York, 1986.
4. Chapanis, A., Human Factors in Systems Engineering, John Wiley and Sons, New York, 1996.
5. McCormick, E.J., Sanders, M.S., Human Factors in Engineering and Design, McGraw- Hill Book Company, New York, 1982.
6. Dhillon, B.S., Advanced Design Concepts for Engineers, Technomic Publishing Company, Lancaster, PA, 1998.
7. AMCP-706-134, Engineering Design Handbook: Maintainability Guide for Design, Prepared by the United States Army Material Command, Alexandria, VA, 1972.
8. Drury, C.G., Fox, J.G., Editors, Human Reliability in Quality Control, John Wiley and Sons, New York, 1975.
9. Oborne, D.J., Ergonomics at Work, John Wiley and Sons, New York, 1982.
10. Dhillon, B.S., Engineering Design: A Modern Approach, Richard D. Irwin, Inc., Chicago, 1996.
11. Peters, G.A., Adams, B.B., Three Criteria for Readable Panel Markings, Product Engineering, Vol. 30, 1959, pp. 375–385.
12. Beech, H.R., Burns, L.E., Sheffield, B.F., A Behavioural Approach to the Management of Stress, John Wiley and Sons, New York, 1982.
13. Hagen, E.W., Human Reliability Analysis, Nuclear Safety, Vol. 17, 1976, pp. 315–326.
14. Meister, D., Human Factors in Reliability, in Reliability Handbook, edited by W.G., Ireson, McGraw-Hill Book Company, New York, 1966, pp. 400–415.
15. Dhillon, B.S., On Human Reliability: Bibliography, Microelectronics and Reliability, Vol. 20, 1980, pp. 371–373.
16. Regulinski, T.L., Askren, W.B., Mathematical Modeling of Human Performance Reliability, Proceedings of the Annual Symposium on Reliability, 1969, pp. 5–11.
17. Askern, W.B., Regulinski, T.L., Quantifying Human Performance for Reliability Analysis of Systems, Human Factors, Vol. 11, 1969, pp. 393–396.
18. Regulinski, T.L., Askern, W.B., Stochastic Modeling of Human Performance Effectiveness Functions, Proceedings of the Annual Reliability and Maintainability Symposium, 1972, pp. 407–416.
19. Dhillon, B.S., Singh, C., Engineering Reliability: New Techniques and Applications, John Wiley and Sons, New York, 1981.
20. Meister, D., The Problem of Human–Initiated Failures, Proceedings of the 8th National Symposium on Reliability and Quality Control, 1962, pp. 234–239.
21. Hammer, W., Product Safety Management and Engineering, Prentice Hall, Inc., Englewood Cliffs, NJ, 1980.
22. Juran, J.M., Inspector’s Errors in Quality Control, Mechanical Engineering, Vol. 57, 1935, pp. 643–644.
23. McCormack, R.L., Inspection Accuracy: A Study of the Literature, Report No. SCTM 53–61 (14), Sandia Corporation, Albuquerque, NM, 1961.
24. Meister, D., Human Factors: Theory and Practice, John Wiley and Sons, New York, 1971.
25. Meister, D., Human Reliability, in Human Factors Review, edited by F.A., Muckler, Human Factors Society, Santa Monica, CA, 1984, pp. 13–53.
26. Dhillon, B.S., Human Error Data Banks, Microelectrics and Reliability, Vol. 30, 1990, pp. 963–971.
27. Munger, S.J., Smith, R.W., Payne, D., An Index of Electronic Equipment Operability:
Data Store, Report No. AIR-C43-1/62 RP (1), American Institute for Research, Pittsburgh, PA, 1962.
28. Reporting Procedures Manual for the Nuclear Plant Reliability Data System (NPRDS), South-West Research Institute, San Antonio, TX, December 1980.
29. Topmiller, D.A., Eckel, J.S., Kozinsky, E.J., Human Reliability Data Bank for Nuclear Power Plant Operations: A Review of Existing Human Reliability Data Banks, Report No. NUREG/CR2744/1, United States Nuclear Regulatory Commission, Washington, D.C., 1982.
30. Irwin, I.S., Levitz, J.J., Freed, A.M., Human Reliability in the Performance of Maintenance, Report No. LRP317/TDR-63-218, Aerojet General Corporation, Sacramento, CA, 1964.
31. Hornyak, S.J., Effectiveness of Display Sub-Systems Measurement Prediction Techniques, Report No. TR-67-292, Rome Air Development Center (RADC), Griffis Air Force Base, Rome, New York, September 1967.
32. Life Sciences Accident and Incident Classification Elements and Factors, AFISC Operating Instruction No. AFISCM 127-6, United States Air Force, Washington, D.C., December 1971.
33. Aviation Safety Reporting Program, FAA Advisory Circular No. 00-46B, Federal Aviation Administration (FAA), Washington, D.C., June 15, 1979.