This section addresses the research question regarding the impact of stressors in the training exercises. The hypotheses asked whether the match (or difference) between the stressors built into the two simulator exercises and the live exercise had an impact on
73
the RNoNA assessment tool’s prediction of team performance and whether there is a differential impact on measures of teamwork and taskwork.
The simulator exercise design suggests that there is higher demand for resilient behavior in cadet teams in the Carey exercise than in the Aden exercise. The live exercise design suggests an even higher demand for resilient behavior in cadet teams. The expectation is therefore to find higher correlations for Carey vs. Dolphin than for Aden vs. Dolphin.
Ordinal ratings data were analyzed using the non-parametric Spearman rank-order correlation coefficient ρ (Siegel & Castellan, 1988). The first set of analyses compares the assessments made in the Carey simulator exercise and the Dolphin live exercise. The second set of analyses compares the assessments made in the Aden simulator exercise and the Dolphin live exercise.
1. Does assessment in Carey predict assessment in Dolphin?
The Carey scenario-based simulator exercise represented uncertainty, vulnerability, ambiguity and dilemma situations in a complex maritime environment, placing a high demand on resilient behavior in the cadet teams.
The Dolphin live exercise is basically a set of events in a maritime military setting representing physical and mental challenges, uncertainty, vulnerability, time pressure, dilemma situations, boredom, ambiguity and danger, placing a very high demand on resilient behavior in the cadet teams.
a. Team Performance
Team performance assessment includes all twelve metrics. The average overall team performance in Carey was compared with the average overall team performance in Dolphin, Table 4. The Spearman rank-order correlation coefficient (n = 8 teams) is .66, with a p-value of .045 (Zar, 1972). This suggests that teams that perform well (or poorly) in Carey will also perform well (poorly) in Dolphin.
74
These findings support hypothesis H4. The overall team performance assessment predictability is high when the stressors built into the training exercise match the stressors in the live exercise.
b. Teamwork
Teamwork assessment includes the eight teamwork metrics. The average teamwork performance in Carey was compared with the average teamwork performance in Dolphin, Table 4. The Spearman rank-order correlation coefficient (n = 8 teams) is .67, with a p-value of .043 (Zar, 1972). This suggests that teams with a high teamwork score (or low) in the Carey have a high probability of receiving similar scores in the Dolphin.
These findings support hypothesis H5. The teamwork assessment predictability is high when the stressors built into the training exercise match the stressors in the live exercise.
c. Taskwork
Taskwork assessment includes the four taskwork metrics. The average taskwork performance in Carey was compared with the average taskwork performance in Dolphin, Table 4. The Spearman rank-order correlation coefficient (n = 8 teams) is .73, with a p-value of .028 (Zar, 1972). This suggests that teams with a high taskwork score (or low) in Carey have a high probability of receiving similar scores in Dolphin.
These findings support hypothesis H6. The taskwork assessment predictability is high when the stressors built into the training exercise match the stressors in the live exercise.
2. Does assessment in Aden predict assessment in Dolphin?
The Aden scenario-based simulator exercise represented time pressure, ethical and tactical dilemma situations, and extensive use of technology in an overt modern allied naval operation, placing a moderate demand on resilient behavior in the cadet teams.
75
In contrast, the Dolphin live exercise is basically a set of events in a maritime military setting representing physical and mental challenges, uncertainty, vulnerability, time pressure, dilemma situations, boredom, ambiguity and danger, placing a very high demand on resilient behavior in the cadet teams.
a. Team Performance
Team performance assessment includes all twelve metrics. The average overall team performance Carey was compared with the average overall team performance in Dolphin, Table 4. The Spearman rank-order correlation coefficient (n = 8 teams) is .29, with a p-value of .27 (Zar, 1972). This suggests that team performance assessments made in Aden have only moderate predictability for performance in Dolphin.
These findings support hypothesis H4. The team performance assessment predictability is low when the match between stressors built into the training exercise and the stressors in the live exercise are low.
b. Teamwork
Teamwork assessment includes the eight teamwork metrics. The average teamwork performance in Carey was compared with the average teamwork performance in Dolphin, Table 4. The Spearman rank-order correlation coefficient (n = 8 teams) is .33, with a p-value of .236 (Zar, 1972). This suggests that teamwork assessments made in Aden have only moderate predictability for performance in Dolphin.
These findings support hypothesis H5. The teamwork assessment predictability is low when the match between stressors built into the training exercise and the stressors in the live exercise are low.
c. Taskwork
Taskwork assessment includes the four taskwork metrics. The average taskwork performance in Carey was compared with the average taskwork performance in Dolphin, Table 4. The Spearman rank-order correlation coefficient (n = 8 teams) is .05,
76
with a p-value above .50 (Zar, 1972). This suggests that taskwork assessments made in Aden have very low predictability for taskwork performance in Dolphin.
These findings support hypothesis H6. The taskwork assessment predictability is low when the match between stressors built into the training exercise and the stressors in the live exercise are low.