Test-Retest Results | Pilot results for individual survey items – pre and post workshop | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Survey Item | Kappaa | SE Kappa | CI 95 % | Expected Agreement (%) | Observed Agreement (%) | ‘p’b | Pre-Workshop Mean (n = 215) | Post-Workshop Mean (n = 215) | Wilcoxon Paired Samples Test | |
‘z’ | ‘p’ | |||||||||
1 | .707 | .140 | .430–.980 | 84.8 | 95.6 | .0000 | 4.1 | 4.6 | 5.769 | .000 |
2 | .781 | .138 | .511–1.00 | 74.9 | 94.5 | .0000 | 1.7 | 1.6 | .754 | .451 |
3 | .577 | .138 | .270–.847 | 90.6 | 96.0 | .0000 | 2.8 | 2.4 | 6.264 | .000 |
4 | .722 | .140 | .450–.994 | 88.8 | 96.9 | .0000 | 4.2 | 4.6 | 6.313 | .000 |
5 | .558 | .141 | .282–.833 | 91.0 | 96.0 | .0000 | 4.5 | 4.7 | 4.582 | .000 |
6 | .544 | .127 | .306–.792 | 90.3 | 95.6 | .0000 | 4.4 | 4.6 | 5.256 | .000 |
7 | .639 | .140 | .365–.913 | 86.5 | 95.1 | .0002 | 4.0 | 4.4 | 6.391 | .000 |
8 | .511 | .138 | .241–.781 | 89.6 | 94.9 | .0001 | 2.0 | 1.6 | 4.331 | .000 |
9 | .686 | .134 | .424–.948 | 92.8 | 97.8 | .0000 | 4.2 | 4.4 | 3.752 | .002 |
10 | .764 | .141 | .487–1.00 | 88.4 | 97.3 | .0000 | 3.1 | 2.6 | 6.016 | .000 |
11 | .704 | .137 | .436–.972 | 92.4 | 97.8 | .0000 | 1.9 | 1.5 | 5.673 | .000 |
12 | .685 | .138 | .415–.995 | 94.4 | 98.3 | .0000 | 4.3 | 4.7 | 6.655 | .000 |
13 | .877 | .140 | .603–1.00 | 87.9 | 98.5 | .0000 | 3.6 | 4.1 | 8.365 | .000 |
14 | .884 | .139 | .612–.995 | 90.3 | 98.9 | .0000 | 4.0 | 4.7 | 9.055 | .000 |
15 | .723 | .139 | .451–.995 | 80.0 | 94.4 | .0000 | 3.4 | 2.3 | 9.860 | .000 |
16 | .669 | .141 | .364–.945 | 89.1 | 96.4 | .0000 | 2.8 | 2.1 | 7.352 | .000 |
17 | .640 | .139 | .368–.912 | 87.8 | 95.6 | .0000 | 2.5 | 3.4 | 8.671 | .000 |
18 | .628 | .139 | .356–.900 | 90.6 | 96.5 | .0000 | 2.9 | 3.9 | 10.770 | .000 |
19 | .374 | .140 | .098–.650 | 93.4 | 95.9 | .0040 | 3.2 | 4.1 | 9.883 | .000 |
20 | .632 | .141 | .403–.908 | 91.2 | 96.8 | .0000 | 3.1 | 4.0 | 10.061 | .000 |
21 | .679 | .141 | .403–.995 | 83.4 | 94.7 | .0000 | 2.9 | 3.9 | 10.398 | .000 |
22 | .388 | .138 | .116–.660 | 90.2 | 94.0 | .0026 | 2.9 | 3.7 | 9.599 | .000 |
23 | .517 | .140 | .243–.791 | 83.4 | 92.0 | .0001 | 2.6 | 3.6 | 9.828 | .000 |
24 | .694 | .141 | .418–.970 | 88.2 | 96.4 | .0000 | 3.4 | 2.3 | 10.306 | .000 |