| Content |
The test content measure what it is supposed to measure |
Structured progress (SP) was developed by two pulmonary consultants (PFC and UB) with more than 10 years’ experience in bronchoscopy, a thoracic surgeon and professor of medical education (LK) and a biomedical engineer with more than 5 years’ experience in simulation (MBSS). SP indicates the number of times the operator progressed from one segment to the immediate succeeding segment. Passing from segment #1 to #2 gives one point but going from segment #2 to #1 gives zero point. It ranges from 0–18 points, corresponding to 18 segments in the bronchial three. |
| Response process |
Integrity of data should always be maintained. Test administration should be controlled or standardized at a maximum level possible. |
All trials were performed in a controlled, simulated environment, each rating was blinded and double–checked with the video recording by the primary investigator KMC. |
| Internal structure |
This refers to the reliability of the test results. The internal consistency of the test items should result to similar scores when measuring the same construct. |
There was a correlation between all three outcome measures: Structured progress, diagnostic completeness, and AIT both across and within different groups of experience. Thereby, test items result to similar scores when measuring competency in bronchoscopy. |
| Relation to other variables |
Assessment scores should correlate with known measures of competence |
Structured progress was able to significantly differentiate the performances among the different levels of experience with median scores ± interquartile range for novices, intermediates and experienced of 5±3, 7±4.75 and 11±5, respectively (P<0.001) |
