Skip to main content
. 2023 Nov 24;12:e51873. doi: 10.2196/51873

Table 1.

Overview of outcome measures.

Outcome measure Variable or scale Measure Analysis method
Primary

Usability (SUSa) Continuous, nominal, ordinal, and 5-point Likert-type scaleb
  • 0-100 (SUS score: >68=above average and <68=below average)

  • The individual scores of the participants for each question are transformed into a new number, which is then aggregated and multiplied by 2.5 to convert the initial range of scores from 0-40 to a new range of 0-100.

The frequencies, means, and SD of each item of the SUS scale will be calculated and compared using the McNemar or chi-square and Wilcoxon tests, respectively. In addition, each group’s usability scores and grades will be correlated using Spearman correlation.
Secondary

Perception of AIc Continuous, nominal, ordinal, and 5-point Likert-type scale
  • The questionnaire consists of four sections: (1) sociodemographic information; (2) AI literacy exploration of positive learning experiences with AI; (3) examination of negative experiences associated with AI use; and (4) an assessment of the potential for discussing accountability, fostering student leadership, and addressing ethical and equity concerns pertaining to the use of AI.

Fisher exact or Pearson chi-square test will investigate the associations between the categorized scales and sociodemographic characteristics.
Learning outcomes Continuous
  • Students’ grades on both interventions. Score range (0-100)

Mean, SD

aSUS: System Usability Scale.

b5=Strongly agree, 4=agree, 3=neither agree nor disagree, 2=disagree, and 1=strongly disagree.

cAI: artificial intelligence.