Table 3.

Sample Alpha-Test Questions: Goal Setting

Observation
Rate the amount of attention the player gave to selecting goals from 1 to 3: 1 = paid no attention   2 = paid a little attention   3 = paid close attention
Did the player commit to trying the goals that they chose (commitment screen)? □ YES □ NO
Record any technical problems: □ If the child stopped playing the game and came back, the game started at the wrong place when they returned □ Broken link (game would not accept child's response to a question or statement) □ Clicking a button on the controller did not do what it was supposed to do □ Missing data (something that was supposed to be included was missing) □ Program froze □ Other; explain:
Record any relevant details:
Other comments:

Interview
Remind them which value they chose:
Show them index card with rating scale on it.
For this question, use this scale: 1 is not important, 2 is a little important, and 3 is very important.
How important, if at all, is this value to you?
Probe to determine underlying reasons for their answer.
Remind them which value reason they chose:
Show them index card with rating scale on it.
For this question, use this scale: 1 is no sense, 2 is a little sense, and 3 is a lot of sense.
How much sense, if any, did this reason make to you for eating fruit and vegetables and drinking water?
Probe to determine underlying reasons for their answer.
Were the goals for you to do or for a character in the game to do?
Probe to determine underlying reasons for their answer.
FOLLOW-UP QUESTION if they thought the goals were for a character in the game:The goals are actually for you to do in real life, not for a character in the game. How could we help the player understand that?
Remind them which problem they chose:
Show them index card with rating scale on it.
For this question, use this scale: 1 is not likely, 2 is a little likely, and 3 is very likely.
How likely would you be to have this problem if you try to (insert the one that they chose) [eat more fruit/ eat more vegetables/ drink more water]?
Probe to determine underlying reasons for their answer.
Remind them which solution they chose:
Show them index card with rating scale on it.
For this question, use this scale: 1 is not likely, 2 is a little likely, and 3 is very likely.
How likely would you be to try this solution if you had a problem (insert the one that they chose) [eating more fruit/ eating more vegetables/ drinking more water]?
Probe to determine underlying reasons for their answer.
Show them index card with rating scale on it.
For this question, use this scale: 1 is not clear at all, 2 is a little clear, and 3 is very clear.
In this segment, you set two goals. On a scale of 1 to 3, how clear was it that that you could still meet one goal if you did not meet the other?
Probe to determine underlying reasons for their answer.

Notes:

Italicized statements are directions to the interviewer.

Bolded statements are read by the interviewer to the alpha tester.