Abstract
Objective
Although there are several validated upper-extremity measures in young children with cerebral palsy (CP), none primarily assess capacity to carry out actions and tasks with the more-affected arm. To address this need, we developed the Pediatric Arm Function Test (PAFT), which involves behavioral observation of how children use their more-affected arm during structured play in the laboratory or clinic. This paper evaluates the reliability and validity of the PAFT Functional Ability scale.
Design
In Study 1, 20 children between 2–8 years with a wide range of upper-extremity hemiparesis due to CP completed the PAFT on two occasions separated by three weeks. In Study 2, 41 children between 2–6 years with similar characteristics completed the PAFT and received a grade reflecting severity of more-affected arm motor impairment.
Results
In Study 1, the PAFT test-retest reliability correlation coefficient was 0.74. In Study 2, convergent validity was supported by a strong, inverse correlation (r = −0.6, p < .001) between PAFT scores and grade of impairment.
Conclusions
The PAFT Functional Ability scale is a reliable and valid measure of more-affected arm motor capacity in children with CP between 2–6 years. It can be employed to measure upper-extremity neurorehabilitation outcome.
Keywords: Upper Extremity, Function, Assessment, Cerebral Palsy
Approximately one-third of children with hemiparesis due to cerebral palsy (CP) exhibit motor deficits in their more-affected arm.1, 2 Although several measures of upper-extremity function in young children with CP are available,3 there are no validated instruments that primarily assess capacity to complete actions and tasks with the more-affected arm. The Pediatric Arm Function Test (PAFT) 4 was developed to evaluate this aspect of arm function in 2–12 year olds.
The International Classification of Function (ICF)5 outlines three domains of function for assessment: anatomy and physiology (i.e., body function and structure); execution of actions and tasks (i.e., activity); and fulfilling social roles (i.e., participation). Furthermore, within the domain of activity, the ICF stresses separately evaluating capacity, what a person can do when tested in a standardized environment without assistance from others or devices, and performance, what a person actually does in their everyday environment.
In adult neurorehabilitation, a strong emphasis has been placed in the last decade on measuring limitations in activity, as opposed to impairments in body structure and function (e.g., restricted range of motion or spasticity). This has been spurred by considerably more empirical support for therapeutic approaches that emphasize training on tasks, such as Constraint-Induced Movement therapy (CIMT),6, 7 than for approaches that emphasize training movements.8 Parallel developments in pediatric neurorehabilitation9 have led to a similar emphasis on measuring limitations in activity, i.e., deficits in executing actions and tasks.
A recent review of measures of this domain in children with congenital hemiplegia identifies three reliable and valid tests of more-affected arm motor capacity.3 However, only a minority of items on these tests assess limitations in capacity in the activity domain: Melbourne Assessment of Unilateral Upper Limb Function (MUUL),10 46%;3 Quality of Upper Extremity Skills Test,11 35%;3 Shriners Hospital Upper Extremity Evaluation (SHUEE) Dynamic Positional Assessment component,12 0%. The majority of items assesses impairment in the body structure and function domain. The SHUEE Spontaneous Functional Assessment component,12 Assisting Hand Assessment,13 and ABILHAND-Kids14 have evidence of reliability and validity and a preponderance of items that assess limitations in the activity domain (> 81%).3 These tests, however, assess motor performance, i.e., what children actually do in daily life, rather than capacity. Other widely used tests that have upper-extremity components measure performance in the activity domain regardless of which arm is used (e.g., Pediatric Evaluation of Disability Inventory [PEDI] Functional Skills scale)15 or assess how much assistance is needed from others (e.g., PEDI Caregiver Assistance scale,15 WeeFIM16).
Thus, there are no validated instruments that primarily measure the capacity of young children with CP to complete actions and tasks independently with the more-affected arm. Such an instrument would permit researchers to test whether new and accepted interventions for the upper-extremity in children with CP produce changes in this critical domain and to examine the contribution of changes in this domain to changes in everyday performance and participation in social roles. Clinicians who care for children with CP would gain a tool for monitoring progress on building capacity to complete actions and tasks with the more-affected arm and for identifying strengths and weaknesses in this domain for the purpose of treatment planning.
To address this need, this paper presents two studies examining the measurement characteristics of the PAFT Functionality Ability scale. The PAFT is a behavioral observation system set in the laboratory or clinic that contains both unilateral and bilateral upper-extremity actions and tasks in the context of structured play. The Functional Ability scale is used by masked raters, who score the PAFT from video, to quantify how effectively a child uses his or her more-affected arm to carry out each item on the test. Study 1 evaluates the test-retest reliability and stability of the PAFT Functional Ability scale after removing items deemed poor by an item analysis. Study 2 evaluates the convergent validity of the streamlined test with an index of the severity of more-affected arm motor impairment in a separate sample. Study 2 also determines the responsiveness of the streamlined test to change in more-affected arm motor capacity.
STUDY 1: METHODS
Participants
Twenty-one children between 2–8 years were enrolled with a wide range of severity of upper-extremity hemiparesis due to CP. Table 1 lists eligibility criteria and recruitment procedures. Table 2 summarizes participants’ characteristics. In both this study and Study 2, informed consent was received from the legal guardians of all the participants; study procedures were approved by our Institutional Review Board.
TABLE 1.
Inclusion and exclusion criteria and recruitment procedures for Study 1 and 2
| STUDY 1 | |
| Inclusion Criteria: between 2 and 8 years; clinical diagnosis of CP; upper-extremity hemiparesis | |
| Exclusion Criteria: serious or recurring medical complications that would interfere with study participation (e.g., uncontrolled seizures) | |
| Recruitment Procedures: Participants were recruited from a pediatric outpatient physical rehabilitation facility at an urban medical center in the southeastern United States. They were paid $50 for their participation. Consecutive children who met the eligibility criteria were enrolled. | |
| STUDY 2 | |
| Inclusion Criteria: between 2 and 6 years; stroke in the prenatal, perinatal, or very early antenatal period confirmed by magnetic resonance imaging; upper-extremity hemiparesis; substantial nonuse of the more-affected upper-extremity in daily life (i.e., PMAL Arm Use score ≤ 2.5) | |
| Exclusion Criteria: serious or recurring medical complications that would interfere with study participation (e.g., uncontrolled seizures); spasticity medication within the last 3 months; previous pediatric CIMT; fixed contractures in the more-affected upper-extremity (Ashworth score > 4) | |
| Recruitment Procedures: Families of the children either contacted our laboratory because of their interest in CIMT or were referred by local rehabilitation professionals. Consecutive children who met the eligibility criteria were enrolled. |
TABLE 2.
Demographic and more-affected arm characteristics of participants
| Characteristics | Study 1 (N = 21) | Study 2 (N = 41) |
|---|---|---|
| Age | ||
| Mean years ± SD | 4.9±1.8 | 3.7±1.5 |
| Range, years | 2–8 | 2–6 |
| Female, n (%) | 13 (62) | 25 (61) |
| Race, n (%) | ||
| European American | 15 (71) | 35 (85) |
| African American | 4 (19) | 4 (10) |
| Other | 2 (10) | 2 (5) |
| Paresis of right side, n (%) | 16 (76) | 27 (66) |
| Severity of more-affected arm motor impairment, * n (%) | ||
| Grade 2 | NA† | 13 (32) |
| Grade 3 | NA | 13 (32) |
| Grade 4 | NA | 11 (27) |
| Grade 5 | NA | 4 (9) |
| Everyday ability to handle objects regardless of arm used: MACS Level, n (%) | ||
| Level I (with ease and success) | 5 (24) | 7 (17) |
| Level II (with reduced quality and/or speed but mostly successful) | 10 (48) | 16 (39) |
| Level III (with difficulty and limited success; needs help with set up) | 6 (28) | 18 (44) |
| More-affected arm capacity for completing tasks: PAFT Functional Ability scale, mean points ± SD (95% CI) | ||
| Total score | 2.7±0.7 (2.4–3.0) | 2.2±0.7 (2.0–2.4) |
| Unilateral subtotal score | 2.7±0.7 (2.4–3.0) | 2.3±0.8 (2.0–2.6) |
| Bilateral subtotal score | 2.7±0.8 (2.3–3.1) | 2.2±0.7 (2.0–2.4) |
Abbreviation: NA, not applicable.
Testers assigned participants a “Grade” based on active range of motion available at the upper-extremity joints. Table 5 describes the scheme used.
These data were not collected for Study 1.
Measures
The PAFT is a behavioral observation system that quantifies more-affected arm function of children with upper-extremity hemiparesis from video of structured play in the treatment setting. It is a substantially modified homologue of the Toddler Arm Use Test (TAUT).17 The TAUT items were generated by identifying unimanual activities commonly undertaken by 2–8 years olds and selecting 22 so that distal and proximal arm movement and different types of grasp were demanded.17 Based on experience using the TAUT to evaluate pediatric CIMT,17 bimanual activities were added when developing the PAFT. In addition, the variety of unilateral activities was increased to demand arm movement in different planes and during different postures, e.g., sitting vs. standing.4 Because the item rating scheme for the TAUT proved cumbersome, the Willingness and Amount of Participation scales were dropped, and the How Well scale was replaced with the Functional Ability scale from the Wolf Motor Function Test (WMFT).18, 19 This scale, however, was modified so that appropriate use of both arms during bimanual activities, which are absent from the WMFT, would not be penalized.
Table 3 lists the 17 unilateral and 9 bilateral upper-extremity items embedded within a PAFT play session. All 26 items are presented first in a fixed order with no cues given about which arm to employ. On Item 1, for example, the tester positions a ball 6 inches directly above children’s heads and says “Touch the ball.” The tester then revisits any items that children do not attempt with more-affected arm. The tester now explicitly asks children to use the more-affected arm for the unilateral items and both arms for the bilateral items. If children still do not attempt to use the more-affected arm, the tester asks children to carry out the item again with the same directive to use the more-affected arm. The tester is now allowed to physically restrain the less-affected arm.
TABLE 3.
Characteristics of the PAFT items (n = 20)
| Dimensions Classified in Content Analysis | ||||||
|---|---|---|---|---|---|---|
| Item | Item-total correlation† |
ICF Domain (code) | Finger movement required |
Plane of arm Movement |
Posture in which activity is done |
|
| Unilateral items | ||||||
| 1 | Reach above head | .42 | Body Function (7101) | No | Overhead | Sitting |
| 2 | Reach at waist level | .70 | Body Function (7101) | No | Straight ahead | Sitting |
| 3 | Reach across midline | .67 | Body Function (7101) | No | Across midline | Sitting |
| 4 | Grasp ball | .53 | Activity (4452, 4450) | Yes | Straight ahead | Sitting |
| 5 | Carry ball | .84 | Activity (4401, 4301) | No | Straight ahead | Standing |
| 6 | Release ball into cup | .82 | Activity (4403) | Yes | Straight ahead | Standing |
| 7 | Pour ball out of cup | .80 | Activity (4452, 4453) | No | To the side | Standing |
| 8 | Throw ball onto target | .74 | Activity (4454) | Yes | Overhead | Standing |
| 9 | Wave bye-bye* | .24 | Activity (3350) | No‡ | To the side or Overhead | Standing |
| 10 | Protective extension in sitting* | .51 | Body Function (755) | No | To the floor | Sitting |
| 11 | Isolated finger use | .65 | Activity (4452, 4402) | Yes | Straight ahead | Sitting |
| 12 | Remove big-knob puzzle piece | .83 | Activity (4452, 4400) | Yes | Straight ahead | Sitting |
| 13 | Crayon grasp | .76 | Activity (4452, 4400) | Yes | Straight ahead | Sitting |
| 14 | Crayon use | .82 | Activity (4401, 4402) | No | Across midline | Sitting |
| 15 | Grasp cracker-sized food (e.g. animal or graham cracker, saltine) | .89 | Activity (4452, 4400) | Yes | Straight ahead | Sitting |
| 16 | Grasp small food item (e.g. cheerio or raisin) | .83 | Activity (4452, 4453, 4450) | Yes | Straight ahead | Sitting |
| 17 | Eat with a spoon | .83 | Activity (4452, 4453, 4450) | Yes | Straight ahead | Sitting |
| Bilateral items | ||||||
| 18 | Separate pull-apart toy | .84 | Activity (4452, 4450) | Yes | To the side | Sitting |
| 19 | Carry large ball (e.g. basketball) | .69 | Activity (410, 4452, 4300, 4301) | No‡ | To the floor | Standing |
| 20 | Throw ball into hoop | .75 | Activity (415, 4454) | Yes | Straight ahead | Standing |
| 21 | Place hat on head | .72 | Activity (4452, 4300, 4450) | Yes | Overhead | Sitting |
| 22 | Put on boots (using hands) | .39 | Activity (4452, 4300, 4450) | Yes | Straight ahead or To the floor‡ | Sitting |
| 23 | Come to sit* | .10 | Activity (410) | No | To the floor | NA |
| 24 | Quadruped weight-bearing | .47 | Activity (415) | No‡ | To the floor | Quadruped |
| 25 | Crawling | .64 | Activity (455) | No‡ | To the floor | Quadruped |
| 26 | Come to stand using bench* | .30 | Activity (410) | No | Straight ahead | NA |
- Following the method described by Cieza et al.,36 the pairs broke up the item into the component actions being tested and assigned an ICF code to each component. The ICF Domain column reports whether the item was placed in the body functions and structure (Body Function) or activities and participation (Activity) domain and reports the codes assigned to each component action. The key37 to these codes is given in the list of abbreviations for this table.
- The pairs judged whether the item required use of the fingers to be done successfully.38
- The pairs coded the plane of movement in which reaching was required.
- The pairs coded the posture in which the item was done.
- The pairs judged whether the item was age appropriate. Since all items were deemed so, these ratings are not reported in the table.
Excluding Items 9, 10, 23, and 26, which were dropped on the basis of the item-analysis, agreement between the pairs of raters for classification of items along Dimension 1, i.e., Body Function vs. Activity, was 100%. For Dimensions 2, 3, 4, and 5 agreement was 86%, 95%, 100%, and 100%, respectively.
Abbreviations: NA, Not applicable; 3350, Producing body language; 410, Changing basic body position; 415, Maintaining a body position; 4300, Lifting; 4301, Carrying in the hands; 4400, Picking up; 4401, Grasping; 4402, Manipulating; 4403, Releasing; 4450, Pulling; 4452, Reaching; 4453, Turning or twisting the hands or arms; 4454, Throwing; 455, Moving around; 7101, Mobility of a single joint; 755, Involuntary movement reaction functions.
The a priori criterion for dropping an item was an item-total correlation < .3.25 Item 10, which tests whether children use their more-affected arm “reflexively” to help maintain their balance when it is perturbed, was dropped on a post-hoc basis because arm movement is elicited rather than being voluntary, as on all the other tasks. Item 10 is also more difficult to administer than the others.
For the item analysis, the Pearson correlation between each item and sum of the other items is reported.
Classification of items for which there was disagreement between the pairs of raters was adjudicated by authors G. U., E.T., & A.G.
After the testing session, trained, masked raters evaluate more-affected arm motor capacity item by item from video using the Functional Ability scale (Table 4). The Functional Ability subtotal score for unimanual items is the sum of the first administration scores from Items 1– 17 that are only administered once plus the sum of the final administration scores from Items 1–17 that are administered more than once all divided by the number of Items 1–17 actually tested. The subtotal for bilateral items is calculated in the same way for Items 18–26. The Functional Ability total score is the average of the unilateral and bilateral subtotal scores. This quantity was chosen, rather than the average of all the items, to give scores from the unilateral and bilateral sections equal weight.
TABLE 4.
PAFT Functional Ability Scale
| Rating | Anchor |
|---|---|
| 0 | Not Used – Does not attempt with upper extremity being tested. |
| 1 | Very Poor – Affected upper extremity does not participate functionally; however, an attempt is made, or the less-affected upper extremity is used to move the upper extremity being tested. In bilateral tasks, the more-affected upper extremity serves as a helper but through only part of the task. |
| 2 | Poor – Requires assistance of the less-affected upper extremity, another body part, or therapist for minor readjustments or change of position, or requires more than two attempts to complete, or accomplishes very slowly. Movement is governed by synergy. In bilateral tasks, the more-affected upper extremity serves only as a helper. |
| 3 | Fair – A moderate amount of synergy is seen, (i.e., synergistic pattern observed with some involuntary posture or movement, and or lack of control of movement, compensatory strategies with trunk/shoulder/elbows observed) or task performed somewhat slowly or with effort. In unilateral tasks, does not require assistance from other upper extremity. |
| 4 | Good – Movement is slightly slower; may lack precision, fine coordination, or fluidity, some synergy may be present, but isolation of movement is predominant. |
| 5 | Normal – Movement appears to be normal. |
An index of more-affected arm motor performance is also derived from the raters’ scores. The Limb Preference total score is the percentage of eight unilateral items (i.e., Items 1–4, 7, 12, 15, and 16) that are attempted with the more-affected arm on the first administration (i.e., Functional Ability score > 0). The other unilateral items are excluded because they have poor item-total correlation or test-retest reliability coefficients (i.e., values < .3) with respect to this index.20 Only tasks from unilateral portion of the test are counted because bilateral activities implicitly constrain children to use the more-affected arm. Only first administration scores are counted because children do not receive prompts about which arm to use. As such, children’s spontaneous choices about whether to use their more-affected arm are thought to reflect how much they actually use that arm in daily life. The reliability and validity of the Limb Preference score are reported elsewhere.21 Instructions for administering, videotaping, and scoring the PAFT are available online.20
Procedure
The PAFT was administered on two occasions (Test 1, Test 2) separated by approximately 3 weeks. Although no treatment was provided by the study, children were permitted to receive customary care, which ranged from no physical rehabilitation to two hours per week of outpatient physical rehabilitation. The maximum amount of upper-extremity rehabilitation was one hour per week. Such treatment has been shown previously not to affect more-affected arm motor capacity in children with CP.4, 17 The PAFT, which typically took 30 minutes, was carried out by pairs of pediatric occupational therapists (OTs). One administered the tasks, while the other controlled the camera and recorded data. Testers had approximately 7 hours of training; they read the manual, shadowed an experienced tester, and conducted 2–3 supervised tests. Testing was done in a private treatment room in an outpatient rehabilitation clinic.
After testing, the children’s more-affected arm Functional Ability was scored from video by one of three pediatric OTs, all of whom were masked to testing occasion. Each rater had approximately 25 hours of training; they read the test manual, scored 3 PAFT sessions jointly under the supervision of an experienced tester, and scored 8 sessions independently followed by joint review of each session under the supervision of the experienced tester. Before scoring study data, raters demonstrated high inter-rater reliability on an additional set of 10 tests (intra-class correlation [ICC]22 = .96).
To describe everyday manual ability, an OT assigned each child a Manual Ability Classification System (MACS)23 level based on a retrospective review of the children’s records. Although the MACS is done ideally by professional and family caregivers together, adequate agreement between professional and family MACS ratings (ICC, range = .73–.85) has been reported even when up to 60% of professionals’ ratings were based solely on chart reviews.24
Data Analysis
Item and content analyses of the PAFT were conducted. Subsequently, several statistics were calculated to evaluate the reliability and validity of the Functional Ability test score. To index internal consistency, Cronbach’s α was calculated using Test 1 data. Test-retest reliability was evaluated by the ICC Type 2,122 between Test 1 and 2 scores. Power to detect adequate levels of internal consistency and test-retest reliability, i.e., coefficients ≥ .7,25 was very good (> .93).26, 27 Stability was evaluated by paired t-tests of Test 1 and 2 scores. Data from one participant who did not return for follow-up testing without giving a reason was excluded from all analyses.
STUDY 1: RESULTS
Item and Content Analysis
The item analysis (Table 3) suggested that Items 9 (Wave bye-bye), 23 (Come to sit), and 26 (Come to stand using bench) be dropped. Functional Ability scores for these items correlated weakly with the summary score for the rest of the test, indicating that these items do not assess the same parameter as the others. In addition, Item 10, which tests whether children use their more-affected arm “reflexively” to help maintain their balance when it is perturbed, was dropped because arm movement is elicited rather than being voluntary, as on all the other tasks. Item 10 was also more difficult to administer than the others.
For the remaining items, the content analysis (Table 3) indicated that all were developmentally appropriate and that all, except for Items 1–3 (Reach above head, at waist level, and across midline) were in the ICF activity domain. Finger movement was necessary for 59% of items. The breakdown for plane of arm movement in which reaching took place during each item was: straight ahead (59%), to the floor (18%), overhead (14%), midline (9%) and side (9%). The percentages add to > 100 because Item 22, putting on boots, can be done either reaching straight ahead or to the floor. Sixty-four percent of items were done in sitting, 27% in standing, and 9% in quadrupedal posture. Only Item 19 (Carry large ball) required transition from one posture to another, i.e., squat to stand.
Reliability, Stability, and Precision
After dropping Items 9, 10, 23, and 26, the internal consistency of the PAFT Functional Ability total score was high (Cronbach’s α = .96). Test-retest reliability was adequate (ICC = .74). Furthermore, total scores did not change from one administration to another (mean change±SD = 0.1±0.5, CI = −0.2–0.3, p = .51).
For the unilateral and bilateral sections of the PAFT, Cronbach’s α values were .96 and .87, respectively, while test-retest reliability coefficients were .7 and .68, respectively. As for the total score, subtotals for these sections did not change from one administration to the other (unilateral subtotal mean change = 0.0±0.5, CI = −0.2–0.3, p = .76; bilateral subtotal mean change = 0.2± 0.6, CI = −0.1–0.5, p = .29).
STUDY 2: METHODS
Participants
Participants were 41 children between 2–6 years with a wide range of severity of upper extremity hemiparesis due to CP. Their data were assembled from two clinical trials: (1) a randomized controlled trial (RCT) testing the efficacy of pediatric CIMT and (2) a dose-response trial testing the effect of reducing the duration of pediatric CIMT on the magnitude of treatment gains. The eligibility criteria and recruitment procedures for these two trials were the same; they are described in Table 1. Table 2 summarizes participants’ characteristics.
Measures, Procedure, and Data Analysis
In the RCT,4 10 children received 97.5 hours of CIMT over 3 weeks: 90 hours were for more-affected arm training and 7.5 hours were for a package of behavioral techniques4, 7 designed to transfer training gains to daily life. The children also wore a cast on their less-affected arm to limit its use. Twelve children received customary care. In the dose-response trial, nine children received 52.5 hours of CIMT over 3 weeks, while ten received 35 hours of CIMT over 2 weeks. Two reviews conclude that the efficacy of pediatric CIMT is supported.28, 29
Participants completed the PAFT before and after CIMT or customary care. Testers gave participants a “Grade” before treatment that reflected severity of more-affected arm motor impairment.4 Table 5 describes this grading scheme, which is based on active range of motion present at the upper-extremity joints. In addition, an OT assigned each child a MACS level, as in Study 1. PAFT administration and scoring was conducted in the same manner as Study 1. Raters, however, were masked to group assignment and Grade and MACS level in addition to testing occasion.
TABLE 5.
Grading system for severity of more-affected arm motor impairment in children with cerebral palsy
| Joint | |||||
|---|---|---|---|---|---|
| Grade of Deficit | Shoulder | Elbow | Wrist | Fingers | Thumb |
| 2 (Mild/Moderate) | WNL/mild limitation* | WNL/mild limitation | WNL/mild limitation | WNL/mild limitation | WNL/mild limitation |
| in flexion or | in extension | in extension | in extension | in lateral abduction | |
| abduction | |||||
| 3 (Moderate) | moderate limitation† in | moderate limitation in | moderate limitation in | moderate limitation in | moderate limitation in |
| flexion or | extension | extension | extension | lateral abduction | |
| abduction | |||||
| 4 (Moderately | severe limitation‡ in | severe limitation in | severe limitation in | severe limitation in | severe limitation in |
| severe) | flexion or | extension | extension | extension | lateral abduction |
| abduction, but > 30° | |||||
| 5A (Severe) | ≤ 30° flexion or | initiation of flexion or | initiation of wrist, fingers or thumb movement | ||
| abduction | extension | ||||
| 5B (Very severe) | ≤ 30° flexion or | initiation of flexion or | no initiation of wrist, fingers and thumb movement | ||
| abduction | extension | ||||
NOTE. Movements described are minimum motor criteria, i.e., if a child does not meet the AROM criteria listed for the grade at even one joint he or she would be placed in the grade corresponding to the movement present at the worst joint.
Abbreviations: WNL, within normal limits; AROM, active range of motion.
AROM is > 2/3 to just below normal range.
AROM is between 1/2 and 2/3 of normal range.
AROM is < 1/2 of normal range but can initiate movement.
Convergent validity was evaluated by the Spearman correlation between PAFT Functional Ability scores and more-affected arm Grade before treatment. A strong, inverse correlation (r ≤ −.5)27 was predicted based on previous studies showing that severity of upper-extremity motor impairment is inversely related to capacity to carry out tasks.30–32 Power to test this prediction was very good (> .93).27 Responsiveness to change was indexed by the standardized response mean (SRM):27, 33 the mean change in Functional Ability scores from pre- to post-treatment for CIMT children in the RCT divided by the SD of the corresponding change scores in the control children. For d', which is a statistic similar to the SRM, values ≥ 0.57 are considered large.27 Two controls who withdrew because of medical complications after pre-treatment testing were excluded from this analysis.
STUDY 2: RESULTS
The correlation between PAFT Functional Ability total scores and Grade was −0.6 (p < .001). The SRM for the Functional Ability total score was 0.73. For both the Functional Ability unilateral and bilateral subtotal scores, the correlation with Grade was the same as for the total score. SRM values for the unilateral and bilateral subtotals were 0.55 and 0.53, respectively.
OVERALL DISCUSSION
As noted in the Introduction, none of the existing measures with evidence of validity for assessing more-affected arm function in young children with CP primarily assess capacity to execute actions and tasks. This ICF domain, activity, is important because of the considerable empirical support for therapeutic approaches that emphasize training on tasks8, 9 and the limits that deficits in capacity to execute actions and tasks place on participation in social roles.34 The content analysis in Study 1 indicates that the PAFT Functional Ability scale, excluding four items that the item analysis deems poor, has a preponderance of items that address this domain.
In addition, Study 1 indicates that the PAFT Functional Ability total score is a reliable and stable measure of more-affected arm capacity. Participants, who received little or no upper-extremity rehabilitation between testing occasions, had total scores at the second occasion that were similar in rank and absolute value to those at the first.
Study 2 indicates that the Functional Ability total score validly measures more-affected arm capacity. Total scores and severity of upper-extremity motor impairment were strongly inversely correlated. Study 2 also shows that the total score is responsive to change. The mean gain in children who received 35 hours or more of CIMT was large relative to the variability in total scores in children who received usual care, i.e., little or no upper-extremity rehabilitation.
In both Study 1 and 2, the reliability and validity of the Functional Ability subtotal scores for the unilateral and bilateral sections of the test are largely similar to those for the total score. The high Cronbach’s α value for Functional Ability scores from the entire test suggest that the items, regardless of whether they are from the unilateral or bilateral section, all assess a single underlying construct, which supports reporting the total score. Reporting the total score only is also supported by high correlations between baseline unilateral and bilateral subtotals in both Study 1 and 2 (r’s ≥ .8, p’s < .001). The unilateral and bilateral section subtotal scores might be of interest in special cases, such as evaluating the effects on bilateral function of an intervention that only trains more-affected arm function.
Study Limitations
Limitations are study samples too small to permit sub-analyses by age or gender, exclusion of participants > 6 years in Study 2, and demonstration of convergent validity with the classification system used rather than an established measure. With regard to age, the PAFT is thought to be appropriate up to twelve years. For older children, whose activities are not that different from adults, the WMFT18, 19 would be appropriate. With regard to the convergent measure, the MACS was not selected because it assesses how well a child handles objects regardless of which arm is used. Thus, MACS ratings can reflect how well the child uses the more-affected arm, less-affected arm, or both in coordination.23 Given this indirect relationship with more-affected arm function, it was not surprising that the association of the PAFT with the MACS was significant (r = −.44, p = .001) but less strong than with the classification system used as the convergent measure, i.e., grade of more-affected arm impairment. Future studies might correlate the PAFT with an established measure such as the MUUL.10
OVERALL CONCLUSIONS
Studies 1 and 2 support the reliability and validity of the PAFT Functional Ability scale for measuring the capacity of children between 2–6 years with upper-extremity hemiparesis due to CP to complete actions and tasks with their more-affected arm. Researchers might use the Functional Ability scale to quantify more-affected arm motor status in children with CP or other conditions with similar upper-extremity sequelae in the above age range. Collection of such data would permit examination of the relationship between capacity to complete actions and tasks with the more-affected arm and actual use of that capacity in everyday life, for example. Researchers might also use the PAFT to document changes in motor status after upper-extremity pediatric neurorehabilitation. Collection of this type of data would permit evaluation of the effect of new and accepted interventions for children with asymmetric upper-extremity motor impairment on capacity to perform actions and tasks with the more-affected arm. In addition to documenting changes after treatment, clinicians might use the PAFT to assist with treatment planning. Activities on which children show limited capacity before treatment might be targeted for training.
ACKNOWLEDGMENTS
The authors thank Anna Ballenger, OTR/L, Margiean Burks, MS, OTR/L, Jane Colburn, MA, OTL, Katherine Goldman, MS, OTR/L, Elise Hollinhead, MS, OTR/L, and Bryony Lane, MS, OTL for carrying out the content analysis of the PAFT.
This research was supported by Grant HD040692 from the National Center for Medical Rehabilitation Research of NICHD and the Department of Psychology at UAB.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Disclosures:
Financial disclosure statements have been obtained, and no conflicts of interest have been reported by the authors or by any individuals in control of the content of this article.
REFERENCES
- 1.Green LB, Hurvitz EA. Cerebral palsy. Phys Med Rehabil Clin N Am. 2007;18:859–882. doi: 10.1016/j.pmr.2007.07.005. [DOI] [PubMed] [Google Scholar]
- 2.Hagberg B, Hagberg G, Beckung E, Uvebrant P. Changing panorama of cerebral palsy in Sweden. VII. prevalance and origin in the birth year period 1991-94. Acta Paediatrica. 2001;90:271–277. [PubMed] [Google Scholar]
- 3.Gilmore G, Sakzewski L, Boyd R. Upper-limb activity measures for 5- to 16-year old children with congenital hemiplegia: a systematic review. Dev Med Child Neurol. 2010;52:14–21. doi: 10.1111/j.1469-8749.2009.03369.x. [DOI] [PubMed] [Google Scholar]
- 4.Taub E, Griffin A, Uswatte G, Gammons K, Nick J, Law CR. Treatment of congenital hemiparesis with pediatric Constraint-Induced Movement therapy. Journal of Child Neurology. 2011;26:1163–1173. doi: 10.1177/0883073811408423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.World Health Organization. Geneva: World Health Organization; 2001. International classification of functioning, disability, and health. [Google Scholar]
- 6.Taub E, Miller NE, Novack TA, Cook EW, III, Fleming WC, Nepomuceno CS, et al. Technique to improve chronic motor deficit after stroke. Arch Phys Med Rehabil. 1993;74:347–354. [PubMed] [Google Scholar]
- 7.Taub E, Uswatte G, King DK, Morris D, Crago J, Chatterjee A. A placebo controlled trial of Constraint-Induced Movement therapy for upper extremity after stroke. Stroke. 2006;37:1045–1049. doi: 10.1161/01.STR.0000206463.66461.97. [DOI] [PubMed] [Google Scholar]
- 8.Langhorne L, Coupar F, Pollack A. Motor recovery after stroke: a systematic review. Lancet Neurology. 2009;8:741–754. doi: 10.1016/S1474-4422(09)70150-4. [DOI] [PubMed] [Google Scholar]
- 9.Damiano D. Rehabilitative therapies in cerebral palsy: the good, the not as good, and the possible. Journal of Child Neurology. 2009;24:1200–1204. doi: 10.1177/0883073809337919. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Johnson LM, Randall MJ, Reddidough DS, Oke LE, Byrt TA, Bach TM. Development of a clinical assessment of quality of movement for unilateral upper limb function. Dev Med Child Neurol. 1994;36:965–973. doi: 10.1111/j.1469-8749.1994.tb11792.x. [DOI] [PubMed] [Google Scholar]
- 11.DeMatteo C, Law M, Russell D, Pollack N, Rosenbaum P, Walter S. Quality of Upper Extremity Skills Test. Hamilton, Ontario: McMaster University, Clinical Research Unit; 1992. [Google Scholar]
- 12.Davids JR, Peace LC, Wagner LV, Gidewall MA, Blackhurst DW, Roberson WM. Validation of the Shriners hospital for children upper extremity evaluation (SHUEE) for children with hemiplegic cerebral palsy. The Journal of Bone and Joint Surgery American Volume. 2006;2006:326–333. doi: 10.2106/JBJS.E.00298. [DOI] [PubMed] [Google Scholar]
- 13.Krumlinde-Sundholm L, Eliasson A-C. Development of the Assisting Hand Assessment: a rasch-built measure intended for children with unilateral upper limb impairments. Scandinavian Journal of Occupational Therapy. 2003;10:16–26. [Google Scholar]
- 14.Arnould C, Penta M, Renders A, Thonnard J-L. ABILHAND-Kids: a measure of manual ability in children with cerebral palsy. Neurology. 2004;63:1045–1052. doi: 10.1212/01.wnl.0000138423.77640.37. [DOI] [PubMed] [Google Scholar]
- 15.Haley SM, Coster WJ, Ludlow LH, Haltiwanger JT, Andrellos PJ. Pediatric Evaluation of Disability Inventory (PEDI) Boston: New England Medical Center Hospitals; 1992. [Google Scholar]
- 16.McCabe M, Granger C. Content validity of a pediatric functional independence measure. Applied Nursing Research. 1990;3:120–122. doi: 10.1016/s0897-1897(05)80128-4. [DOI] [PubMed] [Google Scholar]
- 17.Taub E, Ramey SL, DeLuca SC, Echols K. Efficacy of Constraint-Induced (CI) Movement therapy for children with cerebral palsy with asymmetric motor impairment. Pediatrics. 2004;113:305–312. doi: 10.1542/peds.113.2.305. [DOI] [PubMed] [Google Scholar]
- 18.Wolf SL, Lecraw DE, Barton LA, Jann BB. Forced use of hemiplegic upper extremities to reverse the effect of learned nonuse among chronic stroke and head-injured patients. Experimental Neurology. 1989;104:125–132. doi: 10.1016/s0014-4886(89)80005-6. [DOI] [PubMed] [Google Scholar]
- 19.Morris DM, Uswatte G, Crago J, Cook EW, III, Taub E. The reliability of the Wolf Motor Function Test for assessing upper extremity motor function following stroke. Arch Phys Med Rehabil. 2001;82:750–755. doi: 10.1053/apmr.2001.23183. [DOI] [PubMed] [Google Scholar]
- 20.Taub E, Griffin A, Uswatte G. Pediatric Arm Function Test (PAFT) manual. 2012. [cited 2012 February 20]. Available from: URL: http://www.uab.edu/citherapy/training-manuals-a-publications. [Google Scholar]
- 21.Uswatte G, Taub E, Griffin A, Vogtle L, Rowe J, Barman J. The Pediatric Motor Activity Log-Revised: assessing real-world arm use in children with cerebral palsy. Rehabil Psychol. doi: 10.1037/a0028516. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin. 1979;86:420–428. doi: 10.1037//0033-2909.86.2.420. [DOI] [PubMed] [Google Scholar]
- 23.Eliasson AC, Krumlinde-Sundholm L, Rosblad B, Beckung E, Arner M, Ohrvall AM, et al. The Manual Ability Classification System (MACS) for children with cerebral palsy: scale development and evidence of reliability and validity. Dev Med Child Neurol. 2006;48:549–554. doi: 10.1017/S0012162206001162. [DOI] [PubMed] [Google Scholar]
- 24.Morris C, Kurinczuk JJ, Fitzpatrick R, Rosenbaum PL. Reliability of the Manual Ability Classification System for children with cerebral palsy. Dev Med Child Neurol. 2006;48:950–953. doi: 10.1017/S001216220600209X. [DOI] [PubMed] [Google Scholar]
- 25.Kline P. Handbook of Psychological Testing. 2nd ed. New York: Routledge; 2000. [Google Scholar]
- 26.Bonnett DG. Sample size requirements for testing and estimating coefficient alpha. J Educ Behav Stat. 2002;27:335–340. [Google Scholar]
- 27.Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988. [Google Scholar]
- 28.Huang HH, Fetters L, Hale J, McBride A. Bound for success: a systematic review of Constraint-Induced Movement therapy in children with cerebral palsy supports improved arm and hand use. Physical Therapy. 2009;89:1126–1141. doi: 10.2522/ptj.20080111. [DOI] [PubMed] [Google Scholar]
- 29.Brady K, Garcia T. Constraint-induced movement therapy (CIMT): pediatric applications. Dev Disabil Res Rev. 2009;15:101–111. doi: 10.1002/ddrr.59. [DOI] [PubMed] [Google Scholar]
- 30.Ostensjo S, Brogren Carlsber E, Vollestad NK. Motor impairments in young children with cerebral palsy: relationship to gross motor function and everyday activities. Dev Med Child Neurol. 2004;46:580–589. doi: 10.1017/s0012162204000994. [DOI] [PubMed] [Google Scholar]
- 31.Burridge J, Turk R, Notley SV, Pickering RM, Simpson DM. The relationship between upper limb activity and impairment in post-stroke hemiplegia. Disability and Rehabilitation. 2009;31:109–117. doi: 10.1080/09638280701824699. [DOI] [PubMed] [Google Scholar]
- 32.Wichers M, Hilberink S, Roebrueck ME, van Nieuwenhuizen O, Stam HJ. Motor impairments and activity limitations in children with spastic cerebral palsy: a Dutch population-based study. J Rehabil Med. 2009;41:367–374. doi: 10.2340/16501977-0339. [DOI] [PubMed] [Google Scholar]
- 33.Guyatt GH, Walter S, Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. Journal of Chronic Diseases. 1987;40:171–178. doi: 10.1016/0021-9681(87)90069-5. [DOI] [PubMed] [Google Scholar]
- 34.van Meeteren JV, Roebrueck ME, Celen E, Donkervoort M, Stam HJ Transition Research Group South West Netherlands. Functional activities of the upper extremity of young adults with cerebral palsy: a limiting factor for participation? Disability and Rehabilitation. 2008;30:387–395. doi: 10.1080/09638280701355504. [DOI] [PubMed] [Google Scholar]
- 35.Bohannon RW, Smith MB. Interrater reliability of a modified Ashworth scale of muscle spasticity. Phys Ther. 1987;67:206–207. doi: 10.1093/ptj/67.2.206. [DOI] [PubMed] [Google Scholar]
- 36.Cieza A, Geyh S, Chatterji S, Kostanjsek N, Ustun B. ICF linking rules: an update based on lessons learned. J Rehabil Med. 2005;37:212–218. doi: 10.1080/16501970510040263. [DOI] [PubMed] [Google Scholar]
- 37.WHO. ICF Browser. [cited 2012 January 15];2012 Available from: URL: http://apps.who.int/classifications/icfbrowser/.
- 38.Uswatte G, Taub E, Morris D, Light K, Thompson P. The Motor Activity Log-28: assessing daily use of the hemiparetic arm after stroke. Neurology. 2006;67:1189–1194. doi: 10.1212/01.wnl.0000238164.90657.c2. [DOI] [PubMed] [Google Scholar]
