Skip to main content
. 2018 May 16;7(10):889–903. doi: 10.15171/ijhpm.2018.43

Table 3. Coding Frequencies of Process Metrics in the Taxonomy Per Evaluation Tool .

Metric Tool Number (see Table 1)
133 234 335,36 437 538 639 740 841 942 1043 1144 1245 1346 1447 1547 1648 1749 1849 1950 2051 2151 2252 2353
* Process metric √√ √√ √√ √√ √√ √√√ √√ √√√ √√√ √ √√ √√√ √ √√√ √√ √√ √√√ √√ √√√ √√ √√ √√ √
Direct process metrics ** P2C2 participants’ control over decision process: √ √√ √ √ √ √ √√ √√√ √√√ √ √ √√ √ √ √ √ √√ √ √ √√ √√ √  √
Agenda setting and time allocation √                       √ √     √ √          
Roles in decision-making are defined           √√ √             √   √ √ √       √  
Independence in decision-making                         √                    
Involvement since first stage of decision process                 √     √ √               √    
Involvement throughout types of decision activities √   √ √   √     √√√ √ √√ √ √ √√   √ √ √     √   √
Involvement throughout stages of decision process     √         √         √               √    
Perceived influence on decision-making process   √√     √ √   √√           √     √   √ √√      
Involvement in finalizing decisions                         √                    
Control over the meeting minutes                           √     √            
Assurance of follow-up commitment/translation into action                             √           √√    
Evaluation of the decision-making process     √   √   √ √√ √     √ √   √       √ √      
Revision process (for changing decisions or handling complaints)     √                                        
Surrogate process metrics ** Formal power a     √ √         √ √ √   √ √ √ √ √ √          
** Organizational commitment to engagement a   √√   √ √ √√ √ √ √√ √   √√       √√   √     √√    
** Participation:   √√     √ √√ √   √ √     √ √ √   √   √       √
Activeness of participation                       √                   √
Equality of participation (among P2C2 participants)   √   √ √       √           √ √      
Attendance of engagement participants                 √                  
Regularity of meetings             √   √ √   √   √        
P2C2 participants’ readiness and attitudes towards engagement   √ √ √ √                    
** Tailoring the engagement to P2C2 participants     √              
Cultural beliefs and practices √
Preconditions for engagement metrics P2C2-initiated engagement   √                                      
** Recruitment and membership:     √               √ √√ √ √ √ √     √ √  
Method of recruitment     √               √ √   √ √ √     √ √  
Number of P2C2 members and P2C2 versus non-P2C2 participant ratio                       √ √   √ √          
Time or terms mandate for membership                       √                  
** Representativeness and accountability:   √ √ √         √   √ √   √ √ √   √ √    
Constituent representativeness and accountability   √ √               √     √         √    
Democratic representativeness   √                 √                    
Diversity representativeness     √ √         √         √       √ √    
** Resources provided to P2C2 participants, among them a : √√   √ √ √√   √√ √ √ √ √ √√   √ √√ √ √√ √√ √√ √  
Support for disseminating results of the engagement       √         √ √   √     √ √     √√ √  
Use of a broader P2C2 needs and strengths assessment to support P2C2 representatives in their decision-making     √                                    
Unbiased, jargon-free information on which to make decisions √                   √ √     √ √   √      
** Training (for P2C2 participants) a             √√       √ √ √ √ √ √ √        
** Training (for staff) a               √ √ √       √         √    
Aggregate process metrics Respect         √                 √       √      
Transparency of the decision-making process                                   √ √ √  
Trust           √                       √      
Level of participation                     √                   √
Filled out by: External Evaluator E E     E   E   E       E  
Leader***   L L L L L L L L L L L L L L   L   L   L
P2C2 representative***   R R R R R R R     R   R R      

Abbreviation: P2C2; patient, public, consumer and community.

KEY: √ 1-3 instances, √√ 4-14 instances, √√√ 15 or more instances of coding.

* Row includes instances of items coded only into the outcome metric category when further specification was not possible.

** Row include instances of items coded only into the subdomain when further specification was not possible.

*** Individual coded items could be asked of only leaders, only representatives or both; data shown are for tool as whole.

a For brevity not all coded metrics are shown. For the full list of metrics, see the table in online Supplementary file 5.

Some metrics were absent from all evaluation tools. These are available in Supplementary file 5.