Abstract
Background: Providing educational content for children and parents can promote healthy nutritional habits. During the TITAN project, a pilot digital contest where participants have to developed ready-to-eat meatballs in sauce, using only plant-based ingredients, will be tested. The objective of this study was to develop the lexicon needed to objectively assess the sensory profile of this product.
Methods: Eight judges were recruited and trained. Thirteen 1-hour sessions took place over three months. The steps followed were the selection of commercial reference, generation of descriptors, training of the panel, validation of the trained panel and product characterisation. The judges chose one commercial reference (using simple hedonic evaluation) to serve as a reference. The accepted intensity scale for the generated descriptors was from 0 (low intensity) to 9 (very intense). To test the first versions of the game, food product developers involved in the project, acted as participants, and used a mix of lentils, quinoa, and oats to enhance the commercial version. R-project software was used to analyse the performance of the panel and the sensory profiles.
Results: A glossary with 14 descriptors was generated. The discriminatory capacity of the panel was confirmed by examining the significance of the product effect (p < 0.05). The product–judge interaction was not significant (p > 0.05) for most of the evaluated attributes, indicating a good degree of panel agreement. Overall, the panel was considered reproducible after 9 sessions. Although the appearance, firmness, fragility and chewiness were considered similar to the reference, juiciness and taste (understood as meaty flavour) of the new product were deemed improved.
Conclusions: According to the panel, two of the most appreciated attributes associated with meat analogues, juiciness and taste, were improved compared to the commercial reference. Therefore, the first approach for further development of the contest/game was validated.
Keywords: healthy nutritional habits, sensory analysis, trained panel, ready-to-eat meals, plant-based, meat analogues
Plain language summary
Don't you think it's important for a child to experiment with food from a very young age? Do they know where the food comes from? How do the products arrive to the supermarket? If the answer is yes and if your kids believe that meatballs can only be made with meat, this game is for them, and for you. Imagine the generation of the future, children who, from a young age, have learnt that vegetables are not their enemies, but rather their salvation, and from a very early age they have been taught to combine different types of food, especially plant-based, to make them aware that in the not-too-distant future this could be a real scenario.
This is study is part of the TITAN project, where different gaming options using artificial intelligence will be tested to promote healthy nutritional habits in scholars aged 6–12 years. One of these games is being designed as a contest were students have to develop a ready-to-eat meal, similar to “meatballs in sauce” but using only plant-based ingredients. They will have to improve the sensory properties of a commercial reference. But, to establish a common criterion for assessing the results, it is necessary to develop a common lexicon with descriptors that a trained panel can use to assess the improved prototypes. In this study, 8 judges (4 men and 4 women) were recruited and trained to develop a sensory profile for this type of products. To test the first versions of the game, food product developers involved in the project, acted as participants, and used a mix of lentils, quinoa, and oats to enhance a commercial version. The panel of trained experts validated the results.
Introduction
Healthy nutritional habits start by educating children and their families. Providing educational content of interest to children and their parents using gaming technologies is a promising tool that needs further development. For example, competitive-cooperative games where improving the nutritional profile a particular meal is the challenge to be solved, can influence peer pressure 1 . During the TITAN project, a particular challenge related to improving the nutritional and sensory profile of ready-to-eat meals is being tested before developing a gaming tool for kids and parents. The challenge will be presented as follows.
The large-scale production of animal proteins is considered a strong driver of the loss of biodiversity, global climate change and shortage of water 2 . With the increasing world population and growing concern for animal welfare and environmental properties, the demand for the transition from an animal-based to a plant-based diet is rising.
One of the many possible solutions to the current and future health and environmental challenges is to lower meat consumption and promote plant-based foods 3 . Substituting animal products with alternative proteins could be a viable strategy. However, introducing plant based meat alternatives faces many difficulties despite the known health and environmental issues associated with meat production 4 . The aversion of consumers to these dietary changes, often associated with the sensory and nutritional appeal of meat-based foods and simple access to such products, are of prime concern 5, 6 .
The plant-based meat analogues have attracted much attention thanks to their established health claims and functionality. Moreover, the required nutritional value can be achieved by modifying the physical properties of these products and, at the same time, promoting their sustainability over sensory descriptors 7 .
Many companies have begun to explore the replacement of animal meat-based ingredients with alternative proteins. Some plant-based products are already accessible on the market, such as chunks, strips, patties, sausages, chicken-like blocks, nuggets, ground beef-like products, meatballs and steaks 8 .
The biggest challenge facing the developers of meat analogues is obtaining meat-like texture and flavour 9 . The difficulties in recreating these sensory properties using plant protein sources are usually caused by strong flavours of legumes and decreased tenderness and succulence caused by reduced saturated fat content. However, protein blends can create synergies to overcome these technical issues 10, 11 .
Soy protein has been the most common base ingredient, but the use of other ingredients like pea and proteins from a range of grains and legumes are expected to increase 12 . Protein sources such as quinoa, lentils and oats have been reported as sustainable protein sources 13 with potential beneficial effects for human health 14 . However, even though most of them are already on the market, they are rarely used in everyday foods.
The psychochemical, functional and sensory characteristics of meat analogues can be manipulated to resemble those of meat-based products by changing their texture, flavour, appearance, mouthfeel, digestibility and bioavailability of the nutrients 15 . Testing the sensory properties of such novel products and their optimisation based on customer driven evaluation plays a decisive role in their development and commercialisation 16 .
Several studies have reviewed consumer acceptance of alternative proteins, innovative food and novel food technologies 17 and meat consumption 18 . A review of consumer research on meat replacements and specific alternatives, such as cultured meat and insect and plant-based substitutes, is also available 19 .
Recently, many alternative protein sources (e.g., plants, insects or fungi) have been explored as replacements for animal‐derived proteins 20, 21 . However, a lack of familiarity with novel foods affects expectations and can negatively impact sensory perception and overall liking 22 . It is important to remember that the opinion of the consumer can also be affected by personal factors, not just the sensory properties of the product.
The texture of meat has been widely studied. Many mechanical methods, analytical techniques and sensory evaluations are established for meat and fish products; however, it is unclear whether these methods are adequate for characterising the plant-based matrices 23 . Very little information is available on the flavour profiles of products with high content of plant proteins in comparison with meat such as beef, chicken or pork. Almost all available analytical methods deal with technical aspects and are not directly linked to sensory descriptors. In contrast, the sensory methods can provide both quantitative and qualitative data on flavour, taste, texture and appearance 8 .
The techniques used in sensory evaluations offer data beyond the oral perceptions of food. It is important to note which characteristics contribute to the acceptance of the product itself and which differences are associated with personal factors. Descriptive analysis is the most accurate method; it delivers both qualitative and quantitative data on the sensory profiles supplied by a trained panel. Such panels can provide the description of sensory characteristics and differences between the products, the qualification of intensities and recognition of descriptors 8 . A panel is considered expert when all the panellists can determine differences, reproduce the results, and are consistent with the rest of the panel. This technique improves the efficiency of the development of analogous meat products.
The plant-based meat analogues have some common flaws, e.g., lack of tenderness and characteristic juicy mouthfeel of meat. Some changes in processing technology and formulation of meat analogues are essential to overcome these shortcomings. There are some reports on the formulation of hybrid 24 or fully plant-based meatballs 25– 27 , but the processes described do not include sterilisation to obtain a shelf-stable precooked meal. The methods used in these studies use a cooking process on a laboratory scale. The current study employs processing methods on a pilot scale.
Here, the lexicon appropriate for the analysis of the studied products was developed, and an expert panel trained to the required standards. This panel conducted the validation and sensory profiling of newly formulated product (ready-to-eat plant-based meatballs in tomato sauce, containing a blend of lentils, quinoa and oats).
Methods
Preparation of the ready-to-eat plant-based meatballs in tomato sauce
Ingredients: The formulation consisted of water (17.0%), textured soy protein (17.0%), quinoa (5.0%), red lentil flour (5.0%), oat flour (1.0%), breadcrumbs (2.0%), soy sauce (1.0%), olive oil (1.5%), garlic powder (0.2%), salt (0.1%), parsley (0.1%), black pepper (0.1%) and tomato sauce (50%; consisting of water, tomatoes, sunflower oil, onion, sugar, salt and citric acid). All the ingredients were bought in a local supermarket (Makro, Erandio, Spain) except for the red lentil flour made at AZTI using the lentils bought at the same supermarket. An ultracentrifuge mill (ZM 100, Retsch, Haan, Germany) with a sieve of 500 μm was used for producing the flour.
Production process: The ingredients were weighed and mixed in the Kenwood food processor at minimum speed. Once mixed, the mass was manually formed into balls. The balls weighed between 9 and 11 g. Afterwards, 6 balls were packed in aluminium vacuum bags (160 × 270 × 52 mm; Bolsaplast, Barcelona, Spain) and covered with tomato sauce. The bags were sealed under a vacuum of 750 mbar (Multivac C 200, Multivac, Wolfertschwenden, Germany).
The sterilisation process was performed in a pilot retort (Model APR-95, Surdry, Vizcaya, Spain) programmed to achieve 110 °C in 15 min, hold this temperature for 60 min and cool to 30 °C in 13 min. The pressure was programmed to the maximum of 0.8 bar. The temperatures were recorded employing a TrackSense Pro Mini Wireless Data Logger Serial No. 84633 (Ellab, Hillerød, Denmark) using the ELLAB software ValSuite Basic 3.1.3.10v (Ellab, Hillerød, Denmark). Data acquisition was performed at intervals of 1 min. In each batch, 1 "meatball" was punctured with the data logger before sealing the bag. The temperature at the core of the product was maintained at 105—108 °C for 34 min, achieving an F 0 of 3. Then, the samples were stored at ambient temperature.
Sensory analysis
Sensory tests were carried out in a standard tasting room 28 with ten individual taste booths separated by screens to isolate the different judges. Samples were served at room temperature (about 20 °C) on white plates.
The ethical approval was conducted according to quality standards of the ISO 8586:2012 certified by AENOR, the Spanish Association for Standardization and Certification.
Recruitment of judges and basic training
The recruitment process was carried out to attract and train panellists who were also consumers of meat analogues. An email was sent to all AZTI employees (> 290) explaining the objective of the study and the profile required (female or male consumers of plant-based meat analogues). Those who expressed interest in joining the study were informed of the methods and the time needed to participate. Screening tests to evaluate the sensory abilities of the participants were carried out (a basic taste test, a smell recognition test and a scale management test) 29 . No remuneration was offered. Participants signed an informed consent prior to participating in the study.
Demographic characteristics
Eight participants were enlisted, 4 men and 4 women, aged from 27 to 40, all with middle income, employed, and consumers of this type of product at least once a week.
Generation of descriptors and training of judges
The specific judge training was performed according to international standards 25 . Thirteen 1 hour sessions took place over three months. The subjects covered were the selection of commercial reference (1 session), generation of descriptors (2 sessions), training of the panel (7 sessions), validation of the trained panel and product characterisation (3 sessions).
A combination of methodologies was used for generating the descriptors. The first qualitative study (face-to-face focus group) was conducted to choose the reference product. The panellists were presented with three commercially available types of ready-to-eat plant-based meatballs in tomato sauce ( Figure 1). The participants tasted the products and supplied a simple hedonic evaluation ("which one do you like most?" and "what is the sample most similar to its analogue?"). On the basis of the results, the panellists decided which product would serve as the reference in the subsequent sessions. A standardised procedure for sensory analysis was used, following ISO 11035:1994 30 .
Figure 1. Images of the three commercial plant-based "meatballs" used in the focus group.
The ingredients for each product are listed below.
PRODUCT 1:
Sauces (tomato, onion, carrot, extra virgin olive oil, cane sugar, garlic (citric acid), salt); artificial meatballs (soybean pulp, soybean curd (water, soybeans, magnesium chloride)); sunflower oil, soy, wheat flour, brown rice, cassava starch, oat flakes, parsley, salt, garlic; vegetable broth (onion, carrot, leek, garlic, celery, rice flour, salt, sunflower oil, extracts of yeast, onion powder, carob).
PRODUCT 2:
Filtered water, textured soy protein, isolated soy protein, hydrolysed soy protein, wheat gluten, canola seed oil, tomato juice, modified starch, salt, onion, garlic, vegetable seasonings, and spices.
PRODUCT 3:
Sauce (71%): tomato (40%), water, onion, green pepper, extra virgin olive oil, panela, garlic, pink Himalayan salt and tapioca starch. Meatballs (29%): natural tofu (water, soybeans and magnesium chloride (nigari)), quinoa (20%), textured soy protein, gelling agents: agar–agar and carrageenan, soy sauce (water, soya in variable proportions, 33–46%, sea salt and koji), yeast and Himalayan pink salt.
In the next 2 qualitative sessions (S1 and S2), the panel generated the descriptors and their definitions for the previously selected commercial product via open discussion ( Figure 2).
Figure 2. Generation of descriptors for the product selected as the reference.
The most frequently mentioned descriptors were selected for the following 4 training sessions (S3, S4, S5 and S6). To obtain the sensory characteristics, a QDA approach was used, in which the trained panel evaluates one product several times by grading the previously agreed sensory descriptors.
A structured scale of nine points 24 was used; the descriptors were awarded scores between 1 ("I dislike it extremely") and 9 ("I like it very much"). Each judge was given 2 identical meatballs without tomato sauce to focus on the meatball taste (the sauce was removed using a napkin). After 7 sessions, a consensus on the intensity of each descriptor of the reference product was reached.
Performance of the panel and sensory profile development
The panel validation was based on ISO 11132:2021 (Guidelines for the measurement of the performance of a quantitative descriptive sensory panel) 31 . For each descriptor, the consistency of the panel between sessions was measured. After each tasting session, all responses were pooled to identify the descriptors and judges whose standard deviation was ≥ 1. The difference between sessions should not be significant at the 0.05 level; otherwise, it would mean that the scores of the individual tasters were inconsistent. The participants also scrutinised the descriptors that might be irrelevant or difficult to measure and discussed the potential harmonisation of sensory evaluation for the product. After 7 sessions, the consensus on the intensity of each descriptor of the benchmark commercial product was reached (agreed QDA).
Once the panel performance was deemed repeatable and reproducible, and an adequate capacity of discrimination was determined, the sensory evaluation of the ready-to-eat plant-based meatballs in tomato sauce was conducted. Each assessor was provided with the 2 samples, the reference and the improved prototype (2 pre-heated meatballs per product without tomato sauce on a plate), coded with a 3-digit random number. Sample evaluations were performed at room temperature under normal lighting conditions. All samples were assessed in random order in three sessions (P1, P2 and P3). The panellists scored the intensities of the generated descriptors. The results were analysed to determine whether there were significant differences between the samples and which descriptors made them different. The results were also examined for any resemblance to the QDA of the commercial product.
Statistical analyses
The data analysis was carried out using R-project software (v 4.1.2). The packages used were "readxl", "rapportools", "tidyverse", "ggplot" and "spiderchart". A one-way ANOVA was conducted (per panellist) at the end of each session to see if there were any statistically significant differences (p < 0.05) between the assessors, and a three-way ANOVA to analyse statistical significance (p < 0.05) of the panellist, descriptor and session.
Results and discussion
Glossary of descriptors for plant-based meatballs
Results were obtained and examined in 4 steps. First, the focus group results showed that the most preferred sample was "product 3", voted as the favourite by all panellists. In the second step, two sessions of open discussion (S1 and S2) were organised to generate the list of descriptors and the procedure for evaluating their intensity ( Table 1).
Table 1. Descriptors and definitions used to evaluate the commercial ready-to-eat plant-based "meatballs" in tomato sauce.
| Descriptors | Definition and procedure used for their evaluation |
|---|---|
| Visual | |
| Outer colour | 1, raw meat colour; 5, medium meat colour; 9, light brown |
| Brightness | 1, low brightness; 9, high brightness |
| Elasticity | The middle of the meatball will be pressed with a thumb, slightly indenting the sample (pressing down to
between 1/4 and 1/5 of the thickness). The recovery of the initial shape of the meatball will be assessed. The sample is considered very elastic and will be assigned a high score if it recovers quickly. |
| Inner colour | 1, raw meat colour; 5, medium meat colour; 9, light brown |
| Compactness | The internal appearance of the meat: 1, loose-consistency meat and 9, very compact meat. |
| Odour | |
| Characteristic odour | The higher the intensity, the higher the score assigned (within the scale). |
| Texture | |
| Firmness | Force required to break the sample with the first bite. Bite the meatball in half with your incisors and assess the
force exerted; 1, little force (like biting through a croquette) and 9, much force needed (for example, like biting through an almost raw chop). |
| Cohesiveness/Fragility | The ease with which the sample can be broken: 1, a very hard meatball, difficult to break; 9, a meatball that
breaks easily without applying much force. |
| Juiciness | The sensation of moisture in the mouth during chewing. The greater the sensation of juiciness, the higher the
score. |
| Chewiness | The number of chews necessary to swallow the meatball (1, very chewy, e.g., like black pudding; 9, not very chewy,
e.g., tough meat). |
| Adherence | Force required to detach the product from the palate (1, not very adherent; 9, very adherent). |
| Graininess | Detection of granules or small particles |
| Pastiness | The effort required to swallow the product (1, a little; 9, very doughy) |
| Fat perception | The sensation of fatty coating in the mouth, warm sensation: 1, weak fat perception (e.g., chicken breast); 9,
strong fat perception (e.g., bacon). |
| Taste | |
| Characteristic taste | Meaty flavour |
| Aftertaste | The higher the persistence, the higher the score assigned (within the scale). |
In the second stage, the panel was trained to assess the intensity of each descriptor during four sessions (S3, S4, S5 and S6). The product tested was the commercial reference. The results of these first four sessions are shown in Table 2 and Figure 3. The ANOVA carried out to examine descriptor scores assigned in different sessions showed very significant differences (p < 0.01) for cohesiveness and juiciness and significant differences (p < 0.05) for taste. In fact, the standard deviation for these descriptors per panellist was > 1. To confirm the repeatability of a panellist in different sessions for the same descriptor, the standard deviation should be < 1.
Figure 3. Boxplots showing the sensory results per judge and descriptor in Step1 (4 sessions).
Table 2. Sensory results per judge and descriptor in Step 1 (4 sessions).
| Descriptor | Coefficients | Statistics | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Judge 1 | Judge 2 | Judge 3 | Judge 4 | Judge 5 | Judge 6 | Judge 7 | Judge 8 | p-value | Mean
panel ± SD |
|
| Brightness | 5.75±0.50 | 5.75±0.50 | 6.50±0.58 | 6.00±0.00 | 5.50±0.58 | 5.75±0.50 | 5.75±0.50 | 5.75±0.50 | 0.545 | 5.84±0.51 |
| Elasticity | 1.75±0.50 | 2.25±0.50 | 3.00±0.82 | 2.25±0.50 | 3.00±0.82 | 2.50±0.58 | 2.50±0.58 | 2.50±1.00 | 0.082 | 2.47±0.72 |
| Compactness | 5.00±0.82 | 5.00±0.00 | 5.25±0.50 | 5.50±0.58 | 6.00±0.82 | 5.25±0.50 | 5.25±0.50 | 5.75±0.50 | 0.102 | 5.38±0.61 |
| Characteristic
odour |
0.25±0.50 | 0.00±0.00 | 0.50±1.00 | 0.50±1.00 | 0.50±1.00 | 1.50±0.58 | 2.50±1.29 | 0.00±0.00 | 0.4707 | 0.72±1.08 |
| Firmness | 2.00±0.00 | 1.50±0.58 | 1.63±0.48 | 2.00±0.00 | 2.00±0.82 | 1.75±0.50 | 2.00±0.00 | 1.38±0.95 | 0.582 | 1.78±0.54 |
| Cohesiveness | 6.00±2.94 | 5.75±1.50 | 7.25±1.50 | 4.00±2.45 | 7.00±1.41 | 6.00±2.45 | 5.75±2.87 | 7.50±1.29 | 0.008 ** | 6.16±2.17 |
| Juiciness | 2.50±1.73 | 3.25±1.71 | 2.75±1.50 | 2.25±1.89 | 4.25±2.87 | 4.25±2.87 | 3.25±2.06 | 3.25±2.06 | 0.001 ** | 3.22±2.01 |
| Chewiness | 3.00±1.41 | 3.00±0.00 | 2.88±0.63 | 3.13±0.48 | 3.00±0.00 | 4.00±0.00 | 3.00±0.82 | 2.75±0.50 | 0.334 | 3.09±0.69 |
| Adherence | 2.25±0.50 | 2.75±0.96 | 2.00±0.00 | 2.50±0.58 | 2.75±0.50 | 2.50±1.00 | 2.00±0.00 | 2.00±0.00 | 0.083 | 2.34±0.60 |
| Graininess | 1.25±0.50 | 0.25±0.50 | 1.50±0.58 | 1.25±0.50 | 1.75±0.50 | 1.00±0.00 | 1.67±0.58 | 2.00±0.82 | 0.795 | 1.32±0.70 |
| Pastiness | 5.75±0.50 | 5.50±0.58 | 6.25±0.50 | 7.00±0.82 | 6.50±0.58 | 6.50±0.58 | 6.25±0.50 | 7.00±0.82 | 0.244 | 6.34±0.75 |
| Fat
perception |
2.50±0.58 | 2.00±0.00 | 2.63±0.48 | 2.25±0.50 | 2.13±0.25 | 3.00±0.00 | 2.50±0.58 | 2.50±0.58 | 0.1939 | 2.44±0.49 |
| Taste | 2.50±1.29 | 3.25±2.75 | 1.50±1.91 | 2.25±1.26 | 0.75±1.50 | 2.25±1.26 | 3.50±1.00 | 1.50±1.91 | 0.020 * | 2.19±1.73 |
| Aftertaste | 1.75±0.50 | 1.50±0.58 | 1.00±0.82 | 0.75±0.50 | 1.00±0.00 | 0.75±0.50 | 1.00±0.00 | 0.75±0.50 | 1 | 1.06±0.56 |
Significance codes for p-value: **, (0.001 < p-value < 0.01); *, (0.01 < p-value < 0.05), (0.05 < p-value < 1).
Three more sessions were needed to reduce the variability between the judges. Table 3 shows the results of the two-way ANOVA test for each judge and session; after the three additional sessions, the panel was consistent. The variability of each judge was reduced, and the standard deviation per descriptor and per judge was < 1.
Table 3. Evolution of descriptors defined during the qualitative descriptive analysis of the benchmarked product (7 sessions).
| STEP 1 | STEP 2 | |
|---|---|---|
| S3, S4, S5, S6 | S7, S8, S9 | AGREED QDA |
| Brightness | - Brightness | +Inner colour |
| +Outer colour | ||
| Elasticity | Elasticity | Elasticity |
| Compactness | - Compactness | |
| Odour | Odour | Odour |
| Firmness | Firmness | Firmness |
| Cohesiveness | Cohesiveness | +Fragility |
| Juiciness | Juiciness | Juiciness |
| Chewability | Chewability | Chewability |
| Adherence | Adherence | Adherence |
| Graininess | Graininess | Graininess |
| Pastiness | Pastiness | Pastiness |
| Fat perception | Fat perception | Fat perception |
| Flavour | Flavour | Taste |
| Aftertaste | Aftertaste | Aftertaste |
Figure 2 also depicts the reduced variability, illustrated by the size of the boxplots. The black dots represent the outliers, the solid lines show the median value of the descriptor, and the whiskers represent the minimum and maximum values.
The three descriptors with high variability in the first analysis (cohesiveness, juiciness and taste) were more homogeneously assessed by the 8 judges during the subsequent 3 sessions.
The additional three sessions (S7, S8 and S9) were conducted to re-train the panellists for the chosen descriptors. A particular emphasis was placed on the definition and the intensity of these descriptors. Table 3 shows the changes in the descriptors generated in Step 1 (retained, renamed or deleted).
The panel had difficulties evaluating brightness because the tomato sauce was removed from the meatballs during the tasting session (to reduce the effect of the sauce on the taste). The participants found it easier to assess the external and internal colour of the product (the latter was not affected by the sauce).
Another attribute that was difficult to assess was compactness as the panel did not understand the difference between compactness and cohesiveness or firmness. Therefore, the term "firmness" was retained, and "compactness" was removed. Following the same trend, cohesiveness was removed to avoid confusion, and "fragility" was included as the opposite of compactness/cohesiveness.
Finally, the flavour was deemed an overly complex attribute to assess; it was agreed to replace it with taste (understood as a meaty taste).
A second ANOVA analysis was carried out to examine the statistical differences and the robustness of the panel after 9 sessions. The results are shown in Table 4. Cohesiveness, juiciness and taste have reduced their variability after the second training. All the standard deviations were below 1. Figure 4 depicts the boxplots for each descriptor per session. The red squares indicate the averages for the panel, and the black dots show the outliers. Noticeably, the red symbols are now aligned, with slight variability per session.
Figure 4. Boxplots showing the sensory results per judge and descriptor in Stage 2 (3 sessions). S7, S8 and S9 are the session names. Red squares show the averages; black dots represent the outliers.
Table 4. Sensory results per judge and descriptor in Step 2 (3 sessions).
| Descriptors | Coefficients | Statistics | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Judge 1 | Judge 2 | Judge 3 | Judge 4 | Judge 5 | Judge 6 | Judge 7 | Judge 8 | p-value | Mean for
the panel ± SD |
|
| Outer colour | 7.31±0.32 | 7.71±0.35 | 7.32±0.29 | 7.33±0.34 | 7.52±0.02 | 7.74±0.35 | 7.73±0.34 | 7.23±0.35 | 0.633 | 7.46±0.21 |
| Inner colour | 8.34±0.28 | 8.74±0.33 | 8.34±0.34 | 8.70±0.30 | 8.73±0.34 | 8.22±0.28 | 8.80±0.32 | 7.24±0.34 | 0.914 | 8.36±0.53 |
| Elasticity | 1.67±0.58 | 2.33±0.58 | 3.33±0.58 | 2.33±0.58 | 3.33±0.58 | 2.67±0.58 | 2.67±0.58 | 2.67±1.15 | 0.449 | 2.63±0.77 |
| Characteristic
odour |
0.33±0.58 | 0.00±0.00 | 0.67±1.15 | 0.67±1.15 | 0.67±1.15 | 1.67±0.58 | 3.00±1.00 | 0.00±0.00 | 0.783 | 0.88±1.19 |
| Firmness | 2.00±0.00 | 1.33±0.58 | 1.50±0.50 | 2.00±0.00 | 2.33±0.58 | 2.00±0.00 | 2.00±0.00 | 1.17±1.04 | 0.425 | 1.79±0.57 |
| Fragility | 7.67±0.58 | 7.33±0.58 | 8.00±0.00 | 7.33±0.58 | 7.33±0.58 | 7.67±0.58 | 8.00±1.00 | 7.67±0.58 | 0.705 | 7.63±0.58 |
| Juiciness | 1.67±0.58 | 1.67±0.58 | 2.00±0.00 | 1.67±0.58 | 1.00±0.00 | 1.67±0.58 | 2.00±0.00 | 2.00±0.00 | 0.482 | 1.71±0.46 |
| Chewiness | 3.00±1.73 | 3.00±0.00 | 2.83±0.76 | 3.17±0.58 | 3.00±0.00 | 4.00±0.00 | 3.00±1.00 | 2.67±0.58 | 0.264 | 3.08±0.78 |
| Taste | 2.00±0.00 | 2.17±0.29 | 2.00±0.00 | 2.00±0.00 | 2.00±0.00 | 2.00±0.00 | 2.33±0.58 | 1.33±0.58 | 0.616 | 1.98±0.38 |
| Aftertaste | 2.00±0.00 | 1.67±0.58 | 1.33±0.58 | 1.00±0.00 | 1.00±0.00 | 1.00±0.00 | 1.00±0.00 | 1.00±0.00 | 1.000 | 1.25±0.44 |
| Adherence | 2.33±0.58 | 3.00±1.00 | 2.00±0.00 | 2.67±0.58 | 3.00±0.00 | 2.67±1.15 | 2.00±0.00 | 2.00±0.00 | 0.298 | 2.46±0.66 |
| Graininess | 1.33±0.58 | 0.33±0.58 | 1.67±0.58 | 1.33±0.58 | 1.67±0.58 | 1.00±0.00 | 1.67±0.58 | 2.00±1.00 | 0.796 | 1.38±0.71 |
| Pastiness | 5.67±0.58 | 5.33±0.58 | 6.33±0.58 | 7.33±0.58 | 6.67±0.58 | 6.67±0.58 | 6.33±0.58 | 7.33±0.58 | 0.478 | 6.46±0.83 |
| Fat
perception |
2.67±0.58 | 2.00±0.00 | 2.83±0.29 | 2.33±0.58 | 2.14±0.29 | 3.00±0.00 | 2.67±0.58 | 2.67±0.58 | 0.850 | 2.54±0.49 |
A review published by Djekic et al. 32 has reported that the average number of sessions necessary to train a panel can be as high as 10 (in 22.9% of the searched articles) or even higher (in 5% of the cases). However, no data have been provided in 72.1% of the cases. This is a relevant issue as training a panel can take up to 3 months. Reporting the number of sessions or the time necessary for training is essential as it has a bearing on the robustness of the panel and, thus, can affect the conclusions of the sensory analysis.
Once the standard deviations per descriptor and judge were reduced to less than 1, the panel was scrutinised for its robustness, reproducibility, and repeatability ( Table 5).
Table 5. F-values in three-way ANOVA (8 judges, 3 products, 3 sessions) for all descriptors.
| Descriptors | Product | Judge | Session | Product–Judge | Product–Session | Judge–Session |
|---|---|---|---|---|---|---|
| Outer colour | 13.46 | 3.18 | 3.00 *** | 0.82 | 0.34 | 0.32 |
| Inner colour | 73.65 | 0.87 | 0.90 | 0.83 | 1.12 | 1.60 |
| Elasticity | 62.02 ** | 0.51 | 0.87 | 3.26 * | 2.18 | 2.90 * |
| Characteristic odour | 263.28 *** | 0.60 | 1.00 | 5.02 | 0.21 | 1.64 |
| Firmness | 3.33 | 0.21 | 0.03 | 2.94 | 3.28 | 0.75 |
| Fragility | 27.81 | 1.16 | 0.36 | 0.57 | 1.77 | 1.34 |
| Juiciness | 448.00 * | 43.00 | 0.28 | 0.26 | 3.10 | 0.80 |
| Chewiness | 126.44 | 0.41 | 2.54 | 1.07 | 0.40 | 1.37 |
| Taste | 780.34 *** | 0.54 | 0.36 | 2.07 | 2.54 | 1.44 |
| Aftertaste | 3642.03 * | 1.83 | 0.47 | 1.06 | 0.54 | 1.61 |
| Adherence | 42.00 * | 2.27 | 1.93 | 1.42 | 0.80 | 1.08 |
| Graininess | 1292.85 | 1.35 | 26.60 | 1.41 | 0.06 | 0.98 |
| Pastiness | 172.50 *** | 0.72 | 0.02 | 5.75 ** | 6.24 * | 2.15 |
| Fat perception | 29.56 * | 0.33 | 0.00 | 5.71 ** | 1.00 | 4.29 ** |
Significant effects: *p-value < 0.05, ** p-value < 0.01, ***p-value < 0.0001.
Panel performance
Discriminatory capacity
A significant product effect means that the judges can discriminate between the products. The p-values ( Table 5, F-values in three-way ANOVA, column 1) indicated that the panel was capable of such discrimination based on most of the descriptors, except for the outer or inner colour, firmness, fragility, chewiness and graininess. Overall, the results confirmed that the panel could distinguish between the products.
The judge effect was not significant (p > 0.05) for any of the descriptors ( Table 5, column 2), which implies that the assessors did not differ in evaluating the products. However, there were significant differences (p < 0.05) between scores given for the outer colour ( Table 5, column 3); i.e., the outer colour varied between the sessions, and it was not repeatable. This might have happened because the procedure for removing tomato sauce differed from session to session.
Panel agreement
The product–judge interactions ( Table 5, column 5) were not significant (p > 0.05) for most of the evaluated attributes, which indicated a good degree of agreement within the panel. Significant interactions were only observed for 3 descriptors (elasticity, pastiness and fat perception), and overall, good repeatability was achieved. A significant product–judge interaction would imply a lack of consensus for the given variable. Moreover, it is necessary to take into account the product effect; thus, when this effect is also significant, an adequate panel agreement is presumed.
Panel reproducibility
The product–session and judge–session interactions were analysed to examine the panel reproducibility. Non-significant product–session interactions mean that each product was assessed in the same way in each session. Reproducibility between the different sessions was considered very good for the panel as a whole; significant differences were found only for one descriptor, the pastiness ( Table 2, column 5). This descriptor was scored differently in different sessions. The judge–session interaction ( Table 5, column 6) was only significant for elasticity and fat perception. This implies that some judges did not assign the same scores for those descriptors to all the samples in the two replicates. Overall, the panel reproducibility was very good.
Since the panel response was repeatable and reproducible, and their discrimination capacity was adequate, the judges were considered sufficiently trained, and the sensory evaluation stage could begin.
Sensory profile of ready-to-eat plant-based "meatballs"
The mean results obtained for the two samples analysed are depicted in Figure 5. The red line represents the average value for the reference sample; the dark grey stripe shows an area of ± 1 standard deviation from the agreed QDA for the reference sample. The red squares indicate the mean values for the improved prototype in each session, and the black symbols represent the outliers. Solid lines in the boxes mark the median values of the descriptor, and the whiskers represent the minimum and maximum values. The prototype sample values fell within the reference QDA area for firmness, fragility, inner colour, outer colour, and chewiness.
Figure 5. Boxplots showing the sensory results for each judge and descriptor in Step 3 (3 sessions).
The ANOVA results for product variability presented in Table 5 (column 1) show significant differences between the prototype and reference samples (p-value < 0.05) for aftertaste (6.5 vs 1.2), adherence (1.4 v 2.4), fat perception (1.4 vs 2.5) and juiciness (5.7 vs 1.7). The values for elasticity (7.6 vs 8.5; p-value < 0.0001), characteristic odour (6.9 vs 0.8), taste (6.8 vs 2.0) and pastiness (1.4 vs 6.4) also differed significantly between these products.
Aftertaste, juiciness, characteristic odour and taste were rated higher for the new prototype samples, i.e., the intensities assigned to these descriptors were stronger for the prototype formulation than for the reference. In contrast, the intensities for adherence, fat perception, elasticity and pastiness were reduced in the prototype; the improved formulation lowered the sensory perception of these attributes.
Appearance-related descriptors (the outer and inner colour) and texture-related descriptors (firmness, fragility, graininess and chewiness) did not differ between the samples.
The sensory profiles for the two products are plotted in Figure 6. The main difference between the formulations is the use of gelling agents. The commercial reference product contains agar–agar and carrageenan, whereas the new prototype plant-based "meatballs" were made without any gelling agents. This could explain the lower scores assigned to the texture-related descriptors such as adherence, elasticity and pastiness in the prototype samples compared to the reference. The hydrocolloids employed as thickening agents in foods increase the intensity of attributes such as adhesiveness and elasticity 33 . Carrageenan, used in gel formation, is associated with a perception of pastiness during oral breakdown 34 . These are some of the undesirable sensory attributes of meat analogues 35, 36 . The taste-related descriptors of new prototype samples, the aftertaste, juiciness and taste, obtained higher scores than the reference product descriptors. In a study by Godschalk-Broers, Sala 37 , taste and juiciness were highly correlated with consumer liking. In another recent study by Starowicz, Kubara Poznar 38 , juiciness and meaty taste have been reported among the main sensory attributes determining the acceptance of meat alternatives.
Figure 6. Spider chart showing sensory profiling of the reference meatballs (REFERENCE) and the improved prototype (PROTOTYPE); n = 3 sessions. Mean values are shown in the attached table.
The fat perception was stronger in the commercial sample than in the new product. Godschalk-Broers, Sala 37 also report that large fat globules or pools of oil are associated with stronger fat perception. Although their study focused on chicken-analogue pieces, similar behaviour can be expected when tasting "meatball" analogue pieces elaborated with texturised protein ingredients.
Conclusion
The results presented here showed that the performance of the expert panel assembled and trained for this study was suitable and appropriate. A descriptor set developed for the sensory evaluation of ready-to-eat plant-based meatballs in sauce was used to obtain sensory profiles of two products of this type (the improved prototype and the commercial reference). The analysis of these profiles demonstrated that the improved formula, based on a blend of lentils, quinoa and oats, increased the intensity of sensory properties associated with juiciness and taste (understood as a meaty flavour). The scores for adhesiveness, pastiness and elasticity (undesirable characteristics) were higher for the commercial sample than for the new product. The present study showed that, even though the appearance, firmness, fragility and chewiness of the tested foods were similar, adding a blend of quinoa, oats and lentils improved the taste and juiciness of a popular plant-based ready-to-eat meal without using texturizing agents.
Acknowledgements
The authors would like to thank Ewa Gubb for her help during English language editing.
Funding Statement
This research was financially supported under the European Union’s Horizon Europe research and innovation programme (TITAN, grant number 101060739). This publication is contribution nº 1139 from AZTI, Food Research, Basque Research and Technology Alliance (BRTA).
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
[version 1; peer review: 1 approved with reservations]
Data availability
Underlying data
Zenodo: Fundacion-AZTI/TITAN: Development of the lexicon, trained panel validation and sensory profiling of new ready-to-eat plant-based "meatballs" in tomato sauce. Extended data. http://doi.org/10.5281/zenodo.7452100 39 .
This project contains the following underlying data:
-
-
Quali_sessions_panel.xlsx
-
-
Panel_3steps.xlsx
-
-
R Sensory panel meatballs.R
The qualitative data is in Spanish, however, readers should contact the corresponding author for any queries on the qualitative data.
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).
References
- 1. Chow CY, Riantiningtyas RR, Kanstrup MB, et al. : Can games change children’s eating behaviour? A review of gamification and serious games. Food Qual Prefer. 2020;80:103823. 10.1016/j.foodqual.2019.103823 [DOI] [Google Scholar]
- 2. Aiking H: Protein production: planet, profit, plus people? Am J Clin Nutr. 2014;100(Suppl 1):483S–489S. 10.3945/ajcn.113.071209 [DOI] [PubMed] [Google Scholar]
- 3. Aiking H, de Boer J: The next protein transition. Trends Food Sci Technol. 2020;105:515–522. 10.1016/j.tifs.2018.07.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Niva M, Vainio A, Jallinoja P: Barriers to increasing plant protein consumption in Western populations.In: Vegetarian and plant-based diets in health and disease prevention. Elsevier.2017;157–171. 10.1016/B978-0-12-803968-7.00010-1 [DOI] [Google Scholar]
- 5. Szejda K, Bryant CJ, Urbanovich T: US and UK Consumer Adoption of Cultivated Meat: A Segmentation Study. Foods. 2021;10(5):1050. 10.3390/foods10051050 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Corrin T, Papadopoulos A: Understanding the attitudes and perceptions of vegetarian and plant-based diets to shape future health promotion programs. Appetite. 2017;109:40–47. 10.1016/j.appet.2016.11.018 [DOI] [PubMed] [Google Scholar]
- 7. Kyriakopoulou K, Dekkers B, van der Goot A: Plant-based meat analogues. Sustainable Meat Production and Processing. 2019;103–26. 10.1016/B978-0-12-814874-7.00006-7 [DOI] [Google Scholar]
- 8. Fiorentini M, Kinchla AJ, Nolden AA: Role of Sensory Evaluation in Consumer Acceptance of Plant-Based Meat Analogs and Meat Extenders: A Scoping Review. Foods. 2020;9(9):1334. 10.3390/foods9091334 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Egbert R, Borders C: Achieving success with meat analogs. Food Technology (Chicago). 2006;60(1):28–34. Reference Source [Google Scholar]
- 10. Talens C, Lago M, Simó-Boyle L, et al. : Desirability-based optimization of bakery products containing pea, hemp and insect flours using mixture design methodology. LWT. 2022;168:113878. 10.1016/j.lwt.2022.113878 [DOI] [Google Scholar]
- 11. Talens C, Llorente R, Simó-Boyle L, et al. : Hybrid Sausages: Modelling the Effect of Partial Meat Replacement with Broccoli, Upcycled Brewer's Spent Grain and Insect Flours. Foods. 2022;11(21):3396. 10.3390/foods11213396 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Mintel G: Emerging trends in the plant-based industry. 2021. Reference Source [Google Scholar]
- 13. Nadathur S, Wanasundara JP, Scanlin L: Sustainable protein sources. 2016: Academic Press. 10.1016/C2014-0-03542-3 [DOI] [Google Scholar]
- 14. Lonnie M, Laurie I, Myers M, et al. : Exploring Health-Promoting Attributes of Plant Proteins as a Functional Ingredient for the Food Sector: A Systematic Review of Human Interventional Studies. Nutrients. 2020;12(8):2291. 10.3390/nu12082291 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. He J, Evans NM, Liu H, et al. : A review of research on plant-based meat alternatives: Driving forces, history, manufacturing, and consumer attitudes. Compr Rev Food Sci Food Saf. 2020;19(5):2639–2656. 10.1111/1541-4337.12610 [DOI] [PubMed] [Google Scholar]
- 16. Verbeke W, Sans P, Van Loo EJ: Challenges and prospects for consumer acceptance of cultured meat. J Integr Agric. 2015;14(2):285–294. 10.1016/S2095-3119(14)60884-4 [DOI] [Google Scholar]
- 17. Siegrist M, Hartmann C: Consumer acceptance of novel food technologies. Nat Food. 2020;1(6):343–350. 10.1038/s43016-020-0094-x [DOI] [PubMed] [Google Scholar]
- 18. Sanchez-Sabate R, Sabaté J: Consumer attitudes towards environmental concerns of meat consumption: A systematic review. Int J Environ Res Public Health. 2019;16(7):1220. 10.3390/ijerph16071220 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Weinrich R: Opportunities for the adoption of health-based sustainable dietary patterns: A review on consumer research of meat substitutes. Sustainability. 2019;11(15):4028. 10.3390/su11154028 [DOI] [Google Scholar]
- 20. Maurya N, Kushwaha R: Novel protein foods: alternative sources of protein for human consumption. Research Trends in Food Technology and Nutrition. 2019;4:129–142. Reference Source [Google Scholar]
- 21. Onwezen MC, Bouwman EP, Reinders MJ, et al. : A systematic review on consumer acceptance of alternative proteins: Pulses, algae, insects, plant-based meat alternatives, and cultured meat. Appetite. 2021;159:105058. 10.1016/j.appet.2020.105058 [DOI] [PubMed] [Google Scholar]
- 22. Piqueras-Fiszman B, Spence C: Sensory expectations based on product-extrinsic food cues: An interdisciplinary review of the empirical evidence and theoretical accounts. Food Qual Prefer. 2015;40:165–179. 10.1016/j.foodqual.2014.09.013 [DOI] [Google Scholar]
- 23. Kaczmarska K, Taylor M, Piyasiri U, et al. : Flavor and metabolite profiles of meat, meat substitutes, and traditional plant-based high-protein food products available in Australia. Foods. 2021;10(4):801. 10.3390/foods10040801 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Baune MC, Jeske AL, Profeta A, et al. : Effect of plant protein extrudates on hybrid meatballs – Changes in nutritional composition and sustainability. Future Foods. 2021;4:100081. 10.1016/j.fufo.2021.100081 [DOI] [Google Scholar]
- 25. Thyrén L: Plant-based meat substitutes and their nutritional composition: A study on iron content, zinc content, calcium content and protein quality in meatballs and plant-based substitutes and how they contribute to the goal of reaching recommended daily intakes.2020. Reference Source [Google Scholar]
- 26. Afzal MB, Dolor AM, Jamison IF, et al. : Consumers’ Acceptability of Vegan-meatball Varieties as Commercial Meatballs. ASEAN Journal of Economic and Economic Education. 2022;1(2):6. Reference Source [Google Scholar]
- 27. Penchalaraju M, Bosco SJD: Leveraging Indian pulses for plant-based meat: functional properties and development of meatball analogues. Int J Food Sci Technol. 2022;57(9):5869–5877. 10.1111/ijfs.15908 [DOI] [Google Scholar]
- 28. ISO 8589:2007: Sensory analysis—General guidance for the design of test rooms.ISO: Geneva, Switzerland.2007. Reference Source [Google Scholar]
- 29. ISO 8586:2012: Sensory analysis: general guidelines for the selection, training and monitoring of selected assessors and expert sensory assessors.ISO: Geneve, Switzerland.2012. Reference Source [Google Scholar]
- 30. ISO 11035:1994: Identification and selection of descriptors for establishing a sensory profile by a multidimensional approach.ISO: Geneve, Switzerland.1994. Reference Source [Google Scholar]
- 31. ISO 11132:2021: Guidelines for the measurement of the performance of a quantitative descriptive sensory panel.ISO: Geneve, Switzerland.2021. Reference Source [Google Scholar]
- 32. Djekic I, Lorenzo JM, Munekata PES, et al. : Review on characteristics of trained sensory panels in food science. J Texture Stud. 2021;52(4):501–509. 10.1111/jtxs.12616 [DOI] [PubMed] [Google Scholar]
- 33. Saha D, Bhattacharya S: Hydrocolloids as thickening and gelling agents in food: a critical review. J Food Sci Technol. 2010;47(6):587–97. 10.1007/s13197-010-0162-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Funami T, Nakauma M: Instrumental food texture evaluation in relation to human perception. Food Hydrocoll. 2022;124:107253. 10.1016/j.foodhyd.2021.107253 [DOI] [Google Scholar]
- 35. Popoola O, Soladoye PO, Gaudette NJ, et al. : A Review of sensory and consumer-related factors influencing the acceptance of red meats from alternative animal species. Food Rev Int. 2021;38(sup1):266–285. 10.1080/87559129.2020.1860084 [DOI] [Google Scholar]
- 36. Chen YP, Feng X, Blank I, et al. : Strategies to improve meat-like properties of meat analogs meeting consumers’ expectations. Biomaterials. 2022;287:121648. 10.1016/j.biomaterials.2022.121648 [DOI] [PubMed] [Google Scholar]
- 37. Godschalk-Broers L, Sala G, Scholten E: Meat Analogues: Relating Structure to Texture and Sensory Perception. Foods. 2022;11(15):2227. 10.3390/foods11152227 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Starowicz M, Kubara Poznar K, Zieliński H: What are the main sensory attributes that determine the acceptance of meat alternatives? Curr Opin Food Sci. 2022;48:100924. 10.1016/j.cofs.2022.100924 [DOI] [Google Scholar]
- 39. Talens C: Fundacion-AZTI/TITAN: Development of the lexicon, trained panel validation and sensory profiling of new ready-to-eat plant-based "meatballs" in tomato sauce. Extended data. (TITAN_V1). Zenodo. 2022. 10.5281/zenodo.7452100 [DOI] [PMC free article] [PubMed] [Google Scholar]