- Review
- Open access
- Published:
Cross-cultural adaptation of body image assessment instruments for university students: a systematic review
Psicologia: Reflexão e Crítica volume 34, Article number: 11 (2021)
A Correction to this article was published on 18 May 2021
This article has been updated
Abstract
The theoretical-methodological process of cross-cultural adaptation of scales is fundamental for the expansion of research possibilities related to a given area and population, as instrument adequacy allows for the consistent assessment of the construct being studied. This article aims to highlight the different theoretical-methodological processes of cross-cultural adaptations of scales for assessing body image among young university students. The articles were selected in February 2020, with the following search descriptors: (“body image”) and (young or “college students” or graduating or graduat *) and (“cross-cultural validation” or “cross-cultural adaptation”), in three databases—Scopus, PsycINFO, and Web of Science, without any time restrictions. Altogether, 304 studies were surveyed on the different bases mentioned above, and 14 studies published between 2010 and 2019 were evaluated. This study highlighted the methodological procedures used in the process of cross-cultural adaptation, as well as the population, the types of validity and reliability, and also the main limitations, strengths, and results reported in each study included in this review. The information presented in this review will allow new researchers to make more appropriate choices about instruments for assessing body image in young university students, in addition to presenting the methodological evolution on this theme.
Introduction
Body image is the mental representation that one has of their own body (Schilder, 1999). It can be characterized by cognitive, affective, and behavioral components (Cash & Pruzinsky, 2002; Slade, 1994) and is constantly influenced by social, libidinal, and other aspects (Cash & Pruzinsky, 2002). Many researchers have striven to understand the construct of body image by investigating the aspects related to its development and its constant influences on different phases of life (Laus et al., 2014).
University students have been shown to be vulnerable to different alterations to body image. Studies reveal that university students report high body dissatisfaction and unhealthy practices related to body weight maintenance (Claumann et al., 2017; De Souza & Alvarenga, 2016; Frank et al., 2016). Moreover, university students are considered to be at risk for developing depression, low self-esteem, diminished wellbeing, interpersonal difficulties, suicidal ideation, and eating and body dysmorphic disorders (Barra, Silva, Maroco, & Campos, 2019; de Carvalho et al., 2013; De Souza & Alvarenga, 2016; Sarhan, Krey, Chaud, & Abreu, 2015; Schaefer et al., 2015). Thus, these matters deeply impact the health, professional formation, and the whole academic journey of these university students (Behmani & Kumar, 2016; Felden et al., 2016; Ponte, Fonseca, Carvalhal, & da Fonseca, 2019).
Systematic investigations concerning this population may contribute to tracking risk groups and promoting intervention strategies on body image by creating a healthier and more positive relationship between students and their bodies, therefore preventing the appearance of many comorbidities (Guimarães, Aquino, Prado, & Rodrigues, 2020). To achieve these goals, instruments for assessing body image and valid and reliable measures of the various components of the body image construct must be provided.
One of the main strategies for obtaining psychometric instruments is through the process of cross-cultural adaptation, a series of rigorous and cautious methodological procedures which ensure that the instrument remains equivalent to the original version created in another language and/or culture. It, therefore, allows one scale created for a specific context to be used in another population (Beaton, Bombardier, Guillemin, & Ferraz, 2000; Swami & Barron, 2019). It is recommended that a methodological guide is used for this process, one which describes in detail the methodological procedures to be adopted.
Numerous studies have aimed to perform a cross-cultural adaptation of body image assessment instruments, especially for young university students (Swami & Barron, 2019). It can be said that knowing the main theoretical/methodological findings of these studies, as well as the main limitations pointed out by the authors in the area, can contribute to improving the quality of future studies. Therefore, this research aimed to highlight the different theoretical-methodological processes of cross-cultural adaptations of scales for assessing body image among young university students.
Methods
This systematic review was duly registered at PROSPERO, under the registration number CRD42020145182, and followed the recommendations proposed by the Preferred Reporting Items for Systematic Reviews and Meta-analysis: The Prisma Statement (Moher et al., 2009). The Prisma Statement checklist can be viewed in the supplementary material in this review article.
Articles were selected from three databases: Scopus, Web of Science, and PsycINFO. There was no time restriction for the literature search, which was completed in February 2020. The following search terms were used, only in the English language: (“body image”) and (Young or “College Students” or graduating or graduat*) and (“cross-cultural validation” or “cross-cultural adaptation”). The selection process in the databases was carried out by two independent researchers. In case of disagreement in selecting studies, a third researcher was consulted. Descriptive analysis was used for data analysis, as well as the categorical content analysis of Bardin (1977). Content analysis was used to group information from studies included into similar topics, in other words, into categories. It was also used to make inferences from these results feasible.
The selection of articles was performed initially by reading the titles of all articles found. Those studies in which the search terms were present in the title were included in the first selection. After the first selection from the title, the summary was read in full for more detailed information about the study. Studies that presented information about systematic reviews in the summary were included, and studies that did not have this topic were excluded. After including the articles according to their titles and abstract, the selected articles were read in full to verify if these studies met the inclusion criteria of this systematic review. The articles whose themes were not in agreement with this systematic review’s objective were definitively excluded. After this procedure, the final number of studies included in this review was reached.
As criteria for the inclusion of articles, we used (1) articles whose objective was to describe the cross-cultural adaptation of scales for assessing body image and (2) studies carried out with a population of young university students. The following were excluded from this systematic review: (1) articles in languages other than English, Portuguese, and Spanish; (2) articles that did not highlight the objective of carrying out the cross-cultural adaptation of scales; (3) articles that, despite having this objective, did not have the theme of body image; and (4) articles that addressed the methodological process in question, but were developed in populations other than university students.
Quality assessment and data extraction
To assess the quality of the studies, the Quality Assessment Tools (QATSDD) (Sirriyeh, Lawton, Gardner, & Armitage, 2012) were used. The data for evaluation were extracted directly from the articles included in this systematic review. The QATSDD consists of 16 items for quality assessment, 14 of which are applied to qualitative and quantitative studies, and two of which are used for mixed methods. Each study was scored on a scale from zero to three points in each item, with the minimum score being equal to zero when the authors of each study did not mention the information highlighted in each category; equal to one point when the authors mentioned very little information; equal to two points when the information was made somewhat available in the study; and a maximum score of three points when the information was presented in full. The score was subjective and individual. It is noteworthy that all studies included in this review are quantitative. The quality of each analyzed study was calculated from the percentage of the maximum quality achieved, with a maximum possible score of 42 points. Articles with a score equal to or greater than 21 points (a quality rating of 50%) were classified as having good or high quality. In contrast, studies that did not reach this score were considered to be of lower quality than expected (Sirriyeh et al., 2012).
Results
This systematic review evaluated 14 studies. Figure 1 presents a flowchart that summarizes the process of searching for and selecting the articles found, as well as the process of including and excluding studies after individual analysis of all titles, abstracts, and subsequently, all texts in full.
Flowchart presenting the review of the systematic process of identification and selection of articles. Source: The author, 2021
The included articles were analyzed using the following categories as reference: authorship, publication year, place of development, objective, guideline used for the process of cross-cultural adaptation of scales, sample of each study, type of validity and reliability assessed, main limitations and strengths reported by the authors, and additionally, the main results found in each included study. These detailed results can be seen in Table 1.
In the analysis performed on the included studies, it was observed that they were all published between 2010 and 2019. Half of the studies were published in the last 5 years (N=7; 50%), with 2017 as the year with the most publications on this issue (N=3; 21.4%). The chronological evolution of the published articles is shown in Fig. 2.
Chronological evolution of the studies included in this review. Source: The author, 2020. N, number of articles included
Based on the articles included in this review, Brazil was the country with the largest number of studies (N=8; 57.1%), followed by France (N=2; 14.2%), and then by Japan, Turkey, Canada, and Switzerland with 1 study each (7.1 %).
The most widely used set of guidelines for cross-cultural adaptation was the one proposed by Beaton et al. (2000, 2002, 2007), which served as basic reference for five (35.7%) studies included in this review. Table 2 shows all methodological guidelines used in the analyzed studies.
Regarding the instruments for body image assessment that were put under the process of cross-cultural adaptation, the majority appeared in only one study, excluding the instruments: (1) Intuitive Eating Scale-2 (IES-2) and (2) Male Body Dissatisfaction Scale (MBDS). Most studies were carried out with sample populations that included both sexes (N=10; 71.4%). Two studies counted only with women (14.2%) and two studies had only men as the target population (14.2%).
Regarding the types of validity evaluated, it is important to highlight that, in the studies included, content validity, confirmatory factor analysis, construct validity, and discriminant validity were more frequent, with 64.2%, 50%, 42.8%, and 42.8%, respectively. As for reliability, the internal consistency measure was the most expressive in the studies, as seen in almost all articles (N = 13; 92.8%); the test-retest measure represented the second most used measure (N = 5; 35.7%). More detailed information can be seen in Table 3.
Furthermore, when focusing on the main study limitations reported by the authors, sample homogeneity stands out, shown in two (14.2%) of the analyzed studies. Articles that do not present this information, a total of three (21.4%), and all other studies included in this systematic review have different limitations. In addition, concerning the strengths of the studies, good validity and reliability can be highlighted, in addition to a good understanding of the items in four studies (28.7%), respectively.
The detailed description of these results is shown in Table 4.
Concerning the main results, we highlight two points: (1) results of the factorial structure of the instruments and (2) internal consistency analysis.
In regard to the first aspect, all studies analyzed had a minimum factor loading in the confirmatory factor analysis (CFA) and in the exploratory factor analysis (EFA), as recommended in the literature, λ> 0.30 (Hair Júnior et al., 2009). The reference values in three of the four studies that carried out EFA were also adequate—Kaiser-Meyer-Olkin (KMO)> 0.6 and Bartlett’s test of sphericity (χ2) ≤ 0.05 (Hair Júnior et al., 2009). One of the studies that carried EFA did not make these values clear (Shoji et al., 2018), making analysis impossible. In CFA, the reference values are χ2/gl = chi-square test = ideal <3 and acceptable between 3 and 5. AGFI (Adjusted Goodness-of-Fit Index), NFI (Normed fit index), NNFI (Non -normed Fit Index), CFI (Comparative Fit Index), and GFI (Goodness-of-Fit Index) > 0.90. RMSEA (Root Mean Square Error of Approximation) < 0.08 (Hair Júnior et al., 2009). Although these values are recognized in the literature, some studies did not achieve them. For example, Barra et al. (2019) presented χ2/gl = 8.39; Rousseau et al. (2014) reported the following AGFI values = 0.82; GFI = 0.86, and Pakpour et al. (2014) highlighted GFI = 0.86, NFI = 0.84, CFI = 0.85. RMSEA values that did not fit the reference standard were also found, as example RMSEA = 0.191 (Pakpour et al., 2014) and RMSEA = 0.09 (Chakroun-Baggioni et al., 2017). It is worth mentioning that only two studies (14.2%) combined the use of CFA and EFA (Pakpour et al., 2014; Rousseau et al., 2014). And yet five studies (35.7%) did not perform any type of analysis of the factorial structure of the instruments (Amaral et al., 2011; Conti et al., 2012; Conti et al., 2010; de Carvalho et al., 2013; Ulian et al., 2017).
Regarding the analysis of internal consistency, 12 studies (85.7%) used α = Cronbach’s alpha (α), one study used Omega coefficients (Chakroun-Baggioni et al., 2017), and one study did not make it clear the type of reliability adopted (Conti et al., 2012). Minimum reference values for internal consistency are considered above 0.6 (Malhotra, 2004). In the studies included in this review, all the internal consistency values were above the minimum limit recommended in the literature, which is expressed by the range of 0.64-0.97.
Lastly, concerning the quality of the studies, it is evident that 12 of them (85.7%) had scores above the pre-established average of 50%, which indicates that these articles were of good quality (Amaral et al., 2011; Barra et al., 2019; Bas et al., 2017; Campana et al., 2013; Carbonneau et al., 2016; Chakroun-Baggioni et al., 2017; Conti et al., 2012; Pakpour et al., 2014; Rousseau et al., 2014; Shoji et al., 2018; Silva et al., 2016; Ulian et al., 2017). As for the remaining percentage, two articles (14.2%) scored exactly the previously determined average, indicating acceptable quality (Conti et al., 2010; de Carvalho et al., 2013). No article presented below-average quality, which would be an indicator of poor quality.
Regarding the studies included in this systematic review and their quality, although none presented below-average quality, some studies did not present good quality. However, we have chosen to consider them, regardless of the score achieved. Studies that do not have an expected quality can likewise serve as a reference for future research because they can serve as guidelines for developing future quality studies.
Discussion
This systematic review aimed to identify the current practices of cross-cultural adaptation of body image assessment scales for young university students. The results showed a variety of practices, which will be discussed below along with recommendations for future investigations on the topic.
Analyzing the studies included in this review, we found that the process of cross-cultural adaptation of body image scales for young university students was first recorded in 2010, followed by an increase in studies over the next few years, with peaks in publications in the years 2013 and 2014, 2016 and 2017, bringing together the largest amount of research.
Another point to be highlighted in this review concerns the locations where the studies were carried out. Brazil appears to be the main place for carrying out this type of research, with 8 out of the 14 studies selected in this review being developed in this country. This finding allows the inference of two counterpoints. On the one hand, Brazil appears to be a powerful example of quantitative reference in the researchers’ instrumentalization through the process of cross-cultural adaptation for the assessment of body image among young university students. This can enable the expansion of cross-cultural studies carried out in the country.
On the other hand, it is possible to state that Brazilian researchers may be too much focused on “importing” instruments created in other countries and perhaps not as well involved in the creation of new assessment scales specific to the Brazilian population and cultural context. Although it is not possible with this study to make a comparison of cross-culturally adapted instruments created in Brazil, there is a great involvement of national researchers in the cross-cultural adaptation of instruments, when compared to researchers from other countries. Morgado et al. (2014) consider that the creation of new measures is recommended when there are no instruments already created and validated correctly in other countries. Perhaps, this justifies the fact that Brazil opts to carry out cross-cultural adaptation of instruments, rather than the creation of them. Possibly, on account of the fact that the international literature has shown an abundance of instruments aimed to evaluate different facets of university students’ body image. Additionally, cross-cultural adaptations enable multicultural studies, in the sense that data comparison among different groups becomes possible (Carvalho, Amaral, & Ferreira, 2014), which might be another justifying reason why Brazil leads the ranking of cross-cultural adaptations.
In this regard, Campana and Tavares (2009) add that Brazil has a lack of instruments about body image, and making a cross-cultural adaptation is important to expand the possibilities of research in our country. These notes and Brazil’s growing interest in researching body image justify Brazil’s leadership in translation, cross-cultural adaptation and validation of already existing instruments in the literature.
Additionally, we observed that Beaton’s guide (Beaton et al., 2000; 2002; 2007) was the most used methodological guide for cross-cultural adaptations of instruments, reported in previous studies as useful and usual in the scale adaptation procedure (Argyrides, Kkeli, & Kendeou, 2014; Swami & Barron, 2019). It describes a cultural adaptation model in medical, sociological, and psychological literature, which is a complete adaptation process that includes translation alongside semantic, idiomatic, and experiential adaptations, as well as the conceptual equivalence between the original instruments and their adaptations (Hendricson et al., 1989; Swami & Barron, 2019; Swami et al., 2019).
Another used guide was that of Guillemin et al. (1993), which was based on previous studies in psychology and sociology. It differs from Beaton’s guide as it also recommends, if relevant, the re-examination of the questionnaire scores beyond the proposed steps. Moreover, two other methodological guides appeared in three studies selected in this review. Both follow the same proposal as the other five guides already highlighted above, and therefore, they will not be detailed. Among the studies gathered in this review, one did not clarify which guides it used in the methodological process. However, it is widely recommended that a methodological guide be used to perform the cross-cultural adaptation of instruments in the area of body image (Swami & Barron, 2019), in order to enable the maintenance of cultural, semantic, idiomatic, conceptual, and experimental equivalences in the adapted instrument (Guillemin, 1995).
Nevertheless, Swami and Barron (2019) argue that the best practices indicate that a combination of translation procedures should be adopted as there is no consensus in the literature about a single guide to be used. According to these authors, while Beaton et al. (2000) provides a structure that several body image scholars will find useful due to its clarity in the steps of the methodological process (Argyrides et al., 2014; Carbonneau et al., 2016; Swami et al., 2019), this structure also requires time and effort, which can lead some researchers to view combined translation techniques as less demanding alternatives in the process of cross-cultural adaptation (Swami & Barron, 2019).
Among the 14 studies included in this review, different psychometric instruments were chosen to be translated and adapted through the cross-cultural adaptation process. These instruments have been commonly used to assess the following components of body image, or associated aspects: sociocultural attitudes related to appearance (Amaral et al., 2011; Barra et al., 2019; Conti et al., 2010); thoughts and desires related to body image (Chakroun-Baggioni et al., 2017; Shoji et al., 2018); body dissatisfaction or feelings directed towards muscularity (Campana et al., 2013; de Carvalho et al., 2013; Rousseau et al., 2014); eating attitudes and behaviors (Bas et al., 2017; Carbonneau et al., 2016; Ulian et al., 2017); dissatisfaction with weight and body shape (Silva et al., 2016); sexual activity (Pakpour et al., 2014); and body change (Conti et al., 2012).
At this point, an interest in the multiple dimensions of the body image held by university students is observed. This can be justified by the fact that body image is a multifaceted and complex construct, requiring different instruments to fully assess. It is also noteworthy that body image is an essential phenomenon in several aspects of human life, ranging from biological aspects related to health and diseases, to psychosocial aspects such as quality of life (Campana & Tavares, 2009; Cash & Pruzinsky, 2002; Thompson, 2004).
Among the two instruments cited as the target of more than one study, the results showed good evidence of psychometric qualities. The Intuitive Eating Scale-2 (Bas et al., 2017; Carbonneau et al., 2016), adapted for Turkey and Canada, assesses the tendency of individuals to follow their tracks of hunger and satiety related to when and how much to eat. The instrument showed good validity and reliability, confirming the psychometric properties of the original study. The Male Body Dissatisfaction Scale (de Carvalho et al., 2013; Rousseau et al., 2014) was adapted for France and Brazil to assess body dissatisfaction towards muscularity. Its internal consistency has been proven, demonstrating the instrument’s good reliability.
The study that evaluated the Tripartite Influence Scale describes different stages of the cross-cultural adaptation of the scale. Conti et al. (2010) performed the translation, back-translation, and assessment of the verbal comprehension of the instrument. Similarly, the study by Amaral et al. (2011) described the stages of adaptation of the Sociocultural Attitudes Towards Appearance Questionnaire-3 to the Portuguese language. Both studies, as well as others identified (Conti et al., 2012; de Carvalho et al., 2013; Ulian et al., 2017), evaluated only the content validity of the instruments. This can be a limitation since the safe use of measurement instruments for a given population is directly related to the assessment of its psychometric qualities. It is worth noting that some of the adapted instruments in the aforementioned studies continued in future studies that assessed their psychometric qualities; this was the case with the Sociocultural Attitudes Towards Appearance Questionnaire-3 (Amaral et al., 2011), from the Tripartite Influence Scale (Amaral et al., 2011), and the Male Body Dissatisfaction Scale (Carvalho et al., 2015).
Furthermore, most of the studies selected in this systematic review recruited a sample of both sexes (N = 10), while two studies were conducted only with women, and the other two studies were conducted strictly with men. This may indicate greater sample heterogeneity, which is considered adequate in the processes of cross-cultural adaptation as it often presents different results and possible new findings, thus representing more reliable results (Barra et al., 2019; Dahl, Wickman, & Wengström, 2014). However, some authors argue that sample heterogeneity can represent a very large diversification of results, which does not represent the totality that is expected to be measured. According to these authors, this can hinder the consensus of the results (Bas et al., 2017; Ferreira, Corazza, Francisco, & Neves, 2018; Swami et al., 2019). Therefore, future studies should consider the pros and cons of recruiting homogeneous or heterogeneous samples, with regard to population sex. These findings are in line with what has been pointed out in previous literature, which has found that, especially in the last two decades, both men and women are dissatisfied with their bodies (de Carvalho & Ferreira, 2014; Hobza & Rochlen, 2009; Kelley, Neufeld, & Musher-Eizenman, 2010), which justifies the availability of instruments for both sexes. Therefore, it is necessary to choose appropriate body image assessment instruments for each of these groups, investigating the specificities of the construct for men and women. It also justifies the use of the psychometric processes of scales for both men and women (Beaton et al., 2000; Gardner & Brown, 2010; Thompson, 2004).
Regarding the assessment of validity, this psychometric quality determines whether, in fact, the test measures what it is supposed to measure (Pasquali, 2009). Barra et al. (2019), Bas et al. (2017), and Pakpour et al. (2014) pointed out in their studies the strength of the instrument to be considered valid and reliable, based on the aforementioned validities, assessed in the study. Among the main validities developed in these studies are the content validity, CFA, construct, and discriminant validities. It is worth noting that CFA (50%) was used more than EFA (28.5%). This can be justified by the fact that the factorial structure of the instruments that have undergone the process of cross-cultural adaptation has already been tested in other countries. Then, the CFA would serve to confirm or refute the previous factorial structure. A similar previous review study concerning the development of scales found different results, with EFA being more recurrent than CFA (Morgado et al., 2014). In comparison with this previous study, we can infer that the process of creating a new instrument requires exploring the new factorial structure, which justifies the EFA. Studies with cross-cultural adaptation demand to confirm or refute previous factorial models. This fact justifies greater use of CFA in the context here investigated.
Reliability is considered one of the main quality assurance criteria of the instrument, as it refers to the ability of the test to measure without errors (Pasquali, 2009; Primi, 2012). This criterion focuses on obtaining consistent and reproducible results when measuring a given attribute (Fayers & Machin, 2007). The most used reliability tests in the studies were internal consistency and test-retest. These tests are related to the coherence, consistency of the results, and the confidence that the test inspires in measuring the phenomena without large fluctuations between repeated measures, which would reflect the presence of measurement errors. In other words, these procedures estimate the level of accuracy of a test and establish an expectation of how erroneous the measurement can be (Kimberlin & Winterstein, 2008; Martins, 2006; Pasquali, 2009; Primi, 2012). Therefore, imprecise or incomplete psychometric procedures, performed in this methodological process, will probably bias the results (Morgado et al., 2014). At this point, it is highlighted that specifically, one study did not specify, or did not clearly show, which reliability method it used (Conti et al., 2012).
Regarding the limitations, three studies did not make this information clear in the text. Therefore, it is possible to highlight a diversity of specific limitations highlighted in each included study. The only limitation that is repeated in the studies (n = 4, 28.7%) is related to the characteristics of the sample, highlighting the homogeneity of the sample because the results cannot be reproduced and generalized to other groups (Bas et al., 2017; Carbonneau et al., 2016; Pakpour et al., 2014; Ulian et al., 2017).
Moreover, the following limitations also stand out: (a) lack of validity and reliability. However, several authors emphasize that validity and reliability are psychometric attributes that must be present in a good instrument and must be considered in studies of psychometric adaptation, since their absence can generate errors in the statistical conclusions of the research and can be considered a limitation of the developed study (Cunha, de Almeida Neto, & Stackfleth, 2016; Pilatti, Pedroso, & Gutierrez, 2010; Swami & Barron, 2019), and (b) the cross-sectional model used in the studies, which does not allow the establishment of cause and effect relationship, representing a certain vulnerability to the simultaneity bias. However, although this does not allow a definition of the temporal sequence between the events studied, we can point out positive points of this methodology, highlighting that it is a method widely used in studies which examine the relationship between events, being simple, low cost, and objective in data collection (Chakroun-Baggioni et al., 2017; Gonçalves & Silvany, 2013).
When we observe the main strengths described in the included studies, the following stand out: (a) the instruments are valid and reliable (Barra et al., 2019; Bas et al., 2017; Conti et al., 2010); (b) they have excellent verbal comprehension (Amaral et al., 2011; Conti et al., 2010, 2012; Ulian et al., 2017); and (c) they promote advances in research (Campana et al., 2013; de Carvalho et al., 2013; Ulian et al., 2017). We can infer, from the results, that researchers recognize the importance of psychometric qualities and also a meticulous semantic adaptation process as outstanding aspects in their studies, together with the recommended procedures for carrying out the process of cross-cultural adaptation (Beaton et al., 2000; Swami & Barron, 2019).
Although several authors recognize the importance of the psychometric qualities of scales, we were able to observe flaws in this process when analyzing the statistical results of the factorial structure of instruments. For example, some studies (35.7%) did not do any type of factorial analysis of the instruments. Others used only EFA or CFA. Among those that performed EFA, most studies presented adjusted reference values. However, one study made no mention of such values at all. Among those who did CFA, some studies presented inadequate reference values, according to what is recommended in the literature, and this can be considered a problem because it weakens the instrument's validation process. Additionally, only two studies combined EFA and CFA. For more consistent results on the psychometric indices of a scale, Morgado et al. (2014) indicate the combined use of EFA and CFA. Most of the studies included in this review are in the opposite direction of the abovementioned recommendation.
Regarding internal consistency, which is the most widely used measure of reliability (Morgado et al., 2014), only one study failed to present this value. Among the others, they all presented values that represent what is recommended in the literature. This measure was the reference in the studies that described it.
In relation to the quality of the articles included, it can be noted that the studies with the lowest scores were the oldest (date of publication between 2010 and 2013). The concentration of studies with low quality in this period may be linked to the increase of studies in the area after 2016, which may have had better support for research through previous studies, greater methodological rigor, as well as advances in research related to the constructs in question. It is important to note, therefore, the importance of publishing the limitations and difficulties found in the studies, in order to further improvements in the development of future research and prevent the same errors from being made by new researchers.
It is also noteworthy that the articles with high-quality scores presented an explicit methodological rigor, as well as a detailed presentation of the information about their research processes. This might offer a better understanding of the study for potential readers, as well as better reliability of the information about the research.
This review has some limitations that must be considered. Initially, when selecting articles, studies may not have been included due to the search terms used, which may have impacted the results. Furthermore, another limitation that needs to be highlighted is the fact that the initial inclusion of the studies was made based on the title. This may have contributed to the loss of studies on cross-cultural adaptation since the title does not always represent the entire content of an article. Finally, our study is only current until February 2020. Studies published after this period could not be included in this review.
Despite these limitations, this study presents important contributions. First, this systematic review analyzed consistent information about the literature in question, updated until February 2020, making the article up to date. In addition, this review presents both the evolution of studies on body image among university students, as well as a broad discussion on this theme, permeating the different constructs that encompass body image. Thus, it is expected to assist future researchers in the knowledge and choice of body image assessment instruments for the public in question.
Conclusion
This systematic review presents different studies that have been cross-culturally adapted to other populations. In all of them, the theoretical-methodological procedures chosen by the authors to perform the cross-cultural adaptations were analyzed, such as, for example, the instruments, the methodological guides, as well as the types of validity and reliability used. Several concepts and methodological strategies, as well as the limitations and successes of different studies, were presented and discussed as an overview for future research on the topic. Thus, we believe that this article presents important contributions to the scientific literature, mainly because it provides a comprehensive set of information that can increase the quality of future research practices in cross-cultural adaptation of body image instruments.
Availability of data and materials
All data from the articles included in this review are presented in a properly organized table and were submitted in supplementary material.
Change history
18 May 2021
A Correction to this paper has been published: https://doi.org/10.1186/s41155-021-00180-1
References
Amaral, A. C. S., Cordás, T. A., Conti, M. A., & Ferreira, M. E. C. (2011). Equivalência semântica e avaliação da consistência interna da versão em português do Sociocultural Attitudes Towards Appearance Questionnaire-3 (SATAQ-3). [Semantic equivalence and internal consistency of the Brazilian Portuguese version of the Sociocultural Attitudes Towards Appearance Questionnaire-3 (SATAQ-3)]. Cadernos de SaúdePública, 27(8), 1487–1497. https://doi.org/10.1590/S0102-311X2011000800004.
Argyrides, M., Kkeli, N., & Kendeou, P. (2014). Validation of the factor structure of the greek adaptation of the sociocultural attitudes towards appearance questionnaire (SATAQ-3). Body Image, 11(3), 201–205. https://doi.org/10.1016/j.bodyim.2014.02.003.
Bardin, L. (1977). Análise de conteúdo.[Content Analysis] Lisboa: Edições 70.
Barra, J. V., Silva, W. R., Maroco, J., & Campos, J. A. D. B. (2019). Adaptação transcultural e validação do Questionário de Atitudes Socioculturais em Relação à Aparência-4 (SATAQ-4) aplicado a estudantes universitários.[Cross-cultural adaptation of the Sociocultural Attitudes Towards Appearance Scale-4 (SATAQ-4) applied to university students]. Cadernos de Saúde Pública, 35(5), 00170218. https://doi.org/10.1590/0102-311X00170218.
Bas, M., Karaca, K. E., Saglam, D., Arıtıcı, G., Cengiz, E., Köksal, S., & Buyukkaragoz, A. H. (2017). Turkish version of the Intuitive Eating Scale-2: Validity and reliability among university students. Appetite, 114, 391–397. https://doi.org/10.1016/j.appet.2017.04.017.
Beaton, D., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2002). Recommendations for the cross-cultural adaptation of health status measures, (vol. 12, pp. 1–9). American Academy of Orthopaedic Surgeons.
Beaton, D., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2007). Recommendations for the cross-cultural adaptation of the DASH & Quick DASH outcome measures. Institute for Work & Health, 1(1), 1–45.
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014.
Behmani, R. K., & Kumar, S. (2016). Gender and locality differences in body image among college students. Indian Journal of Community Psychology, 12(1), 130.
Bracken, B. A., & Barona, A. (1991). State of the art procedures for translating, validating and using psychoeducational tests in cross-cultural assessment. School Psychology International, 12(1-2), 119–132. https://doi.org/10.1177/0143034391121010.
Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1(3), 185–216. https://doi.org/10.1177/135910457000100301.
Brislin, R. W. (1986). The wording and translation of research instruments. In W. J. Lonner, & J. W. Berry (Eds.), Cross-cultural research and methodology series, Vol. 8. Field methods in cross-cultural research, (pp. 137–164). Sage Publications, Inc..
Campana, A. N. N. B., & Tavares, M. C. C. G. F. (2009). Avaliação da imagem corporal: instrumentos e diretrizes para a pesquisa. [Body image assessment: instruments and guidelines for research.]. Phorte.
Campana, A. N. N. B., Tavares, M. d. C. G. C. F., Swami, V., & da Silva, D. (2013). An examination of the psychometric properties of Brazilian Portuguese translations of the Drive for Muscularity Scale, the Swansea Muscularity Attitudes Questionnaire, and the Masculine Body Ideal Distress Scale. Psychology of Men & Masculinity, 14(4), 376–388. https://doi.org/10.1037/a0030087.
Carbonneau, E., Carbonneau, N., Lamarche, B., Provencher, V., Bégin, C., Bradette-Laplante, M., … Lemieux, S. (2016). Validation of a French-Canadian adaptation of the Intuitive Eating Scale-2 for the adult population. Appetite, 105, 37–45. https://doi.org/10.1016/j.appet.2016.05.001.
Carvalho, P. H. B., Amaral, A. C. S., & Ferreira, M. E. C. (2014. Cap. 7.). Diretrizes teóricas e metodológicas para criação de escalas de medida em imagem corporal. [Theoretical and methodological guidelines for creating body image measurement scales]. In M. E. C. Ferreira, M. R. de Castro, & F. F. R. Morgado (Eds.), Imagem Corporal: reflexões, diretrizes e práticas de pesquisa, (pp. 157–172). Juiz de Fora: Ufjf.
Carvalho, P. H. B. D., Conti, M. A., Neves, C. M., Meireles, J. F. F., Oliveira, F. C., & Ferreira, M. E. C. (2015). Psychometric assessment of the Brazilian version of the Male Body Dissatisfaction Scale. Archives of Clinical Psychiatry (São Paulo), 42(4), 90–94.
Cash, T. F., & Pruzinsky, T. (2002). Body image: A handbook of theory, research, and clinical practice. The Guilford Press.
Chakroun-Baggioni, N., Corman, M., Spada, M. M., Caselli, G., & Gierski, F. (2017). Desire thinking as a confounder in the relationship between mindfulness and craving: Evidence from a cross-cultural validation of the Desire Thinking Questionnaire. Psychiatry research, 256, 188–193. https://doi.org/10.1016/j.psychres.2017.06.051.
Claumann, G. S., Maccari, F. E., Ribovski, M., Pinto, A. D. A., Felden, É. P. G., & Pelegrini, A. (2017). Qualidade de vida em acadêmicos ingressantes em cursos de Educação Física. [Quality of life in academics entering Physical Education courses]. Journal of Physical Education. https://doi.org/10.4025/jphyseduc.v28i1.2824.
Conti, M. A., Ferreira, M. E. C., Amaral, A. C. S., Hearst, N., Cordás, T. A., & Scagliusi, F. B. (2012). Equivalência Semântica da versão em português do “Body Change Inventory”. [Semantic equivalence of the Portuguese version of the “Body Change Inventory”]. Ciência & Saúde Coletiva, 17(9), 2457–2469. https://doi.org/10.1590/S1413-81232012000900026.
Conti, M. A., Scagliusi, F., Queiroz, G. K. d. O., Hearst, N., & Cordás, T. A. (2010). Adaptação transcultural: tradução e validação de conteúdo para o idioma português do modelo da Tripartite Influence Scale de insatisfação corporal. [Cross-cultural adaptation: translation and content validation into Portuguese of the Tripartite Influence Scale model of body dissatisfaction]. Cadernos de SaúdePública, 26(3), 503–513. https://doi.org/10.1590/S0102-311X2010000300008.
Cunha, C. M., de Almeida Neto, O. P., & Stackfleth, R. (2016). Principais métodos de avaliação psicométrica da validade de instrumentos de medida. [Main methods of psychometric assessment of the validity of measurement instruments]. Revista de Atenção à Saúde, 14(47), 75–83. https://doi.org/10.13037/ras.vol14n47.3391.
Dahl, O., Wickman, M., & Wengström, Y. (2014). The cultural adaptation and validation of a Swedish version of the satisfaction with appearance scale (SWAP-Swe). Burns, 40(4), 598–605. https://doi.org/10.1016/j.burns.2013.08.036.
de Carvalho, P. H. B., & Ferreira, M. E. C. (2014). Imagem corporal em homens: instrumentos avaliativos. [Body image in men: evaluation instruments]. Psicologia: Teoria e Pesquisa, 30(3), 277–285. https://doi.org/10.1590/S0102-37722014000300005.
de Carvalho, P. H. B., Ferreira, M. E. C., Kotait, M., Teixeira, P. C., Hearst, N., Cordás, T. A., & Conti, M. A. (2013). Equivalências conceitual, semântica e instrumental: análises preliminares da versão em português (Brasil) da Male Body Dissatisfaction Scale (MBDS). [Conceptual, semantic and instrumental equivalences: preliminary analyzes of the Portuguese (Brazil) version of the Male Body Dissatisfaction Scale (MBDS)]. Cadernos de SaúdePública, 29(2), 403–409. https://doi.org/10.1590/S0102-311X2013000200027.
De Souza, A. C., & Alvarenga, M. d. S. (2016). Insatisfação com a imagem corporal em estudantes universitários — Uma revisão integrativa [Body dissatisfaction among university students — An integrative review]. Jornal Brasileiro de Psiquiatria, 65(3), 286–299. https://doi.org/10.1590/0047-2085000000134.
Fayers, P., & Machin, D. (2007). Quality of Life: The assessment, analysis and interpretation of patient-reported outcomes, (2nd ed., ). Wiley. https://doi.org/10.1002/9780470024522.
Felden, É. P. G., Pio, I. G., de Oliveira Santos, M., Barbosa, D. G., Andrade, R. D., & Pelegrini, A. (2016). Internalização dos ideais de corpo em acadêmicos de Educação Física e Fisioterapia. [Internalization of body ideals in Physical Education and Physiotherapy students]. Revista Brasileira de Ciência e Movimento, 24(4), 121–128. https://doi.org/10.18511/rbcm.v24i4.6508.
Ferreira, L., Corazza, J. F., Francisco, J. N., & Neves, A. N. (2018). Tradução e adaptação cultural da Escala de Perfeccionismo para Aparência Física (PAPS) para a língua portuguesa no Brasil. [Translation and cultural adaptation of the Perfectionism Scale for Physical Appearance (PAPS) into Portuguese in Brazil]. Revista Brasileira de Ciências do Esporte, 40(3), 266–272. https://doi.org/10.1016/j.rbce.2018.03.002.
Frank, R., Claumann, G. S., Pinto, A. D. A., Cordeiro, P. C., Felden, É. P. G., & Pelegrini, A. (2016). Fatores associados à insatisfação com a imagem corporal em acadêmicos de Educação Física.[Factors associated with dissatisfaction with body image in Physical Education students]. Jornal Brasileiro de Psiquiatria, 65(2), 161–167. https://doi.org/10.1590/0047-2085000000118.
Gardner, R. M., & Brown, D. L. (2010). Body image assessment: A review of figural drawing scales. Personality and Individual Differences, 48(2), 107–111. https://doi.org/10.1016/j.paid.2009.08.017.
Gonçalves, S. S., & Silvany, N. A. M. (2013). Dimensão psicológica da qualidade de vida de estudantes de Medicina. [Psychological dimension of quality of life among Medical students]. Revista Brasileira de Educação Médica, 37(3), 385–395. https://doi.org/10.1590/S0100-55022013000300011.
Guillemin, F. (1995). Cross-cultural adaptation and validation of health status measures. Scandinavian journal of rheumatology, 24(2), 61–63. https://doi.org/10.3109/03009749509099285.
Guillemin, F., Bombardier, C., & Beaton, D. (1993). Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of clinical epidemiology, 46(12), 1417–1432. https://doi.org/10.1016/0895-4356(93)90142-n.
Guimarães, B. E. D. B., Aquino, R., Prado, N. M. B. L., & Rodrigues, P. V. A. (2020). O consumo excessivo de álcool e a insatisfação com a imagem corporal por adolescentes e jovens de um município baiano, Brasil. [Excessive alcohol intake and dissatisfaction with body image among adolescents and young adults in a municipality in Bahia State, Brazil]. Cadernos de Saúde Pública, 36(1). https://doi.org/10.1590/0102-311x044919.
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2009). Análise multivariada de dados. Bookman editora.
Hendricson, W. D., Russell, I. J., Prihoda, T. J., Jacobson, J. M., Rogan, A., Bishop, G. D., & Castillo, R. (1989). Development and initial validation of a dual-language English-Spanish format for the Arthritis Impact Measurement Scales. Arthritis and rheumatism, 32(9), 1153–1159. https://doi.org/10.1002/anr.1780320915.
Herdman, M., Fox-Rushby, J., & Badia, X. (1998). A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation, 7(4), 323–335. https://doi.org/10.1023/a:1024985930536.
Hobza, C. L., & Rochlen, A. B. (2009). Gender role conflict, drive for muscularity, and the impact of ideal media portrayals on men. Psychology of Men & Masculinity, 10(2), 120–130. https://doi.org/10.1037/a0015040.
Kelley, C. C., Neufeld, J. M., & Musher-Eizenman, D. R. (2010). Drive for thinness and drive for muscularity: Opposite ends of the continuum or separate constructs? Body Image, 7(1), 74–77. https://doi.org/10.1016/j.bodyim.2009.09.008.
Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and reliability of measurement instruments used in research. American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364.
Laus, M. F., Kakeshita, I. S., Costa, T. M. B., Ferreira, M. E. C., Fortes, L. de S., Almeida, S. S. (2014). Body image in Brazil: recent advances in the state of knowledge and methodological issues. Revista de Saúde Pública, 48(2), 331–346. https://doi.org/10.1590/S0034-8910.2014048004950.
Malhotra, N. K. (2004). Pesquisa de marketing: Uma orientação aplicada (4ath ed.). Porto Alegre: Bookman.
Martins, G. A. (2006). Sobre confiabilidade e validade. [About reliability and validity]. Revista Brasileira de Gestão de Negócios, 8(20), 1–12.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097.
Morgado, F. F. d. R., et al. (2014. Cap. 6). Diretrizes teóricas e metodológicas para criação de escalas de medida em imagem corporal. [Theoretical and methodological guidelines for creating body image measurement scales]. In M. E. C. Ferreira, M. R. de Castro, & F. F. d. R. Morgado (Eds.), Imagem Corporal: reflexões, diretrizes e práticas de pesquisa, (pp. 137–156). Ufjf.
Pakpour, A. H., Zeidi, I. M., Ziaeiha, M., & Burri, A. (2014). Cross-cultural adaptation of the Female Genital Self-Image Scale (FGSIS) in Iranian female college students. Journal of sex research, 51(6), 646–653. https://doi.org/10.1080/00224499.2013.821441.
Pasquali, L. (1999). Instrumentos psicológicos: Manual prático de elaboração. [Psychological tools: Practical elaboration manual] LabPAM/IBAP, Brasília.
Pasquali, L. (2000). Princípios de elaboração de escalas psicológicas. In: Gorenstein, C., Andrade, L. H. S. G., Zuardi, A. W. Escalas de avaliação clínica em psiquiatria e psicofarmacologia. São Paulo: Lemos Editorial. p. 15–21.
Pasquali, L. (2009). Psicometria.[Psychometrics]. Revista da Escola de Enfermagem da USP [online], 43, 992–999. https://doi.org/10.1590/S0080-62342009000500002.
Pilatti, L. A., Pedroso, B., & Gutierrez, G. L. (2010). Propriedades psicométricas de instrumentos de avaliação: um debate necessário. [Psychometric properties of measurement instruments: a necessary debate]. Revista brasileira de ensino de Ciência e Tecnologia, 3(1). https://doi.org/10.3895/S1982-873X2010000100005.
Ponte, M. A. V., Fonseca, S. S. C. F., Carvalhal, M. I. M. M., & da Fonseca, J. J. S. (2019). Autoimagem corporal e prevalência de sobrepeso e obesidade em estudantes universitários. [Body self-image and prevalence of overweight and obesity in university students], Revista Brazileira em Promoção da Saúde, 32. https://doi.org/10.3895/S1982-873X2010000100005.
Primi, R. (2012). Psicometria: fundamentos matemáticos da teoria clássica dos testes. [Psychometrics: mathematical foundations of classical testtheory]. Avaliação Psicológica, 11(2), 297–307.
Reichenheim, M. E., & Moraes, C. L. (2007). Operacionalização de adaptação transcultural de instrumentos de aferição usados em epidemiologia. [Operationalization of cross-cultural adaptation of measurement instruments used in epidemiology]. Revista de SaúdePublica, 41(1), 665–673.
Rousseau, A., Denieul, M., Lentillon, V., & Valls, M. (2014). French validation of the Male Body Dissatisfaction Scale in a sample of young men. Journal de Thérapie Comportementale et Cognitive, 24(3), 122–129. https://doi.org/10.1016/j.jtcc.2014.07.001.
Sarhan, A. C., Krey, J. P., Chaud, D. M. A., & Abreu, E. S. (2015). Avaliação da percepção da imagem corporal e atitudes alimentares de estudantes das áreas de saúde e humanas de uma universidade do município de São Paulo.[Evaluation of the perception of body image and eating attitudes of students from the health and human areas of a university in the city of São Paulo]. RevistaSimbio-Logias, 8(11), 79–93.
Schaefer, L. M., Burke, N. L., Thompson, J. K., Dedrick, R. F., Heinberg, L. J., Calogero, R. M., … Swami, V. (2015). Development and validation of the Sociocultural Attitudes Towards Appearance Questionnaire-4 (SATAQ-4). Psychological assessment, 27(1), 54–67. https://doi.org/10.1037/a0037917.
Schilder, P. (1999). A imagem do corpo: as energias construtivas da psique. [The body image: the constructive energies of the psyche], (3rd ed., ). Martins Fontes.
Shoji, M., Mehling, W. E., Hautzinger, M., & Herbert, B. M. (2018). Investigating Multidimensional Interoceptive Awareness in a Japanese Population: Validation of the Japanese MAIA-J. Frontiers in psychology, 9, 1855. https://doi.org/10.3389/fpsyg.2018.01855.
Silva, W. R., Costa, D., Pimenta, F., Maroco, J., & Campos, J. A. D. B. (2016). Psychometric evaluation of a unified Portuguese-language version of the Body Shape Questionnaire in female university students. Cadernos de Saúde Pública, 32(7). https://doi.org/10.1590/0102-311X00133715.
Sirriyeh, R., Lawton, R., Gardner, P., & Armitage, G. (2012). Reviewing studies with diverse designs: the development and evaluation of a new tool. Journal of Evaluation in Clinical Practice, 18(4), 746–752. https://doi.org/10.1111/j.1365-2753.2011.01662.x.
Slade, P. D. (1994). What is body image? Behaviour Research and Therapy, 32(5), 497–502. https://doi.org/10.1016/0005-7967(94)90136-8.
Swami, V., & Barron, D. (2019). Translation and validation of body image instruments: Challenges, good practice guidelines, and reporting recommendations for test adaptation. Body image, 31, 204–220. https://doi.org/10.1016/j.bodyim.2018.08.014.
Swami, V., Mohd. Khatib, N. A., Toh, E., Zahari, H. S., Todd, J., & Barron, D. (2019). Factor structure and psychometric properties of a Bahasa Malaysia (Malay) translation of the Body Appreciation Scale-2 (BAS-2). Body Image, 28, 66–75. https://doi.org/10.1016/j.bodyim.2018.12.006.
Thompson, J. K. (2004). The (mis)measurement of body image: ten strategies to improve assessment for applied and research purposes. Body image, 1(1), 7–14. https://doi.org/10.1016/S1740-1445(03)00004-4.
Ulian, M. D., Sato, P. d. M., Benatti, F. B., Campos-Ferraz, P. L. d., Roble, O. J., Unsain, R. F., … Scagliusi, F. B. (2017). Adaptação transcultural para o português dos Questionários de Desejos Intensos por Comida – Estado ou Traço (QDIC-E e QDIC-T) dos State and Trait Food-Cravings Questionnaires (FCQ-S and FCQ-T). [Cross-cultural adaptation into Portuguese of the State and Trait Food-Cravings Questionnaires (FCD-S and FCQ-T) Intense Food Wishes Questionnaires (QDIC-E and QDIC-T)]. Ciência & Saúde Coletiva, 22(2), 403–416. https://doi.org/10.1590/1413-81232017222.18272015.
Acknowledgements
Not applicable.
Funding
There was no funding for this article.
Author information
Authors and Affiliations
Contributions
Ravine Carvalho Pessanha Coelho da Silva and Fabiane Frota da Rocha Morgado: General conception of the project; writing of the article; data analysis; and discussion of the article. Ana Carolina Soares Amaral and Vitor Alexandre Rabelo de Almeida: Data analysis. Marcus Vinicius Freitas Rodrigues: English translation and proofreading. All authors contributed to the critical review of the article. The author(s) read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was revised: "The author Fabiane Frota da Rocha Morgado's name was corrected.
Supplementary Information
Additional file 1.
PRISMA checklist.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
da Silva, R.C.P.C., Amaral, A.C.S., Quintanilha, A.K.S. et al. Cross-cultural adaptation of body image assessment instruments for university students: a systematic review. Psicol. Refl. Crít. 34, 11 (2021). https://doi.org/10.1186/s41155-021-00177-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s41155-021-00177-w