Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Developing and validating a scale to measure Food and Nutrition Literacy (FNLIT) in elementary school children in Iran

  • Aazam Doustmohammadian,

    Affiliation Department of Community Nutrition, National Nutrition and Food Technology Research Institute; and Faculty of Nutrition Sciences and Food Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran

  • Nasrin Omidvar,

    Affiliation Department of Community Nutrition, National Nutrition and Food Technology Research Institute; and Faculty of Nutrition Sciences and Food Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran

  • Nastaran Keshavarz-Mohammadi,

    Affiliation School of Public Health, Shahid Beheshti University of Medical Sciences, Tehran, Iran

  • Morteza Abdollahi,

    Affiliation Department of Nutrition Research, National Nutrition and Food Technology Research Institute; and Faculty of Nutrition Sciences and Food Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran

  • Maryam Amini,

    Affiliation Department of Nutrition Research, National Nutrition and Food Technology Research Institute; and Faculty of Nutrition Sciences and Food Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran

  • Hassan Eini-Zinab

    hassan.eini@gmail.com

    Affiliation Department of Community Nutrition, National Nutrition and Food Technology Research Institute; and Faculty of Nutrition Sciences and Food Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran

Abstract

Background

Food and nutrition literacy is an emerging term which is increasingly used in policy and research. Though research in this area is growing, progression is limited by the lack of an accepted method to measure food and nutrition literacy. The aim of this study is to develop a valid and reliable questionnaire to assess food and nutrition literacy in elementary school children in the city of Tehran.

Methods

The study was conducted in three phases. To develop Food and Nutrition Literacy (FNLIT) questionnaire, a comprehensive literature review and a qualitative study were initially performed to identify food and nutrition literacy dimensions and its components. Content and face validity of the questionnaire were evaluated by an expert panel as well as students. In the second phase, construct validity of the scale was evaluated using Explanatory Factor Analyses (EFA) and Confirmatory Factor Analyses (CFA). In the last phase (confirmatory phase), the final version of the questionnaire was evaluated on 400 students.

Results

Findings show Content Validity Ratio (CVR) and Content Validity Index (CVI) of the 62-item questionnaire at acceptable levels of 0.87 and 0.92, respectively. EFA suggested a six-factor construct, namely, understanding food and nutrition information, knowledge, functional, interactive, food choice, and critical. The results of CFA indicated acceptable fit indices for the proposed models. All subscales demonstrated satisfactory internal consistency (Cronbach’s alpha≥0.70), except for critical skill subscale (0.48). The intraclass correlation coefficient (ICC = 0.90, CI: 0.83–0.94) indicated that Food and Nutrition Literacy (FNLIT) scale had satisfactory stability. Each phase of development progressively improved the questionnaire, which resulted in a 46-item (42 likert-type items and 4 true-false items) Food and Nutrition Literacy (FNLIT) scale. The questionnaire measured two domains with 6 subscales, including: 1) cognitive domain: understanding and knowledge; 2) skill domain: functional, food choice, interactive, and critical skills.

Conclusion

The developed food and nutrition literacy scale is a valid and reliable instrument to measure food and nutrition literacy in children. This measure lays a solid empirical and theoretical foundation for future research and tailored interventions to promote food and nutrition literacy in this age group.

Introduction

Non-Communicable Diseases (NCDs), including obesity, diabetes, cardiovascular diseases (CVDs) and hypertension are the leading causes of premature death worldwide. Of these premature deaths, 80% occur in low and middle income countries [1]. According to the World Health Organization (WHO), smoking and sedentary behaviors along with unhealthy dietary intake are common risk factors for 80% of chronic diseases [2]. Furthermore, the focus on the role of nutrition in the etiology of chronic diseases is increasing [2]. Nutrition transition has resulted in a great change in dietary habits of children and adolescents throughout the world [3,4]. Due to time constraints, families have started to rely on convenience and pre-packed foods, which are usually high in saturated fats, sugar and salt with limited consumption of fruits, vegetables and fiber [5,6,7]. In Iran, as a country experiencing nutrition transition, high-risk behaviors such as unhealthy dietary intake [8,9] and physical inactivity [10,11] are rising, resulting in an increase in the prevalence of childhood overweight and obesity [11,12].

According to studies, children’s food choices and dietary habits can affect the risk of nutrition-related diseases lifelong [13,14]. Childhood, therefore provides an opportunity that can be utilized by health promoters to establish healthy behaviors that could prevent the development of health problems later in life [15,16]. Understanding determinants of unhealthy behaviors is therefore crucial. One way for understanding the reasons behind the nutrition-related problems and behaviors among children and adolescents is assessment of their food and nutrition literacy level [17].

Food literacy is an emerging term defined as “collection of inter-related knowledge, skills and behaviors required to plan, manage, select, prepare and eat foods to meet needs and determine food intake”[18]. This term is increasingly used in nutrition related policy and research to address complex health problems. Therefore, improving children’s food and nutrition literacy has been in particular the target of intervention studies and contemporary nutrition plans and policies [19]. Though research in this area is growing, progression is limited by the lack of an accepted method to measure food and nutrition literacy. Development of a scale to assess children’s food and nutrition literacy level therefore, is required to guide the development and ensure effectiveness of nutrition related interventions [19]. The present study aimed to develop and validate a questionnaire to assess food and nutrition literacy in 10–12 years old children in Tehran.

Materials and methods

Theoretical framework

This study was based on Nutbeam’s hierarchical model for health literacy [20]. Nutbeam proposed two distinctly different conceptual approaches for health literacy: health literacy as a “risk factor” and health literacy as an “asset”. The first approach needs to be identified and appropriately managed in clinical care. The second approach has evolved from origins in public health and health promotion [20]. Using such insights, health literacy can be categorized into different levels that progressively reflect greater autonomy and personal empowerment in decision making, as well as engagement in a wider range of health actions that extend from personal behaviors to social action to address the determinants of health [21]. According to Nutbeam’s hierarchical model, nutrition literacy is the ability to access, interpret and use nutrition information [22]. Nutrition literacy can be classified in three levels as functional, interactive and critical [23]. At the lowest level, functional nutrition literacy is concerned with basic reading and writing skills necessary to understand and follow simple nutrition message(s). The second level, interactive nutrition literacy, is advanced literacy which includes cognitive and interpersonal skills needed to manage nutrition issues in partnership with professionals. As an example of second level actions one can refer to ability of students to interact nutritional information with others (peer, family and nutritionists) in order to promote healthy eating pattern. Finally, the third level, critical nutrition literacy, is the ability to analyze nutrition information critically, increase awareness, and participate in action to address barriers. Examples of this level are engagement of students to oppose opening of a fast food restaurant near their school; and community participation in order to promote healthy eating pattern [23,24]. The second and third levels are in a hierarchical order.

Study design

The study was designed in three distinct phases, aimed at ensuring validity and reliability: 1) identification of food and nutrition literacy dimensions and its components; 2) development and validation of a scale; and 3) confirmatory study to ensure validity of the scale. Fig 1, presents an overview of scale development process.

thumbnail
Fig 1. Summary of steps followed in the development of the food and nutrition literacy scale.

a Focus Group Discussion.

https://doi.org/10.1371/journal.pone.0179196.g001

Phase1: Identification of food and nutrition literacy dimensions and its components (scale items).

  1. Literature review. A comprehensive literature search through PubMed, ISI, Science direct, Scopus and Google Scholar was conducted to identify concepts of food and nutrition literacy and its components, as well as related questionnaires using the Keywords: ”food skill”, “food literacy”, “nutrition literacy”, “health literacy”, “food preparation”, “food choice“, “food wellbeing”, for the first search. In the second search, reference lists of the studies were checked for additional related works.
  2. Qualitative study. Using a qualitative approach, 15 in-depth interviews with experts and 12 focus group discussions with 10–12 years old students (n = 89, mean age = 11.07 years) were conducted to explore their perceptions about food and nutrition literacy concepts. Data were open coded by two authors independently to look for key themes and components of food and nutrition literacy. Transcripts were reviewed at least 5 times. All coding and interpretations were discussed by the research team. Interviewing stopped when theoretical saturation reached. Data were analyzed using MAXQDA2010 software.

Phase2: Development and validation of the scale.

  1. Item generation. Using the concepts identified at phase one and reviewing existing questionnaires [25,26,27,28,29,30], a pool of 103 items was generated to measure 5 domains and 12 components of food and nutrition literacy. After elimination of redundant items, 94 items remained which included 90 Likert-type and 4 true/false items. To assess construct validity, factor analyses was performed only on likert-type items.
  2. Content validity. For qualitative content validity, a panel of eight experts (3 nutritionists, 2 health education and health promotion, 2 sociologists, 1 social medicine and 1 public health professionals) examined the initial questionnaire. Items were modified based on the experts’ comments. To calculate content validity ratio (CVR) and content validity index (CVI), the experts were asked to comment on the necessity, relevance, clarity and simplicity of each item. A CVR for total scale was computed according to Lawshe scores [31]. The CVI of each question was determined by the proportion of experts who rated each item with a 3 or a 4 [32]. Content validity and expert panel review led to elimination of 32 items. The second draft of the scale consisted of 62 items, including4 true-false and 58 likert-type items.
  3. Face validity. To confirm face validity of the scale, 15 students aged 10–12 years, similar to target group, were recruited through convenience sampling. Students were interviewed to assess each item for ambiguity and complexity.
  4. Construct validity. For construct validity, 373 students aged 10–12 years, participated in the study during October 2015. The General Office of Education in Tehran classifies existing 19-educational-districts into three socioeconomic levels, including: affluent (Northern Tehran), semi-affluent (Central Tehran) and deprived (Southern Tehran). To maximize heterogeneity of the sample, two schools were randomly selected from each of the three different socio-economic levels (a total of 6 schools). A second round of random sampling was used to select students from the schools. Written informed consent was obtained from students. Data analysis for construct validity included the following two phases:
    • Exploratory factor analysis (EFA). To assess construct validity of the scale, EFA was used to explore whether the statements in the scale reflected the three levels of nutrition literacy based on Nutbeam’s hierarchical model of health literacy. An oblique rotation (i.e. promax) and Principal Axis Factoring (PAF) extraction were used to explore the existing factorial pattern. The number of factors was determined through evaluating four criteria: eigenvalues, percent of explained variance by each factor, scree plot and interpretability criteria [33]. Based on this evaluation, a decision on the number of factors was made. The decision to delete items was based on the item’s factor loading.
    • Confirmatory factor analysis (CFA). Confirmatory factor analysis was performed to test whether data fit the hypothesized measurement model, which was extracted by EFA.
  5. Reliability. Reliability of the scale was assessed using internal consistency reliability and test-retest procedure. Internal consistency of subscales was evaluated by calculating Cronbach’s alpha for each scale. For reproducibility, test-retest was performed by re-administration of the questionnaire on 30 students aged 10–12 years, (15 girls and 15 boys), two weeks apart. Average length of time for completion of the questionnaire was 20 minutes. At the end of this phase, the final draft of the questionnaire with 46 items (42 likert-type and 4 true-false) was developed.

Phase 3: Confirmatory study.

In order to evaluate the factor structures identified through this analysis, 400 students aged 10–12 years, were selected from three different socio-economic areas: districts 2, 4 and 5 (affluent areas); districts 9, 11 and 14 (semi-affluent areas) and districts 15, 16 and 17 (deprived areas) of Tehran Metropolitan Area. To assess consistency of results, the selected samples were different from those studied in the construct validity study. Written informed consent was obtained from students and their parents. Data collection conducted during November 2015 to January 2016. Confirmatory factor analysis was performed by AMOS using the same parameters and fit indices as phase 2.

Statistical analysis

Exploratory Factor Analysis (EFA) was used to determine the number and nature of underlying factors in the scale. Kaiser-Meyer-Olkin (KMO) was used to measure sampling adequacy. Bartlett’s test of sphericity, and total variance explained were used for the evaluation of factor analysis. An oblique rotation (i.e. promax) and Principal Axis Factoring (PAF) extraction were used in the EFA. Factor loadings were used to keep or drop items. Confirmatory Factor Analysis (CFA) was performed to test whether the data fit the hypothesized measurement model, which was extracted by EFA. Weighted Least Squares (WLS) estimation method was used at CFA. Asymptomatic covariance matrix was considered as a weighted matrix. Goodness-of-fit indices (GFIs) and reasonable threshold levels of these indices for CFA were considered as χ2/df< 3, root mean square error of approximation (RMSEA) < 0.08, goodness-of-fit index (GFI)> 0.9 and adjusted goodness of fit index (AGFI)>0/8 [34]. Internal consistency of likert-type items of the scale was determined by calculating Cronbach’s alpha coefficient. Kuder-Richardson formula 20 (KR-20) was used for true-false items. Values equal to 0.7 and above were considered as satisfactory [35]. Before the Cronbach’s alpha calculation, coding for reverse- items were reversed. The test-retest reliability of the scale was evaluated using the intraclass correlation coefficient (ICC) where ICCs > 0.75 were considered acceptable. The test-retest reliability of true-false items was evaluated by Cohen kappa coefficient. Kappa values greater than 0.75 were defined as excellent accord, and those below 0.5 as poor [36]. All statistical analysis were performed using SPSS 21.0 (SPSS Inc., Chicago, Illinois, U.S.) and AMOS 21.0 [37].

Ethics statement

The study protocol was approved by the National Nutrition and Food Technology Research Institute (NNFTRI) ethical committee (No.1394.20, 16-10-2015). Informed written consent was obtained from children and their parents.

Results

Phase 1: Dimensions of food and nutrition literacy and its components

  1. Literature review. A total of thirty studies were included in the review. Of these, 5 studies simultaneously addressed both food/nutrition literacy definitions and its components [18,22,25,38,39], only 17 studies defined food/nutrition literacy [19,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55] and 8 focused on food/nutrition literacy dimensions [17,24,56,57,58,59,60,61]. Based on the literature, components of nutrition literacy are based on Nutbeam’s concept of health literacy. They are mainly focused on abilities necessary to obtain, understand and process food and nutrition information. The components of food literacy incorporated a broader spectrum of skills. Most of food literacy literature emphasized on abilities and skills in three domains as food knowledge and understanding the effects of food on health; skills needed to make healthy food choices and preparation, and capacities, including self-efficacy and creativity.
  2. Qualitative study. Nutbeam’s hierarchical model of health literacy was the theoretical framework used to develop skill domain of measurement. In order to assess theoretical framework in our local context, a qualitative study was conducted with food and nutrition experts, as well as students. Based on the results of qualitative study, in cognitive domain, 2 dimensions, including knowledge and understanding were identified. In skill domain in line with Nutbeam’s hierarchical model of health literacy, 3 dimensions, including functional, interactive and critical literacy were identified. In general, 12 components of food and nutrition literacy identified which fell into five dimensions. Table 1 presents these results.
thumbnail
Table 1. Food and nutrition literacy dimensions and components in children.

https://doi.org/10.1371/journal.pone.0179196.t001

Phase 2: Development and validation of the scale

  1. Item generation. A pool of 103 items was generated at first phase of the study. After elimination of redundant items, 94 items remained. They included 90 Likert-type items to assess the five dimensions of food and nutrition literacy and 4 true/false items to assess food label literacy.
  2. Content validity. Findings regarding the CVR and CVI confirmed the quantitative content validity of 62 items. The CVR for total scale was 0.87, indicating a satisfactory result [62]. A satisfactory level of agreement was found (CVI = 0.92) among panelists suggesting that the scale had a good content validity [63].
  3. Face validity. Based on the results of face validity, most of the scale items were generally easy to read and comprehend for students; except for a few words that were changed to meet participants’ considerations, such as replacing “rarely” with “seldom” as recommended by the children.
    Through content validity, experts commented on the necessity, relevance, clarity and simplicity of each item. Following the experts’ assessments, face validity was achieved through interview with students similar to target group to assess each items for ambiguity and complexity. Receiving an acceptable level of content and face validity in the second phase ensured that questionnaire items are tailored for the study group. In addition, through two further studies with 773 students (373 students in construct validity study and 400 students in confirmatory study), the questionnaire was completed under researchers supervision. During these studies the respondents did not encountere any complex or ambiguous item, which also justified the results of validity study.
  4. Construct validity. A total of 373 students participated in the construct validity study, %51 of which were male. The average age of students was 11.07±0.57 years. Participants were from grades 5 (48.3%) and 6 (51.7%). Demographic characteristics of students participated in the second phase (construct validity study) are shown at Table 2.
    • Exploratory factor analysis (EFA). For cognitive domain, the Kaiser–Meyer–Olkin (KMO) test showed sampling adequacy (KMO = 0.78), and Bartlett’s test confirmed factor analysis was appropriate (χ2 = 1241.35, df = 231, and P < 0.001). Two factors (understanding and knowledge) with 17 items were extracted for cognitive domain. In skills domain of food and nutrition literacy, KMO showed sampling adequacy (KMO = 0.85), and Bartlett’s test confirmed the EFA was appropriate (χ2 = 3385.36, df = 630, and P < 0.001). This domain, consistent with the theoretical hypotheses, included four factors with29 items (i.e. functional, interactive, food choice and critical). Factor loading, eigenvalue, explained variance percent and croanbach’s α related to cognitive and skill domains are reported in S1 File. Additional Alpha test be deleting items one at a time showed that removing items Q18_1, Q18_3, Q40 and Q36 of understanding, knowledge, functional and interactive subscales resulted in an increase in Cronbach’s alpha (S1 and S2 Tables). Considering items content and their factor loadings, items Q18_3 and Q36 were removed which resulted in a significant increase in the corresponding sub-scale's Cronbach’s alpha from 0.63 to 0.69 and 0.70 to 0.79, respectively. Also, these items poorly represented the core constructs and their elimination was justifiable to the research team. After removing the specified items, scales were re-analyzed. The KMO sampling adequacies were greater than 0.80 (KMO = 0.81 in cognitive domain and KMO = 0.84 in skill domain) and the Bartlett Sphericity Test was significant at p< 0. 001. The final EFA extracted two factors with 15 items in cognitive domain (Table 3). The percentage of the total variance was 23.72% by the two rotated factors. In skills domain, four factors, including 27 items were extracted (Table 4). The percentage of total variance explained by these factors was 32.97%. The final results of EFA and the internal consistency of items are presented in Tables 3 and 4. As shown, alpha for the subscales would not be improved by removing any item. All items were loaded between 0.22 and 0.64 for cognitive domain and between 0.30 and 0.75 for skills domain.
    • Confirmatory factor analysis (CFA). The result of CFA showed the first-order factor loadings for cognitive domain of scale ranged from 0.29 to 0.70, and for skills domain of scale ranged from 0.23 to 0.78 (S1 and S2 Figs). All factor loadings were statistically significant (p<0.001). Fig 2, displays the standardized factor loadings for the second-order factor model in construct validity study. The results of the model fit for the first-order factor models of cognitive and skills domains of scale are reported in Table 5 which indicates desirable fit of the proposed models.
  5. Reliability. Internal consistency reliabilities and Cronbach’s alpha for each of the subscales are presented in Table 6. Cronbach’s alpha coefficient ranged from 0.48 to 0.80 for various domains. Kuder-Richarson reliability index for the dichotomous responses of food label critical literacy was acceptable (0.71). Kappa coefficients for each pair of dichotomous responses of items 43, 44, 45 and 46 were at acceptable levels of 0.68, 0.92, 0.83, and 0.85, respectively. The intraclass correlation coefficient (ICC = 0.90) indicated that Food and Nutrition Literacy (FNLIT) scale had satisfactory stability.
thumbnail
Table 2. Demographic characteristics of students participated in validity and confirmatory studies.

https://doi.org/10.1371/journal.pone.0179196.t002

thumbnail
Table 3. Factor analysis results and item statistics of cognitive domain of food and nutrition literacy after item deleted because of increasing alpha in students aged 10–12 (n = 373).

https://doi.org/10.1371/journal.pone.0179196.t003

thumbnail
Table 4. Factor analysis results and item statistics of skills domains of food and nutrition literacy after item deleted because of increasing alpha in students (N = 373).

https://doi.org/10.1371/journal.pone.0179196.t004

thumbnail
Fig 2. Second-order confirmatory factor analysis factor loadings construct validity study for FNLIT scale.

Note: n = 373; All factor loadings are standardized and are statistically significant, p< 0.001.

https://doi.org/10.1371/journal.pone.0179196.g002

thumbnail
Table 5. Results of confirmatory factor analysis for the first-order and second-order model of FNLIT scale a.

https://doi.org/10.1371/journal.pone.0179196.t005

thumbnail
Table 6. Croanbach’s α coefficient and ICC for the FNLIT scale and its subscales.

https://doi.org/10.1371/journal.pone.0179196.t006

Phase 3: Confirmatory study

400 students (51% male) aged 10–12 years (11.3±0.65) participated in the confirmatory study. Demographic characteristics of students participated in confirmatory study are demonstrated in Table 2. The higher-order factor model was run in new sample and demonstrated desirable fit as indicated by multiple fit indicators shown in Table 5. Factor loadings for the second-order factor model in confirmatory study ranged from 0.40 to 0.90 and all factor loadings were statistically significant (p < 0.001).

Discussion

Through this study a reliable and valid instrument to assess food and nutrition literacy in elementary school students was developed. To our knowledge, this study is the first attempt to develop and evaluate a food and nutrition literacy scale in children using a mixed method. Several studies have developed nutrition knowledge questionnaires in children, but not nutrition literacy [64,65,66,67,68]. It’s rarely been the case where children’s food and nutrition literacy explored through both expert and children’s perspectives [25,30]. Measuring food and nutrition literacy is a new issue. Existing food and nutrition literacy instruments tend to emphasize literacy and numeracy skills, as well as nutrition knowledge [26,27] mainly in adults. Some researchers have just applied nutrition knowledge-based outcomes in their work [58,69], whereas others have focused on the ability to effectively use food labels [27,30]. Studies suggest that food and nutrition literacy is a social, cultural and political feature that should be considered as a structure with multiple dimensions [18,24]. The complex nature of food and nutrition literacy concept confirms the necessity to use a multi-dimensional tool. The designed questionnaire included a wide range of items to assess individual, interpersonal, and social factors relating to children’s food and nutrition literacy. The questionnaire led to a comprehensive approach of functional, interactive and critical dimension in a diverse context.

Since the skill domain of scale was based on theoretical framework, we independently analyzed the variables of cognitive and skills domains. During exploratory factor analysis, it was tried to remain loyal to the conceptual framework of the study. Although we originally proposed three factors of the skill domain of food and nutrition literacy scale, explanatory factor analysis supported a four-factor model. The factors or subscales of skill domain which conceived by the research team represented functional, food choice, interactive and critical skills of food and nutrition literacy scale. This may suggest that food choice is the most important part of children’s food and nutrition literacy which have potential to influence their food consumption decisions [18,70]. In estimating dimensions of model, due to lack of consensus among Structural Equation Model (SEM) specialists, several model fit indices were used [71], including chi-square (χ2), goodness-of-fit index (GFI), the adjusted goodness-of-fit index (AGFI) and root mean square error of approximation (RMSEA). Cut-points of model fit criteria show acceptable values for the first-order models of cognitive and skill domains of food and nutrition literacy scale. Although, GFI was very close to the nominal value of 0.9 [71] for skill domain. Therefore, two-factor structure of cognitive domain and four-factor structure of skill domain of food and nutrition literacy scale was confirmed. In the second-order model, the GFI of both construct validity and confirmatory analysis were close to the nominal value of 0.9. This result can be interpreted as a GFI that may have been affected by the external factors such as, sample size, the number of parameters and the degrees of freedom to sample size ratio and does not reflect poor model fit [72,73]. In our study, the degree of freedom was more than sample size which warranted this result. The RMSEA is currently the most popular measure of fitness which was within the acceptable range both at first-order and second-order models [71]. Therefore, results of structural equation models showed the optimum model of the scale was matched to the theoretical approach and reasonably confirmed by related indices.

All of the subscales demonstrated satisfactory test-retest reliability and their internal consistency reliabilities generally exceeded the standard of 0.70, except for critical skill subscale. This finding was consistent with result of Ndahura (2012), which also found the internal consistency value of Critical Nutrition Literacy (CNL) construct (0.46) lower than the standard value [25]. A possible explanation for the low internal consistency values is that internal consistency reliabilities values depend on the number of items in the scale. Since the critical skill subscale consisted of four items, this could have resulted in lower internal consistency values [74]. The lower reliability observed for this subscale may reflect the variability observed in the scores of the items comprising it. The lower reliability estimates will not necessarily negate the value of the subscale, since expert panel rated the items as relevant during the second phase. After the completion of validity and reliability phases, the food and nutrition literacy scale for children consisted of 4 true-false items and 42 likert-type items within 6 areas. These were understanding and knowledge, as well as functional, food choice, interactive and critical food and nutrition literacy.

The strength of the current study is that food and nutrition literacy scale was developed and validated based on a theoretical framework, using mixed method approach. Furthermore, the final food and nutrition scale was confirmed through re-analysis in a new independent data set which empirically supported the reasonable fit of the model. The results also provide insight regarding the dimensions of food and nutrition literacy. However, the study has certain limitations. First, a predictability criterion to report was not used. In addition, considering the fact that food and nutrition literacy is influenced by culture and society, it is important to consider the role of deeply rooted sociocultural norms regarding health and eating. Therefore, the questionnaire cannot serve as a universal tool, and should be localized according to social context [24]. The study focused on a specific age group and school settings, future studies are encouraged to be carried out among different age groups of children and in different settings. The evaluation of such studies may lead to a stronger confirmation of the validity properties of the FNLIT scale. At present, both Persian and English versions of the questionnaire are available (S1 and S2 Files).

Conclusion

Food and nutrition literacy scale is a valid and reliable instrument to measure food and nutrition literacy in children in Iran. This measure lays a solid empirical and theoretical foundation for future research and tailored interventions to promote food and nutrition literacy in children.

Supporting information

S1 Fig. First-order confirmatory factor analysis factor loadings construct validity study for cognitive domain of FNLIT scale.

Note: n = 373; All factor loadings are standardized and are statistically significant, p< 0.001.

https://doi.org/10.1371/journal.pone.0179196.s001

(TIF)

S2 Fig. First-order confirmatory factor analysis factor loadings construct validity study for skill domain of FNLIT scale.

Note: n = 373; All factor loadings are standardized and are statistically significant, p< 0.001.

https://doi.org/10.1371/journal.pone.0179196.s002

(TIF)

S1 Table. Factor analysis results and item statistics of cognitive domain of food and nutrition literacy in students aged 10–12 (N = 373).

a Item deleted because of increasing alpha.

https://doi.org/10.1371/journal.pone.0179196.s003

(DOCX)

S2 Table. Factor analysis results and item statistics of cognitive and skills domains of food and nutrition literacy in students (N = 373).

a Item deleted because of increasing alpha.

https://doi.org/10.1371/journal.pone.0179196.s004

(DOCX)

S1 File. Food and Nutrition Literacy (FNLIT) scale_English version.

https://doi.org/10.1371/journal.pone.0179196.s005

(PDF)

S2 File. Food and Nutrition Literacy (FNLIT) scale_Persian version.

https://doi.org/10.1371/journal.pone.0179196.s006

(PDF)

Acknowledgments

The authors hereby express their gratitude to the Shahid Beheshti University of Medical Sciences, National Nutrition and Food Technology Research Institute (NNFTRI), all coordinators, interviewers, and all the students participated in this study. This research was conducted by the approval and funding of the NNFTRI.

Author Contributions

  1. Conceptualization: AD NO NKM.
  2. Formal analysis: AD HEZ.
  3. Investigation: AD NO M. Amini.
  4. Methodology: AD NO HEZ NKM.
  5. Writing – original draft: AD.
  6. Writing – review & editing: AD NO HEZ NKM M. Abdollahi M. Amini.

References

  1. 1. Barry MM, Battel-Kirk B, Dempsey C. Developing Health Promotion Workforce Capacity for Addressing Non-communicable Diseases Globally. Global Handbook on Noncommunicable Diseases and Health Promotion: Springer. pp. 417–439.2013.
  2. 2. World Health Organization. Global status report on noncommunicable diseases 2014. http://www.who.int/nmh/publications/ncd-status-report-2014/en/.
  3. 3. Ghassemi H, Harrison G, Mohammad K. An accelerated nutrition transition in Iran. Public Health Nutr.2002;5(1A): 149–155. pmid:12027278
  4. 4. Popkin BM, Gordon-Larsen P. The nutrition transition: worldwide obesity dynamics and their determinants. Int J Obes Relat Metab Disord.2004;28 Suppl 3: S2–9. pmid:15543214
  5. 5. Diethelm K, Jankovic N, Moreno LA, Huybrechts I, De Henauw S, De Vriendt T, et al. Food intake of European adolescents in the light of different food-based dietary guidelines: results of the HELENA (Healthy Lifestyle in Europe by Nutrition in Adolescence) Study. Public Health Nutr.2012;15(3): 386–398. pmid:21936969
  6. 6. Caraher M, Lloyd S, Lawton J, Singh G, Horsley K, Mussa F. A tale of two cities: A study of access to food, lessons for public health practice. Health Education Journal.2010;69(2): 200–210.
  7. 7. Lai Yeung WL. Gender perspectives on adolescent eating behaviors: a study on the eating attitudes and behaviors of junior secondary students in Hong Kong. J Nutr Educ Behav.2010;42(4): 250–258. pmid:20579607
  8. 8. Kelishadi R, Pour MH, Zadegan NS, Kahbazi M, Sadry G, Amani A, et al. Dietary fat intake and lipid profiles of Iranian adolescents: Isfahan Healthy Heart Program—Heart Health Promotion from Childhood. Prev Med.2004;39(4): 760–766. pmid:15351543
  9. 9. Azadbakht L, Esmaillzadeh A. Macro and Micro-Nutrients Intake, Food Groups Consumption and Dietary Habits among Female Students in Isfahan University of Medical Sciences. Iran Red Crescent Med J.2012;14(4): 204–209. pmid:22754682.
  10. 10. Kelishadi R, Razaghi EM, Gouya MM, Ardalan G, Gheiratmand R, Delavari A, et al. Association of physical activity and the metabolic syndrome in children and adolescents: CASPIAN Study. Horm Res.2007;67(1): 46–52. pmid:17035710
  11. 11. Kelishadi R, Pour MH, Sarraf-Zadegan N, Sadry GH, Ansari R, Alikhassy H, et al. Obesity and associated modifiable environmental factors in Iranian adolescents: Isfahan Healthy Heart Program—Heart Health Promotion from Childhood. Pediatr Int.2003;45(4): 435–442.pmid:12911481.
  12. 12. Kelishadi R, Ardalan G, Gheiratmand R, Majdzadeh R, Hosseini M, Gouya MM, et al. Thinness, overweight and obesity in a national sample of Iranian children and adolescents: CASPIAN Study. Child Care Health Dev.2008;34(1): 44–54. pmid:18171443
  13. 13. Brug J., & Klepp K. (2007). Children and adolescents. In Lawrence M. & Worsley T. (Eds.), Public health nutrition: From principles to practice (pp. 100–126). Maidenhead: Open University Press.
  14. 14. Birch LL, Savage JS, Fisher JO. Right sizing prevention. Food portion size effects on children's eating and weight. Appetite.2015;88: 11–16. pmid:25464022
  15. 15. Sacco J, Lillico HG, Chen E, Hobin E. The influence of menu labelling on food choices among children and adolescents: a systematic review of the literature. Perspect Public Health.2016. pmid:27436235
  16. 16. World Health Organisation. Strengthening the health sector responses to adolescent health and development; 2010. http://www.who.int/child_adolescent_health/documents/cah_adh_flyer_2010_12_en.pdf.
  17. 17. Vaitkeviciute R, Ball LE, Harris N. The relationship between food literacy and dietary intake in adolescents: a systematic review. Public Health Nutr.2015;18(4): 649–658. pmid:24844778
  18. 18. Vidgen HA, Gallegos D. Defining food literacy and its components. Appetite.2014;76: 50–59. pmid:24462490
  19. 19. Cullerton K, Vidgen HA, Gallegos D. A review of food literacy interventions targeting disadvantaged young people. Queensland University of Technology, School of Public Health;.2012.
  20. 20. Nutbeam D. The evolving concept of health literacy. Social science & medicine.2008;67(12): 2072–2078. pmid:18952344
  21. 21. Nutbeam D, Kickbusch I. Advancing health literacy: a global challenge for the 21st century. Health promotion international.2000;15(3): 183–184.
  22. 22. Zoellner J, Connell C, Bounds W, Crook L, Yadrick K. Nutrition literacy status and preferred nutrition communication channels among adults in the Lower Mississippi Delta. Prev Chronic Dis.2009;6(4): A128.pmid:19755004
  23. 23. Pettersen, S., Kjøllesdal, J. G., & Aarnes, S. B. (2009a). Measuring nutrition literacy. Paper presented at the 19th International Conference of Nutrition, Bangkok, Thailand.
  24. 24. Velardo S. The Nuances of Health Literacy, Nutrition Literacy, and Food Literacy. J Nutr Educ Behav.2015;47(4): 385–389 e381. pmid:26026651
  25. 25. Ndahura NB. Nutrition literacy status of adolescent students in Kampala district, Uganda, PhD thesis. Oslo and Akershus University College of Applied Sciences,Lillestrøm, Norway.2012.
  26. 26. Diamond JJ. Development of a reliable and construct valid measure of nutritional literacy in adults. Nutr J.2007;6: 5. pmid:17300716
  27. 27. Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, et al. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med.2005;3(6): 514–522. pmid:16338915
  28. 28. Ghanbari S, Ramezankhani A, Montazeri A, Mehrabi Y. Health Literacy Measure for Adolescents (HELMA): Development and Psychometric Properties. PLoS One.2016;11(2): e0149202. pmid:26881933
  29. 29. Gibbs H, Chapman-Novakofski K. Establishing content validity for the Nutrition Literacy Assessment Instrument. Prev Chronic Dis.2013;10: E109. pmid:23823698
  30. 30. Reynolds JS, Treu JA, Njike V, Walker J, Smith E, Katz CS, et al. The validation of a food label literacy questionnaire for elementary school children. J Nutr Educ Behav.2012;44(3): 262–266. pmid:22406011
  31. 31. Lawshe CH. A quantitative approach to content validity. Personnel psychology.1975;28(4): 563–575.
  32. 32. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health.2007;30(4): 459–467. pmid:17654487
  33. 33. Courtney MGR, Gordon M. Determining the number of factors to retain in EFA: Using the SPSS R-Menu v2. 0 to make more judicious estimations. Practical Assessment, Research & Evaluation.2013;18(8): 1–14. Available online:http://pareonline.net/getvn.asp?v=18&n=8.
  34. 34. Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychological bulletin.1980;88(3): 588.
  35. 35. George D, Mallery P. SPSS for Windows step by step: A simple guide and reference. 4th edition.: Boston: Allyn & Bacon; 2003.
  36. 36. Svanholm H, Starklint H, Gundersen HJ, Fabricius J, Barlebo H, Olsen S. Reproducibility of histomorphologic diagnoses with special reference to the kappa statistic. APMIS.1989;97(8): 689–698. pmid:2669853.
  37. 37. Arbuckle JL. Amos (version 7.0)[computer program]. Chicago: SPSS.2006.
  38. 38. Block LG, Grier SA, Childers TL, Davis B, Ebert JE, Kumanyika S, et al. From nutrients to nurturance: A conceptual introduction to food well-being. Journal of Public Policy & Marketing.2011;30(1): 5–13.1547–7207.
  39. 39. Howard, A., & Brichta, J. What's to Eat? Improving Food Literacy in Canada.2013. http://www.conferenceboard.ca/temp/d95c5003-64f9-43b3-bb90-0844b849460a/14-091_whatstoeat_cfic_rpt.pdf.
  40. 40. Rawl R, Kolasa KM, Lee J, Whetstone LM. A learn and serve nutrition program: the Food Literacy Partners Program. J Nutr Educ Behav.2008;40(1): 49–51. pmid:18174105.
  41. 41. Kolasa K, Lackey C. The logic model as a framework for community program evaluations: the food literacy partners program. Fam Med.2006;38(10): 690–691. pmid:17075735.
  42. 42. National Academies of Sciences, Engineering, and Medicine. 2016. Food literacy: How do communications and marketing impact consumer knowledge, skills, and behavior?: Workshop summary. Washington, DC: The National Academies Press. https://doi.org/10.17226/21897 pmid:27252998
  43. 43. Cullen T, Hatch J, Martin W, Higgins JW, Sheppard R. Food Literacy: Definition and Framework for Action. Can J Diet Pract Res.2015;76(3): 140–145. pmid:26280794.
  44. 44. Thomas HM, Irwin JD. Cook It Up! A community-based cooking program for at-risk youth: overview of a food literacy intervention. BMC Res Notes.2011;4: 495. pmid:22085523
  45. 45. Begley A, Gallegos D. Should cooking be a dietetic competency? Nutrition & Dietetics.2010;67(1): 41–46.
  46. 46. Pendergast D, Garvis S, Kanasa H. Insight from the public on home economics and formal food literacy. Family and Consumer Sciences Research Journal.2011;39(4): 415–430.
  47. 47. Carbone ET, Zoellner JM. Nutrition and health literacy: a systematic review to inform nutrition research and practice. Journal of the Academy of Nutrition and Dietetics.2012;112(2): 254–265. pmid:22732460
  48. 48. Cardwell VB. Literacy: What Level for Food, Land, Natural Resources, and Environment? Journal of natural resources and life sciences education.2005;34: 112–117.
  49. 49. Elrick H, Samaras TT, Demas A. Missing links in the obesity epidemic. Nutrition Research.2002;22(10): 1101–1123.
  50. 50. Bellotti Bill. Food Literacy: Reconnecting the City with the Country [online]. Agricultural Science. 2010; 22 (3): 29–34. http://search.informit.com.au/documentSummary;dn=609839497923648;res=IELHSS.
  51. 51. Murimi MW. Healthy literacy, nutrition education, and food literacy. Journal of nutrition education and behavior.2013;45(3): 195. http://dx.doi.org/10.1016/j.jneb.2013.03.014.
  52. 52. Bublitz M, Peracchio LA, Andreasen A, Kees J, Kidwell B, Miller E, et al. The quest for eating right: Advancing food well-being. J of Res for Consum.2011;19: 1–13.
  53. 53. Desjardins, E. & Hailburton, K. (2013) Making something out of nothing: Food literacy among youth, young pregnant women and young parents who are at risk for poor health. Retrieved from the Ontario Society of Nutrition Professionals in Public Health. 2013. http://www.osnpph.on.ca/resources/Food%20Literacy%20Study.LDCPOntario.Final.Dec2013.pdf
  54. 54. Macdiarmid JI, Loe J, Douglas F, Ludbrook A, Comerford C, McNeill G. Developing a timeline for evaluating public health nutrition policy interventions. What are the outcomes and when should we expect to see them? Public health nutrition.2011;14(04): 729–739. pmid:20707947
  55. 55. Vanderkooy, P. Food skills of waterloo region adults. Region of Waterloo Public Health.2010. http://chd.region.waterloo.on.ca/en/researchResourcesPublications/resources/FoodSkills.pdf.
  56. 56. Escott-Stump SA. Our nutrition literacy challenge: making the 2010 dietary guidelines relevant for consumers. J Am Diet Assoc.2011;111(7): 979. pmid:21703372
  57. 57. Sadegholvad S, Yeatman H, Omidvar N, Parrish A, Worsley A. What do school-leavers need to know about nutrition and food systems? Views of prominent food-related experts in iran. Journal of Nutrition & Intermediary Metabolism.2014;1: 11–12.
  58. 58. Silk KJ, Sherry J, Winn B, Keesecker N, Horodynski MA, Sayir A. Increasing nutrition literacy: testing the effectiveness of print, web site, and game modalities. J Nutr Educ Behav.2008;40(1): 3–10. pmid:18174098
  59. 59. Slater J. Is cooking dead? The state of Home Economics Food and Nutrition education in a Canadian province. International Journal of Consumer Studies. 2013; 37(6), 617–624.
  60. 60. Fordyce-Voorham S. Identification of essential food skills for skill-based healthful eating programs in secondary schools. J Nutr Educ Behav.2011;43(2): 116–122. pmid:21036670.
  61. 61. Sumner J. Reading the world: Food literacy and the potential for food system transformation. Studies in the Education of Adults.2015;47(2): 128–141.
  62. 62. Davis LL. Instrument review: Getting the most from a panel of experts. Applied nursing research.1992;5(4): 194–197.
  63. 63. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in nursing & health.2007;30(4): 459–467. pmid:17654487.
  64. 64. Choi E-S, Shin N-R, Jung E-I, Park H-R, Lee H-M, Song K-H. A study on nutrition knowledge and dietary behavior of elementary school children in Seoul. Nutrition research and practice.2008;2(4): 308–316.http://doi.org/10.4162/nrp.2008.2.4.308. pmid:20016735
  65. 65. Hoddinott J, Karachiwalla NI, Ledlie NA, Roy S. Adolescent girls' infant and young child nutrition knowledge levels and sources differ among rural and urban samples in Bangladesh. Maternal & child nutrition.2016;12(4): 885–897.
  66. 66. Oldewage-Theron W, Egal A, Moroka T. Nutrition Knowledge and Dietary Intake of Adolescents in Cofimvaba, Eastern Cape, South Africa. Ecology of food and nutrition.2015;54(2): 138–156. pmid:25514183
  67. 67. Lin W, Yang H-C, Hang C-M, Pan W-H. Nutrition knowledge, attitude, and behavior of Taiwanese elementary school children. Asia Pacific journal of clinical nutrition.2007;16(S2): 534–546.https://www.ncbi.nlm.nih.gov/pubmed/17723993.
  68. 68. Whati LH. The development of a valid and reliable nutrition knowledge questionnaire and performance-rating scale for urban South African adolescents participating in the'Birth-to-Twenty'study: Stellenbosch: University of Stellenbosch.2005.
  69. 69. Wall CL, Gearry RB, Pearson J, Parnell W, Skidmore PM. Dietary intake in midlife and associations with standard of living, education and nutrition literacy. N Z Med J.2014;127(1397): 30–40. pmid:24997699.
  70. 70. Vidgen HA, Gallegos D. What is food literacy and does it influence what we eat: a study of Australian food experts. Queensland University of Technology, Brisbane, Queensland, Australia. http://eprints.qut.edu.au/45902/.2011.
  71. 71. Hu LT, Bentler PM, Kano Y. Can test statistics in covariance structure analysis be trusted? Psychol Bull.1992;112(2): 351–362. pmid:1454899.
  72. 72. Marsh HW, Balla JR, McDonald RP. Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological bulletin.1988;103(3): 391.
  73. 73. Sharma S, Mukherjee S, Kumar A, Dillon WR. A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure models. Journal of Business Research.2005;58(7): 935–943.
  74. 74. Pallant J. SPSS survival manual: a step by step guide to data analysis using SPSS for Windows.3th edition. Maidenhead: Open University Press. 2007.