The Development and Validation of Food Atlas for Portion Size Estimation in the Balkan Region

Assessment of portion sizes is an important factor for the accuracy of food consumption surveys. The objective of this study was to develop and validate a food atlas of commonly consumed foods in the Balkan region in order to improve the accuracy of portion size estimation for food consumption surveys. A list of 135 foods and their portion sizes was based on previously conducted food consumption surveys in this region. Food was cooked, measured and served in three or four portion sizes right before being photographed. A validation study was conducted through the visual perception method. Without receiving training on usage of the food picture book, participants were asked to evaluate two portion sizes of 20 selected foods by comparison with a photo series of each food. Portion sizes were evaluated by 18 nutrition professionals and 17 lay individuals who had no nutritional education. Mean differences and the standard deviations of the mean differences (SD) between the portions estimated by each participant and the served portion were calculated. The percentages of participants who selected the correct, adjacent or distant portion size also were calculated. The number of food items that were quantified within the predefined acceptable range (i.e., mean difference < ∣ 0·7 ∣ and SD < 1) was 16 (80%) among lay individuals and 17 (85%) among nutritional professionals. Among 16 photo series that were assessed as “acceptable,” the percentage of all participants, who selected the correct picture, was between 44.3 and 82.9%, with an average of 60.2%. Only three foods were assessed correctly by <50% participants. The percentage of participants who selected the correct or adjacent serving size was above 98% for both lay and professional evaluators. This is the first food atlas containing representative foods and recipes commonly consumed in the Balkan region. However, further adjustments of the methodology should include larger number of food items to be tested, involvement of more participants and provision of training for the users of the food atlas. This food atlas could be used in food consumption surveys in the Balkan region after further testing and validation.

Introduction

The development of much needed research infrastructure for nutrition in the Balkan region requires designing research tools that are standardized and validated to ensure comparable results in an international context (1). In the past decade, different elements of research infrastructure were developed: a food composition database (2), dietary software for data collection and nutrient calculation (3), and nutritional planning and dietary assessment software with incorporated nutritional recommendations (4). All of these are prerequisite for conducting food consumption surveys and other nutritional research.

However, one of the biggest challenges in food consumption data collection is estimation of the amount of consumed foods. The most accurate method for measuring food intake is weighing foods before and after consumption, known as “weighed food intake method.” This method has many disadvantages: it is costly, time-consuming, can influence consumption, and cause participant fatigue. Its application becomes increasingly difficult in epidemiological studies, e.g., in circumstances where scales might not be available. Thus, other methods have been designed to help individuals estimate the amount of food consumed. For accurately completing food frequency questionnaires or other types of food consumption surveys, pictorial food portion guides that represent different portion sizes have been developed (5). Portion guides have been shown to be a valid method to help respondents estimate the amount of consumed foods (6, 7). These improve the accuracy of measurements, particularly in large scale studies in the general population (5, 8). A food atlas, a pictorial guide of foods with different food portion sizes, contains photos of the foods that are representative of the national/regional diet of the population, with the ranges of portion sizes usually consumed.

The objective of this study is to present the process of development and validation of a food atlas containing photos of typical foods and most consumed dishes in the Balkan region. The food atlas was tested and validated for its accuracy among nutritional professionals and lay individuals. The atlas is integrated in the regional food composition database (2) and dietary assessment tool - Diet Assess and Plan (DAP) (9), and also printed in hardcopy versions for fieldwork for future dietary surveys.

Methodology

Subjects and Study Design

In order to define a format for the food atlas for the Balkan region numerous food atlases from other countries/regions and scientific publications on their development and validation were reviewed (10–19). The development of the food atlas included three steps: selection of foods and recipes, determination of portion sizes, and photographing, followed by coding of photos and codebook creation. After food atlas development, a validation study was performed using the perception method as previously described (20). The ability of study participants to assess food portion sizes was tested by choosing correct food portion size from a photo series after exposure to real food portions (8, 15, 20). This survey was approved by the ethical committee of the Institute for Medical Research, University of Belgrade (No. EO123/2017).

Selection of Foods and Recipes

Based on previously conducted food consumption surveys in the Balkan region the most consumed foods and recipes were selected for the food atlas (21–24). Furthermore, to address local dietary patterns and improve cultural competency of the atlas, additional dishes from traditional cookbooks, and restaurant menus were included. A final list of 125 items was reviewed and approved by a panel of five experts in nutrition and dietary intake assessment. The panel consisted of two senior researchers in the field of nutrition and three post-doc researchers, experts in food consumption surveys. The choice of food items within food groups corresponds to common dishes or food types in the Balkan dietary pattern. The food atlas might be use for the assessment of other food items and dishes not included in the food atlas but of similar appearance/shape and texture or composition like ones presented in the photos. A list of selected food items for children was created based on previous surveys and a food list provided by the EU Menu protocol for development of food atlases for children (25). Dishes consumed in a home environment are usually served using different ladle or other utensil sizes, while beverages are often consumed directly from the original packaging such as cans, bottles or paperboards. Thus, 5 utensils, 6 different types of liquid packaging, and baby bottles are represented. The draft version of the food atlas was used in a pilot food consumption survey in Serbia, Montenegro, and Bosnia and Herzegovina for the assessment of food portion sizes reported in 24 h recalls among adults and food diaries among children. After the pilot study, field workers highlighted 10 food items that were consumed by participants, but were not present in the food atlas and could not be assessed by any other available photo. Therefore, additional photos with different portions for the selected 10 food items were added to the food atlas. The final version of the food atlas contains 135 foods, 5 utensils, and 6 liquid packaging types. The structure of the final version, based on food group classification, is presented in Table 1.

TABLE 1

Table 1. Number of selected food items and recipes present in the food picture book according to food group.

Selection of Portion Sizes

Medium portion sizes for all selected foods and recipes were defined based on the average portion from previous food consumption surveys in the Balkan region (22–24). A coefficient equal to 1 was assigned to the medium portion size, while the small portion was calculated by multiplying the medium portion size by 0.5. The large portion size was calculated by multiplying the medium one by 1.5, while the extra-large was calculated by multiplying the large portion by 1.5. Portion sizes for children were adopted from the EU Menu protocol for the development of food atlases for children (25). Photo series of selected food items and recipes consist of three or four photos per series, depicting a range of portion sizes in increasing order as shown in Figure 1. This way of presenting a photo series was suggested by the EU Menu methodology proposed by EFSA as the most commonly used (25). A few standardized bakery products (e.g., doughnuts and bread rolls) and barbeque meals (e.g., ćevapčići and standard traditional sausage) are presented as a single photo. Food items that could be served in diverse ways were presented in more than 4 photos like sliced or diced cucumber, whole or sliced tomato, etc. A unique numerical identification code was assigned to each food item. Photographs within series were labeled with uppercase letters and arranged alphabetically to assign a gradual increase in portion size. In order to avoid response bias and misreporting, actual weights of portions were not indicated in conjunction with photographs, but at the end in a separate codebook.

FIGURE 1

Figure 1. Photo series of carrot soup (left) and scrambled eggs (right).

Food Preparation, Presentation, and Photographing

Food items and recipes were prepared and served by a professional cook who was provided with detailed guidance on how to prepare, measure, and serve food for photographing. Prepared food was measured on a digital kitchen scale Beurer KS 19 with a precision of 1 g and a maximum capacity of 5 kg, calibrated for the serving plate weight. Food items were served on a white table cloth and on a white standard shallow or deep plate (diameter = 24 cm) or small shallow plate (diameter = 20 cm) or small white bowl (diameter = 18 cm). For the assessment of beverages several types of glassware are presented. Four types of different glassware for water and other non-alcoholic beverages are shown to depict different volumes in different glass shapes (150, 250 ml-two different shapes, 330 ml). Wine and shot glasses are captured with three different levels of liquid amounts to help in the assessment of alcoholic beverage consumption. Cutlery was always placed adjacent to the plate for easier perception of plate size. All selected food items were captured by a professional photographer under standard lighting conditions using a digital camera Nikon D80. All the photos were taken in identical conditions: angle of 45 degrees and the distance of 55 cm above the plate with a white background and aperture between 11–16 and focal length of 100 mm. The camera was always mounted on a tripod above the plate at eye level of a seated person of average height.

Validation Study

A validation study was conducted through the visual perception of food portions by comparison with a photo series of shown food (8, 15, 20, 26, 27). The aim of this survey was to validate the food atlas for the usage by nutrition professionals (28) and people without any nutritional background (lay individuals) (20). The rationale was to test its relevance, accuracy and applicability to both groups of users, i.e., those who are more trained to estimate portions sizes and those who are less trained but represent prospective respondents. Therefore, the study sample involved two groups of volunteers: 18 professionals with documented educational background/expertise in nutrition (average age: 46.4 ± 9.3 years) and 17 subjects without any formal training or professional experience in the field (average age: 36.4 ± 7.2 years). Verbal informed consent was obtained from all participants. Females were overrepresented as they expressed more interest in the survey. Eight out of 35 participants were mothers of children younger than 10 years. The validation session took place in the hotel meeting room during the Capacity Development in Nutrition Network—CAPNUTRA Symposium, Capacity development in dietary intake survey - harmonization with EU MENU methodology regional training for DIET ASSESS & PLAN (DAP) application and implementation in the Balkan region (www.capnutra.org). The training involved 35 participants from five countries, including Bosnia and Herzegovina, Montenegro, Former Yugoslav Republic of Macedonia (FYROM), Italy and Serbia. Food was prepared, measured on a digital kitchen scale and served by the hotel's staff guided by nutrition professionals from the CAPNUTRA team.

The study was designed to have 20 photo series evaluated through 40 food portions (two different randomly selected portions of each food item). In this way 50% of portion sizes were evaluated as suggested by the EU Menu protocol for the validation of food atlases (20). A list of evaluated food items is presented in Table 2. Food items were placed on the table so that two different portions of the same food item were not next to nor close to each other. Corresponding coded photo series of three or four photos representing different portion sizes in increasing order, just as in the food atlas, were placed above each plate. Printed evaluation forms, with the list of foods in the order of serving, were provided to all participants 2 h before the session, with both written and oral instructions on how to fill them. In addition, participants received a clear verbal explanation on how to approach the evaluation and assess the sizes of served portions. However, the participants did not receive training on the assessment of portion sizes using the food atlas, as we wanted to get comprehensive feedback on the applicability and accuracy of the tool. Members of the CAPNUTRA team were answering all of the participants' questions related to the evaluation to clarify any ambiguities. Communication between participants was not allowed during the session. All participants evaluated both served portion sizes of each food and wrote the selected code from the photo series next to the name of the food in the evaluation form. In this way each food (photo series) was evaluated 70 times. The utensils and packaging were not tested within the validation study, as their volumes are standardized.

TABLE 2

Table 2. List of evaluated foods and recipes with mean and standard deviation (SD) of the difference between the estimated portion number minus the actual portion number; Spearman's coefficients of correlation (r) between the estimated portion number and the actual portion number.

Statistical Analysis

All pictures were numbered from 1, for the smallest portion, to 4, for the largest portion. Mean difference and standard deviations were calculated between the portion number estimated by participant and served portion number, for data obtained from nutrition professionals, lay individuals and all participants together reflecting the total sample. The limit of bias of the mean difference is ~0.7 calculated as 99.999% CI of the estimation error using normal distribution. Standard deviation of the mean difference <1 was used since a random error of choosing adjacent photo (±1) was considered as acceptable. Choosing the adjacent photo could not lead to significant over- or under- reporting of energy intake since this misreporting account for <10% of the average daily energy intake for the most energy—dense food items such as pasta. Moreover, it is expected that under—and overestimated portion sizes, by choosing adjacent photo, of different foods would attenuate the error. The high percentage of CI was chosen because it gives a wider range of acceptance for variables where the mean value is not significantly different from 0 (15). Spearman correlation coefficients between the chosen and correct number of the photo were calculated for both groups separately and for the total sample. Percentage of participant choosing the correct, adjacent (±1) or distant (>1, <-1) number of photo was calculated and chi square test was applied to check for differences in assessment between nutrition professionals and lay public group. Results are considered significant at p < 0.05. All analyses were performed using the IBM SPSS software package 20.0.

Results

Means and standard deviations of the differences between the estimated picture number minus the correct portion size number and Spearman correlation coefficients between the estimated picture number and the actual portion number are summarized in Table 2. The number of food items that were quantified within the predefined acceptable range (i.e., mean difference < ∣ 0·7 ∣ and SD < 1) was 16 (80%) among lay individuals and 17(85%) among nutritional professionals. On the other hand, nutrition professionals quantified 29 (72.5%) portions within the acceptable range, while lay individuals correctly assessed 26 portions (65%). However, chi-square test has shown that there were no statistically significant differences between nutrition professionals and lay individuals regarding the number of foods, quantified within the acceptable range, (p = 0.576). Spearman correlation coefficients between the estimated picture number and the correct picture number were between 0.5 and 0.95 and significant at 0.01 level among both groups and on the total sample with exception of cream for the lay public group (r = 0.37, p = 0.031) and apple among nutrition professionals (r = 0.42, p = 0.01). Sixteen out of twenty selected photo series performed well, while four food items were assessed correctly by < 35% participants and with mean difference > ∣ 0.7 ∣. In general, the assessment of small and medium portions was better (64.9 and 45.9% correct answers, respectively), than assessment of large and extra-large portion (41–43.8% correct answer). Participants were more likely to overestimate small and medium portion and underestimate large and extra-large portion sizes as presented in Table 3. The percentages of participants choosing the correct, adjacent or distant number of a picture when comparing shown food items with photo series are presented in Table 4. Among 16 photo series that were assessed as “acceptable,” the food items that were correctly assessed by the lowest percentage of participants are: grape (44.3%) among the total sample, raw banana (38.9%) among nutrition professionals, and mashed banana (32.4%) among lay public. The food items that were correctly assessed by majority of participants are: baked beans among the total sample and lay public (82.9 and 82.4%, respectively) and walnuts (88.9%) among nutrition professionals. The percentage of participants who selected correct or adjacent number of photo series was above 98% for both groups and for the total sample. Distant photo in the series was chosen by 1.4–8.6% participants on total sample. Mashed banana, ground biscuit and walnuts were better assessed by nutrition professionals than by the lay public group (p < 0.001, p = 0.019, p = 0.03, respectively), while there were no significant differences among other food items. Four picture series that didn't performed well were cake, grated fresh cabbage, lettuce and grated carrot (shaded in gray in Tables 2, 4). These food items were assessed correctly by only 2.9–34.3% of participants from the total sample, while the mean difference indicated an overestimation for cake and lettuce with mean difference of 0.71 and 1.19 respectively and underestimation of grated cabbage (−1.11) and grated carrot (−1.29). Distant picture was chosen by 5.7% of participants for cake, 15.7% for grated cabbage, 21.4% for lettuce, and 40% for grated carrot.

TABLE 3

Table 3. Proportion of correct responses and direction of errors for the estimation of portion sizes in the total sample.

TABLE 4

Table 4. Percentages of participants choosing the correct, adjacent, or distant picture when comparing shown food items with the photo series.

Discussion

We conducted this study to develop and evaluate the first food atlas in the Balkan region, based on previous knowledge of the dietary habits and commonly consumed food among adults in this region. In the evaluation process, we applied the prospective method, which was previously used in similar studies. The results of our study are in accordance with the evaluation of food atlases for children in three European countries, where using similar methodologies, 50% of parents selected the correct photo in the food atlas (15). In addition, a study of Finnish adults showed that between 43 and 65% of participants chose the correct photo (27) while in our study the correct photo was chosen by 60.3% participants in average (44.3–82.9%). However, the correct or adjacent photo was chosen by more than 98% of participants in our study while in Greek adults more than 90% of participants chose the correct or adjacent photo (8), with even lower percentage found among Belgium adolescents (71%) (26).

Two studies reported a Spearman correlation coefficient of 0.5–0.9 between the number of shown and chosen photo (15, 26) which is in accordance with our results. In our study, challenges are recognized with some specific food items such as cake. Trolle et al. found that it is crucial for the shape of the cake to be as similar as possible as on the shown photo, which is not always possible due to the many existing types of cakes (15). How the cake is served was also recognized as an important factor e.g., whether the piece of cake was placed vertically on the plate or laid down. Lettuce and mixed salads were found challenging by Trolle et al. too, as a shapeless food (like grated cabbage and carrots in our study) due to difficult presentation in exactly the same way as on the photos (15). Similar issues were recognized in a recent study by Subar et al. (29).

However, the methodology of the present study could be improved by several aspects. Error in perception due an inadequate photo would have a much larger impact on energy and macronutrient intake estimation when high caloric foods are misrepresented and inadequately assessed than with foods such as lettuce, cabbage, or carrots. For instance, choosing a distant photo for cake would lead to the under or overestimation of energy intake of ~250 kcal, while making the same error with lettuce would result in 11 kcal. Thus, the methodology could be improved by providing more photos of these particular foods in different shapes and forms. In addition, the whole experience in this study has shown us that training for users on how to appropriately employ the food atlas in contact with correspondents, during the food consumption surveys, would certainly increase the accuracy of their assessments. Particularly, the training could prepare users to assist respondents in finding appropriate alternatives when some food they ate is missing in the food atlas and help them recall the food portion size without influencing the estimation.

The strength of this study is that this is the first food atlas to be developed in the Balkan region containing the most consumed food items and dishes and validated according to approved methodology. These photos are integrated and connected to appropriate foods data in the regional FCDB (2), which allows faster data collection and further processing in DAP software (9). Furthermore, hardcopy version of the Food Atlas has been used as a portion size estimation aid in food consumption survey based on EU Methodology in the Balkan region (Serbia, Bosnia and Herzegovina, Montenegro, and Macedonia- with translation to Macedonian).

The limitation of this study is related to the limited number of food portions tested and relatively small number of assessors, in both groups. In future studies larger number of food items and assessors should be engaged for the validation of the tool. Particularly, the number of male participants is critically small in both groups, which might question the adequacy of future estimations in this population group. Statistical analysis has shown that there were more participants who tended to underestimate large and extra-large portions than those who tended to overestimate small and medium portion. Thus, usage of this tool could lead to the underreporting of energy and nutrient intake. Analysis in the future should include the effects of factors such as gender and weight status on the assessment outcome.

Conclusion

The accuracy of portion size estimates is essential in the assessment of food consumption. In order to provide information of the portion sizes of commonly consumed food items and traditional dishes, a food atlas was developed with food portions presented in photos. This is the first food atlas of the most representative diet in the Balkan region. Food items, challenging for assessment, were recognized in the applied validation process. However, further adjustments of the methodology should include larger number of food items to be tested, involvement of more participants (both, professionals and lay individuals) and provision of training for the users of the food atlas. This food atlas could be used in food consumption surveys in the Balkan region after further testing and validation.

Author Contributions

MaG, MiG, and MN were responsible for the formulation of the research question and designing the study. MN, JM, and MZ were responsible for caring it out. MN was responsible for the data analysis. MN and JM drafted the manuscript. JM, MZ, MiG, and MaG edited the working versions of the manuscript and provided advice regarding interpretation. MN had primary responsibility for the final content. All authors read and approved the final manuscript.

Funding

This research did not receive any specific grant from any funding agency in the public or commercial sector. It was supported by the non-profit organization Capacity Development Network in Nutrition in Central and Eastern Europe (CAPNUTRA).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors would like to thank to Z. Nikolic for professional photographing, MN and N. Strbac for the preparation of foods, M. Djekic-Ivankovic and Natalija Glibetic for the professional editing of English and A. Kadvan for the implementation of food atlas in the food composition database and Diet Assess and Web platform. Thanks also go to all volunteers who participated in the validation study.

References

1. Gurinović M, Milešević J, Novaković R, Kadvan A, Djekić-Ivanković M, Šatalić Z, et al. Improving nutrition surveillance and public health research in Central and Eastern Europe/Balkan Countries using the Balkan Food Platform and dietary tools. Food Chem. (2016) 193:173–80. doi: 10.1016/j.foodchem.2015.03.103

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Gurinović M, Milešević J, Kadvan A, Dekić-Ivanković M, Debeljak-Martačić J, et al. Establishment and advances in the online Serbian food and recipe data base harmonized with EuroFIR standards. Food Chem. (2016) 193:30–8. doi: 10.1016/j.foodchem.2015.01.107

CrossRef Full Text | Google Scholar

3. Gurinović M, Milešević J, Kadvan A, Nikolić M, Zeković M, Djekić-Ivanković M, et al. Development, features and application of DIET ASSESS &amp; PLAN (DAP) software in supporting public health nutrition research in Central Eastern European Countries (CEEC). Food Chem. (2018) 238:186–94. doi: 10.1016/J.FOODCHEM.2016.09.114

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Gurinović M, Kadvan A, Bucchini L, Matthys C, Torres D, Novaković R, et al. EURRECA nutritional planning and dietary assessment software tool: NutPlan. Eur J Clin Nutr. (2010) 64(Suppl. 2):S38–42. doi: 10.1038/ejcn.2010.59

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Turconi G, Guarcello M, Berzolari FG, Carolei A, Bazzano R, Roggi C. An evaluation of a colour food photography atlas as a tool for quantifying food portion size in epidemiological dietary surveys. Eur J Clin Nutr. (2005) 59:923–31. doi: 10.1038/sj.ejcn.1602162

PubMed Abstract | CrossRef Full Text | Google Scholar

6. EFSA. Use of the EFSA comprehensive european food consumption database in exposure assessment. Eur Food Saf Auth J. (2011) 9:2097. doi: 10.2903/j.efsa.2011.2097.

CrossRef Full Text

7. Gavrieli A, Naska A, Konstantinidi C, Berry R, Roe M, Harvey L, et al. Dietary Monitoring Tools for Risk Assessment. EFSA Supporting Publications (2014). Available online at: http://www.efsa.europa.eu/en/supporting/pub/607e

8. Naska A, Valanou E, Peppa E, Katsoulis M, Barbouni A, Trichopoulou A. Evaluation of a digital food photography atlas used as portion size measurement aid in dietary surveys in Greece. Public Health Nutr. (2016) 19:2369–76. doi: 10.1017/S1368980016000227

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Gurinović M, Milešević J, Kadvan A, Nikolić M, Zeković M, Djekić-Ivanković M, et al. Development, features and application of DIET ASSESS & PLAN (DAP) software in supporting public health nutrition research in Central Eastern European Countries (CEEC). Food Chem. (2018) 238:186–94. doi: 10.1016/j.foodchem.2016.09.114

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Abu Dhabi Food Control Authority. A Photographic Atlas of Food Portions for the Emirate of Abu Dhabi. Abu Dhabi Food Control Authority (2014).

11. Mohamed H, Marzooqi A, Burke SJ, Rasheed M, Ghazali A, Duffy E, et al. The development of a food atlas of portion sizes for the United Arab Emirates. J Food Composit Analy. (2015) 43:140–8. doi: 10.1016/j.jfca.2015.05.008

CrossRef Full Text | Google Scholar

12. Instituto Nazionale di Ricerca per gli Alimenti e la Nutrizione I. Atlante Alimentare (2010). Available online at: www.inran.it

13. Jayawardena R, Herath MP. Development of a food atlas for Sri Lankan adults. BMC Nutr. (2017) 3:43. doi: 10.1186/s40795-017-0160-4

CrossRef Full Text | Google Scholar

14. Bouchoucha M, Akrout M, Bellali H, Bouchoucha R, Tarhouni F, Ben Mansour A, et al. Development and validation of a food photography manual, as a tool for estimation of food portion size in epidemiological dietary surveys in Tunisia. Libyan J Med. (2016) 11:32676. doi: 10.3402/ljm.v11.32676

CrossRef Full Text | Google Scholar

15. Trolle E, Vandevijvere S, Ruprich J, Ege M, Dofková M, De Boer E, et al. Validation of a food quantification picture book targeting children of 0-10 years of age for pan-European and national dietary surveys. Br J Nutr. (2013) 110:2298–308. doi: 10.1017/S0007114513001694

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Nelson M, Haraldsdóttir J. Food photographs: practical guidelines I. Design and analysis of studies to validate portion size estimates. Public Health Nutr. (1998) 1:219–30.

PubMed Abstract | Google Scholar

17. Vilela S, Lopes C, Guiomar S, Severo M, Rangelova L, Petrova S, et al. Validation of a picture book to be used in a pan-European dietary survey. Public Health Nutr. (2018) 21:1–10. doi: 10.1017/S1368980017004153

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Amougou N, Cohen E, Mbala ML, Grosdidier B, Bernard JY, Saïd-Mohamed R, et al. Development and validation of two food portion photograph books to assess dietary intake among adults and children in Central Africa. Br J Nutr. (2016) 115:895–902. doi: 10.1017/S0007114515005401

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Lazarte CE, Encinas ME, Alegre C, Granfeldt Y. Validation of digital photographs, as a tool in 24-h recall, for the improvement of dietary assessment among rural populations in developing countries. Nutr J. (2012) 11:61. doi: 10.1186/1475-2891-11-61

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Menu EU, Appendix G. Example of a Protocol for Validation of a Food Picture Book Based on the PILOT-PANEU Project 1 (2013). p. 1–16.

21. Gurinović M, Kadvan A, Vukotić M. The quality of nutrition in schoolchildren and adult members of families. In: Nedeljkovic S, editor. Monograph: Yugoslav Study of Atherosclerosis Precursors in Schoolchildren in Serbia: Twenty Years Follow-Up. Belgrade: Medical Faculty University of Belgrade (2011) 343–68.

22. Knez M, Nikolic M, Zekovic M, Stangoulis JCR, Gurinovic M, Glibetic M. The influence of food consumption and socio-economic factors on Zn and Fe intake and status in Serbia. Public Heal Nutr. (2017) 20:2486–98. doi: 10.1017/S1368980017001240

CrossRef Full Text | Google Scholar

23. Zekovic M, Djekic-Ivankovic M, Nikolic M, Gurinovic M, Krajnovic D, Glibetic M. Validity of the food frequency questionnaire assessing the folate intake in women of reproductive age living in a country without food fortification: application of the method of triads. Nutrients (2017) 9:E128. doi: 10.3390/nu9020128

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Djekic-Ivankovic M, Weiler HA, Nikolic M, Kadvan A, Gurinovic M, Mandic LM, et al. Validity of an FFQ assessing the vitamin D intake of young Serbian women living in a region without food fortification: the method of triads model. Public Health Nutr. (2015) 19:437–45. doi: 10.1017/S136898001500138X

PubMed Abstract | CrossRef Full Text | Google Scholar

25. European Food Safety Authority (EFSA). Example of a Protocol for Production of a Picture Book for Children Based on the PANCAKE Project. Available online at: http://www.efsa.europa.eu/sites/default/files/efsa_rep/blobserver_assets/3944A-6-3-1.pdf (Accessed May 7, 2018).

26. Vereecken C, Dohogne S, Covents M, Maes L. How accurate are adolescents in portion-size estimation using the computer tool Young Adolescents' Nutrition Assessment on Computer (YANA-C)? Br J Nutr. (2010) 103:1844–50. doi: 10.1017/S0007114510000127

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Ovaskainen ML, Paturi M, Reinivuo H, Hannila ML, Sinkko H, Lehtisalo J, et al. Accuracy in the estimation of food servings against the portions in food photographs. Eur J Clin Nutr. (2008) 62:674–81. doi: 10.1038/sj.ejcn.1602758

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Olafsdottir AS, Hörnell A, Hedelin M, Waling M, Gunnarsdottir I, Olsson C. Development and validation of a photographic method to use for dietary assessment in school settings. PLoS ONE (2016) 11:e0163970. doi: 10.1371/journal.pone.0163970

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Subar AF, Crafts J, Zimmerman TP, Wilson M, Mittl B, Islam NG, et al. Assessment of the accuracy of portion size reports using computer-based food photographs aids in the development of an automated self-administered 24-hour recall. J Am Diet Assoc. (2010) 110:55–64. doi: 10.1016/j.jada.2009.10.007

PubMed Abstract | CrossRef Full Text | Google Scholar