Skip to main content

ORIGINAL RESEARCH article

Front. Nutr.
Sec. Nutrition Methodology
Volume 11 - 2024 | doi: 10.3389/fnut.2024.1520674
This article is part of the Research Topic Revolutionizing Personalized Nutrition: AI's Role in Chronic Disease Management and Health Improvement View all 5 articles

The potential of short-wave infrared hyperspectral imaging and deep learning for dietary assessment: a prototype on predicting closed sandwiches fillings

Provisionally accepted
  • Wageningen Food & Biobased Research, Wageningen University and Research, Wageningen, Netherlands

The final, formatted version of the article will be published soon.

    Accurate measurement of dietary intake without interfering in natural eating habits is a longstanding problem in nutritional epidemiology. We explored the applicability of hyperspectral imaging and machine learning for dietary assessment of home-prepared meals, by building a proof-of-concept, which automatically detects food ingredients inside closed sandwiches. Individual spectra were selected from 24 hyperspectral images of assembled closed sandwiches, measured in a spectral range of 1116.14nm to 1670.62nm over 108 bands, preprocessed with Standard Normal Variate filtering, derivatives, and subsampling, and fed into multiple algorithms, amount which PLS-DA, multiple classifiers, and a simple neural network. The resulting best performing models had an accuracy score of ~80% for predicting type of bread, ~60% for butter, and ~28% for filling type. We see that the main struggle in predicting the fillings lies with the spreadable fillings, meaning the model may be focusing on structural aspects and not nutritional composition. Further analysis on non-homogeneous mixed food items, using computer vision techniques, will contribute towards a generalizable system. While there are still significant technical challenges to overcome before such a system can be routinely implemented in studies of free-living subjects, we believe it holds promise as a future tool for nutrition research and population intake monitoring.

    Keywords: hyperspectral imaging, image classification, machine learning, dietary assessment, chemometrics

    Received: 31 Oct 2024; Accepted: 13 Dec 2024.

    Copyright: © 2024 Kok, Chauhan, Tufano, Feskens and Camps. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Esther Kok, Wageningen Food & Biobased Research, Wageningen University and Research, Wageningen, Netherlands

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.