Image-Based Dietary Assessment: A Healthy Eating Plate Estimation System (2403.01310v1)
Abstract: The nutritional quality of diets has significantly deteriorated over the past two to three decades, a decline often underestimated by the people. This deterioration, coupled with a hectic lifestyle, has contributed to escalating health concerns. Recognizing this issue, researchers at Harvard have advocated for a balanced nutritional plate model to promote health. Inspired by this research, our paper introduces an innovative Image-Based Dietary Assessment system aimed at evaluating the healthiness of meals through image analysis. Our system employs advanced image segmentation and classification techniques to analyze food items on a plate, assess their proportions, and calculate meal adherence to Harvard's healthy eating recommendations. This approach leverages machine learning and nutritional science to empower individuals with actionable insights for healthier eating choices. Our four-step framework involves segmenting the image, classifying the items, conducting a nutritional assessment based on the Harvard Healthy Eating Plate research, and offering tailored recommendations. The prototype system has shown promising results in promoting healthier eating habits by providing an accessible, evidence-based tool for dietary assessment.
- CDC. About NHANES;. https://www.cdc.gov/nchs/nhanes/about_nhanes.htm/.
- The impact of doubling dairy or plant-based foods on consumption of nutrients of concern and proper bone health for adolescent females. Public Health Nutr. 2017;20(5):824-31.
- Ultra-processed diets cause excess calorie intake and weight gain: An inpatient randomized controlled trial of ad libitum food intake. Cell Metabolism. 2019;30(1):67-77.
- Is the degree of food processing and convenience linked with the nutritional quality of foods purchased by US households? American Journal of Clinical Nutrition. 2017;101(6):1251-62.
- The quality and monetary value of diets consumed by adults in the United States. American Journal of Clinical Nutrition. 2016;103(1):132-40.
- Harvard T H Chan School of Public Health. Healthy Eating Plate;. https://www.hsph.harvard.edu/nutritionsource/healthy-eating-plate/.
- Health benefits of reducing sugar-sweetened beverage intake in high-risk populations of California: Results from the cardiovascular disease (CVD) policy model. PloS One. 2018;13(4):e0196053.
- Dietary fats and cardiovascular disease: A presidential advisory from the American Heart Association. Circulation. 2019;136(3):e1-e23.
- Popkin B. The Challenge in Improving the Diets of Supplemental Nutrition Assistance Program Recipients: A Historical Commentary. Am J Prev Med. 2017;52(2S2):S106-14. Erratum in: Am J Prev Med. 2017 Apr;52(4):554.
- Food Recommendation System Using Clustering Analysis for Diabetic Patients. In: 2010 International Conference on Information Science and Applications. Seoul, Korea (South); 2010. p. 1-8.
- Pham VH, Lee BR. An image segmentation approach for fruit defect detection using k-means clustering and graph-based algorithm. Vietnam J Comput Sci. 2015;2:25–33.
- Automatic image segmentation using sobel operator and k-means clustering: A case study in volume measurement system for food products. In: 2015 International Conference on Science in Information Technology (ICSITech). Yogyakarta, Indonesia; 2015. p. 13-8.
- Shimoda W, Yanai K. Weakly-Supervised Plate And Food Region Segmentation. In: 2020 IEEE International Conference on Multimedia and Expo (ICME). London, UK; 2020. p. 1-6.
- Kawano Y, Yanai K. Real-Time Mobile Food Recognition System. In: 2013 IEEE Conference On Computer Vision And Pattern Recognition Workshops; 2013. p. 1-7.
- Harvard T H Chan School of Public Health. Vegetables and Fruits;. https://www.hsph.harvard.edu/nutritionsource/what-should-you-eat/vegetables-and-fruits/.
- Harvard T H Chan School of Public Health. Protein;. https://www.hsph.harvard.edu/nutritionsource/what-should-you-eat/protein/.
- Harvard T H Chan School of Public Health. Cardiovascular Disease;. https://www.hsph.harvard.edu/nutritionsource/disease-prevention/cardiovascular-disease/.
- Harvard T H Chan School of Public Health. Whole Grains;. https://www.hsph.harvard.edu/nutritionsource/what-should-you-eat/whole-grains/.
- Harvard T H Chan School of Public Health. Fats and Cholesterol;. https://www.hsph.harvard.edu/nutritionsource/what-should-you-eat/fats-and-cholesterol/.
- Spyne - Plate & Bowl Computer Vision Project. Plate & Bowl Computer Vision Project; 2021. Accessed: February 18, 2024. https://universe.roboflow.com/spyne-odwyj/plate---bowl.
- Segmentation and recognition of multi-food meal images for carbohydrate counting. In: 13th IEEE International Conference on BioInformatics and BioEngineering. Chania, Greece; 2013. p. 1-4.
- Ho SY, Lee KZ. Design and Analysis of an Efficient Evolutionary Image Segmentation Algorithm. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology. 2003;35:29–42.
- Bandyopadhyay H. An Introduction to Image Segmentation: Deep Learning vs. Traditional [+Examples]. V7Labs. 2022.
- Ballard DH, Brown CM. Computer Vision; 1982.
- C BP. Learn K-Means Clustering by Quantizing Color Images in Python;. https://hackernoon.com/learn-k-means-clustering-by-quantizing-color-images-in-python.
- Lihi Gur Arie P. Color Segmentation with K-means Clustering;. https://towardsdatascience.com/image-color-segmentation-by-k-means-clustering-algorithm-5792e563f26e.
- Classification between Apple and Oranges-Machine Learning example with Images for beginners;. https://pythonscript.medium.com/classification-between-apple-and-oranges-machine-learning-example-with-images-for-beginners-487b3173f50.
- OpenCV: Open Source Computer Vision Library; 2022. https://docs.opencv.org/4.x/index.html.
- Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research. 2011;12:2825-30.