Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Eating Speed Measurement Using Wrist-Worn IMU Sensors Towards Free-Living Environments (2401.05376v2)

Published 15 Dec 2023 in eess.SP and cs.HC

Abstract: Eating speed is an important indicator that has been widely investigated in nutritional studies. The relationship between eating speed and several intake-related problems such as obesity, diabetes, and oral health has received increased attention from researchers. However, existing studies mainly use self-reported questionnaires to obtain participants' eating speed, where they choose options from slow, medium, and fast. Such a non-quantitative method is highly subjective and coarse at the individual level. This study integrates two classical tasks in automated food intake monitoring domain: bite detection and eating episode detection, to advance eating speed measurement in near-free-living environments automatically and objectively. Specifically, a temporal convolutional network combined with a multi-head attention module (TCN-MHA) is developed to detect bites (including eating and drinking gestures) from IMU data. The predicted bite sequences are then clustered into eating episodes. Eating speed is calculated by using the time taken to finish the eating episode to divide the number of bites. To validate the proposed approach on eating speed measurement, a 7-fold cross validation is applied to the self-collected fine-annotated full-day-I (FD-I) dataset, and a holdout experiment is conducted on the full-day-II (FD-II) dataset. The two datasets are collected from 61 participants with a total duration of 513 h, which are publicly available. Experimental results show that the proposed approach achieves a mean absolute percentage error (MAPE) of 0.110 and 0.146 in the FD-I and FD-II datasets, respectively, showcasing the feasibility of automated eating speed measurement in near-free-living environments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. S. Sasaki, A. Katagiri, T. Tsuji, T. Shimoda, and K. Amano, “Self-reported rate of eating correlates with body mass index in 18-y-old Japanese women,” Int. J. Obes., vol. 27, no. 11, pp. 1405–1410, 2003.
  2. E. Woodward, J. Haszard, A. Worsfold, and B. Venn, “Comparison of self-reported speed of eating with an objective measure of eating rate,” Nutrients, vol. 12, no. 3, pp. 18–24, 2020.
  3. K. Kyritsis, C. Diou, and A. Delopoulos, “A data driven end-to-end approach for in-the-wild monitoring of eating behavior using smartwatches,” IEEE J. Biomed. Heal. Informatics, vol. 25, no. 1, pp. 22–34, 2020.
  4. J. Qiu, F. P. W. Lo, S. Jiang, Y. Y. Tsai, Y. Sun, and B. Lo, “Counting bites and recognizing consumed food from videos for passive dietary monitoring,” IEEE J. Biomed. Heal. Informatics, vol. 25, no. 5, pp. 1471–1482, 2021.
  5. K. S. Lee, “Joint audio-ultrasound food recognition for noisy environments,” IEEE J. Biomed. Heal. Informatics, vol. 24, no. 5, pp. 1477–1489, 2020.
  6. M. Tufano, M. Lasschuijt, A. Chauhan, E. J. M. Feskens, and G. Camps, “Capturing eating behavior from video analysis: A systematic review,” Nutrients, vol. 14, no. 22. pp. 1–14, 2022.
  7. S. Sharma and A. Hoover, “Top-Down detection of eating episodes by analyzing large windows of wrist motion using a convolutional neural network,” Bioengineering, vol. 9, no. 2, pp. 20–23, 2022.
  8. A. Doulah, T. Ghosh, D. Hossain, M. H. Imtiaz, and E. Sazonov, “‘Automatic ingestion monitor version 2’ - A novel wearable device for automatic food intake detection and passive capture of food images,” IEEE J. Biomed. Heal. Informatics, vol. 25, no. 2, pp. 568–576, 2021.
  9. C. Wang, T. S. Kumar, W. De Raedt, G. Camps, H. Hallez, and B. Vanrumste, “Eat-Radar: Continuous Fine-Grained Intake Gesture Detection Using FMCW Radar and 3D Temporal Convolutional Network with Attention,” IEEE J. Biomed. Heal. Informatics, doi: 10.1109/JBHI.2023.3339703.
  10. N. Alshurafa, S. Zhang, C. Romano, H. Zhang, A. F. Pfammatter, and A. W. Lin, “Association of number of bites and eating speed with energy intake: Wearable technology results under free-living conditions,” Appetite, vol. 167, no. September 2020, p. 105653, 2021.
  11. P. V. Rouast and M. T. P. Adam, “Learning deep representations for video-based intake gesture detection,” IEEE J. Biomed. Heal. Informatics, vol. 24, no. 6, pp. 1727–1737, 2020.
  12. C. Wang, T. S. Kumar, G. Markvoort, H. Hallez, and B. Vanrumste, “Eating activity monitoring in home environments using smartphone-based video recordings,” in 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA), 2022, pp. 1–5.
  13. G. Mertes, L. Ding, W. Chen, H. Hallez, J. Jia, and B. Vanrumste, “Measuring and localizing individual bites using a sensor augmented plate during unrestricted eating for the aging population,” IEEE J. Biomed. Heal. Informatics, vol. 24, no. 5, pp. 1509–1518, 2020.
  14. V. Papapanagiotou, C. Diou, L. Zhou, J. Van Den Boer, M. Mars, and A. Delopoulos, “A novel chewing detection system based on PPG, audio, and accelerometry,” IEEE J. Biomed. Heal. Informatics, vol. 21, no. 3, pp. 607–618, 2017.
  15. R. Zhang, S. Bernhart, and O. Amft, “Diet eyeglasses: Recognising food chewing using EMG and smart eyeglasses,” in BSN 2016 - 13th Annual Body Sensor Networks Conference, 2016, pp. 7–12.
  16. Y. Dong, A. Hoover, J. Scisco, and E. Muth, “A new method for measuring meal intake in humans via automated wrist motion tracking,” Appl. Psychophysiol. Biofeedback, vol. 37, no. 3, pp. 205–215, 2012.
  17. Y. Shen, J. Salley, E. Muth, and A. Hoover, “Assessing the accuracy of a wrist motion tracking method for counting bites across demographic and food variables,” IEEE J. Biomed. Heal. Informatics, vol. 21, no. 3, pp. 599–606, 2017.
  18. P. V. Rouast and M. T. P. Adam, “Single-stage intake gesture detection using CTC loss and extended prefix beam search,” IEEE J. Biomed. Heal. Informatics, vol. 25, no. 7, pp. 2733–2743, 2021.
  19. B. Wei, S. Zhang, X. Diao, Q. Xu, Y. Gao, and N. Alshurafa, “An end-to-end energy-efficient approach for intake detection with low inference time using wrist-worn sensor,” IEEE J. Biomed. Heal. Informatics, vol. 27, no. 8, pp. 3878–3888, 2023.
  20. A. Bedri, D. Li, R. Khurana, K. Bhuwalka, and M. Goel, “FitByte: Automatic diet monitoring in unconstrained situations using multimodal sensing on eyeglasses,” in the CHI Conference on Human Factors in Computing Systems, 2020, pp. 1–12.
  21. M. Ester, H. P. Kriegel, J. Sander, and X. Xu, “A density-based algorithm for discovering clusters in large spatial databases with noise,” in Proc. 2nd Int. Conf. Knowl. Discovery Data Mining, Portland, OR, USA, Aug. 1996, pp. 226–231.
  22. C. Lea, M. D. Flynn, R. Vidal, A. Reiter, and G. D. Hager, “Temporal convolutional networks for action segmentation and detection,” In Proc. 30th IEEE Conf. Comput. Vis. Pattern Recognition (CVPR), 2017, pp. 1003–1012.
  23. Y. A. Farha and J. Gall, “MS-TCN: Multi-stage temporal convolutional network for action segmentation,” In Proc. 32th IEEE Conf. Comput. Vis. Pattern Recognition (CVPR), 2019, pp. 3570–3579.
  24. B. Filtjens, B. Vanrumste, and P. Slaets, “Skeleton-based action segmentation with convolutional neural networks,” IEEE Trans. Emerg. Top. Comput., vol. PP, pp. 1–11, 2022.
  25. Y. Luo, J. Li, K. He, and W. Cheuk, “A hierarchical attention-based method for sleep staging using movement and cardiopulmonary signals,” IEEE J. Biomed. Heal. Informatics, vol. 27, no. 3, pp. 1354–1363, 2022.
  26. S. P. Singh, M. K. Sharma, A. Lay-Ekuakille, D. Gangwar, and S. Gupta, “Deep convLSTM with self-attention for human activity decoding using wearable sensors,” IEEE Sens. J., vol. 21, no. 6, pp. 8575–8582, 2021.
  27. P. V. Rouast, H. Heydarian, M. T. P. Adam, and M. E. Rollo, “OREBA: A dataset for objectively recognizing eating behavior and associated intake,” IEEE Access, vol. 8, pp. 181955–181963, 2020.
  28. H. Sloetjes and P. Wittenburg, “Annotation by category - ELAN and ISO DCR,” In Proc. 6th Int. Conf. Lang. Resour. Eval. Lr., 2008, pp. 816–820.
  29. J. Cohen, “A coefficient of agreement for nominal scales,” Educ. Psychol. Meas., vol. 20, no. 1, pp. 37–46, 1960.
  30. M. Mirtchouk, D. Lustig, A. Smith, I. Ching, M. Zheng, and S. Kleinberg, “Recognizing eating from body-worn sensors: Combining free-living and laboratory data,” Proc. ACM Interactive, Mobile, Wearable Ubiquitous Technol., vol. 1, no. 3, 2017, pp. 1–20.
  31. Y. Dong, J. Scisco, M. Wilson, E. Muth, and A. Hoover, “Detecting periods of eating during free-living by tracking wrist motion,” IEEE J. Biomed. Heal. Informatics, vol. 18, no. 4, pp. 1253–1260, 2014.
  32. J. M. Fontana, M. Farooq, and E. Sazonov, “Automatic ingestion monitor: A novel wearable device for monitoring of ingestive behavior,” IEEE Trans. Biomed. Eng., vol. 61, no. 6, pp. 1772–1779, 2014.
  33. E. Thomaz, I. Essa, and G. D. Abowd, “A practical approach for recognizing eating moments with wrist-mounted inertial sensing,” UbiComp 2015 - Proc. 2015 ACM Int. Jt. Conf. Pervasive Ubiquitous Comput., 2015, pp. 1029–1040.
  34. S. Sen, V. Subbaraju, A. Misra, R. Balan, and Y. Lee, “Annapurna: Building a real-world smartwatch-based automated food journal,” 19th IEEE Int. Symp. a World Wireless, Mob. Multimed. Networks, WoWMoM 2018, 2018, pp. 1–6.
  35. G. Schiboni and O. Amft, “Sparse natural gesture spotting in free living to monitor drinking with wrist-worn inertial sensors,” Proc. Int. Symp. Wearable Comput. ISWC, 2018, pp. 140–147.
  36. S. Sharma, P. Jasper, E. Muth, and A. Hoover, “The impact of walking and resting on wrist motion for automated detection of meals,” ACM Trans. Comput. Healthc., vol. 1, no. 4, 2020, pp. 1-19.
  37. F. J. de Gooijer, A. van Kraaij, J. Fabius, S. Hermsen, E. J. M. Feskens, and G. Camps, “Assessing snacking and drinking behavior in real-life settings: Validation of the SnackBox technology,” Food Qual. Prefer., vol. 112, no. May, p. 105002, 2023.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now