Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning About Social Context from Smartphone Data: Generalization Across Countries and Daily Life Moments (2306.00919v5)

Published 1 Jun 2023 in cs.HC and cs.CY

Abstract: Understanding how social situations unfold in people's daily lives is relevant to designing mobile systems that can support users in their personal goals, well-being, and activities. As an alternative to questionnaires, some studies have used passively collected smartphone sensor data to infer social context (i.e., being alone or not) with machine learning models. However, the few existing studies have focused on specific daily life occasions and limited geographic cohorts in one or two countries. This limits the understanding of how inference models work in terms of generalization to everyday life occasions and multiple countries. In this paper, we used a novel, large-scale, and multimodal smartphone sensing dataset with over 216K self-reports collected from 581 young adults in five countries (Mongolia, Italy, Denmark, UK, Paraguay), first to understand whether social context inference is feasible with sensor data, and then, to know how behavioral and country-level diversity affects inferences. We found that several sensors are informative of social context, that partially personalized multi-country models (trained and tested with data from all countries) and country-specific models (trained and tested within countries) can achieve similar performance above 90% AUC, and that models do not generalize well to unseen countries regardless of geographic proximity. These findings confirm the importance of the diversity of mobile data, to better understand social context inference models in different countries.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (97)
  1. Towards population scale activity recognition: A framework for handling data diversity. Proceedings of the AAAI Conference on Artificial Intelligence 26, 1, 851–857.
  2. Sensing and using social context. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 5, 2 (2008), 1–27.
  3. Social sensing: when users become monitors. Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, 476–479.
  4. Multimodal Earable Sensing for Human Energy Expenditure Estimation. arXiv preprint arXiv:2305.00517 (2023).
  5. Complex Daily Activities, Country-Level Diversity, and Smartphone Sensing: A Study in Denmark, Italy, Mongolia, Paraguay, and UK. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (2023). https://doi.org/10.1145/3569483
  6. Detecting Drinking Episodes in Young Adults Using Smartphone-Based Sensors. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 5 (jun 2017), 36 pages. https://doi.org/10.1145/3090051
  7. Sensing Eating Events in Context: A Smartphone-Only Approach. IEEE Access 10 (2022), 61249–61264. https://doi.org/10.1109/ACCESS.2022.3179702
  8. Loneliness around the world: Age, gender, and cultural differences in loneliness. Personality and Individual Differences 169 (2021), 110066.
  9. Roy F Baumeister and Mark R Leary. 1995. The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychological bulletin 117, 3 (1995), 497.
  10. Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. Psychiatric rehabilitation journal 38, 3 (2015), 218.
  11. Objective measurement of sociability and activity: mobile sensing in the community. The Annals of Family Medicine 9, 4 (2011), 344–350.
  12. Integrating Individual and Social Contexts into Self-Reflection Technologies. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 1–6.
  13. Bites ‘n’bits: Inferring eating behavior from contextual mobile data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1–33.
  14. Sarah-Jayne Blakemore. 2012. Development of the social brain in adolescence. Journal of the Royal Society of Medicine 105, 3 (2012), 111–116.
  15. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. Advances in neural information processing systems 29 (2016).
  16. Your Day in Your Pocket: Complex Activity Recognition from Smartphone Accelerometers. In International Conference on Pervasive Computing Technologies for Healthcare. Springer, 247–258.
  17. Douglas Broom. 2021. Home or office? Survey shows opinions about work after COVID-19. World Economic Forum. July 21.
  18. Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. Conference on fairness, accountability and transparency, 77–91.
  19. Harnessing context sensing to develop a mobile intervention for depression. Journal of medical Internet research 13, 3 (2011), e55.
  20. Stress detection in daily life scenarios using smart phones and wearable sensors: A survey. Journal of biomedical informatics 92 (2019), 103139.
  21. A systematic study of unsupervised domain adaptation for robust human-activity recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1–30.
  22. SMOTE: synthetic minority over-sampling technique. Journal of artificial intelligence research 16 (2002), 321–357.
  23. Guanling Chen and David Kotz. 2000. A survey of context-aware mobile computing research. (2000).
  24. Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 785–794. https://doi.org/10.1145/2939672.2939785
  25. Hoi Shan Cheung and Elinor Lim. 2021. A systematic review of parenting in Singapore: Insights to the culture-specific functions of styles and practices. (2021).
  26. Activity sensing in the wild: a field trial of ubifit garden. Proceedings of the SIGCHI conference on human factors in computing systems, 1797–1806.
  27. Imagenet: A large-scale hierarchical image database. 2009 IEEE conference on computer vision and pattern recognition, 248–255.
  28. Google Developers. 2021. Activity Recognition API. https://developers.google.com/location-context/activity-recognition. Accessed: 2022-02-15.
  29. Context inference of users’ social relationships and distributed policy management. 2009 IEEE international conference on pervasive computing and communications, 1–8.
  30. Anind K Dey. 2001. Understanding and using context. Personal and ubiquitous computing 5, 1 (2001), 4–7.
  31. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human–Computer Interaction 16, 2-4 (2001), 97–166.
  32. Fairness through awareness. Proceedings of the 3rd innovations in theoretical computer science conference, 214–226.
  33. Mental health and social contact during the COVID-19 pandemic: an ecological momentary assessment study. Clinical Psychological Science 10, 2 (2022), 340–354.
  34. Richard Fry and Kim Parker. 2021. Rising share of US adults are living without a spouse or partner. (2021).
  35. Andrew J Fuligni and Jacquelynne S Eccles. 1993. Perceived parent-child relationships and early adolescents’ orientation toward peers. Developmental psychology 29, 4 (1993), 622.
  36. A worldwide diversity pilot on daily routines and social practices (2020-2021). University of Trento Technical Report-DataScientia dataset descriptors.
  37. Diversity in machine learning. IEEE Access 7 (2019), 64323–64350.
  38. Jack Goody. 1996. Comparing family systems in Europe and Asia: Are there different sets of rules? Population and Development Review (1996), 1–20.
  39. John Heron. 1970. The phenomenology of social encounter: The gaze. Philosophy and Phenomenological Research 31, 2 (1970), 243–264.
  40. Loneliness and social isolation as risk factors for mortality: a meta-analytic review. Perspectives on psychological science 10, 2 (2015), 227–237.
  41. Elderly people living alone: Detecting home visits with ambient and wearable sensing. Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care, 85–88.
  42. Understanding the Social Context of Eating with Multimodal Smartphone Sensing: The Role of Country Diversity. Proceedings of the 25th International Conference on Multimodal Interaction (ICMI ’23) (2023).
  43. Sayash Kapoor and Arvind Narayanan. 2022. Leakage and the reproducibility crisis in ML-based science. arXiv preprint arXiv:2207.07048 (2022).
  44. Modeling personality vs. modeling personalidad: In-the-wild mobile data analysis in five countries suggests cultural impact on personality models. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–24.
  45. Relationships between adults and parents in Asia. Successful aging: Asian perspectives (2015), 101–122.
  46. Openimages: A public dataset for large-scale multi-label and multi-class image classification. Dataset available from https://github. com/openimages 2, 3 (2017), 18.
  47. Guanqing Liang and Jiannong Cao. 2015. Social context-aware middleware: A survey. Pervasive and mobile computing 17 (2015), 207–219.
  48. Moodscope: Building a mood sensor from smartphone usage patterns. Proceeding of the 11th annual international conference on Mobile systems, applications, and services, 389–402.
  49. Roderick JA Little and Donald B Rubin. 2019. Statistical analysis with missing data. Vol. 793. John Wiley & Sons.
  50. Applications of mobile activity recognition. Proceedings of the 2012 ACM Conference on Ubiquitous Computing, 1054–1058.
  51. The future of work after COVID-19. McKinsey global institute 18 (2021).
  52. S Mass. 2021. Work from home likely to remain elevated post pandemic. The Digest 6 (2021).
  53. Social isolation, loneliness and depression in young adulthood: a behavioural genetic analysis. Social psychiatry and psychiatric epidemiology 51, 3 (2016), 339–348.
  54. Making social matching context-aware: Design concepts and open challenges. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 545–554.
  55. Generalization and Personalization of Mobile Sensing-Based Mood Inference Models: An Analysis of College Students in Eight Countries. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 176 (jan 2023), 32 pages. https://doi.org/10.1145/3569483
  56. Lakmal Meegahapola and Daniel Gatica-Perez. 2020. Smartphone Sensing for the Well-Being of Young Adults: A Review. IEEE Access (2020).
  57. Examining the Social Context of Alcohol Drinking in Young Adults with Smartphone Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–26.
  58. Alone or with others? understanding eating episodes of college students with mobile sensing. 19th International Conference on Mobile and Ubiquitous Multimedia, 162–166.
  59. Protecting mobile food diaries from getting too personal. Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia, 212–222.
  60. One More Bite? Inferring Food Consumption Level of College Students Using Smartphone Sensing and Self-Reports. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 1, Article 26 (mar 2021), 28 pages. https://doi.org/10.1145/3448120
  61. Keep Sensors in Check: Disentangling Country-Level Generalization Issues in Mobile Sensor-Based Models with Diversity Scores. Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, 217–228. https://doi.org/10.1145/3600211.3604688
  62. COVID student study: A year in the life of college students during the COVID-19 pandemic through the lens of mobile phone sensing. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 1–19.
  63. Time use. Our World in Data (2020).
  64. Scikit-learn: Machine learning in Python. the Journal of machine Learning research 12 (2011), 2825–2830.
  65. Mobile Sensing Around the Globe: Considerations for Cross-Cultural Research. https://doi.org/10.31234/osf.io/q8c7y
  66. Identification of activities of daily living using sensors available in off-the-shelf mobile devices: Research and hypothesis. International Symposium on Ambient Intelligence, 121–130.
  67. Transforming robot programs based on social context. Proceedings of the 2020 CHI conference on human factors in computing systems, 1–12.
  68. Assessing gender bias in machine translation: a case study with google translate. Neural Computing and Applications 32, 10 (2020), 6363–6381.
  69. Floating search methods in feature selection. Pattern recognition letters 15, 11 (1994), 1119–1125.
  70. Multimodal deep learning for activity and context recognition. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 1, 4 (2018), 1–27.
  71. ContextPhone: A prototyping platform for context-aware mobile applications. IEEE pervasive computing 4, 2 (2005), 51–59.
  72. Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligence. arXiv preprint arXiv:2002.04803 (2020).
  73. DrinkSense: Characterizing youth drinking behavior using smartphones. IEEE Transactions on Mobile Computing 17, 10 (2018), 2279–2292.
  74. Using physical-social interactions to support information re-finding. 885–910.
  75. The Theory, Practice, and Ethical Challenges of Designing a Diversity-Aware Platform for Social Relations. Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, 905–915.
  76. Mobile sensing at the service of mental well-being: a large-scale longitudinal study. Proceedings of the 26th International Conference on World Wide Web, 103–112.
  77. No classification without representation: Assessing geodiversity issues in open data sets for the developing world. arXiv preprint arXiv:1711.08536 (2017).
  78. Lewis B Sheiner and Thaddeus H Grasela. 1991. An introduction to mixed effect modeling: concepts, definitions, and justification. Journal of pharmacokinetics and biopharmaceutics 19 (1991), S11–S24.
  79. Gürkan Solmaz and Fang-Jing Wu. 2017. Together or alone: Detecting group mobility with wireless fingerprints. 2017 IEEE International Conference on Communications (ICC), 1–7.
  80. Smart devices are different: Assessing and mitigatingmobile sensing heterogeneities for activity recognition. Proceedings of the 13th ACM conference on embedded networked sensor systems, 127–140.
  81. Living alone and positive mental health: a systematic review. Systematic reviews 8, 1 (2019), 1–8.
  82. Hiromi Taniguchi and Gayle Kaufman. 2021. Family, Collectivism, and Loneliness from a Cross-Country Perspective. Applied Research in Quality of Life (2021), 1–27.
  83. Less in-person social interaction with peers among US adolescents in the 21st century and links to loneliness. Journal of Social and Personal Relationships 36, 6 (2019), 1892–1913.
  84. Why do the lonely stay lonely? Chronically lonely adolescents’ attributions and emotions in situations of social inclusion and exclusion. Journal of Personality and Social Psychology 109, 5 (2015), 932.
  85. Methods to adjust for multiple comparisons in the analysis and sample size calculation of randomised controlled trials with multiple primary outcomes. BMC medical research methodology 19, 1 (2019), 1–13.
  86. It’s a man’s Wikipedia? Assessing gender inequality in an online encyclopedia. Proceedings of the international AAAI conference on web and social media 9, 1, 454–463.
  87. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR mHealth and uHealth 4, 3 (2016), e5960.
  88. Social sensing: assessing social functioning of patients living with schizophrenia using mobile phone sensing. Proceedings of the 2020 CHI conference on human factors in computing systems, 1–15.
  89. Detecting Social Contexts from Mobile Sensing Indicators in Virtual Interactions with Socially Anxious Individuals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1–26.
  90. Molly Stroud Weeks and Steven R Asher. 2012. Loneliness in childhood: Toward the next generation of assessment and research. Advances in child development and behavior 42 (2012), 1–39.
  91. GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 190 (jan 2023), 34 pages. https://doi.org/10.1145/3569485
  92. Understanding practices and needs of researchers in human state modeling by passive mobile sensing. CCF Transactions on Pervasive Computing and Interaction 3, 4 (2021), 344–366.
  93. Smartphone bluetooth based social sensing. Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication, 95–98.
  94. Context-awareness for mobile sensing: A survey and future directions. IEEE Communications Surveys & Tutorials 18, 1 (2014), 68–93.
  95. Impact of parental migration on psychosocial well-being of children left behind: a qualitative study in rural China. International journal for equity in health 17, 1 (2018), 1–10.
  96. Missing data estimation in mobile sensing environments. IEEE Access 6 (2018), 69869–69882.
  97. James Zou and Londa Schiebinger. 2018. AI can be sexist and racist—it’s time to make it fair.
Citations (4)

Summary

We haven't generated a summary for this paper yet.