Critiquing Self-report Practices for Human Mental and Wellbeing Computing at Ubicomp (2311.15496v1)
Abstract: Computing human mental and wellbeing is crucial to various domains, including health, education, and entertainment. However, the reliance on self-reporting in traditional research to establish ground truth often leads to methodological inconsistencies and susceptibility to response biases, thus hindering the effectiveness of modelling. This paper presents the first systematic methodological review of self-reporting practices in Ubicomp within the context of human mental and wellbeing computing. Drawing from existing survey research, we establish guidelines for self-reporting in human wellbeing studies and identify shortcomings in current practices at Ubicomp community. Furthermore, we explore the reliability of self-report as a means of ground truth and propose directions for improving ground truth measurement in this field. Ultimately, we emphasize the urgent need for methodological advancements to enhance human mental and wellbeing computing.
- 2009. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4 (2009), 624–634. https://doi.org/10.1016/j.jesp.2009.02.016
- User-centered design. Bainbridge, W. Encyclopedia of Human-Computer Interaction. Thousand Oaks: Sage Publications 37, 4 (2004), 445–456.
- Identifying Mobile Sensing Indicators of Stress-Resilience. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5 (06 2021), 1–32. https://doi.org/10.1145/3463528
- A method to induce stress in human subjects in online research environments. Behavior Research Methods (07 2022). https://doi.org/10.3758/s13428-022-01915-3
- Frank M Andrews and A Regula Herzog. 1986. The quality of survey data as related to age of respondent. J. Amer. Statist. Assoc. 81, 394 (1986), 403–410.
- Behavior Modeling Approach for Forecasting Physical Functioning of People with Multiple Sclerosis. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 1, Article 7 (mar 2023), 29 pages. https://doi.org/10.1145/3580887
- LemurDx: Using Unconstrained Passive Sensing for an Objective Measurement of Hyperactivity in Children with No Parent Input. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 2, Article 46 (jun 2023), 23 pages. https://doi.org/10.1145/3596244
- Physical human activity recognition using wearable sensors. Sensors 15, 12 (2015), 31314–31338.
- Incentives in surveys. Journal of Economic Psychology 93 (2022), 102552. https://doi.org/10.1016/j.joep.2022.102552
- Anjana Bali and Amteshwar Singh Jaggi. 2015. Clinical experimental stress studies: methods and assessment. Reviews in the Neurosciences 26 (2015), 555 – 579.
- Roy Baumeister and Mark Leary. 1995. The Need to Belong: Desire for Interpersonal Attachments as a Fundamental Human Motivation. Psychological bulletin 117 (06 1995), 497–529. https://doi.org/10.1037/0033-2909.117.3.497
- Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. Journal of personality assessment 67 3 (1996), 588–97.
- Facetube: predicting personality from facial expressions of emotion in online conversational video. In Proceedings of the 14th ACM international conference on Multimodal interaction. 53–56.
- Experience sampling and ecological momentary assessment studies in psychopharmacology: a systematic review. European Neuropsychopharmacology 25, 11 (2015), 1853–1864.
- A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017–1034.
- A database of German emotional speech.. In Interspeech, Vol. 5. 1517–1520.
- Luca Canzian and Mirco Musolesi. 2015. Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2015).
- Noelle E. Carlozzi. 2011. Shipley Institute of Living Scale. Springer New York, New York, NY, 2287–2289. https://doi.org/10.1007/978-0-387-79948-3_1070
- To What Extent Can We Shorten HRV Analysis in Wearable Sensing? A Case Study on Mental Stress Detection.
- Neuro-QOL. Neurology 78, 23 (2012), 1860–1867. https://doi.org/10.1212/WNL.0b013e318258f744 arXiv:https://n.neurology.org/content/78/23/1860.full.pdf
- Bernard C. K. Choi and Anita W. P. Pak. 2004. A Catalog of Biases in Questionnaires. Preventing Chronic Disease 2 (2004).
- Irene-Angelica Chounta and Alexander Nolte. 2022. The CAT Effect: Exploring the Impact of Casual Affective Triggers on Online Surveys’ Response Rates (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 583, 13 pages. https://doi.org/10.1145/3491102.3517481
- James A Coan and John JB Allen. 2007. Handbook of emotion elicitation and assessment. Oxford university press.
- A global measure of perceived stress. Journal of health and social behavior 24 4 (1983), 385–96.
- John Cooper. 2001. Diagnostic and statistical manual of mental disorders (4th edn, text revision)(DSM–IV–TR) Washington, DC: American Psychiatric Association 2000. 943 pp.£ 39.99 (hb). ISBN 0 89042 025 4. The British Journal of Psychiatry 179, 1 (2001), 85–85.
- EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2016).
- John R. Crawford and Julie D. Henry. 2004. The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. The British journal of clinical psychology 43 Pt 3 (2004), 245–65.
- Semantic Gap in Predicting Mental Wellbeing through Passive Sensing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 374, 16 pages. https://doi.org/10.1145/3491102.3502037
- Semantic Gap in Predicting Mental Wellbeing through Passive Sensing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–16.
- R. S. Davies. 2020. Designing Surveys for Evaluations and Research. https://edtechbooks.org/designing_surveys
- International handbook of survey methodology. Routledge.
- What is Engagement and How Do We Measure It? Toward a Domain Independent Definition and Scale. https://doi.org/10.24251/HICSS.2019.092
- What Causes Depression. 2012. what is depression? World Health Organization (2012).
- Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
- Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults. Brain Sciences 10 (12 2020), 994. https://doi.org/10.3390/brainsci10120994
- New measures of well-being: Flourishing and positive and negative feelings. Soc Indic Res 39 (01 2010), 247–266.
- Reading the Room: Automated, Momentary Assessment of Student Engagement in the Classroom: Are We There Yet? Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–26.
- Reading the Room: Automated, Momentary Assessment of Student Engagement in the Classroom: Are We There Yet? Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 112 (sep 2022), 26 pages. https://doi.org/10.1145/3550328
- Human emotion recognition: Review of sensors and methods. Sensors 20, 3 (2020), 592.
- UStress: Understanding college student subjective stress using wrist-based passive sensing. In 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). 673–678. https://doi.org/10.1109/PERCOMW.2017.7917644
- Panteleimon Ekkekakis. 2013. The measurement of affect, mood, and emotion: A guide for health-behavioral research. Cambridge University Press.
- Paul Ekman and Wallace V Friesen. 1978. Facial action coding system. Environmental Psychology & Nonverbal Behavior (1978).
- A wearable system for mood assessment considering smartphone features and data from mobile ECGs. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (2016).
- Opensmile: the munich versatile and fast open-source audio feature extractor. In Proceedings of the 18th ACM international conference on Multimedia. 1459–1462.
- Arlene Fink. 2003. The survey handbook. sage.
- Arlene Fink. 2015. How to conduct surveys: A step-by-step guide. Sage Publications.
- Incentives to Participate in Online Research: An Experimental Examination of ”Surprise” Incentives. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3433–3442. https://doi.org/10.1145/2556288.2557418
- Surveys and Questionnaires. 77–112.
- Kate French. 1981. Methodological considerations in hospital patient opinion surveys. International journal of nursing studies 18, 1 (1981), 7–32.
- Development of a Self-report Instrument for Measuring in-class Student Engagement Reveals that Pretending to Engage is a Significant Unrecognized Problem. PLoS ONE 13, 10 (2018), e0205828.
- Adrian Furnham and Monika Henderson. 1982. The good, the bad and the mad: Response bias in self-report measures. Personality and Individual Differences 3, 3 (1982), 311–320.
- What is the relationship between mental workload factors and cognitive load types? International journal of psychophysiology : official journal of the International Organization of Psychophysiology 83 (10 2011), 269–75. https://doi.org/10.1016/j.ijpsycho.2011.09.023
- Individual and group-wise classroom seating experience: Effects on student engagement in different courses. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–23.
- Investigating the reliability of self-report data in the wild: The quest for ground truth. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. 237–242.
- n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1–26.
- Predicting Personality Traits from Physical Activity Intensity. Computer 52, 7 (2019), 47–56.
- Using Unobtrusive Wearable Sensors to Measure the Physiological Synchrony Between Presenters and Audience Members. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3 (2019), 1 – 19.
- Stress and anxiety detection using facial cues from videos. Biomed. Signal Process. Control. 31 (2017), 89–101.
- Continuous stress detection using a wrist device: in laboratory and real life. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (2016).
- Psychometric properties of the Depression Anxiety and Stress Scale-21 in older primary care patients. Journal of affective disorders 110 3 (2008), 248–59.
- Predicting personality from twitter. In 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing. IEEE, 149–156.
- Nitesh Goyal and Susan R. Fussell. 2017. Intelligent Interruption Management Using Electro Dermal Activity Based Physiological Sensor for Collaborative Sensemaking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 52 (sep 2017), 21 pages. https://doi.org/10.1145/3130917
- MSLife: Digital Behavioral Phenotyping of Multiple Sclerosis Symptoms in the Wild Using Wearables and Graph-Based Statistical Analysis. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 158 (dec 2022), 35 pages. https://doi.org/10.1145/3494970
- Measuring Stress. Encyclopedia of behavioural neuroscience (12 2010), 186–191. https://doi.org/10.1016/B978-0-08-045396-5.00188-3
- Using electrodermal activity to recognize ease of engagement in children during social interactions. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2014).
- cStress: towards a gold standard for continuous stress assessment in the mobile environment. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2015).
- Assessing social anxiety using gps trajectories and point-of-interest data. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2016).
- Felicia A. Huppert and Timothy T. C. So. 2011. Flourishing Across Europe: Application of a New Conceptual Framework for Defining Well-Being. Social Indicators Research 110 (2011), 837 – 861.
- EngageMon: Multi-Modal Engagement Sensing for Mobile Games. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2 (2018), 13:1–13:27.
- Technologies for cognitive training and cognitive rehabilitation for people with mild cognitive impairment and dementia. A systematic review. Frontiers in psychology 11 (2020), 648.
- Guest Editors’ Introduction: Human-Centered Computing–Toward a Human Revolution. Computer 40, 5 (2007), 30–34.
- Oliver P. John and Sanjay Srivastava. 1999. The Big Five Trait taxonomy: History, measurement, and theoretical perspectives.
- Hyun Kang. 2021. Sample size determination and power analysis using the G* Power software. Journal of educational evaluation for health professions 18 (2021).
- “I didn’t know I looked angry”: Characterizing observed emotion and reported affect at work. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–18.
- Good practice in the conduct and reporting of survey research. International Journal for Quality in health care 15, 3 (2003), 261–266.
- Modeling Personality vs. Modeling Personalidad: In-the-Wild Mobile Data Analysis in Five Countries Suggests Cultural Impact on Personality Models. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 88 (sep 2019), 24 pages. https://doi.org/10.1145/3351246
- Monique F Kilkenny and Kerin M Robinson. 2018. Data quality:“Garbage in–garbage out”. , 103–105 pages.
- Comparing Data from Chatbot and Web Surveys: Effects of Platform and Conversational Style on Survey Response Quality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300316
- Micro-Stress EMA: A Passive Sensing Framework for Detecting in-the-Wild Stress in Pregnant Mothers. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 91 (sep 2019), 22 pages. https://doi.org/10.1145/3351249
- The ’Trier Social Stress Test’–a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 28 1-2 (1993), 76–81.
- Look into my eyes: using pupil dilation to estimate mental workload for task complexity adaptation. In Extended abstracts of the 2018 chi conference on human factors in computing systems. 1–6.
- An Ultra-brief Screening Scale for Anxiety and Depression: The PHQ-4. Psychosomatics 50, 6 (2009), 613–621.
- The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. General Hospital Psychiatry 32, 4 (2010), 345–359. https://doi.org/10.1016/j.genhosppsych.2010.03.006
- The PHQ-8 as a Measure of Current Depression in the General Population. Journal of Affective Disorders 114, 1 (2009), 163–173.
- The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus. Archives of neurology 46 10 (1989), 1121–3.
- Appraisal Theory-Based Mobile App for Physiological Data Collection and Labelling in the Wild. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (London, United Kingdom) (UbiComp/ISWC ’19 Adjunct). Association for Computing Machinery, New York, NY, USA, 752–756. https://doi.org/10.1145/3341162.3345595
- A Multi-Sensor Approach to Automatically Recognize Breaks and Work Activities of Knowledge Workers in Academia. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 (2020), 1 – 20.
- Unobtrusive Assessment of Students’ Emotional Engagement during Lectures Using Electrodermal Activity Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 (2018), 1 – 21.
- OSN mood tracking: exploring the use of online social network activity as an indicator of mood changes. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (2016).
- Center for Epidemiologic Studies Depression Scale (CES-D) as a screening instrument for depression among community-residing older adults. Psychology and aging 12 2 (1997), 277–87.
- Boning Li and Akane Sano. 2020. Extraction and Interpretation of Deep Autoencoder-based Temporal Features from Wearables for Forecasting Personalized Mood, Health, and Stress. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 (2020), 1 – 26.
- Eustress or distress: an empirical study of perceived stress in everyday college life. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (2016).
- Mingnan Liu and Laura Wronski. 2018. Trap questions in online surveys: Results from three web survey experiments. International Journal of Market Research 60, 1 (2018), 32–49.
- Applications of mobile activity recognition. In Proceedings of the 2012 ACM conference on ubiquitous computing. 1054–1058.
- Deborah Lupton. 2014. Self-tracking cultures: towards a sociology of personal informatics. In Proceedings of the 26th Australian computer-human interaction conference on designing futures: The future of design. 77–86.
- Mitja Luvstrek and Bovstjan Kaluvza. 2009. Fall detection and activity recognition with machine learning. Informatica 33, 2 (2009).
- mHealth for mental health: Integrating smartphone technology in behavioral healthcare. Professional Psychology: Research and Practice 42, 6 (2011), 505.
- Neil Malhotra. 2008. Completion Time and Response Order Effects in Web Surveys. Public Opinion Quarterly 72, 5 (2008), 914–934.
- University student’s engagement: development of the University Student Engagement Inventory (USEI). Psicologia: Reflexão e Crítica 29 (2016).
- Richard P. Mattick and J.Christopher Clarke. 1998. Development and validation of measures of social phobia scrutiny fear and social interaction anxiety11Editor’s note: This article was written before the development of some contemporary measures of social phobia, such as the Social Phobia and Anxiety Inventory (Turner et al., 1989). We have invited this article for publication because of the growing interest in the scales described therein. S.T. Behaviour Research and Therapy 36, 4 (1998), 455–470. https://doi.org/10.1016/S0005-7967(97)10031-6
- Sentiment analysis algorithms and applications: A survey. Ain Shams engineering journal 5, 4 (2014), 1093–1113.
- Generalization and Personalization of Mobile Sensing-Based Mood Inference Models: An Analysis of College Students in Eight Countries. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 176 (jan 2023), 32 pages. https://doi.org/10.1145/3569483
- Daniel Miller and Heather A Horst. 2020. The digital and the human: A prospectus for digital anthropology. In Digital anthropology. Routledge, 3–35.
- Differentiating Higher and Lower Job Performers in the Workplace Using Mobile Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3 (2019), 1 – 24.
- The Case for a Commodity Hardware Solution for Stress Detection. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (2018).
- Stress Detection Using Wearable Physiological and Sociometric Sensors. International journal of neural systems 27 2 (2017), 1650041.
- Magen Mhaka Mutepfa and Roy Tapera. 2019. Traditional Survey and Questionnaire Platforms. Springer Singapore, Singapore, 541–558. https://doi.org/10.1007/978-981-10-5251-4_89
- Automated prediction and analysis of job interview performance: The role of what you say and how you say it. In 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Vol. 1. 1–6. https://doi.org/10.1109/FG.2015.7163127
- Detecting Job Promotion in Information Workers Using Mobile Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 (2020), 1 – 28.
- Audio features for music emotion recognition: a survey. IEEE Transactions on Affective Computing (2020).
- The self-report method. Handbook of research methods in personality psychology 1, 2007 (2007), 224–239.
- Ashley L. Peterson. 2022. What is… psychological testing. https://mentalhealthathome.org/2020/09/04/what-is-psychological-testing/
- PAM: a photographic affect meter for frequent, in situ measurement of affect. In Proceedings of the SIGCHI conference on Human factors in computing systems. 725–734.
- Incorporating ideas from computer-supported cooperative work. Journal of biomedical informatics 37, 2 (2004), 128–137.
- Depression, Anxiety and Stress Among Indians in Times of Covid-19 Lockdown. Community Mental Health Journal 57 (2020), 42 – 48.
- A Mobile Sensing Approach to Stress Detection and Memory Activation for Public Bus Drivers. IEEE Transactions on Intelligent Transportation Systems 16, 6 (2015), 3294–3303. https://doi.org/10.1109/TITS.2015.2445314
- Towards a Mobile and Wearable System for Predicting Panic Attacks. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp ’15). Association for Computing Machinery, New York, NY, USA, 529–533. https://doi.org/10.1145/2750858.2805834
- Daniel Russell. 1996. UCLA Loneliness Scale (Version 3): Reliability, Validity, and Factor Structure. Journal of personality assessment 66 (03 1996), 20–40. https://doi.org/10.1207/s15327752jpa6601_2
- Inferring Mood Instability on Social Media by Leveraging Ecological Momentary Assessments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 (2017), 1 – 27.
- Person-Centered Predictions of Psychological Constructs with Social Media Contextualized by Multimodal Sensing. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies 5 (03 2021), 32. https://doi.org/10.1145/3448117
- M3Sense: Affect-Agnostic Multitask Representation Learning Using Multimodal Wearable Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6 (07 2022), 1–32. https://doi.org/10.1145/3534600
- Dr. Archana Sharma* and Dr. Vibhakar Mansotra. 2019. Multimodal Decision-level Group Sentiment Prediction of Students in Classrooms. , 4902–4909 pages. https://doi.org/10.35940/ijitee.l3549.1081219
- Reliability and validity of the Panic Disorder Severity Scale: replication and extension. Journal of Psychiatric Research 35, 5 (2001), 293–296. https://doi.org/10.1016/S0022-3956(01)00028-0
- Human computer interaction. In 2010 3rd International Conference on Emerging Trends in Engineering and Technology. IEEE, 1–4.
- Effectiveness of incentives and follow-up on increasing survey response rates and participation in field studies. BMC Medical Research Methodology 19 (12 2019), 230. https://doi.org/10.1186/s12874-019-0868-8
- Cognitive psychology. Pearson Education New Zealand.
- Measuring time use in surveys – Concordance of survey and experience sampling measures. Social Science Research 41, 5 (2012), 1037–1052. https://doi.org/10.1016/j.ssresearch.2012.03.013
- Manual for the State-Trait Anxiety Inventory.
- A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of internal medicine 166, 10 (2006), 1092–1097.
- Th. Steimer. 2002. The biology of fear- and anxiety-related behaviors. Dialogues in Clinical Neuroscience 4 (2002), 231 – 249.
- Measuring daily events and experiences: Decisions for the researcher. Journal of personality 59, 3 (1991), 575–607.
- Emotion trajectories in smartphone use: Towards recognizing emotion regulation in-the-wild. International Journal of Human-Computer Studies 166 (2022), 102872.
- Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1701–1708.
- Using physiological sensors to detect levels of user frustration induced by system delays. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2015).
- The Tale of a Complicated Relationship: Insights from Users’ Love/Breakup Letters to Their Smartphones before and during the COVID-19 Pandemic. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1–34.
- DepreST-CAT: Retrospective Smartphone Call and Text Logs Collected during the COVID-19 Pandemic to Screen for Mental Illnesses. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6 (07 2022), 1–32. https://doi.org/10.1145/3534596
- StudentSADD: Rapid Mobile Depression and Suicidal Ideation Screening of College Students during the Coronavirus Pandemic. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6 (07 2022), 1–32. https://doi.org/10.1145/3534604
- Tracking Fatigue and Health State in Multiple Sclerosis Patients Using Connnected Wellness Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3 (2019), 1 – 19.
- Timothy J. Trull and Ulrich W. Ebner-Priemer. 2009. Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. Psychological assessment 21 4 (2009), 457–62.
- Gamification of mobile experience sampling improves data quality and quantity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–21.
- The Current State of EMA and ESM Study Design in Mood Disorders Research: A Comprehensive Summary and Analysis.
- CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2016).
- StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students Using Smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp ’14). Association for Computing Machinery, New York, NY, USA, 3–14. https://doi.org/10.1145/2632048.2632054
- SmartGPA: how smartphones can assess and predict academic performance of college students. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2015).
- Predicting Symptom Trajectories of Schizophrenia using Mobile Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 (2017), 1 – 24.
- Tracking Depression Dynamics in College Students using Mobile Phone and Wearable Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1–26.
- Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 (2018), 1 – 26.
- Sensing Behavioral Change over Time. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 (2018), 1 – 21.
- First-Gen Lens: Assessing Mental Health of First-Generation Students across Their First Year at College Using Mobile Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 95 (jul 2022), 32 pages. https://doi.org/10.1145/3543194
- Can People Self-Report Security Accurately? Agreement Between Self-Report and Behavioral Measures. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2228–2232.
- Objective Measures of Cognitive Load Using Deep Multi-Modal Learning: A Use-Case in Aviation. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 1, Article 40 (mar 2021), 35 pages. https://doi.org/10.1145/3448111
- Leveraging Routine Behavior and Contextually-Filtered Features for Depression Detection among College Students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3 (2019), 1 – 33.
- Leveraging Collaborative-Filtering for Personalized Behavior Modeling: A Case Study of Depression Detection among College Students. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 1, Article 41 (mar 2021), 27 pages. https://doi.org/10.1145/3448107
- GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior Modeling. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 190 (jan 2023), 34 pages. https://doi.org/10.1145/3569485
- Han Yu and Akane Sano. 2023. Semi-Supervised Learning for Wearable-Based Momentary Stress Detection in the Wild. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 2, Article 80 (jun 2023), 23 pages. https://doi.org/10.1145/3596246
- The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study. BMC Medical Research Methodology 17 (2017).
- A survey of affect recognition methods: audio, visual and spontaneous expressions. In Proceedings of the 9th international conference on Multimodal interfaces. 126–133.
- Moodexplorer: Towards Compound Emotion Detection via Smartphone Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1–30.
- MoodExplorer: Towards Compound Emotion Detection via Smartphone Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1 (2018), 176:1–176:30.
- TeamSense: Assessing Personal Affect and Group Cohesion in Small Teams through Dyadic Interaction and Behavior Analysis with Wearable Sensors. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2 (2018), 150:1–150:22.