How Work From Home Affects Collaboration: A Large-Scale Study of Information Workers in a Natural Experiment During COVID-19

Abstract: The COVID-19 pandemic has had a wide-ranging impact on information workers such as higher stress levels, increased workloads, new workstreams, and more caregiving responsibilities during lockdown. COVID-19 also caused the overwhelming majority of information workers to rapidly shift to working from home (WFH). The central question this work addresses is: can we isolate the effects of WFH on information workers' collaboration activities from all other factors, especially the other effects of COVID-19? This is important because in the future, WFH will likely to be more common than it was prior to the pandemic. We use difference-in-differences (DiD), a causal identification strategy commonly used in the social sciences, to control for unobserved confounding factors and estimate the causal effect of WFH. Our analysis relies on measuring the difference in changes between those who WFH prior to COVID-19 and those who did not. Our preliminary results suggest that on average, people spent more time on collaboration in April (Post WFH mandate) than in February (Pre WFH mandate), but this is primarily due to factors other than WFH, such as lockdowns during the pandemic. The change attributable to WFH specifically is in the opposite direction: less time on collaboration and more focus time. This reversal shows the importance of using causal inference: a simple analysis would have resulted in the wrong conclusion. We further find that the effect of WFH is moderated by individual remote collaboration experience prior to WFH. Meanwhile, the medium for collaboration has also shifted due to WFH: instant messages were used more, whereas scheduled meetings were used less. We discuss design implications -- how future WFH may affect focused work, collaborative work, and creative work.

• The paper employs a difference-in-differences method with coarsened exact matching to isolate the specific effects of WFH, revealing a 2% decline in collaboration and a 3.6% increase in focus hours.
• The paper finds a significant 27.7% uptick in instant messaging usage alongside a 6.4% drop in scheduled meetings, highlighting a shift toward more flexible communication methods.
• The paper highlights that employees with less remote work experience face greater collaboration declines, underscoring the importance of developing remote collaboration skills.

Insights from a Large-Scale Study on Work From Home and Collaboration During COVID-19

The paper, "How Work From Home Affects Collaboration: A Large-Scale Study of Information Workers in a Natural Experiment During COVID-19," explores the impact of Work From Home (WFH) on the collaborative activities of information workers during the COVID-19 pandemic. The authors employ a difference-in-differences (DiD) analytical framework to isolate the effects of WFH from other concurrent pandemic-related factors.

Methodology

To disentangle the specific effects of WFH, the authors use a DiD approach, which leverages the fact that some employees already worked from home prior to the pandemic while others were office-based. This approach allows them to compare changes in work behavior between these groups when they both shifted to working from home due to pandemic mandates. They reweighted control group observations through coarsened exact matching to ensure balance in job role, managerial status, and seniority, enhancing the credibility of their causal estimates.

Key Findings

1. Effects on Collaboration and Focus: The study finds that, contrary to observable data, WFH specifically led to a 2.0% decrease in collaboration hours and a 3.6% increase in focus hours for information workers. This discrepancy highlights the necessity of using causal inference methods to avoid inaccurate conclusions derived from simple observational data.
2. Shifts in Communication Mediums: There was a notable shift in the mediums of collaboration. Instant messaging usage increased significantly by 27.7%, while scheduled meeting hours decreased by 6.4%. These changes suggest that WFH prompts workers to favor more flexible, less structured communication when they are physically separated from their colleagues.
3. Variation by Remote Collaboration Experience: Workers with limited prior remote collaboration experience experienced more pronounced effects from the shift to WFH. For these individuals, collaboration hours decreased by 3.1% and meeting hours by 9.23%, whereas those with more remote experience showed minimal changes. This implies that familiarity with remote collaboration tools and methods can moderate the impacts of the sudden shift to WFH.

Implications for Future Work Patterns

The findings of this study have considerable implications for the anticipated increase in WFH arrangements post-pandemic, suggesting that organizations must be cautious in using unadjusted pandemic-era data to predict future norms. The paper indicates that WFH can foster productivity through increased focus hours but may impair collaboration, particularly for workers unaccustomed to remote interactions.

Design Implications for Productivity Tools

The growing reliance on instant messaging over formal meetings suggests a need for tools that can support less structured communication, potentially including capabilities that mimic informal in-office interactions (e.g., "water-cooler chats"). The difference in WFH impact based on prior remote work experience also emphasizes the need for customizable tools that adapt to individual user needs, enabling effective collaboration regardless of the user's previous experience with remote work.

Conclusion and Future Directions

This research contributes to understanding the specific effects of WFH during an unprecedented global experiment necessitated by the COVID-19 pandemic. It underscores the complexity of remote work effects, cautioning against simplistic extrapolations from pandemic-related data to permanent work arrangements. Future investigations could broaden this analysis to include other aspects of productivity and work practices, which can inform strategies for effective remote collaboration and for the design of supportive technologies in the evolving landscape of work.