Digital Transformation Stress Scale

• Digital Transformation Stress Scale (DTSS) is a self-report instrument that measures employee stress related to rapid digitalization and ICT challenges.
• The scale was developed through rigorous multi-stage content derivation and validated with strong factor analysis and reliability metrics.
• DTSS offers practical insights for monitoring digital transformation stress, enabling timely organizational interventions and targeted support.

The Digital Transformation Stress Scale (DTSS) is a psychometric self-report instrument designed to quantify employees' stress reactions specifically resulting from ongoing workplace digitization initiatives. Developed to capture the multidimensional nature of stress induced by digital transformation (DT) efforts—such as new information and communication technologies (ICT) rollouts—the DTSS measures both the workload pressures and hassles associated with rapid digital change, as well as the employee's perceived self-efficacy in dealing with these challenges. The scale’s theoretical underpinnings integrate Bandura’s self-efficacy framework and the transactional stress model of Lazarus and Folkman, situating the DTSS at the intersection of organizational psychology, technostress research, and digital transformation management (Makowska-Tłumak et al., 18 Oct 2025).

1. Development and Theoretical Foundations

The creation of the DTSS involved multi-stage content derivation anchored in the technostress and digital transformation stress literatures (e.g., Tarafdar et al. 2007; Makowska-Tłomak et al. 2021). An initial item pool was assembled through literature review and expert interviews with organizational psychologists and IT project managers, yielding approximately 15–20 candidate statements. Item content was engineered to reflect: (a) increased workload and time pressure owing to DT projects, (b) ICT-related hassles and technological breakdowns, and (c) the psychological construct of self-efficacy in mastering unfamiliar digital tools. This multidimensional coverage facilitated both the unidimensional and potential bifactor interpretation of the instrument, balancing the need for parsimony with sensitivity to stress drivers unique to digital transformation programs.

2. Factor Structure and Psychometric Validation

The formal validation study (Makowska-Tłomak et al. 2023) employed exploratory factor analysis (EFA) on samples of size N ≈ 400–450, supporting either a strong single-factor solution or a two-factor structure (ICT Hassles Stress and DT Project Workload Stress), contingent on extraction criteria. Factor loadings ranged from .52 to .85, surpassing established cut-offs and confirming construct coherence. Subsequent confirmatory factor analysis (CFA) on a holdout sample demonstrated excellent model fit for a unidimensional structure, with fit indices CFI ≥ .95 and RMSEA ≤ .06. This statistical evidence positions the DTSS as a robust global measure of digital transformation stress—either as a total index or as two intercorrelated subscales.

3. Reliability, Validity, and Correlates

The DTSS exhibits high reliability, with Cronbach’s α between .90 and .93 for the overall scale. When split by factor structure, both ICT-hassles (α ≈ .88) and workload (α ≈ .86) subscales showed strong internal consistency. Convergent validity was established through moderate to strong correlations with the Perceived Stress Scale–4 (PSS-4; r ≈ .45–.55) and existing technostress and burnout measures (r ≈ .40–.50). Discriminant validity was evidenced by low associations with unrelated constructs including social desirability and job satisfaction (r < .20). These metrics confirm the DTSS’s specificity and its distinctiveness from both general work stress and personality confounds.

4. Scale Structure and Scoring

The DTSS is implemented as a brief scale, typically in a 10-item short form. Each item is rated on a 5-point Likert scale (1 = “Not at all”, 5 = “Extremely”), addressing experiences such as feeling overwhelmed by ICT adoption pace, anxiety over system malfunctions, pressure to upskill rapidly, and helplessness in the face of recurrent glitches. Scores are computed as raw sums:

$\text{Total DTSS} = \sum_{i=1}^N x_i$

where $x_i$ is the respondent’s score for item $i$ and $N$ is the number of items (usually $N=10$). Subscale scores are analogously computed using the relevant subsets of items. Higher aggregate scores denote greater digital transformation-specific stress. The DTSS is optimized for online administration and can typically be completed in under five minutes.

5. Administration and Empirical Application

In the study “Women Have It Worse: an ICT Workplace Digital Transformation Stress Gender Gap” (Makowska-Tłumak et al., 18 Oct 2025), the DTSS was administered to N = 37 employees (30 women, 7 men) at a medium-sized Polish financial firm. Participants represented managerial, expert, and operational occupational strata; the majority (78%) held university degrees and the average age was 40.5 years (SD = 8.8). Administration occurred via a secure internal online survey during a period of intensive digital rollout, including a new Document Management System and pandemic-driven remote work shifts. Data collection was voluntary and anonymous, and, with explicit consent, scale data were matched to behavioral sentiment traces from help-desk ticketing systems.

6. Example Items

Items exemplifying the DTSS construct include:

• “I feel overwhelmed by the pace of new digital tools being introduced.”
• “When the system malfunctions, I worry I won’t be able to fix it.”
• “I feel pressured to master unfamiliar software on a very tight timetable.”
• “Frequent ICT glitches make me feel helpless.”

These items probe both the affective and efficacy-related dimensions of employee experience under digital transformation stressors.

7. Interpretation and Organizational Utility

Normative data indicate that a mean item score above 3.0 (on the 5-point scale) signals moderate-to-high levels of digital transformation stress, potentially warranting intervention at the organizational or individual level. The DTSS can be administered at regular intervals (quarterly or semi-annually), particularly during major DT rollouts, to monitor emerging risks across demographic subgroups (such as gender, occupational role, or department). Published cut-offs and detailed percentile norms enable nuanced interpretation, and the DTSS is designed for integration with behavioral sentiment analysis (e.g., help-desk ticket logs) to triangulate self-reported and observed stress indicators. This dual-method approach enhances both sensitivity and ecological validity while minimizing participant fatigue.

In summary, the DTSS is a rigorously validated, compact, and flexible measurement instrument for organizational researchers and practitioners seeking to monitor and respond to the psychosocial impacts of digital transformation initiatives, including those relevant to subgroup disparities such as gender effects (Makowska-Tłumak et al., 18 Oct 2025).