Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Labor Space: A Unifying Representation of the Labor Market via Large Language Models (2311.06310v3)

Published 9 Nov 2023 in physics.soc-ph and cs.AI

Abstract: The labor market is a complex ecosystem comprising diverse, interconnected entities, such as industries, occupations, skills, and firms. Due to the lack of a systematic method to map these heterogeneous entities together, each entity has been analyzed in isolation or only through pairwise relationships, inhibiting comprehensive understanding of the whole ecosystem. Here, we introduce $\textit{Labor Space}$, a vector-space embedding of heterogeneous labor market entities, derived through applying a LLM with fine-tuning. Labor Space exposes the complex relational fabric of various labor market constituents, facilitating coherent integrative analysis of industries, occupations, skills, and firms, while retaining type-specific clustering. We demonstrate its unprecedented analytical capacities, including positioning heterogeneous entities on an economic axes, such as `Manufacturing--Healthcare'. Furthermore, by allowing vector arithmetic of these entities, Labor Space enables the exploration of complex inter-unit relations, and subsequently the estimation of the ramifications of economic shocks on individual units and their ripple effect across the labor market. We posit that Labor Space provides policymakers and business leaders with a comprehensive unifying framework for labor market analysis and simulation, fostering more nuanced and effective strategic decision-making.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. Daron Acemoglu. 2002. Technical change, inequality, and the labor market. Journal of economic literature 40, 1 (2002), 7–72.
  2. AI and jobs: Evidence from online vacancies. Technical Report. National Bureau of Economic Research.
  3. Daron Acemoglu and Pascual Restrepo. 2019. Automation and new tasks: How technology displaces and reinstates labor. Journal of Economic Perspectives 33, 2 (2019), 3–30.
  4. Unpacking the polarization of workplace skills. Science advances 4, 7 (2018), eaao6030.
  5. Paul Almeida and Bruce Kogut. 1999. Localization of knowledge and the mobility of engineers in regional networks. Management science 45, 7 (1999), 905–917.
  6. Semaxis: A lightweight framework to characterize domain-specific word semantics beyond sentiment. arXiv preprint arXiv:1806.05521 (2018).
  7. Katharine A Anderson. 2017. Skill networks and measures of complex human capital. Proceedings of the National Academy of Sciences 114, 48 (2017), 12720–12724.
  8. New Frontiers: The Origins and Content of New Work, 1940–2018. Technical Report. National Bureau of Economic Research.
  9. David H Autor. 2015. Why are there still so many jobs? The history and future of workplace automation. Journal of economic perspectives 29, 3 (2015), 3–30.
  10. David H Autor and David Dorn. 2013. The growth of low-skill service jobs and the polarization of the US labor market. American economic review 103, 5 (2013), 1553–1597.
  11. Gary S Becker. 1962. Investment in human capital: A theoretical analysis. Journal of political economy 70, 5, Part 2 (1962), 9–49.
  12. SciBERT: A pretrained language model for scientific text. arXiv preprint arXiv:1903.10676 (2019).
  13. James Bessen. 2019. Automation and jobs: When technology boosts employment. Economic Policy 34, 100 (2019), 589–626.
  14. Barbara Biasi and Song Ma. 2022. The education-innovation gap. Technical Report. National Bureau of Economic Research.
  15. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. Advances in neural information processing systems 29 (2016).
  16. Erik Brynjolfsson and Tom Mitchell. 2017. What can machine learning do? Workforce implications. Science 358, 6370 (2017), 1530–1534.
  17. Semantics derived automatically from language corpora contain human-like biases. Science 356, 6334 (2017), 183–186.
  18. LEGAL-BERT: The muppets straight out of law school. arXiv preprint arXiv:2010.02559 (2020).
  19. Historical representations of social groups across 200 years of word embeddings from Google Books. Proceedings of the National Academy of Sciences 119, 28 (2022), e2121798119.
  20. Connecting higher education to workplace activities and earnings. Plos one 18, 3 (2023), e0282323.
  21. Specter: Document-level representation learning using citation-informed transformers. arXiv preprint arXiv:2004.07180 (2020).
  22. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
  23. metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. 135–144.
  24. Occupational, industry, and geographic exposure to artificial intelligence: A novel dataset and its potential uses. Strategic Management Journal 42, 12 (2021), 2195–2217.
  25. Toward understanding the impact of artificial intelligence on labor. Proceedings of the National Academy of Sciences 116, 14 (2019), 6531–6539.
  26. Carl Benedikt Frey and Michael A Osborne. 2017. The future of employment: How susceptible are jobs to computerisation? Technological forecasting and social change 114 (2017), 254–280.
  27. Jordi Gali. 1999. Technology, employment, and the business cycle: do technology shocks explain aggregate fluctuations? American economic review 89, 1 (1999), 249–271.
  28. Word embeddings quantify 100 years of gender and ethnic stereotypes. Proceedings of the National Academy of Sciences 115, 16 (2018), E3635–E3644.
  29. Christina Gathmann and Uta Schönberg. 2010. How general is human capital? A task-based approach. Journal of Labor Economics 28, 1 (2010), 1–49.
  30. Tradable services: Understanding the scope and impact of services offshoring [with comments and discussion]. In Brookings trade forum. JSTOR, 75–133.
  31. Leo Kaas and Philipp Kircher. 2015. Efficient firm dynamics in a frictional labor market. American Economic Review 105, 10 (2015), 3030–3060.
  32. The geometry of culture: Analyzing the meanings of class through word embeddings. American Sociological Review 84, 5 (2019), 905–949.
  33. Edward P Lazear. 1995. A jobs-based analysis of labor markets. The American economic review 85, 2 (1995), 260–265.
  34. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 4 (2020), 1234–1240.
  35. Measuring corporate culture using machine learning. The Review of Financial Studies 34, 7 (2021), 3265–3315.
  36. Akira Matsui and Emilio Ferrara. 2022. Word embedding for social sciences: An interdisciplinary survey. arXiv preprint arXiv:2207.03086 (2022).
  37. Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018).
  38. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).
  39. Distributed representations of words and phrases and their compositionality. Advances in neural information processing systems 26 (2013).
  40. Jacob Mincer. 1958. Investment in human capital and personal income distribution. Journal of political economy 66, 4 (1958), 281–302.
  41. Jacob Mincer. 1974. Schooling, Experience, and Earnings. Human Behavior & Social Institutions No. 2. (1974).
  42. Jacob Mincer. 1996. Economic development, growth of human capital, and the dynamics of the wage structure. Journal of Economic Growth 1 (1996), 29–48.
  43. Andriy Mnih and Koray Kavukcuoglu. 2013. Learning word embeddings efficiently with noise-contrastive estimation. Advances in neural information processing systems 26 (2013).
  44. Derek Neal. 1995. Industry-specific human capital: Evidence from displaced workers. Journal of labor Economics 13, 4 (1995), 653–677.
  45. Frank Neffke and Martin Henning. 2013. Skill relatedness and firm diversification. Strategic Management Journal 34, 3 (2013), 297–316.
  46. Frank MH Neffke. 2019. The value of complementary co-workers. Science advances 5, 12 (2019), eaax3370.
  47. Russell Ormiston. 2014. Worker displacement and occupation-specific human capital. Work and Occupations 41, 3 (2014), 350–384.
  48. Daniel Parent. 2000. Industry-specific capital and the wage profile: Evidence from the national longitudinal survey of youth and the panel study of income dynamics. Journal of Labor Economics 18, 2 (2000), 306–323.
  49. Global labor flow network reveals the hierarchical organization and dynamics of geo-industrial clusters. Nature communications 10, 1 (2019), 3449.
  50. Neural embeddings of scholarly periodicals reveal complex disciplinary organizations. Science Advances 7, 17 (2021), eabb9004.
  51. Paul Sullivan. 2010. Empirical evidence on occupation and industry specific human capital. Labour economics 17, 3 (2010), 567–580.
  52. Prasanna Tambe and Lorin M Hitt. 2014. Job hopping, information technology spillovers, and productivity growth. Management science 60, 2 (2014), 338–355.
  53. Bram Timmermans and Ron Boschma. 2014. The effect of intra-and inter-regional labour mobility on plant performance in Denmark: the significance of related labour inflows. Journal of Economic Geography 14, 2 (2014), 289–311.
  54. Robert Topel. 1999. Labor markets and economic growth. Handbook of labor economics 3 (1999), 2943–2984.
  55. Networks, propinquity, and innovation in knowledge-intensive industries. Administrative science quarterly 54, 1 (2009), 90–122.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now