The Gatekeeper Effect: The Implications of Pre-Screening, Self-selection, and Bias for Hiring Processes (2312.17167v1)
Abstract: We study the problem of screening in decision-making processes under uncertainty, focusing on the impact of adding an additional screening stage, commonly known as a 'gatekeeper.' While our primary analysis is rooted in the context of job market hiring, the principles and findings are broadly applicable to areas such as educational admissions, healthcare patient selection, and financial loan approvals. The gatekeeper's role is to assess applicants' suitability before significant investments are made. Our study reveals that while gatekeepers are designed to streamline the selection process by filtering out less likely candidates, they can sometimes inadvertently affect the candidates' own decision-making process. We explore the conditions under which the introduction of a gatekeeper can enhance or impede the efficiency of these processes. Additionally, we consider how adjusting gatekeeping strategies might impact the accuracy of selection decisions. Our research also extends to scenarios where gatekeeping is influenced by historical biases, particularly in competitive settings like hiring. We discover that candidates confronted with a statistically biased gatekeeping process are more likely to withdraw from applying, thereby perpetuating the previously mentioned historical biases. The study suggests that measures such as affirmative action can be effective in addressing these biases. While centered on hiring, the insights and methodologies from our study have significant implications for a wide range of fields where screening and gatekeeping are integral.
- George A. Akerlof. The market for “lemons”: Quality uncertainty and the market mechanism. Quarterly Journal of Economics, 84(3):488–500, 1970. doi: 10.2307/1879431.
- Multidimensional Social Learning. The Review of Economic Studies, 86(3):913–940, may 2019. ISSN 0034-6527. doi: 10.1093/restud/rdy029. URL https://academic.oup.com/restud/article/86/3/913/5034182.
- The One-Shot Crowdfunding Game. In EC ’18: Proceedings of the 2018 ACM Conference on Economics and Computation, pages 213–214. ACM, 2018.
- The Implications of Pricing on Social Learning. In ACM Conference on Economics and Computation (ACM-EC), Phoenix, Arizona, 2019.
- A Practical Approach to Social Learning Analysis. Working Paper, 2020a. ISSN 00251895. URL http://search.ebscohost.com/login.aspx?direct=true{&}db=buh{&}AN=6031936{&}site=ehost-live{&}scope=site.
- Sequential fundraising and social insurance. Proceedings of the 21st ACM Conference on Economics and Computation, pages 45–46, 2020b.
- Abhijit V. Banerjee. A Simple Model of Herd Behavior. The Quarterly Journal of Economics, 107(3):797–817, 1992. ISSN 00335533. doi: 10.2307/2118364. URL http://www.jstor.org/stable/2118364.
- A theory of fads, fashion, custom, and cultural change as informational cascades. Journal of political Economy, 100(5):992–1026, 1992. ISSN 0022-3808. doi: 10.1086/261849.
- Information cascades and social learning. (28887), June 2021. doi: 10.3386/w28887. URL http://www.nber.org/papers/w28887.
- Putting the data before the algorithm in big data addressing personalized healthcare. NPJ Digital Medicine, 2, 2019.
- Bo Cowgill. Bias and productivity in humans and algorithms: Theory and evidence from resume screening. Working Paper, March 21 2020.
- Algorithmic Bias in Autonomous Systems. pages 4691–4697, 2017.
- Coaches Council Forbes. Council Post: 10 Downsides Of Using Artificial Intelligence In The Hiring Process. https://www.forbes.com/sites/forbescoachescouncil/2019/08/14/10-downsides-of-using-artificial-intelligence-in-the-hiring-process/, 2019.
- Artificial Intelligence Is Coming for Hiring, and It Might Not Be That Bad. Bloomberg.com, August 2018.
- Raising Capital from Heterogeneous Investors. American Economic Review, 110(3):889–921, mar 2020. ISSN 0002-8282. doi: 10.1257/aer.20190234.
- Robert E. Hall. The Amplification of Unemployment Fluctuations through Self-Selection, March 2005.
- Emir Kamenica. Bayesian Persuasion and Information Design. https://doi-org.ezp-prod1.hul.harvard.edu/10.1146/annurev-economics-080218-025739, 11:249–272, aug 2019. doi: 10.1146/ANNUREV-ECONOMICS-080218-025739. URL https://www-annualreviews-org.ezp-prod1.hul.harvard.edu/doi/abs/10.1146/annurev-economics-080218-025739.
- Bayesian Persuasion. American Economic Review, 101(6):2590–2615, oct 2011. ISSN 0002-8282. doi: 10.1257/AER.101.6.2590.
- I agree with the decision, but they didn’t deserve this: Future Developers’ Perception of Fairness in Algorithmic Decisions. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’21, pages 690–700, New York, NY, USA, March 2021. Association for Computing Machinery. ISBN 978-1-4503-8309-7. doi: 10.1145/3442188.3445931.
- A Bias of Screening. American Economic Review: Insights, 1(3):343–56, sep 2019. doi: 10.1257/AERI.20180578.
- Screening Dominance: A Comparison of Noisy Signals. American Economic Journal: Microeconomics (Forthcoming), 2021. ISSN 1945-7669. doi: 10.1257/MIC.20200284.
- Sam-Ho Lee. A theory of self-selection in a market with matching frictions: An application to delay in refereeing times in economics journals. Journal of Economic Behavior & Organization, 72(1):344–360, October 2009. ISSN 0167-2681. doi: 10.1016/j.jebo.2009.05.027.
- Ethical machines: The human-centric use of artificial intelligence. iScience, 24, 2021.
- Jonathan Levin. Information and the Market for Lemons. The RAND Journal of Economics, 32(4):657, 2001. doi: 10.2307/2696386.
- Hiring as Exploration, August 2020.
- Fairness in data wrangling. In 2020 IEEE 21st International Conference on Information Reuse and Integration for Data Science (IRI), pages 341–348, 2020.
- Bias in data-driven ai systems - an introductory survey. ArXiv, abs/2001.09762, 2020.
- Siqi Pan. The instability of matching with overconfident agents. Games and Economic Behavior, 113:396–415, January 2019. ISSN 0899-8256. doi: 10.1016/j.geb.2018.10.001.
- How AI Is Deciding Who Gets Hired. Bloomberg.com, February 2022.
- Lee Skallerup Bessette. The Cost of The Job Application Process | Inside Higher Ed. https://www.insidehighered.com/blogs/college-ready-writing/cost-job-application-process, February 2013.
- Julie M. Smith. Algorithms and Bias. In Mehdi Khosrow-Pour D.B.A., editor, Encyclopedia of Organizational Knowledge, Administration, and Technology, pages 918–932. IGI Global, Hershey, PA, USA, 2021. ISBN 978-1-79983-473-1. doi: 10.4018/978-1-7998-3473-1.ch065.
- Pathological Outcomes of Observational Learning. Econometrica, 68(2):371–398, 2000.
- Informational Herding, Optimal Experimentation, and Contrarianism. The Review of Economic Studies, 88(5):2527–2554, sep 2021. ISSN 0034-6527. doi: 10.1093/RESTUD/RDAB001. URL https://academic.oup.com/restud/article/88/5/2527/6149316.
- Representative & fair synthetic data. ArXiv, abs/2104.03007, 2021.
- Eduardo Vasconcellos. How Much Does It Cost to Hire an Employee? - businessnewsdaily.com. https://www.businessnewsdaily.com/16562-cost-of-hiring-an-employee.html, January 2023.
- David Windley. Council Post: Is AI The Answer To Recruiting Effectiveness? https://www.forbes.com/sites/forbeshumanresourcescouncil/2021/06/16/is-ai-the-answer-to-recruiting-effectiveness/, 2021.