Racial Bias Trends in the Text of US Legal Opinions
Abstract: Although there is widespread recognition of racial bias in US law, it is unclear how such bias appears in the language of law, namely judicial opinions, and whether it varies across time period or region. Building upon approaches for measuring implicit racial bias in large-scale corpora, we approximate GloVe word embeddings for over 6 million US federal and state court cases from 1860 to 2009. We find strong evidence of racial bias across nearly all regions and time periods, as traditionally Black names are more closely associated with pre-classified "unpleasant" terms whereas traditionally White names are more closely associated with pre-classified "pleasant" terms. We also test whether legal opinions before 1950 exhibit more implicit racial bias than those after 1950, as well as whether opinions from Southern states exhibit less change in racial bias than those from Northeastern states. We do not find evidence of elevated bias in legal opinions before 1950, or evidence that legal opinions from Northeastern states show greater change in racial bias over time compared to Southern states. These results motivate further research into institutionalized racial bias.
- Tampa International Airport. 2020. Us census regions.
- Marianne Bertrand and Sendhil Mullainathan. 2004. Are emily and greg more employable than lakisha and jamal? a field experiment on labor market discrimination. American Economic Review, 94(4):991–1013.
- Daniel M. Butler and Jonathan Homola. 2017. An empirical justification for the use of racially distinctive names to signal race in experiments. Political Analysis, 25(1):122–130.
- Relating word embedding gender biases to gender gaps: A cross-cultural analysis. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 18–24, Florence, Italy. Association for Computational Linguistics.
- Measuring individual differences in implicit cognition: the implicit association test. Journal of personality and social psychology, 74 6:1464–80.
- Thomas G. Hansford and James F. Spriggs. 2006. The politics of precedent on the U.S. Supreme Court. Princeton University Press.
- Race in america 2019. Technical report, Pew Research Center.
- Semantics derived automatically from language corpora necessarily contain human biases. CoRR, abs/1608.07187.
- A lexicon-based approach for detecting hedges in informal text. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 3109–3113, Marseille, France. European Language Resources Association.
- Anne Lauscher and Goran Glavaš. 2019. Are we consistently biased? multidimensional analysis of biases in distributional word vectors. In Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019), pages 85–91, Minneapolis, Minnesota. Association for Computational Linguistics.
- Jeffrey R. Lax and Kelly T. Rader. 2010. Legal constraints on supreme court decision making: Do jurisprudential regimes exist? The Journal of Politics, 72:273 – 284.
- Guilty by implicit racial bias: The guilty/not guilty implicit association test. Ohio State Journal of Criminal Law, 8.
- Investigating sports commentator bias within a large corpus of American football broadcasts. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 6355–6361, Hong Kong, China. Association for Computational Linguistics.
- Quantitative analysis of culture using millions of digitized books. Science, 331(6014):176–182.
- Finn Årup Nielsen. 2011. A new anew: Evaluation of a word list for sentiment analysis in microblogs. In #MSM.
- GloVe: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1532–1543, Doha, Qatar. Association for Computational Linguistics.
- Racial bias in legal language. Research & Politics, 6(2):2053168019848930.
- Hidden in plain sight? implicit racial bias in the united states congress, 1967-2011. (unpublished).
- Douglas R. Rice and Christopher Zorn. 2021. Corpus-based dictionaries for sentiment analysis of specialized vocabularies. Political Science Research and Methods, 9(1):20–35.
- Emerson Tiller and Frank Cross. 2005. What is legal doctrine? Northwestern University Law Review, 100.
- Harvard University. 2018. Caselaw access project.
Paper Prompts
Sign up for free to create and run prompts on this paper.