Papers
Topics
Authors
Recent
Search
2000 character limit reached

Divide-and-Conquer Dynamics in AI-Driven Disempowerment

Published 9 Oct 2023 in cs.CY, cs.AI, and cs.LG | (2310.06009v2)

Abstract: AI companies are attempting to create AI systems that outperform humans at most economically valuable work. Current AI models are already automating away the livelihoods of some artists, actors, and writers. But there is infighting between those who prioritize current harms and future harms. We construct a game-theoretic model of conflict to study the causes and consequences of this disunity. Our model also helps explain why throughout history, stakeholders sharing a common threat have found it advantageous to unite against it, and why the common threat has in turn found it advantageous to divide and conquer. Under realistic parameter assumptions, our model makes several predictions that find preliminary corroboration in the historical-empirical record. First, current victims of AI-driven disempowerment need the future victims to realize that their interests are also under serious and imminent threat, so that future victims are incentivized to support current victims in solidarity. Second, the movement against AI-driven disempowerment can become more united, and thereby more likely to prevail, if members believe that their efforts will be successful as opposed to futile. Finally, the movement can better unite and prevail if its members are less myopic. Myopic members prioritize their future well-being less than their present well-being, and are thus disinclined to solidarily support current victims today at personal cost, even if this is necessary to counter the shared threat of AI-driven disempowerment.

Authors (2)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (65)
  1. Alberta Machine Intelligence Institute “John Carmack and Rich Sutton partner to accelerate development of Artificial General Intelligence” Globe News Wire, 2023 URL: https://www.globenewswire.com/news-release/2023/09/25/2749057/0/en/John-Carmack-and-Rich-Sutton-partner-to-accelerate-development-of-Artificial-General-Intelligence.html
  2. “Actors strike ends: SAG-AFTRA leadership OKs tentative deal with major Hollywood studios”, USA TODAY, 2023 URL: https://www.usatoday.com/story/entertainment/tv/2023/11/08/sag-aftra-strike-ends-with-tentative-deal-studios/71050537007/
  3. Dario Amodei “Dario Amodei, C.E.O. of Anthropic, on the paradoxes of A.I. safety and Netflix’s ’Deep Fake Love’ [Interview]” Hosted and interviewed by Kevin Roose and Casey Newton, Produced by Davis Land and Rachel Cohn, Edited by Jen Poyant, Engineered by Alyssa Moxley, Original music by Dan Powell, Elisheba Ittoop, Marion Lozano and Rowan Niemisto The New York Times, 2023 URL: https://www.nytimes.com/2023/07/21/podcasts/dario-amodei-ceo-of-anthropic-on-the-paradoxes-of-ai-safety-and-netflixs-deep-fake-love.html
  4. Justine Bateman “Justine Bateman on the destruction of the film business” Daily Beast, 2023 URL: https://www.thedailybeast.com/hollywood-ceos-greed-will-burn-the-movie-biz-down
  5. Suzanne Bearne “New AI systems collide with copyright law” BBC News, 2023 URL: https://www.bbc.com/news/business-66231268
  6. Keep America Beautiful “About Keep America Beautiful” Keep America Beautiful, 2023 URL: https://kab.org/about-keep-america-beautiful/
  7. Sharon Beder and Beder “Global spin: The corporate assault on environmentalism” Green Books Totnes, 2002
  8. Emily Bender “Mystery AI Hype Theater 3000 Ep. 4 - Is AI Art Actually Art?” Screenshot of tweet was highlighted for emphasis in Figure 1., 2022 URL: https://twitter.com/emilymbender/status/1589632880833355778
  9. “Mystery AI Hype Theater 3000. Episode 4: Is AI Art Actually ’Art’? [Podcast]” The Distributed AI Research Institute, 2022 URL: https://peertube.dair-institute.org/w/7La1qsDxFZNRV67RQ1M3P3
  10. “Fast and local: How lockdown policies affect the spread and severity of COVID-19” In COVID Economics 23, 2020, pp. 325–351
  11. Rob Bonta “Plastics” State of California Department of Justice, 2023 URL: https://oag.ca.gov/plastics
  12. Erik Brynjolfsson “The Turing Trap: The promise & peril of human-like artificial intelligence” In Daedalus 151.2, 2022, pp. 272–287
  13. David Cave “Operation COMPASS: The Australian Army’s first experience of manoeuvre warfare in World War 2” In Australian Defence Force Journal Kensington Park, SA: Australian Defence Force Journal, 2017, pp. 57–66
  14. Alex J. Champandard “I’m looking for lawyer with experience in filing DCMA claims, specifically with regards to tools that "circumvent technological protection measures […] that control access to copyrighted works." [Tweet]” X, 2023 URL: https://twitter.com/alexjc/status/1686700109445177344
  15. Devin Coldewey “Ethicists fire back at ‘AI Pause’ letter they say ‘ignores the actual harms”’ TechCrunch, 2023 URL: https://techcrunch.com/2023/03/31/ethicists-fire-back-at-ai-pause-letter-they-say-ignores-the-actual-harms/
  16. Adriana S. Cordis and Elizabeth M. Lambert “Whistleblower laws and corporate fraud: Evidence from the United States” In Accounting Forum 41.4, 2017, pp. 289–299 DOI: https://doi.org/10.1016/j.accfor.2017.10.003
  17. Chip Cutter “The $900,000 AI Job Is Here” Wall Street Journal, 2023 URL: https://www.wsj.com/articles/artificial-intelligence-jobs-pay-netflix-walmart
  18. Andrew Deck “AI-generated art sparks furious backlash from Japan’s anime community” Rest of World, 2022 URL: https://restofworld.org/2022/ai-backlash-anime-artists/
  19. Clem Delangue “We will very likely cross 1,000,000 AI repositories (models, datasets, spaces) on Hugging Face by the end of this summer [LinkedIn post]” LinkedIn, 2023 URL: https://www.linkedin.com/posts/clementdelangue_we-will-very-likely-cross-1000000-ai-repositories-activity-7080475269995606017-gZ1v/
  20. Norman L. Durham “The command and control of the Grand Armée: Napoleon as organizational designer” Wagram Press, 2015 URL: https://books.google.com/books?id=2D5wCwAAQBAJ
  21. Environmental Protection Agency “Plastics: Material-specific data” Quotes are second-hand and originally from “a report written in April 1973 by scientists tasked with forecasting possible issues for top industry executives,” obtained from Syracuse University., 2023 URL: https://www.epa.gov/facts-and-figures-about-materials-waste-and-recycling/plastics-material-specific-data
  22. Edward J. Erickson “Defeat in detail: The Ottoman Army in the Balkans, 1912-1913”, ABC-Clio ebook Bloomsbury Academic, 2003 URL: https://books.google.com/books?id=0kIU3-xnmBkC
  23. Sheera Frenkel and Stuart A. Thompson “‘Not for machines to harvest’: data revolts break out against A.I.” The New York Times, 2023 URL: https://www.nytimes.com/2023/07/15/technology/artificial-intelligence-models-chat-data.html
  24. “Introductory probability” LibreTexts, 2022 URL: https://stats.libretexts.org/Bookshelves/Probability_Theory/Book%3A_Introductory_Probability_(Grinstead_and_Snell)
  25. Demis Hassabis “DeepMind expands to Canada with new research office in Edmonton, Alberta” Google DeepMind, 2023 URL: https://www.deepmind.com/blog/deepmind-expands-to-canada-with-new-research-office-in-edmonton-alberta
  26. Jordan R. Hayworth “The French way of war” In Napoleon and the Operational Art of War: Essays in Honor of Donald D. Horward Leiden, The Netherlands: Brill, 2020, pp. 39–86 DOI: https://doi.org/10.1163/9789004438408_004
  27. DM Hemlock “I’m currently divided, as many artists I respect are on diff sides in this, some feeling it is important to oppose, others feeling it is overblown and that things will be fine. [Tweet]” Screenshot of tweet was highlighted for emphasis in Figure 1. X, 2022 URL: https://twitter.com/Rainonthe_River/status/1603134489798283264
  28. “Training compute-optimal large language models”, 2022 arXiv:2203.15556 [cs.CL]
  29. Walter Isaacson “Inside Elon Musk’s struggle for the future of AI” Time, 2023 URL: https://time.com/6310076/elon-musk-ai-walter-isaacson-biography/
  30. Aki Ito “The AI Heretic” In Business Insider, 2023 URL: https://www.businessinsider.com/ai-chatgpt-replace-jobs-unemployment-salaries-technology-economist-daron-acemoglu-2023-9
  31. Aaron James “Planning for mass unemployment: Precautionary basic income” In Ethics of artificial intelligence Oxford University Press, 2020 DOI: 10.1093/oso/9780190905033.003.0007
  32. “AI art and its impact on artists” In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, AIES ’23 Montréal, QC, Canada: Association for Computing Machinery, 2023, pp. 363–374 DOI: 10.1145/3600211.3604681
  33. Brian Joseph “Legislature considers bills to regulate AI decision-making” Capitol Weekly, 2023 URL: https://capitolweekly.net/legislature-considers-bills-to-regulate-ai-decision-making/
  34. Samantha Murphy Kelly “TV and film writers are fighting to save their jobs from AI. They won’t be the last” CNN, 2023 URL: https://edition.cnn.com/2023/05/04/tech/writers-strike-ai/index.html
  35. Kelly Lawler “SAG-AFTRA is worried about AI, but can it really replace actors? It already has” USA Today, 2023 URL: https://www.usatoday.com/story/entertainment/tv/2023/08/01/ai-and-hollywood-strikes-what-the-real-threat-is-to-actors-writers/70436618007/
  36. Yann LeCun “A civilian casualty of the anti-AI crusade [Tweet]” X, 2023 URL: https://twitter.com/ylecun/status/1689188498329227266
  37. Yann LeCun “Once AI systems become more intelligent than humans, humans we will *still* be the "apex species." [Tweet]” X, 2023 URL: https://twitter.com/ylecun/status/1695056787408400778
  38. Yann LeCun “World models, intuitive physics, planning, problem solving, discrete search for solutions, continuous optimization of control parameters… [LinkedIn post]” LinkedIn, 2023 URL: https://www.linkedin.com/posts/yann-lecun_smart-dog-helps-his-human-move-tires-and-activity-6878480285898436608-15r9/
  39. Levels.fyi “OpenAI software engineer salaries” Levels.fyi, 2023 URL: https://www.levels.fyi/companies/openai/salaries/software-engineer
  40. Jane L. Levere “After the ‘crying Indian,’ Keep America Beautiful starts a new campaign [Photo]” The New York Times, 2013 URL: https://www.nytimes.com/2013/07/17/business/media/decades-after-a-memorable-campaign-keep-america-beautiful-returns.html
  41. Katie Mather “What was Prosecraft? Platform creator gets pressure from Book Twitter to shut it down” In The Know, 2023 URL: https://www.intheknow.com/post/prosecraft-benji-smith/
  42. Chris Metinko “AI funding explosion: Inflection AI nabs $1.3B, runway and typeface also raise big” Crunchbase News, 2023 URL: https://news.crunchbase.com/ai-robotics/funding-explosion-venture-generative-ai-unicorn/
  43. Jr. Nash “Equilibrium points in n-person games” In Proceedings of the National Academy of Sciences 36.1 National Academy of Sciences, 1950, pp. 48–49
  44. Evgeny Obedkov “Game illustrator jobs in China down 70% due to rapid AI adoption” Game World Observer, 2023 URL: https://gameworldobserver.com/2023/04/12/game-artist-jobs-china-down-70-percent-gen-ai-adoption
  45. OpenAI “OpenAI charter” OpenAI, 2018 URL: https://openai.com/charter
  46. Nick St. Pierre “Midjourney [Tweet and photos]” X, 2023 URL: https://twitter.com/nickfloats/status/1676279157620199424
  47. Ian Stanley Ord Playfair “The Mediterranean and Middle East: The early successes against Italy (to May 1941)”, History of the Second World War Naval & Military Press, 2004
  48. Katyanna Quach “Judge lets art trio take another crack at suing AI devs over copyright” The Register, 2023 URL: https://www.theregister.com/2023/07/21/judge_ai_art/
  49. Rumtin Sepasspour “A reality check and a way forward for the global governance of artificial intelligence” In Bulletin of the Atomic Scientists 79.5 Taylor & Francis, 2023, pp. 304–315
  50. Martin Shkreli “F*** AI safety [Tweet and video]” X, 2023 URL: https://twitter.com/wagieeacc/status/1672629808759463937
  51. Valkyrie Spooky Witch “It is wild that Artists was the first thing that AI will end up replacing [Tweet]” Screenshot of tweet was highlighted for emphasis in Figure 1. X, 2023 URL: https://twitter.com/CreamLunar/status/1619603601114144768
  52. AllTechAsia Staff “Baidu’s Chief Scientist: Worrying about AI today is like worrying about overpopulation on Mars” AllTechAsia, 2016 URL: https://alltechasia.com/2016/03/01/baidus-chief-scientist-worrying-ai-today-like-worrying-overpopulation-mars/
  53. Jonathan Stempel “Martin Shkreli: I’m not in contempt over drug industry ban” Reuters, 2023 URL: https://www.reuters.com/business/martin-shkreli-im-not-contempt-over-drug-industry-ban-2023-02-10/
  54. Laura Sullivan “How Big Oil misled the public into believing plastic would be recycled” NPR, 2020 URL: https://www.npr.org/2020/09/11/897692090/how-big-oil-misled-the-public-into-believing-plastic-would-be-recycled
  55. Rich Sutton “AI succession [Youtube video of talk]” World Artificial Intelligence Conference in Shanghai, 2023 URL: https://www.youtube.com/watch?v=NgHFMolXs3U
  56. Jinzhe Tan, Hannes Westermann and Karim Benyekhlef “ChatGPT as an artificial lawyer” In Artificial Intelligence for Access to Justice (AI4AJ 2023), 2023
  57. Dana Taylor “Hollywood on strike: The future of AI in the entertainment industry: 5 Things podcast” USA Today, 2023 URL: https://www.usatoday.com/story/news/nation/2023/07/09/hollywood-on-strike-the-future-of-ai-in-the-entertainment-industry/70394275007/
  58. Vanessa Thorpe “‘ChatGPT said I did not exist’: how artists and writers are fighting back against AI” The Guardian, 2023 URL: https://www.theguardian.com/technology/2023/mar/18/chatgpt-said-i-did-not-exist-how-artists-and-writers-are-fighting-back-against-ai
  59. James Titcomb “‘A relationship with another human is overrated’ – inside the rise of AI girlfriends” The Telegraph, 2023 URL: https://www.telegraph.co.uk/business/2023/07/16/ai-girlfriend-replika-caryn-apps-relationship-health/
  60. “Marketing, recycling, and climate change: An opportunity” In Sustainability and Climate Change 14.1 Mary Ann Liebert, Inc., publishers 140 Huguenot Street, 3rd Floor New …, 2021, pp. 60–66 DOI: https://doi.org/10.1089/scc.2020.0064
  61. James Vincent “AI art tools Stable Diffusion and Midjourney targeted with copyright lawsuit” The Verge, 2023 URL: https://www.theverge.com/2023/1/16/23557098/generative-ai-art-copyright-legal-lawsuit-stable-diffusion-midjourney-deviantart
  62. Gerrit De Vynck “The man who unleashed AI on an unsuspecting Silicon Valley” In The Washington Post, 2023 URL: https://www.washingtonpost.com/technology/2023/04/09/sam-altman-openai-chatgpt/
  63. “The Hollywood writers’ strike is over — and they won big” Vox, 2023 URL: https://www.vox.com/culture/2023/9/24/23888673/wga-strike-end-sag-aftra-contract
  64. Matteo Wong “Artists are losing the war against AI” The Atlantic, 2023 URL: https://www.theatlantic.com/technology/archive/2023/10/openai-dall-e-3-artists-work/675519/
  65. Mark Zuckerberg “Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp [Youtube video of interview by Lex Fridman]”, Lex Fridman Podcast, 2023 URL: https://www.youtube.com/watch?v=Ff4fRgnuFgQ

Summary

  • The paper's main contribution is a game-theoretic model that quantifies win probabilities using a generalized gambler's ruin framework.
  • It demonstrates that complete unity within the pro-human movement (m=1) significantly increases the likelihood of overcoming AI-driven replacement.
  • The study highlights the importance of coordinated legal, political, and social strategies to counteract divisive tactics in AI disempowerment.

Divide-and-Conquer Dynamics in AI-Driven Disempowerment: A Game-Theoretic Approach

The paper "Divide-and-Conquer Dynamics in AI-Driven Disempowerment," authored by Peter S. Park and Max Tegmark, presents a comprehensive game-theoretic model to analyze the conflicts arising from AI-induced disempowerment. Specifically, the study aims to elucidate the causes and consequences of disunity among those affected by AI-driven automation and suggests strategic insights for resistance movements confronting this technological shift.

Overview

The authors focus on the conflicts between two major groups: proponents of human roles augmented by AI (Movement 1, also termed the pro-human movement) and those advocating for unrestricted AI deployment aimed at replacing human roles (Movement 2, the AI replacement movement). By constructing a generalized gambler's ruin model, the study positions these movements within a dynamic system of conflict, exploring the probability of either group's victory based on several parameters, including unity, relative strength, randomness, and perceived threat levels.

Theoretical Model

The paper delineates its model by segmenting it into two main parts: the dynastic system and the game-theoretic analysis:

  1. Dynamical Systems Approach: Using parameters such as the degree of unity (quantified by the number of parts mm for Movement 1 and nn for Movement 2) and the relative strength ss, the model calculates the win probability of each movement. A robust finding is that for sufficiently large ss, complete unity (i.e., m=1m=1) provides the highest probability of victory for Movement 1.
  2. Game-Theoretic Analysis: The analysis evaluates the conditions under which members of Movement 1, driven by varying perceptions of AI threat (s^\hat{s}), costs of unity (cc), and benefits (bb), choose to unite or defect. The model predicts potential strategic pitfalls: myopia, naivety, collaborationism, defeatism, and complacency, all of which undermine unified action against AI encroachment.

Empirical Implications

The study extends its theoretical findings to historical examples of military and corporate divide-and-conquer dynamics, critically examining AI industry leaders' statements that may promote such fragmentation among the opposition. Historical records of military strategy (e.g., Napoleon's campaigns) and corporate influence tactics (e.g., marketing of plastics) corroborate the model’s predictions. Furthermore, the paper suggests that leaders in the AI industry frequently make pronouncements that, intentionally or not, could amplify divisions within the pro-human movement.

Future Directions and Practical Considerations

On a practical level, the paper suggests that stakeholders combine efforts across various domains: legal (through strategic copyright lawsuits), political (advocating for AI regulation), and social (public awareness campaigns). A critical observation is the necessity for timely and cohesive action, as delay may favor the faster-moving AI deployment by corporations ("a race to get most people hooked on AI").

The authors call for strategic unity among differing stakeholders within the pro-human movement to enhance their collective efficacy, suggesting that synergistic cooperation can catalyze success in ongoing negotiations, legal challenges, and advocacy movements.

Conclusion

Overall, this research importantly highlights the impending socio-economic transformations driven by AI and offers a rigorous clarification of the dynamics at play between different human groups under technological transition pressure. The game-theoretic framework adopted serves as a valuable tool for anticipating reactions within these movements and fostering successful cooperation that might effectively counteract AI-driven disempowerment. Such insights could guide future strategic planning and policy formulation in AI ethics and regulation.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 9 tweets with 8 likes about this paper.

HackerNews