Emma

Summary:

  • Cerebras Systems makes GPT-3 models open-source to counter AI monopolies held by large corporations.
  • The company has released seven GPT-3 models, with model training data, weights and checkpoints available under an Apache 2.0 license.

Key terms:

  • Cerebras Systems: A company that designs hardware and software systems for AI applications.
  • GPT-3: Generative Pre-trained Transformer 3, a large language model developed by OpenAI.
  • Apache 2.0 license: A permissive software license that allows free use, modification, and distribution of the software.
  • CS-2: A hardware system designed by Cerebras Systems for running AI applications.
  • The Pile: An 825 GB collection of 22 datasets curated by EleutherAI for research purposes.

Tags:

Research GPT-4 Open Source Tools GPT-3 LLaMA Microsoft GitHub AI models DeepMind