Cerebras Systems makes GPT-3 models open-source to counter AI monopolies held by large corporations.
The company has released seven GPT-3 models, with model training data, weights and checkpoints available under an Apache 2.0 license.
Cerebras Systems: A company that designs hardware and software systems for AI applications.
GPT-3: Generative Pre-trained Transformer 3, a large language model developed by OpenAI.
Apache 2.0 license: A permissive software license that allows free use, modification, and distribution of the software.
CS-2: A hardware system designed by Cerebras Systems for running AI applications.
The Pile: An 825 GB collection of 22 datasets curated by EleutherAI for research purposes.