Derivative Work Status of Large Language Models
Determine whether large language models trained on text datasets constitute derivative works of their training data and clarify the applicable legislation and case law governing this classification, as this determination directly impacts the permissibility of using various Creative Commons–licensed materials for model pre-training.
References
The discussion on whether LLMs should constitute a derivative work (a transformed version) of their training dataset is yet unresolved and legislation and case law is currently unclear.
Whether any of these constitutes a “derivative” is actually unsettled, Creative Commons licenses were written for creative works rather than model weights, and no court has drawn the line.
The Alpaca terms are a licence on a dataset; we do not consider a model trained on a dataset to be a copy or adaptation of it, though that is a position, not a settled legal question.