---
title: LLM-Informed Prior Distributions
url: https://www.emergentmind.com/topics/llm-informed-prior-distributions
type: topic
---

# LLM-Informed Prior Distributions

LLM-Informed Prior Distributions are Bayesian priors whose specification or parameters are directly or indirectly derived from the outputs, domain knowledge, or metadata produced by large language models (LLMs). This paradigm enables incorporation of linguistic, expert, and contextual information into statistical models, especially in settings where classic expert elicitation is infeasible, where observational data alone are insufficiently informative, or where domain expertise is latent in large-scale textual corpora. LLM-informed priors can be constructed by querying LLMs with natural language prompts, by extracting predictive summaries, or by conditioning model parameters on contextual signals, thereby enabling inductive bias and enhancing sample efficiency in both classical and modern machine learning regimes.

## 1. Principles and Mathematical Formulation

The construction of LLM-informed prior distributions begins with explicitly formalizing how the LLM output relates to prior specification. In the general setting, suppose $\theta$ denotes the vector of model parameters and $y$ denotes observed or target data. An LLM can be used to generate relevant prior information in several modes:

- **Parametric elicitation:** Query the LLM (via prompt engineering) for point estimates or distributional summaries (mean, standard deviation, quantiles) for $\theta$ or for hyperparameters. These values are then used to define a prior, e.g., $\theta \sim \mathcal{N}(\mu_{LLM}, \sigma_{LLM}^2)$.
- **Prior for hyperparameters:** For hierarchical models, LLM-derived summaries specify hyperpriors. For instance, $\alpha \sim \text{Exponential}(\lambda_{LLM})$, where $\lambda_{LLM}$ is output by the LLM, typically via a prompt for expert-informed rate parameters [2509.04250].
- **Mixture-of-experts or mixture priors:** Multiple queries to the LLM (using paraphrased prompts) are used; the set of resulting estimates $\{(\mu_k, \sigma_k)\}_{k=1}^K$ are aggregated into a mixture prior:
  \[
  p_{LLM}(\theta) = \sum_{k=1}^K \pi_k \mathcal{N}(\theta | \mu_k, \sigma_k^2)
  \]
  where $\pi_k$ are mixture weights, frequently Dirichlet distributed [2411.17284].

In certain frameworks, LLM-informed priors are further contextualized into probabilistic models via transformative procedures (e.g., prior normalization [2202.00074], translation of predictive distributions [2303.08528]) or by direct linkage between language metadata and learning components (feature selection, reward shaping) [2210.12530].

## 2. Elicitation Procedures and Prompt Design

LLM-informed prior construction critically depends on prompt engineering and interaction design:

- **Direct numerical elicitation:** Prompts are crafted in natural language to ask the LLM for domain-relevant parameter values, ranges, or distributions. For hierarchical Bayesian models, LLMs are queried to provide rate parameters for hyperpriors (e.g., $\alpha$ and $\beta$ in a Gamma prior for Poisson or Negative Binomial modeling) [2509.04250]. Disease-informed or context-free prompts are possible, with outputs aggregated over different temperatures and prompt variants to ensure robustness.
- **Contextual prompting for structured domains:** Compositional zero-shot learning frameworks prompt LLMs to generate sentence-level contextual descriptions for each class or attribute, which are then encoded (often as embeddings via CLIP text encoders) and used to induce a Gaussian class prior [2305.14428].
- **Multiple prompt aggregation:** AutoElicit generates many paraphrased versions of a task description to the LLM, each yielding distinct prior estimates, which are pooled into a flexible mixture model for predictive modeling [2411.17284].
- **Expert knowledge via language metadata:** LMPriors proposes the use of task metadata (variable names, contextual sentences) in prompts, with the LLM’s output interpreted as soft probabilities for inclusion or penalization, which are then used in downstream learning decisions [2210.12530].

Prompt sensitivity, selection, and calibration are non-trivial; empirical studies indicate that temperature averaging, disease annotation, and paraphrasing can all impact the informativeness and variability of the resulting prior [2509.04250, 2411.17284].

## 3. Integration into Bayesian Modeling Frameworks

LLM-informed prior distributions are deployed in a variety of Bayesian inferential architectures:

- **Hierarchical Bayesian models:** Hyperpriors derived from LLM outputs are used for site-level parameters (e.g., in adverse event modeling for clinical trials: $y_{ij} \sim \mathrm{Poisson}(\lambda_j)$, $\lambda_j \sim \mathrm{Gamma}(\alpha, \beta)$, $\alpha\sim\mathrm{Exp}(\lambda_\alpha^{LLM})$) [2509.04250].
- **Mixture models and clustering:** An asymmetric Dirichlet prior is tailored for mixture weights in finite mixture models, enabling direct control over the number of clusters via LLM-informed hyperparameters; this elicits user-chosen or LLM-suggested values for the expected number of occupied clusters $K^+$ [2308.00768].
- **Regression and predictive modeling:** AutoElicit constructs priors for interpretable linear model coefficients using a mixture of LLM-sourced Gaussians, allowing rapid learning with limited labeled data and providing sample-efficient error reduction [2411.17284].
- **Compositional and multi-modal learning:** In compositional zero-shot learning (CZSL), class prior distributions are formed by encoding LLM-generated sentences, fusing language-informative features with visual embeddings, and leveraging attention-based modules for primitive decomposition [2305.14428].
- **Model space specification:** LLM-informed priors impact not only parameter distributions but also model selection; the adjustment to the prior on model space (e.g., $f(m)\propto p(m)c_m^{d_m}$) neutralizes the over-penalization from diffuse parameter priors and can be generalized to contexts where LLMs specify more or less informative priors [1207.5651].

These frameworks frequently exhibit enhancements in sample efficiency, inference stability, and predictive validity, contingent on the informativeness of the LLM-derived prior and its calibration to the data.

## 4. Theoretical Properties, Robustness, and Calibration

Theoretical analysis of LLM-informed priors centers around the interplay between prior informativeness, model calibration, and robustness to prior-data conflict:

- **Data-dependent mixture weighting:** In mixture data-dependent priors, the relative weight of the LLM-driven versus baseline prior is guided by a resampling procedure that computes distances (e.g., Hellinger) between likelihoods; when there is prior-data conflict, the mixture shifts toward the noninformative baseline to safeguard against overdominance [1708.00099].
- **Adjustment for Lindley’s paradox:** Joint specification of parameter and model space priors, with the model prior boosted by the dispersion term $c_m^{d_m}$, renders model selection robust to arbitrary choices of prior scale, a result generalizable to highly informative or diffuse LLM-sourced priors [1207.5651].
- **Translation of predictive distributions:** When only predictive or observable priors are available—either from expert elicitation or LLM predictions—global Bayesian optimization is used to find hyperparameter settings in a flexible parametric family, minimizing discrepancy from the LLM-elicited predictive target and balancing faithfulness with prior spread [2303.08528].
- **Robustness and transfer mechanisms:** In ensemble judgment or sparse data regimes, mixture models (Beta-Binomial) and prior transfer via embedding similarity allow LLM-informed priors learned from one dataset to efficiently inform uncertainty quantification in another, minimizing required labeled samples and providing theoretical bounds on estimation error [2504.12589].
- **Information-geometric interpretation:** In power prior frameworks, the influence of LLM-driven historical data can be adaptively calibrated by weighting and by generalizing beyond KL divergence to Amari’s $\alpha$-divergence, resulting in a posterior that lives along a geodesic in the statistical manifold, offering robustification and geometric insight [2505.16244].

Empirical analyses validate these theoretical guarantees, showing that proper mixing, calibration, and adjustment render LLM-informed priors robust to both misspecification and underspecification.

## 5. Empirical Performance and Practical Applications

The deployment of LLM-informed prior distributions leads to quantifiable improvements in performance, efficiency, and applicability across domains:

- **Sample efficiency and predictive accuracy:** In clinical trial safety modeling, LLM-informed hyperpriors enabled substantial reduction in required patient numbers for equivalent statistical power, providing more ethical and cost-effective trial design [2509.04250].
- **Feature selection and causal inference:** LLM-driven priors in high-dimensional datasets facilitated relevant variable selection and improved causal direction inference, supplementing or surpassing data-driven approaches in accuracy and interpretability [2210.12530].
- **Compositional zero-shot generalization:** Models using LLM-supported class distributions demonstrated superior harmonic mean accuracies and generalization to unseen compositions compared to traditional prompt and distribution-based methods [2305.14428].
- **Clinical predictive modeling:** Mixture-of-Gaussians priors constructed by AutoElicit led to rapid learning curves and significant reductions in annotation requirements in healthcare applications (e.g., urinary tract infection detection) [2411.17284].
- **Causal structure learning:** Mitigation strategies for LLM-derived prior errors in Bayesian networks—based on detection of quasi-circles—enhanced resilience against order-reversed prior mistakes while preserving most correct edge priors [2306.07032].
- **Sparse and structured inference:** Prior normalization enabled the use of heavy-tailed or sparsity-inducing priors (potentially informed by LLMs) within efficient MCMC frameworks for inverse problems, ensuring both computational tractability and theoretical convergence [2202.00074].

A table summarizing selected frameworks and their empirical impact:

| Framework                | Empirical Outcome                     | Domain      |
|--------------------------|---------------------------------------|-------------|
| Hierarchical LLM priors  | 20% sample reduction, better LPD      | Clinical    |
| AutoElicit               | 55% reduction in labels, early accuracy| Healthcare  |
| LMPriors                 | Feature selection accuracy gains      | ML          |
| PLID (CZSL)              | Highest mean/AUC on CZSL benchmarks   | Vision      |
| Data-dependent mixture   | MSE reduction, robust small-sample behavior | Bayesian   |

## 6. Limitations, Challenges, and Future Directions

LLM-informed prior distributions, while versatile, require careful handling:

- **Prompt sensitivity and bias propagation:** Outputs are highly sensitive to prompt design, temperature setting, and context; LLMs can propagate dataset, cultural, or user biases into priors, necessitating external calibration or mitigation strategies [2210.12530, 2509.04250].
- **Non-uniqueness and replicability:** Translation from predictive to joint priors may yield multiple hyperparameter sets that provide practically indistinguishable predictive behavior, complicating reproducibility and interpretation [2303.08528].
- **Computational scaling:** Certain procedures, such as prior optimization or mixture prior construction, incur substantial computational costs relative to classical inference; scalability remains an open challenge [2303.08528, 2202.00074].
- **Complexity of error mitigation:** For causal structure learning, robust frameworks are needed to distinguish order-preserving from order-reversing prior errors and to analytically correct for LLM misdirection [2306.07032].
- **Extension to new domains and modalities:** While vision, language, and tabular ML tasks have benefited, extensions to multivariate time series, spatial models, or reinforcement learning regimes require further methodological adaptation [2305.14428].

Continued research into more trustworthy, transparent, and context-sensitive mechanisms for prior elicitation—as well as calibration with domain experts, prior transferability, and integration with hierarchical Bayesian architectures—is warranted.

## 7. Significance and Outlook

LLM-informed prior distributions fundamentally expand the toolbox of Bayesian modeling by enabling the injection of rich, context-dependent, expert-level domain knowledge using large-scale pretrained language models. This capability is especially salient in low-data environments, complex hierarchical models, and compositional tasks. By marrying linguistic context with numerical inference, these priors offer quantifiable improvements in efficiency, accuracy, and interpretability without sacrificing theoretical rigor. Ongoing developments in transfer learning, prompt calibration, mixture modeling, and robust geometric inference continue to shape the practical landscape of LLM-informed Bayesian inference across scientific domains.

Source: https://www.emergentmind.com/topics/llm-informed-prior-distributions