---
title: Aggregate Relational Data (ARD)
url: https://www.emergentmind.com/topics/aggregate-relational-data-ard
type: topic
---

# Aggregate Relational Data (ARD)

Aggregated Relational Data (ARD) are summary counts obtained when sampled respondents are asked questions of the form “How many \(X\)’s do you know?”, rather than being asked to enumerate every dyadic tie in a network. In the standard social-network formulation, the observed data are an integer matrix \(Y=[y_{ik}]\), where \(y_{ik}=\sum_{j\in G_k}A_{ij}\) counts the number of alters of respondent \(i\) belonging to subpopulation \(G_k\); equivalent notation writes \(y_{k,i}=\sum_{j=1}^{n_2} g^*_{ij}w_{k,j}\), with \(g^*_{ij}\) the unobserved link indicator and \(w_{k,j}\) the trait indicator. ARD are used to estimate hidden-population sizes, personal network sizes, degree distributions, mixing patterns, and latent network structure, and they replace the \(O(n^2)\) dyadic questioning required by a classic network census with a small set of aggregate questions [2506.21353][2601.17153][2001.06052].

## 1. Survey representation and measurement logic

In the canonical survey setting, ARD arise when respondents are asked “How many \(X\)’s do you know?”, producing counts \(y_{ik}\) for respondent \(i\) and group \(k\). Typical examples include questions about acquaintances with specified demographic or behavioral traits, such as having been arrested, owning a farm, or having graduated high school. The most well-known application is the Network Scale-Up Method (NSUM), which uses ARD to estimate respondent degrees and group prevalences simultaneously [2601.17153].

Formally, if \(n\) respondents are surveyed over \(K\) groups, then \(Y=(y_{ik})_{i=1,\dots,n;\,k=1,\dots,K}\). When the full adjacency matrix \(A\) is unobserved, ARD provide indirect access to network structure through counts aggregated over known groups. In one notation, \(y_{ik}=\sum_{j\in G_k}A_{ij}\). In another, with \(n_2\) total population members and \(n_1\le n_2\) interviewed agents, \(y_{k,i}=\sum_{j=1}^{n_2} g^*_{ij}w_{k,j}\), and in matrix form \(Y=W\cdot G^* + (\text{survey-noise})\), where \(W\) records trait membership and \(G^*\) collects the unobserved links from the population to sampled respondents [2001.06052].

This measurement design is motivated by feasibility. A classic network census asks every ordered pair \((i,j)\) whether they are linked, which requires \(O(n^2)\) questions. ARD replace this with a small number of aggregate questions per sampled ego. The resulting compression is central to both the utility and the difficulty of ARD: collection is cheaper and often more practical, but inference becomes an inverse problem because the data are coarse summaries of an unobserved graph [2001.06052][1703.04157].

## 2. Inferential targets and identification

The inferential target varies across ARD applications. In hidden-population estimation, the target is typically the vector of prevalences
$$
p_k=\frac{N_k}{N},
$$
for unknown subpopulation sizes \(N_k\) in a population of size \(N\), together with degree-distribution parameters such as \(\mu_d\) and \(\sigma_d\) under a prior like \(\log d_i\sim \mathcal N(\mu_d,\sigma_d^2)\) [2606.03961]. In broader Bayesian ARD models, latent parameters often include personal network sizes \(d=(d_1,\dots,d_n)\), baseline tie-formation rates \(b=(b_1,\dots,b_K)\), and possibly overdispersion, mixing, or latent-position parameters [2506.21353].

A more general network-recovery formulation treats the unobserved links as generated by
$$
g^*_{ij}=1\{\eta_{ij}\le f(\alpha_i,\alpha_j)\},
$$
where \(\eta_{ij}\) are i.i.d. errors with unknown cdf \(F_\eta\), \(\alpha_i\in\mathbb R^p\) are latent node-specific effects, and \(f\) is an unknown link-utility function. The primary object of interest is then the link-probability matrix
$$
M^*=(m^*_{ij}),\qquad m^*_{ij}=E[g^*_{ij}]=F_\eta(f(\alpha_i,\alpha_j)),
$$
so that estimating \(M^*\) is equivalent to estimating the distribution of links [2001.06052].

Identification results in the ARD literature exploit cross-group link probabilities. One line of work shows that, for the beta-model with node-specific unobserved effects, the stochastic block model with unobserved community structure, and latent geometric space models with unobserved latent locations, cross-group link probabilities identify the model parameters, meaning that ARD are sufficient for parameter estimation under those model classes [1908.09881]. Another line of work uses a latent-distance formation model with node positions \(z_i\in S^p\), gregariousness parameters \(\nu_i\), and homophily parameter \(\zeta\), under which
$$
E[y_{ik}] = \lambda_{ik} = d_i b_k \cdot F_p(\zeta,\eta_k,\theta(z_i,\upsilon_k)).
$$
Up to sphere-wide rotations and reflections, three trait centers must be fixed to remove rotational indeterminacy; under support conditions such as non-collinearity of centers, parameters are uniquely identified [1703.04157].

These identification results delimit what ARD can and cannot recover. They support consistent estimation of model parameters and many derived network statistics, but they do not imply exact recovery of realized edges in a single observed graph.

## 3. Estimation frameworks for network recovery

Bayesian parametric estimation was an early dominant approach. In the latent-distance specification, ARD counts are modeled with a Poisson approximation,
$$
y_{ik}\sim \text{Poisson}(\lambda_{ik}(\nu_i,\zeta,z_i,\upsilon_k,\eta_k,b_k)),
$$
and the posterior is explored by Metropolis-within-Gibbs updates over \(z_i\), \(\nu_i\), trait centers and concentrations, and \(\zeta\). Posterior draws of the latent parameters induce link probabilities \(P^{(s)}_{ij}\), from which full graphs can be simulated and arbitrary node-level or graph-level statistics estimated by Monte Carlo averaging [1703.04157].

A distinct route dispenses with strong parametric assumptions and instead exploits low effective rank. Writing the ARD moment condition in expectation as
$$
E[Y]=WM^*,
$$
network recovery can be posed as nuclear-norm penalized regression:
$$
\min_{M\in\mathcal M}\ \frac12\|Y-WM\|_F^2+\lambda\|M\|_*.
$$
Here \(\|\cdot\|_F\) is the Frobenius norm, \(\|\cdot\|_*\) is the nuclear norm, \(\lambda>0\) is a tuning parameter, and \(\mathcal M\) can enforce nonnegativity, symmetry, and a zero diagonal. The nuclear-norm penalty is motivated by the empirical observation that many economic network models, including latent-space models, blockmodels, random-dot-product graphs, and degree-heterogeneity models, have low-effective-rank \(M^*\) [2001.06052].

The corresponding optimization is implemented with an accelerated proximal gradient method rather than direct semidefinite programming. Each iteration applies a gradient step,
$$
G = M^k - (1/L)\,W'(WM^k-Y),
$$
followed by singular-value thresholding. Theory gives a finite-sample bound in terms of the effective rank
$$
ER(M^*)=\left(\frac{\|M^*\|_*}{\|M^*\|_F}\right)^2,
$$
under which
$$
\|\hat S-M^*\|_F^2 \le C\cdot \frac{ER(M^*)}{K}\cdot (n_1n_2),
$$
so that the average per-entry mean squared error is \(O(ER(M^*)/K)\); when \(M^*\) has true rank \(r\ll \min(n_1,n_2)\), this becomes \(MSE\approx O(r/K)\) [2001.06052].

This suggests that ARD-based recovery is especially effective when the latent link-probability matrix is low-rank or low-dimensional, and less informative when the inferential target is the exact realized adjacency matrix.

## 4. Bayesian modeling, diagnostics, and intractable likelihoods

The contemporary Bayesian ARD literature includes a unified Stan-based implementation of existing models. A common baseline is the Poisson model \(y_{ik}\mid d_i,b_k\sim \text{Poisson}(d_i b_k)\), with overdispersed extensions using the NegativeBinomial family, and priors such as \(\log d_i\sim \text{Normal}(\mu_d,\sigma_d^2)\) and \(\beta_k\sim \text{Normal}(\mu_b,\sigma_b^2)\) for \(b_k=\exp(\beta_k)\). A central technical issue is non-identifiability: the transformation \(d_i\mapsto c d_i\), \(b_k\mapsto b_k/c\) leaves \(d_i b_k\) unchanged. Within-iteration rescaling addresses this by anchoring to reference subpopulations with known prevalence, eliminating the ad hoc post-processing scaling step and improving convergence diagnostics; in synthetic experiments, \(\hat R\) dropped from approximately \(1.1\)–\(1.2\) in the unscaled models to approximately \(1.00\) in the scaled models [2506.21353].

Model criticism has become a separate focus. A point-estimate-based diagnostic workflow proceeds in three stages: covariate-structure diagnostics, correlation diagnostics, and distributional diagnostics. Baseline Poisson or negative-binomial models are fit by MLE or MAP; randomized-quantile residuals are then used in local-covariate plots and global-covariate plots to decide whether covariates should enter with group-specific or common coefficients. Residual dependence across groups is assessed from the largest eigenvalue of the sample covariance matrix of residuals, centered and scaled to form a Tracy–Widom test statistic. Distributional adequacy is checked with rootograms and per-group dispersion indices \(D_k\). The prescribed ordering matters: misordering the diagnostics can produce spurious detection of correlation or overdispersion when omitted covariates create extra residual noise [2601.17153].

A further development addresses ARD models whose likelihood cannot be written down or efficiently evaluated. In that setting, a simulation-based neural estimation framework trains a permutation-invariant neural Bayes estimator that outputs a posterior median and a \(95\%\) credible interval for each marginal parameter by minimizing a multi-quantile pinball loss with a cumulative-gap construction that rules out quantile crossing by design. The framework was demonstrated on three structurally distinct intractable extensions of NSUM-style inference: a stochastic block model, a latent-space model, and a recall-subset model. On held-out simulated data, credible-interval empirical coverage was within \(\pm 0.03\) of nominal on all three simulators; training required approximately \(25\) minutes on a single CPU core per model, while inference on a single real survey took less than \(1\) ms [2606.03961].

These developments reflect a shift in ARD methodology from single-model estimation toward a broader workflow of identification, computation, diagnostic checking, and sensitivity analysis.

## 5. Empirical performance and substantive applications

Simulation and field evidence indicate that ARD can recover many network summaries reliably, though not all of them. In the latent-distance Bayesian framework, simulations with \(n=250\), \(p=2\), and \(K=12\) trait centers showed that degree and eigenvector centrality typically have mean squared error tending to zero as \(n\) grows, and graph-level statistics such as maximal eigenvalue, proximity, and clustering also had low MSE. At the same time, single-edge MSE remained large, and betweenness and component count had larger errors [1703.04157].

The same paper applied the method to \(75\) village networks in Karnataka, using a \(30\%\) random subsample with ARD on \(8\) traits. Posterior-mean versus true village-level statistics yielded \(R^2\approx 0.94\) for max-eigenvalue, \(R^2\approx 0.92\) for proximity, \(R^2\approx 0.75\) for global clustering, and \(R^2\approx 0.80\) for eigenvector-cut. For node-level quantities, degree achieved \(R^2\approx 0.85\) on ARD nodes and \(R^2\approx 0.60\) on all nodes via kNN imputations, while eigenvector centrality achieved \(R^2\approx 0.80\) on ARD nodes. In a top-decile centrality classification exercise, the true-positive rate was approximately \(47\%\) for ARD nodes versus \(29\%\) for all nodes. The same study reported that, in rural India, ARD surveys were approximately \(80\%\) cheaper than full network surveys [1703.04157].

The penalized-regression approach exhibits a different performance profile. Under latent-space, random-dot-product, and stochastic-block simulation designs with \(n\in\{50,100,200,300,400,500\}\) and \(K=\text{round}(\sqrt n)\), the reported average MSE \(= n^{-2}\|\hat S-M^*\|_F^2\) fell from approximately \(0.04\)–\(0.06\) at \(n=50\) to approximately \(0.017\)–\(0.036\) at \(n=500\). Computation time was less than \(5\) seconds for \(n=500\) on a standard laptop, and comparison to parametric latent-space MCMC showed orders-of-magnitude speedup, with similar or better accuracy when the rank assumption held [2001.06052].

Diagnostic work has also been evaluated on large real datasets. In Ukraine 2008–2009 ARD with \(n=9{,}241\) respondents, \(K=15\) groups, eight respondent-level covariates, and one respondent–group “respect” covariate, the diagnostic workflow identified local effects for Gender, Age, Employment, Internet Access, and Secondary Education, and global effects for Ukrainian ethnicity, Vocational Education, and Academic Education. After fitting a negative-binomial regression with the selected covariates, the Tracy–Widom test yielded \(T\approx 102\) with \(p\ll 0.001\), strongly rejecting independence and indicating residual group correlation [2601.17153].

Likelihood-free ARD models have been applied to the 2011 Rwanda household survey, which interviewed approximately \(10{,}000\) respondents and asked ARD questions for \(22\) known populations and \(4\) hidden populations. Across stochastic-block, latent-space, and recall-subset NSUM models, posterior medians for hidden-population sizes differed by factors of \(2\)–\(10\). The paper emphasizes that no single model is “truth,” and treats these discrepancies as quantification of model uncertainty beyond sampling error [2606.03961].

ARD has also been used outside the standard hidden-population setting. In a three-wave King County study of people experiencing homelessness, RDS-II population estimates of mean acquaintance degree were \(\hat\mu=82.8\) in 2023 and \(\hat\mu=36.1\) in 2024, while close-friend estimates were \(\hat\mu=2.6\) in 2023 and \(\hat\mu=2.5\) in 2024, and kinship estimates were \(\hat\mu=1.76\) in 2023 and \(\hat\mu=1.98\) in 2024. The reported interpretation was declining visibility, stable but low strong-tie support, and modestly growing family clustering within the unsheltered population [2411.13517].

## 6. Limits, misconceptions, and terminological scope

A recurrent misconception is that ARD recover the realized graph itself. The literature is more circumspect. Parametric and nonparametric methods can recover model parameters, link-probability matrices, and many node-level or graph-level statistics, but they do not generally recover individual edges accurately. The latent-distance study explicitly reports that single-edge MSE stays large, and that high-order quantities such as betweenness and component count are harder to estimate [1703.04157]. This suggests that ARD are best understood as instruments for inference on distributions of ties and network summaries, not as substitutes for a complete edge list.

Another central issue is modeling assumptions. Much Bayesian ARD inference assumes that, conditional on degree, counts for different subpopulations are independent. Recent work argues that homophily, latent-space clustering, imperfect recall, non-random mixing, visibility biases, unobserved heterogeneity, and residual dependence can violate that assumption. The practical response in the recent literature is not a single replacement model but a layered workflow: covariate diagnostics, correlation testing, distributional checks, posterior predictive checks, and cross-validation where feasible [2601.17153][2506.21353][2606.03961].

The acronym “ARD” also has a separate meaning in database-oriented machine learning over relational data. In that literature, an ARD query is a SQL-style aggregate over a feature-extraction join, and a batch of ARD queries is computed together to form the sufficient statistics for objectives such as ridge regression, PCA, support vector machines, decision trees, and k-means. Optimized ARD processing based on factorization, FAQ/InsideOut, aggregate fusion, tries, and incremental maintenance can avoid materializing large joins; on a retailer dataset, a structure-aware system was reported to reduce runtime from \(13{,}200\) seconds in a Postgres+TensorFlow pipeline to \(6\) seconds, a \(2{,}160\times\) speedup, while moving \(37\) KB instead of \(23\) GB [2008.07864].

The coexistence of these usages makes terminological precision important. In the social-network and survey-statistics literature, ARD denote aggregated counts over personal networks; in the database literature, ARD denote aggregate queries over relational joins. The two traditions share an emphasis on aggregation as a surrogate for more expensive full-data access, but they address different inferential objects and computational problems.

Source: https://www.emergentmind.com/topics/aggregate-relational-data-ard