---
title: 'Selection Functions: Concepts and Applications'
url: https://www.emergentmind.com/topics/selection-functions
type: topic
---

# Selection Functions: Concepts and Applications

Searching arXiv for relevant papers on “selection functions” across major usages (astronomy, logic/game theory, optimization/ML).
Searching arXiv for “selection functions astronomy survey completeness selection functions”.
Selection functions are formal devices that specify how elements of a space become selected, retained, or acted upon. Across disciplines, the term denotes different mathematical objects: a survey-inclusion probability \(S(\vec q)\), a cluster-detection threshold \(S(M,z)\), a choice map \(C:Q\to Q_{\emptyset}\), a higher-order functional \(J_R X=(X\to R)\to X\), a nondeterministic selector \(J_R^{\mathcal P}X=(X\to R)\to \mathcal P(X)\), or a learned internal score \(s_\theta(x)\) used for replacement and survival. What unifies these constructions is not a single formalism but a common role: each mediates between an underlying space of possibilities and an observed subset, selected action, or continuation [2106.07653][1605.07620][2003.11631][1407.7046][1811.06810][2106.09153].

## 1. Conceptual scope and formal heterogeneity

The term has no field-independent canonical definition. In astronomical catalog modeling, a selection function is the probability that an object with observables \(x\) or \(\vec q\) is included in a catalog or sample, typically written \(S(x)=P(\text{included in sample}\mid x)\) or \(S(\vec q)\) [2106.07653][2111.04127]. In cluster cosmology, the operational definition becomes a threshold object: the minimum halo mass as a function of redshift for which completeness and purity exceed prescribed levels, formalized as
\[
S(M,z)=\mathbf{1}\{\,C(M,z)\ge T_C \ \text{and}\ P(M,z)\ge T_P\,\}
\]
with \(T_C=T_P=80\%\) in the baseline construction [1605.07620]. In axiomatic choice theory, by contrast, a selection or choice function is a map \(C:Q\to Q_{\emptyset}\) sending each non-empty feasible set \(A\subseteq V\) to a chosen subset \(C(A)\subseteq A\), possibly empty [2003.11631]. In higher-order semantics, a selection function is a functional of type \(J_R X=(X\to R)\to X\), and the corresponding selection monad supports binary products and iterated products with direct proof-theoretic and game-theoretic interpretations [1407.7046]. In evolutionary search, a selection function maps individual-level features such as fitness, novelty, age, and rank to deterministic tournament outcomes or selection probabilities, thereby controlling exploration and exploitation [2106.09153]. In Datalog\(+/-\), a selection function maps a program \(P\cup D\) to a subset of chase positions \(S(P\cup D)\subseteq \mathrm{FinPos}(P\cup D)\), marking where finitely many values appear [2108.00903].

| Domain | Formal object | Primary role |
|---|---|---|
| Astronomical catalogs | \(S(x)\), \(S(\vec q)\) | Inclusion probability |
| Cluster surveys | \(S(M,z)\) | Completeness–purity threshold |
| Choice theory | \(C:Q\to Q_{\emptyset}\) | Chosen subset from feasible set |
| Higher-order computation | \(J_R X=(X\to R)\to X\) | Optimization-aware choice |
| Nondeterministic games | \(J_R^{\mathcal P}X=(X\to R)\to \mathcal P(X)\) | Set-valued admissible moves |
| Evolutionary search | \(s_\theta(x)\) or tournament rule | Survival and replacement |
| Datalog\(+/-\) | \(S(P\cup D)\subseteq \mathrm{FinPos}(P\cup D)\) | Finite-position marking |

A recurrent misconception is that a selection function must always be probabilistic. The literature shows otherwise: some are probabilities, some are threshold indicators, some are set-valued maps, and some are higher-type continuations.

## 2. Inclusion probabilities, completeness, and calibration in astronomy

In astronomical survey modeling, selection functions are the link between a population model and catalog incidence. For a catalog or curated sample, \(S(\vec q)\) is the probability that an object with attributes \(\vec q\) appears in the sample, and it enters forward modeling multiplicatively, with nuisance-variable dependence removed by integration. The standard effective-volume construction is
\[
V_{\mathrm{eff}}(M_G,B-R)=\int_{\Omega}\int_0^\infty S_C(\vec q(M_G,B-R,r,\hat n))\,r^2\,dr\,d\Omega,
\]
which yields \(N_{\mathrm{exp}}(M_G,B-R)=\Phi_0(M_G,B-R)V_{\mathrm{eff}}(M_G,B-R)\). In the Gaia white dwarf example, the paper argues that strict volume-limited sampling is often sub-optimal: for \(\Delta M=5\) mag, the accessible volume ratio in a flux-limited survey is \(\sim 1000\), and after explicit selection modeling the inferred white dwarf luminosity–color function peak shifts by \(\sim 4\) magnitudes relative to raw counts [2106.07653].

Cluster cosmology uses a more operational notion. In stage-IV optical and infrared surveys, completeness is defined as \(C=N_{\rm matched\,sim}/N_{\rm sim}\), purity as \(P=N_{\rm matched\,det}/N_{\rm det}\), and the selection function is the minimum halo mass satisfying threshold cuts in both quantities. Using the Bayesian Cluster Finder on realistic mock catalogs, Euclid-Optimistic reaches \(>80\%\) completeness and purity down to \(M_{\rm h}\simeq 8\times10^{13}\,h^{-1}M_{\odot}\) for \(z<1\), and \(M_{\rm h}\simeq 2\times10^{14}\,h^{-1}M_{\odot}\) up to \(z=2\). Euclid-Pessimistic has a similar shape with \(\approx 10\%\) higher mass limits, while LSST has \(\approx 5\%\) higher mass limits than Euclid-Optimistic up to \(z<0.7\) and reaches \(M_{\rm h}\simeq 2\times10^{14}\,h^{-1}M_{\odot}\) by \(z\simeq 1.4\). The same work fits
\[
\langle \log M^*_{\rm CL}\mid M_{\rm h},z\rangle
=
p_0+p_1\log\!\left(\frac{M_{\rm h}}{M_{\rm pivot}}\right)+p_2\log(1+z),
\]
with \(M_{\rm pivot}=10^{14}M_{\odot}\), finding intrinsic scatters \(0.124\), \(0.135\), and \(0.136\) dex for Euclid-Optimistic, Euclid-Pessimistic, and LSST, respectively, and negligible redshift evolution within uncertainties [1605.07620].

For Milky Way spectroscopic surveys, empirical selection functions are commonly estimated relative to a photometric parent catalog. In observed space, \(S(\mathbf{x})=P(S\mid \mathbf{x})\), with \(\mathbf{x}\) typically containing sky position, magnitude, and color. The seestar framework models both the parent photometric density and the field-level spectroscopic selection function with Gaussian mixture models, uses a Poisson point-process likelihood, and combines overlapping fields via
\[
S_{\mathrm{survey}}(\mathbf{x}) = 1 - \prod_{k\in\mathcal{F}(\mathbf{x})}\bigl[1-S_k(\mathbf{x})\bigr].
\]
It also defines an intrinsic selection function \(S_{\mathrm{intr}}(\boldsymbol{\theta})=S(\mathcal{T}(\boldsymbol{\theta}))\), obtained by composing the observable-space selector with geometry, stellar models, and extinction maps [1902.10485].

Gaia EDR3 subset selection functions sharpen the same principle. The paper on Gaia EDR3 models the probability of having astrometry, \( \mathrm{RUWE}<1.4\), or a reported radial velocity as conditional probabilities relative to inclusion in the EDR3 source catalog, with dependencies on \(G\), sky position, and, for RUWE and RVS, color \(C=G-G_{\mathrm{RP}}\). It uses HEALPix \(N_{\rm side}=64\), spherical needlets up to \(j_{\max}=5\), and binomial likelihoods per HEALPix–magnitude–color bin. The inferred functions show strong scanning-law and crowding dependence, and the paper emphasizes that ignoring this structure risks biased density and kinematic inference [2111.04127].

Two further lines of work address calibration and precision. A median-division binning algorithm for spectroscopic surveys recursively partitions the \(J\) versus \(J-K_s\) plane until each cell contains between \(N_{\rm crit}\) and \(2N_{\rm crit}\) spectroscopic stars, then estimates
\[
S=\frac{N_{\rm spec}+1/2}{N_{\rm phot}+1},\qquad
\sigma_S=\sqrt{\frac{S(1-S)}{N_{\rm phot}+1}},
\]
with the empirical calibration \(N_{\rm crit}=\mathrm{int}(0.91\times N_{\rm obs}^{0.37})+1\) [1810.12296]. Separately, injection-based calibration of empirically measured selection functions shows that the effective number of found injections must satisfy \(\mathrm{eff}>4\,\mathrm{obs}\) for a well-behaved posterior, and that the number of found injections scales linearly with the number of detected objects in the population [1904.10879].

Selection functions also enter weak-lensing systematics. For galaxy samples with complex, implicit targeting, the effective slope controlling magnification bias is calibrated from realistic mocks rather than from a nominal flux limit. For BOSS-like samples, the calibrated values are \(\alpha_{\rm obs}=1.93\pm0.05\) for \(0.2<z\le 0.5\) and \(\alpha_{\rm obs}=2.62\pm0.28\) for \(0.5<z\le 0.75\), values then inserted into the standard magnification term \(2(\alpha_{\rm obs}-1)\kappa\) [2101.05261].

## 3. Selection effects in dynamical and spatio-temporal inference

In stellar dynamics, the crucial distinction is between purely spatial selection and phase-space selection. If \(f(\vec x,\vec v)\) is the true tracer DF and the survey selection is purely spatial, then
\[
g(\vec x,\vec v)\propto S(\vec x)\,f(\vec x,\vec v),
\]
so at fixed \(\vec x\),
\[
p_{\mathrm{obs}}(\vec v\mid \vec x)=p(\vec v\mid \vec x).
\]
This invariance fails when selection depends on velocity or on phase-space quantities. The conditional Deep Potential method exploits exactly this cancellation: it learns \(p(\vec v\mid \vec x)\), the gravitational potential \(\Phi(\vec x)\), and the full tracer density \(n(\vec x)\) under the stationary collisionless Boltzmann equation without explicitly modeling the spatial selection function. In mock tests with complex dust-induced angular incompleteness, it recovers \(n(\vec x)\) to \(\approx 10\%\) accuracy across all \(S(\vec x)\), recovers \(p(\vec v\mid \vec x)\) to \(\approx 2\%\) down to \(S(\vec x)\approx 0.01\), and uses \(\approx 47\) thousand parameters for \(\ln n(\vec x)\), compared with \(\approx 1.4\) million parameters for an explicit selection-function network. The same paper stresses that the approach fails without modification under kinematic or magnitude-dependent kinematic selection [2512.02115].

In animal movement, selection functions appear as statistical weights and as mechanistic objects. Resource selection functions model locations through a weighted distribution over space; step selection functions condition availability on the previous location. In the mechanistic construction derived from ecological diffusion, the selection term is
\[
g(w(s(t_i)),\theta)=\frac{1}{\delta(s(t_i))\,\Delta t_i},
\]
and the availability kernel is Gaussian, so the stepwise point-process model coincides with the PDE fundamental solution. This yields a direct link between covariates, movement probability \(\psi(s)\), and residence time
\[
r(s)=\frac{4\,\Delta t}{\mathrm{logit}^{-1}(w'(s)\theta)}.
\]
The paper’s mountain lion application interprets the fitted model in terms of movement speed through ridges, slopes, and lower-elevation habitats rather than merely relative habitat preference [1911.03549].

## 4. Choice, games, and higher-order semantics

In axiomatic decision theory, selection functions appear as choice functions over feasible sets. Let \(V\) be a real vector space and \(Q\) the set of non-empty subsets of \(V\). A choice function is \(C:Q\to Q_{\emptyset}\), where \(C(A)\subseteq A\). The paper on strict partial orders studies “proper orders” \(\succ\) satisfying irreflexivity, transitivity, positive homogeneity, and translation invariance, and defines the maximality-based selector
\[
C[\succ](A)=\{x\in A:\neg\exists y\in A\text{ with }y\succ x\}.
\]
For a family \(O\) of proper orders,
\[
C[O](A)=\bigcup_{\succ\in O} C[\succ](A),
\]
which coincides with E-admissibility in imprecise probability. The representation theory proceeds through desirability cones \(D[\succ]=\{u\in V:u\succ 0\}\), rejection kernels \(K[C]\), and axioms PC\(_0\)–PC\(_3\), yielding a general characterization of proper choice functions generated by sets of strict partial orders [2003.11631].

In higher-order computation, a selection function has type
\[
J_R X=(X\to R)\to X.
\]
Escardó and Oliva show that \(J_R\) forms a monad with unit
\[
\mathrm{return}_X(x)(k)=x,
\]
and a bind operation that threads the continuation \(k\). More importantly, the binary product of selection functions encodes backward induction, and its iterated forms yield the explicitly controlled product and implicitly controlled product. Over System \(T\), the explicitly controlled product is \(T\)-equivalent to Spector’s bar recursion, while the implicitly controlled product is \(T\)-equivalent to modified bar recursion; both suffice, with System \(T\), to interpret full classical analysis via the dialectica interpretation and modified realizability [1407.7046].

The 2025 work on handling the selection monad reintroduces this higher-order object into programming-language semantics. It takes the selection monad
\[
J_R X=(X\to R)\to X
\]
as the semantic basis for effect handlers that, in addition to delimited continuations, receive choice continuations exposing possible future losses. In the operational semantics of \(\lambda C\), a handler for an operation receives both \(k:(par\times in)\to \sigma'\ \epsilon\) and \(l:(par\times in)\to loss\ \epsilon\), enabling programmer-defined optimization heuristics that inspect future loss rather than relying on an externally fixed argmin or argmax. The paper establishes progress, type soundness, and, under a mild hierarchical constraint on effect signatures, termination, then gives a denotational semantics in an augmented selection monad and proves soundness and adequacy [2504.03890].

Game theory supplies a further interpretation. For the finite nonempty powerset monad \(\mathcal P\), a nondeterministic selection function has type
\[
J_R^{\mathcal P}X=(X\to R)\to \mathcal P(X).
\]
Its product computes sets of admissible plays in sequential games of perfect information. The paper identifies two key structural properties—witnessing and upwards closure—and proves that they characterize when the product coincides with the set of rational plays. It also proves a negative result: no nondeterministic selection function computes the set of all subgame perfect Nash equilibrium plays unless it is constant. A positive substitute is obtained via strict-dominance selection functions \(\epsilon_i^s\), whose products compute sequential versions of iterated removal of strictly dominated strategies [1811.06810].

## 5. Adaptive and learned selection in optimization and machine learning

In evolutionary algorithms, selection functions determine which individuals survive and reproduce. Sel4Sel replaces hand-crafted selectors with a learned internal fitness \(s_\theta(x)\) computed by a three-layer feedforward network over the features Underlying Fitness, Rank, Age, Novelty, Noise, and Generation. Inner-loop replacement is deterministic tournament selection:
\[
s_\theta(\phi)\ge s_\theta(r)\ \Rightarrow\ \phi\ \text{replaces}\ r.
\]
The outer loop uses evolution strategies to optimize \(\theta\) for evolvability, measured as final population fitness after \(N\) generations. On Convex Bits, Hashed Bits, and Deceptive Bits, Sel4Sel achieves \(32.0\pm 0.0\), \(31.65\pm0.73\), and \(32.0\pm0.0\), respectively, matching greedy fitness on smooth landscapes and outperforming novelty-only, minimal-criterion, and random-drift baselines on deceptive or uncorrelated ones. Feature correlations reveal an emergent “explore first, exploit later” schedule: high positive correlation with novelty early, then near-perfect correlation with fitness and rank later [2106.09153].

In functional data analysis, adaptive basis selection is cast as a spike-and-slab problem. The representation
\[
g(t_{ij})=\sum_{k=1}^K Z_{ki}\beta_{ki}B_k(t_{ij})
\]
uses Bernoulli indicators \(Z_{ki}\) to zero coefficients with positive probability, thereby selecting both the number of bases and which bases are active. The Gibbs sampler updates \(\beta_{.i}\), \(Z_{ki}\), \(\theta_{ki}\), \(\tau^2\), and \(\sigma^2\) from closed-form conditionals. In simulations with B-spline and Fourier bases, the method recovers the true zero and nonzero coefficients closely, and in the trigonometric experiment it selects only two bases out of \(30\) in the Fourier family, consistent with the generating curve \(y(t)=\cos(t)+\sin(2t)+\epsilon\). The paper reports that the proposed model can outperform Bayesian LASSO in this functional, multi-curve setting while also quantifying uncertainty in the selection process [2204.03115].

Selection functions also appear in differentiable subset selection through submodular modeling. FLEXSUBNET learns monotone, non-monotone, and monotone \(\alpha\)-submodular set functions by recursively applying learned concave functions to modular functions. For the monotone model,
\[
F^{(0)}(S)=m^{(0)}_\theta(S),\qquad
F^{(n)}(S)=\phi_\theta\big(\lambda F^{(n-1)}(S)+(1-\lambda)m^{(n)}_\theta(S)\big).
\]
For \(\alpha\)-submodularity, the paper proves that if \(\diffc\) is increasing and satisfies
\[
\frac{d^2\diffc(x)}{dx^2}\le \frac{1}{k}\log\!\left(\frac{1}{\alpha}\right)\frac{d\diffc(x)}{dx},
\]
then \(F(S)=\diffc(\sum_{s\in S}m(s))\) is monotone \(\alpha\)-submodular for \(|S|\le k\). The learned selector is then paired with an order-sensitive probabilistic greedy rule and an adversarial Gumbel–Sinkhorn permutation relaxation to learn from \((V,S^\star)\) supervision. On synthetic submodular targets and on Amazon baby-registry subset selection, FLEXSUBNET outperforms Set Transformer, Deep Sets, DSF, SubMix, and non-trainable Facility Location, DPP, and Disparity-Min baselines [2210.11033].

## 6. Selection as search control in logic and automated reasoning

In Datalog\(+/-\), selection functions mark chase positions where only finitely many values arise. A selection function is any map \(S\) with \(S(P\cup D)\subseteq \mathrm{FinPos}(P\cup D)\). The extreme cases are \(S^\bot(P\cup D)=\emptyset\) and \(S^\top(P\cup D)=\mathrm{FinPos}(P\cup D)\); the weakly-sticky choice is \(S^{\mathrm{rank}}(P\cup D)=\Pi_F(P)\), and the paper introduces \(S^\exists(P\cup D)=\Pi_F^\exists(P)\) from existential dependency ranks. Stickiness modulo \(S\) defines the semantic class \(\mathrm{sch}(S)\), and the query-answering procedure \(\mathsf{QChase}^S\) is terminating, sound, and complete for \(P\cup D\in\mathrm{sch}(S)\). In particular, conjunctive query answering is in PTIME for Sticky, WS, and the new JWS class, and JWS—unlike WS—is closed under magic-sets rewriting [2108.00903].

Automated theorem proving uses a different notion: literal selection in superposition calculi. The paper “Selecting the Selection” distinguishes classical completeness-preserving selection from intentionally incomplete strategies that reduce search-space growth. It formulates the completeness condition as “select either a negative literal or all maximal literals with respect to \(<\),” then proposes two refinements. Quality-based selection composes literal preorders such as heavier weight, fewer variables, fewer top-level variables, avoidance of positive equality, and preference for negative polarity. Lookahead selection estimates the number of immediate children a clause would produce if a given literal were selected, using
\[
\mathrm{estimate}(l)=\sum_{i=1}^n |T_i[l]|
\]
over the current term indexes \(T_i\). In experiments with Vampire on \(11{,}107\) TPTP FOF and CNF problems, \(5{,}908\) were solved by at least one strategy with AVATAR enabled, and the incomplete lookahead strategy 1011 was the strongest overall. The paper reports selection overheads of about \(0.1\%\) of proof time for quality selection, \(\sim 1.74\%\) for complete lookahead, and \(\sim 4.27\%\) for incomplete lookahead, arguing that restricting inference proliferation is often more useful in practice than preserving completeness at every step [1604.08055].

Taken together, these literatures show that “selection function” is best understood as a family resemblance term. In some fields it denotes inclusion probabilities needed for unbiased inference; in others, admissible-choice operators, monadic continuations, or search-control policies. The underlying mathematical forms differ sharply, but the recurring problem is the same: how a system maps latent possibilities into realized observations, decisions, or derivations under explicit structural constraints.

Source: https://www.emergentmind.com/topics/selection-functions