---
title: Omni-Feature Generator (OFG)
url: https://www.emergentmind.com/topics/omni-feature-generator-ofg
type: topic
---

# Omni-Feature Generator (OFG)

Omni-Feature Generator (OFG) is a designation used in recent machine-learning literature for systems that construct new feature spaces from raw observations, either by explicit feature engineering, by multi-view feature fusion, or by physically grounded featurization. In tabular machine learning, OFG denotes LLM-centered pipelines that apply unary and binary operations to raw variables, sometimes under generator-critic duet-play without labels and sometimes through multi-agent Tree-of-Thoughts, Monte Carlo Tree Search, or two-stage rationale-and-code generation [2504.21304] [2406.03505] [2503.23371]. In robot manipulation, the term names a deformable attention module that lifts \(M\) image feature maps into a unified bird’s-eye-view (BEV) 3D feature volume [2508.11898]. In atomistic machine learning, it has also been used as a unifying interpretation of the Gaussian-multipole (GMP) featurization scheme, which maps local electron-density structure to fixed-length, rotationally invariant descriptors [2102.02390].

## 1. Scope of the term and core mathematical formulations

The literature does not use OFG as a single canonical algorithm. Instead, the name is attached to several mechanisms whose common function is feature-space construction. In the tabular setting, one formulation starts from a labeled dataset \(D=\langle F,y\rangle\) with original feature set \(F=\{f_1,\dots,f_n\}\) and seeks a reconstructed feature set \(F^*\) maximizing downstream performance,
\[
F^*=\arg\max_{\hat F}\,\theta_{R(\hat F,y)},
\]
where \(R\) denotes the downstream task and \(\theta\) its evaluation criterion [2406.03505]. A second formulation is explicitly unsupervised: with \(X\in\mathbb{R}^{n\times d}\) and operator set \(O=\{+, -, *, /, \log, \exp, \dots\}\), a critic implements \(k:\mathbb{R}^{n\times d}\to\Theta\), where \(\Theta\) is textual advice, and a generator implements \(g:(\mathbb{R}^{n\times d},O,\Theta)\to S\), where \(S\) is a token sequence representing transformed features [2504.21304].

The same naming pattern appears outside tabular ML. In OmniD, OFG is a 3D-feature-fusion core that maps multi-view image features \(F_j\in\mathbb{R}^{B\times C\times H\times W}\) to a fused BEV tensor \(F_{\mathrm{BEV}}\in\mathbb{R}^{B\times d\times N}\) [2508.11898]. In GMP featurization, the “OFG” interpretation refers to a fixed-dimensional per-atom representation derived from multipole projections of approximate valence-electron density [2102.02390].

| Context | Input \(\rightarrow\) output | Core mechanism |
|---|---|---|
| Unsupervised tabular transformation | \(X\in\mathbb{R}^{n\times d} \rightarrow Z\in\mathbb{R}^{n\times d'}\) | generator-critic duet-play, in-context generation |
| Dynamic adaptive tabular generation | \(D=\langle F,y\rangle \rightarrow F^*\) | multi-agent ToT, feedback loop, MCTS |
| Reason-generation tabular engineering | raw variables \(\rightarrow\) rationale \(\rightarrow\) pandas code | two-stage conversational dialogue, SFT, DPO |
| Multi-view robot perception | \(\{F_j\}_{j=1}^M \rightarrow F_{\mathrm{BEV}}\) | deformable attention-based BEV fusion |
| Atomistic featurization | local electron density \(\rightarrow\) fixed-length per-atom vector | Gaussian multipole projections, MCSH, radial Gaussians |

## 2. Generator-critic OFG for unsupervised feature transformation

In "Unsupervised Feature Transformation via In-context Generation, Generator-critic LLM Agents, and Duet-play Teaming" [2504.21304], the OFG approach is also referred to as LPFG. Its architecture consists of a critic agent, a generator agent, and an iterative refinement loop. The critic diagnoses the raw dataset along two axes—semantic, defined by feature names versus task description, and distributional, defined by feature-space statistics—and emits “advice” or “textual gradients” about how the feature space could be improved. The generator tokenizes original features and operators into a symbolic grammar and produces new feature-transformation expressions such as \((f_1/f_2)\), \((f_1-f_2)\), and \(\log(f_3)\).

The iterative loop is specified as
\[
\Theta^t \leftarrow \mathrm{Critic}(Z^{t-1}),\qquad
S^t \leftarrow \mathrm{Generator}(Z^{t-1},O,\Theta^t),\qquad
Z^t \leftarrow Z^{t-1}\cup \mathrm{decode}(S^t),
\]
with initialization \(Z^0\leftarrow X\), repetition for \(T\) iterations, and termination when convergence or no meaningful advice is observed. The tokenization grammar is expressed informally as
\[
\langle \mathrm{FeatureExpr}\rangle ::= f_i \mid (\langle \mathrm{FeatureExpr}\rangle \langle \mathrm{Op}\rangle \langle \mathrm{FeatureExpr}\rangle) \mid \langle \mathrm{UnaryOp}\rangle(\langle \mathrm{FeatureExpr}\rangle),
\]
with \(\langle \mathrm{Op}\rangle ::= + \mid - \mid * \mid /\) and \(\langle \mathrm{UnaryOp}\rangle ::= \log \mid \exp \mid \sqrt \mid \dots\).

A central claim of this formulation is that pseudo-supervision can be derived from unlabeled data. Semantic pseudo-labels come from feature names and task description; distributional pseudo-labels come from summary statistics such as skewness and correlation structure; and the textual advice \(\Theta\) serves as the only supervision. The paper states that the duo of critic and generator therefore constitutes a “pseudo model,” “pseudo objective,” and “pseudo optimization.” Although the critic output is textual, the method is described as implicitly guided by distributional cues such as variance improvement \(\Delta \mathrm{Var}=\mathrm{Var}(Z_{\mathrm{new}})-\mathrm{Var}(Z_{\mathrm{old}})\), correlation reduction, and cluster separation estimated by silhouette score on \(Z_{\mathrm{new}}\). The same framework can be generalized to human-agent collaborative generation by replacing the critic agent with human experts.

## 3. Dynamic, adaptive, and reason-generative OFG in tabular machine learning

In "Dynamic and Adaptive Feature Generation with LLM" [2406.03505], OFG is an end-to-end pipeline around a large-language-model core, augmented with prompted agent-creation, Tree-of-Thoughts (ToT) reasoning, and Monte Carlo Tree Search (MCTS). The user supplies raw feature set \(F\), label \(y\), and operation set \(O=\{\mathrm{square}, \mathrm{exp}, \mathrm{log}, \mathrm{plus}, \mathrm{multiply}, \dots\}\). The LLM is prompted using a ToT template to spawn \(L\) “expert” agents \(A_1,\dots,A_L\). Each agent inspects an assigned subset \(F_\ell\), applies operations \(o\in O\) in sequence, emits an extended subset \(F_\ell'\), and records full step-by-step reasoning. The subsets are unioned into \(F'\), which is then evaluated by downstream model \(R\) via \(\theta\), after which the agents exchange feedback and revise subsequent operations. In parallel or at the end, an MCTS runs over the generation tree to explore promising branches.

The adaptive control layer uses both self-evaluation and peer-learning. Agent \(\ell\) tracks \(\theta_\ell^{(t)}\) versus \(\theta_\ell^{(t-1)}\); if \(\Delta\theta>0\), its strategy is reinforced. MCTS uses standard UCB selection,
\[
\mathrm{UCB}(i)=w_i + C\sqrt{\frac{2\ln s_i'}{s_i}},
\]
where \(s_i\) denotes visits to node \(i\), \(s_i'\) visits to its parent, and
\[
w_i=\frac{1}{n}\sum_{j=1}^n\bigl[\theta_t^{(j)}-\theta_{t-1}^{(j)}\bigr].
\]
The operation set can be extended beyond numeric transforms to handle categorical, textual, timestamp, and image inputs, and the same pipeline is reported for classification, regression, and ranking. Interpretability is explicit: each agent produces a fully documented ToT, the prompt enforces “Markdown and Organization,” and the final feature set is accompanied by a human-readable log of transforms and \(\Delta\theta\) improvements.

In "FeRG-LLM : Feature Engineering by Reason Generation Large Language Models" [2503.23371], OFG appears as a two-stage conversational dialogue. Stage 1 takes domain, task type, raw-feature descriptions, and a machine-learning objective, then generates a Chain-of-Thought rationale consisting of numbered definitions for candidate feature ideas. Stage 2 asks the model to create new features in Python code using those ideas; the output is executable pandas code that realizes each idea as a new column. The underlying model stack is Llama 3.1 8B, fine-tuned with LoRA on approximately \(7{,}190\) two-turn dialogues and then aligned by Direct Preference Optimization (DPO) to prefer rationales that improve downstream AUC or MSE. The DPO objective is given as
\[
\mathcal{L}_{\rm DPO}(\theta)
=-
\mathbb{E}_{(x,r^+,r^-)\sim\mathcal{D}}
\Bigl[
\log \sigma\bigl(p_\theta(r^+\mid x)-p_\theta(r^-\mid x)\bigr)
\Bigr],
\]
with
\[
p_\theta(r\mid x)=\beta\log\frac{\pi_\theta(r\mid x)}{\pi_{\rm SFT}(r\mid x)},\qquad \beta=0.1.
\]
This variant emphasizes local deployability, lower inference time, and the avoidance of cloud-hosted APIs.

## 4. OFG as a representation-construction module beyond tabular data

In "OmniD: Generalizable Robot Manipulation Policy via Image-Based BEV Representation" [2508.11898], OFG is not a symbolic feature-engineering engine but the 3D-feature-fusion core of a three-stage visuomotor policy. Stage 1 performs 3D feature learning: \(M\) monocular RGB images are passed through a shared ResNet-18 backbone to yield 2D feature maps \(F_j\), and OFG lifts and fuses these maps into a unified BEV 3D feature volume. Stage 2 performs dimensional compression by channel pooling, and Stage 3 performs conditional denoising by concatenating the compressed BEV feature with proprioceptive robot states and feeding the result into a diffusion-based action head.

The internal OFG mechanism is deformable attention over BEV queries. A fixed set of \(N=X_{\mathrm{res}}\times Y_{\mathrm{res}}\times Z_{\mathrm{res}}=64\times16\times64=65{,}536\) spatial query points is embedded into \(q_i\in\mathbb{R}^d\). Each 3D query \(q_i'\) is projected into each camera view by intrinsics and extrinsics, producing a 2D reference \(r_{ij}=\pi_j(q_i')\). A lightweight MLP predicts offsets \(\Delta p_{ijk}\in\mathbb{R}^2\) and attention scores \(a_{ijk}\), which are normalized as
\[
\alpha_{ijk}=\frac{\exp(a_{ijk})}{\sum_{j'=1}^{M}\sum_{k'=1}^{K}\exp(a_{ij'k'})}.
\]
The final fused feature is
\[
f_i=\sum_{j=1}^{M}\sum_{k=1}^{K}\alpha_{ijk}\,\bigl[W_f\,\mathrm{Bilinear}(F_j,s_{ijk})\bigr],
\]
where \(s_{ijk}=r_{ij}+\Delta p_{ijk}\). OFG is trained end-to-end, and the sole loss is the diffusion policy’s MSE denoising loss
\[
\mathcal{L}=\mathbb{E}_{a_0,\epsilon,t}\bigl\|\epsilon-g_\theta(a_t,t)\bigr\|^2.
\]

In "A Universal Framework for Featurization of Atomistic Systems" [2102.02390], OFG appears as a unified reading of the Gaussian-multipole featurization scheme. Each atom is associated with an approximate valence-electron density \(\hat\rho(\mathbf r)\) represented as a fixed linear combination of atom-centered Gaussians. Radial probes \(G_i(r)=\exp[-r^2/(2\sigma_i^2)]\) and angular probes given by Maxwell-Cartesian spherical harmonics \(S^{(n)}_{abc}(x,y,z)\) are used to compute multipole moments
\[
\mu_{i,abc}
=
\int G_i\,S^{(n)}_{abc}\,\hat\rho\,d^3r.
\]
The per-atom feature vector groups components of the same multipole order \(n=a+b+c\) and enforces rotation invariance through a weighted Euclidean norm,
\[
f_{i,n}
=
\sqrt{\sum_{(abc)\in P(a,b,c)} w_{abc}\,\mu_{i,abc}^2},
\qquad
w_{abc}=\frac{n!}{a!\,b!\,c!}.
\]
The total feature dimension remains fixed regardless of the number of chemical elements, and the features interpolate smoothly across element types through the Gaussian decomposition of isolated valence densities.

## 5. Experimental protocols and quantitative performance

The empirical literature evaluates OFG under different downstream criteria: classification accuracy and AUC in tabular learning, MSE in regression, success rate and out-of-distribution robustness in robot manipulation, and MAE versus runtime or feature count in atomistic prediction [2504.21304] [2406.03505] [2503.23371] [2508.11898] [2102.02390].

| Work | Benchmark setting | Reported result |
|---|---|---|
| Unsupervised generator-critic OFG | 12 public tabular binary-classification sets; baselines TTG, AutoFeat, GRFG, OpenFE, CAAFE | unsupervised yet outperforms all supervised baselines on 8/12 datasets, matches second-best on the rest; average accuracy lift over original features: \(+5\)–\(10\%\); consistently \(<30\)s per dataset |
| Dynamic adaptive OFG | UCI/Kaggle: Ionosphere, Amazon Reviews, Abalone, Diabetes Indicators; RF accuracy | Raw \(89.2,59.6,53.9,85.9\); RL \(91.1,60.7,55.9,85.9\); OFG-3 iter \(91.8,61.5,56.4,86.0\); OFG \(\le 10\) iters \(95.6,63.9,56.4,86.1\) |
| FeRG-LLM OFG | binary classification AUC and regression MSE | dataset-averaged AUC: XGB \(80.78\), CAAFE \(81.22\), FeatLLM \(71.51\), Llama 3.1 70B \(83.90\), FeRG-LLM \(84.79\); MSE reductions include Concrete \(18.61 \rightarrow 16.47\) and Realestate \(32.60 \rightarrow 29.26\) |
| OmniD OFG | in-distribution, OOD, few-shot robot manipulation | average improvement over best baseline: \(11\%\), \(17\%\), and \(84\%\); removing OFG drops multi-view BCDE performance from \(96\%\) to \(84.3\%\) |
| GMP as OFG | MD17, QM9, OC20 | MD17 Aspirin: BP+HDNN \(97\)–\(101\) meV at \(\sim12\)–\(22\) ms/image, GMP+SNN \(28\) meV at \(\sim4\) ms/image and \(17\) meV at \(\sim28\) ms/image; QM9 reaches \(35\) meV at \(100\)k, below chemical accuracy \(43\) meV |

Within the unsupervised duet-play setting, ablations isolate the value of textual guidance. Replacing the critic with downstream accuracy feedback (LPFG-a), with feature importance from Random Forest (LPFG-i), or removing the critic entirely so that a single LLM diagnoses and generates (LPFG-o) all degrade performance; LPFG-o falls behind by \(3\)–\(7\%\) on average, and LPFG-a and LPFG-i underperform even LPFG-o on many datasets [2504.21304]. In the dynamic adaptive setting, OFG-3 already captures most of the gain in three rounds, while the full system adds further \(3\)–\(5\%\) and yields similar gains of \(4\)–\(7\%\) absolute in Precision, Recall, and F1 [2406.03505]. In FeRG-LLM, inference speed is reported as \(16.4\) s per dataset on \(1\times\)A6000 in cloud settings and approximately \(5\) s locally, compared with \(83.7\) s for Llama 3.1 70B on \(4\times\)A6000 and \(34.1\) s on \(2\times\)A100 [2503.23371]. In OmniD, OFG yields up to \(90\%\) success under background OOD on four novel textures and \(18\%\) zero-shot success under position OOD, whereas competitors are reported at \(0\%\) in both settings [2508.11898].

## 6. Interpretive issues, limitations, and future directions

A common misconception is that OFG denotes one standardized architecture. The literature instead spans at least four distinct paradigms: unsupervised generator-critic feature transformation, supervised multi-agent adaptive feature generation, reason-generation followed by executable code synthesis, and deformable attention-based feature fusion; GMP adds a physically motivated featurization interpretation [2504.21304] [2406.03505] [2503.23371] [2508.11898] [2102.02390]. This suggests that OFG is best understood as a family resemblance among methods that reorganize representation spaces, rather than as a single algorithmic specification.

Another misconception is that OFG is inherently supervised or label-driven. The LPFG formulation explicitly derives pseudo-supervision from feature names, task description, and summary statistics without numeric \(y\), whereas the dynamic adaptive and FeRG-LLM variants optimize downstream performance with labels, and OmniD trains OFG only through the diffusion policy’s denoising loss without separate feature-reconstruction or attention-regularization losses [2504.21304] [2406.03505] [2503.23371] [2508.11898]. The tabular papers also position OFG against brute-force or fixed-policy exploration: prior methods are described as enumerating operation combinations in BFS/DFS, using RL over expression DAGs, or relying on single-policy heuristics, whereas OFG variants separate diagnosis from generation, run simultaneous reasoning branches, or revisit decisions through tree search [2504.21304] [2406.03505].

The limitations are domain-specific. In dynamic adaptive LLM-based generation, repeated LLM queries and MCTS tree expansions can be expensive on very large datasets; noisy or poorly curated data may misguide the LLM; and reliance on GPT-3.5 Turbo risks embedding undesirable biases [2406.03505]. In GMP featurization, manual selection of Gaussian widths and maximum multipole order remains a limitation [2102.02390]. Reported future directions include scaling through smaller distilled LLMs or adapter-based fine-tuning, integrating symbolic reasoning engines for guaranteed algebraic correctness, extending to fully mixed data such as audio and video via multi-modal LLMs, conducting deeper causal analysis of generated feature semantics, using self-consistent electron densities, adding spin-density probes for magnetic materials, embedding electrostatic or long-range physics directly into featurization, and automating hyperparameter optimization [2406.03505] [2102.02390]. In the unsupervised duet-play setting, an additional extension is explicit human-agent collaborative generation by swapping the critic agent for human experts [2504.21304].

Source: https://www.emergentmind.com/topics/omni-feature-generator-ofg