FLOAT: Multi-Domain Phenomena & Computation
- FLOAT is a diverse set of phenomena encompassing physical floatation, numerical representations, and simulation algorithms, integral to capillarity studies, AI hardware, and robotics.
- It includes innovations such as vibration-enhanced capillary lift, entropy-coded floating-point formats that reduce model size by up to 30%, and non-iterative simulation methods for fluid–structure interactions.
- Domain-specific FLOAT frameworks optimize tasks from semantic scene parsing to offshore wind turbine design by integrating surrogate modeling, hybrid optimization, and hardware-software co-design techniques.
FLOAT encompasses a diverse set of phenomena, mathematical objects, formats, and algorithms associated with “floating” as a physical state, “floating-point” as a numerical representation, and “FLOAT” as an acronym for advanced methods in scientific computing, machine learning, robotics, and engineering. This article surveys FLOAT in the context of (1) capillarity and static/vibrated fluid drops, (2) floating-point numerical formats and their adaptations for AI/ML hardware and scientific models, (3) algorithmic advances in dynamical simulation of floating bodies, (4) domain-specific FLOAT frameworks for engineering and computer vision, (5) advanced techniques for memory-efficient model deployment, and (6) the role of FLOAT in robotic and physical system design.
1. Capillarity and the Physics of Floatation
Physical floatation—the ability of a body or drop to stably reside at a fluid interface—arises from a competition between gravity, interfacial tension, and wetting geometry. For a small drop of heavier liquid (density ) floating on a lighter fluid (density ), static equilibrium is governed by the Young–Laplace law for capillary pressure at each of the three interfaces (drop–gas, drop–oil, oil–gas), resulting in a coupled free-boundary ODE problem. The coupled arclength formulation, as given by Boucher et al. (1975) and extended in (Pototsky et al., 2021), yields:
- Sessile (above interface) and pendant (submerged) cap morphologies, each satisfying a local mean-curvature equation with appropriate surface tension and hydrostatic pressure terms.
- A vectorial Neumann triangle for balance at the triple-phase contact line, reducing to two scalar equations that couple the capillary force components.
- No analytical exists; numerical continuation reveals two distinct stable equilibrium shapes (“small-” and “large-”) for sufficiently small drop volume, separated by a saddle-node; the energy landscape is thus bistable.
Under vertical vibration (amplitude , frequency ), excitation above the Faraday threshold generates subharmonic standing waves on the drop’s upper cap. The resulting anisotropic radiation pressure induces a time-periodic elliptical deformation, lengthening the triple-phase contact line and enhancing the capillary “lift”. Quantitatively, drops in the vibrated regime exhibit increased maximum floatable volume compared to static conditions, as the mean lift grows with the average contact-line length . The phase diagram in 0 vs. 1 space distinguishes between circular, elongated-float, and sinking regimes (Pototsky et al., 2021).
2. Floating-Point Representations: Theory, Architectures, and Compression
Floating-point numbers are the primary representation for real-valued computation in scientific and AI domains, with IEEE 754 forming the dominant standard. A floating-point value 2 is typically encoded as 3.
Innovations and architectural variants address the following challenges:
- Entropy-coded and adaptive floats: EFloat (Bordawekar et al., 2021) and Dynamic-Length Float (DFloat11) (Zhang et al., 15 Apr 2025) exploit exponent clustering in real-world deep learning weights and embeddings to apply variable-length, entropy-optimal codes to exponent and sign fields. This allows aggressive bit-width reduction without sacrificing dynamic range, yielding, e.g., 11-bit effective storage for lossless BFloat16 LLM deployment with 30% size reduction.
- Block-based and exponent-optimized representations: ReFloat (Song et al., 2020) adopts a block-floating exponent per ReRAM crossbar, encoding exponent offsets and truncated mantissas for high hardware efficiency, supporting robust iterative linear solvers directly in analog memory arrays.
- Adaptive and format-specialized floats: AdaptivFloat (Tambe et al., 2019) dynamically maximizes and clips representable range per neural network layer via a layer-specific exponent bias, regularly outperforming block floating-point, posit, and classical 8/6/4-bit floats in PTQ and QAT benchmarks.
- AetherFloat (Morisaki, 26 Feb 2026) generalizes floating-point by adopting base-4 scaling, explicit mantissas, and lexicographic one’s-complement encoding, entirely eliminating block-scaling (AMAX) hardware in vector/matrix AI hardware (see Table below). AF8 and AF16 cover dynamic range limitations of E4M3 and BFloat16 with improved area and power metrics.
| Format | Bit Width | Dynamic Range | Structure | Special Features |
|---|---|---|---|---|
| IEEE-754 FP32 | 32 | 4 | 1-sign, 8-exp, 23-mantissa | Standard reference |
| EFloat EF16 | 16 (avg) | 5 | Variable-length entropy-coded exp/sign | +4 bits effective mantissa vs. BF16 |
| DFloat11 | 11 (avg) | 6 | Lossless, entropy-coded on exponent | 30%~ model size reduction |
| ReFloat (block) | 7–9 | Block-tunable | Shared block exponent, offsets, fraction | Matched to hardware crossbar layout |
| AetherFloat-8 | 8 | 7–8 | Base-4 scaling, explicit mantissa | Block-scale-free for LLM activations |
| AdaptivFloat | 4–8 | Layer-adaptive | Exponent bias per layer, no denormals | QAT can outperform FP32 at 8 bits |
3. Algorithmic Advances in Floating-Body Simulation
Robust simulation of fluid–structure interactions, especially for floating bodies, faces the challenge of added-mass instability when the displaced fluid mass approaches or exceeds that of the body. The FloatStepper algorithm (Roenby et al., 2023) provides a non-iterative solution by:
- Decomposing the fluid force into added-mass (acceleration-proportional) and all other components via probe motions for each timestep in the CFD solver.
- Explicitly measuring the 9 added-mass matrix 0 and the residual force 1, enabling direct inversion of the coupled Newton–Euler equations 2 at each step.
- Completely eliminating the outer relaxation iterations typical of partitioned FSI, thereby ensuring stability even for massless or light bodies, rapidly varying added mass, and two-phase interfaces.
- Demonstrating mesh-convergent, benchmark-validated results for cases ranging from rising/falling discs to multi-DoF floating boxes in regular waves.
4. Domain-Specific FLOAT Frameworks: Scene Parsing and Offshore Structures
In advanced scene parsing, FLOAT (Factorized Learning of Object Attributes) (Singh et al., 2022) introduces a scalable label factorization for multi-object/multi-part semantic segmentation:
- Decomposes part labels into orthogonal predictors for object, root-part, and directional “side-attributes” per pixel, replacing the conventional monolithic label space.
- Achieves significant absolute improvements (mean IOU up to +8.6%) versus monolithic and competing SOTA methods on the Pascal-Part datasets (58, 108, and 201 parts).
- Employs inference-time “Zoom Refinement,” localizing high-resolution part prediction to detected objects, yielding large gains for small parts.
In fatigue-aware design of floating offshore wind turbine towers, FLOAT (Fatigue-aware Lightweight Optimization and Analysis for Towers) (Ribeiro et al., 4 Jan 2026) integrates:
- A calibrated analytical fatigue damage surrogate enabling optimization over geometry while maintaining section-by-section fatigue constraints.
- Monte Carlo–sampled probabilistic wind–wave load cases, reducing simulation burden from 3 to 4.
- High-fidelity OpenFAST modeling, including dynamic platform/tower coupling with pitch/heave calibration.
- Application to the IEA 22 MW reference FOWT tower yields the first lifetime-robust, resonance-safe redesign (from 9 months to 25 years fatigue life), validated against full simulation with 5 conservativism in the surrogate.
5. Compression, Representation, and Deployment of Large AI Models
Aggressive compression of deep models without numerical loss is achieved by exploiting statistical structure in their floating-point weights:
- Dynamic-Length Float (DFloat11) (Zhang et al., 15 Apr 2025) compresses BFloat16 models by entropy-coding the highly skewed exponent distributions, yielding bit-exact reconstruction and 30% storage/memory saving. This supports hosting a 405B parameter Llama 3.1 model (811 GB BF16) in 551 GB on an 8x80 GB GPU server—lossless inference, up to 46× faster than CPU-offloaded solutions, and up to 10× larger context windows.
- EFloat (Entropy-coded Floating Point) (Bordawekar et al., 2021) enables highly compact representations for large embedding tables, with 16-bit variants matching 32-bit accuracy, and 12-bit variants exceeding BFloat16 at a 25% reduced bit-budget, leveraging Huffman-coded exponents and maximal mantissa allocation.
6. FLOAT in Robotics, Object Tagging, and Dynamics
- FLOAT Drone (Lin et al., 2 Mar 2025): Introduces a fully-actuated, coaxial dual-rotor UAV with integrated control surfaces, yielding 6-DOF force/torque decoupling and minimized airflow disturbance. The design allows manipulation in proximity to delicate surfaces, e.g., flower watering and curtain interaction, with robust model-based and hierarchical control.
- Float Self-Tagging (Melançon et al., 2024): Presents an encoding mechanism for dynamic/high-level languages to store IEEE 754 float type tags and payload in the same N-bit word by leveraging frequent bit-pattern “coincidences” (e.g., exponent MSBs or mantissa bits), drastically reducing heap-boxing and type-check overhead compared to both tagged pointers and NaN-boxing. Demonstrated speedups are 2.4× (Scheme) and 3.6× (JavaScript) for float-intensive workloads.
- Floaters in Water Waves (Herreman et al., 2024): Analytical, numerical, and experimental investigation of the orientation of parallelepiped floaters in gravity waves establishes a controlling nondimensional parameter 6 with a sharp head–beam transition at 7.
7. Perspectives and Implications
The modern expansion of FLOAT in both physical and computational domains illustrates the convergence of physical insight, information-theory–driven representation, and hardware co-design:
- Physical floatation phenomena motivate intricate stability analyses leveraging geometry, capillarity, bifurcation, and vibration-driven enhancement (e.g., Faraday-induced elongation).
- FLOAT-inspired architectures in AI, scientific computing, and scene parsing provide orders-of-magnitude gains in storage, power, and scalability while preserving or enhancing model fidelity.
- Innovations such as block-scale-free architectures and entropy-coded floats directly reshape hardware-software boundaries in high-performance inference and training.
- Domain-specific FLOAT frameworks (engineering, scene parsing) demonstrate the efficacy of factorization, surrogate modeling, and hybrid optimization in large-scale, real-world–constrained settings.
The unifying theme is the systematic re-examination and exploitation of floating—whether of bodies at interfaces, or numbers in memory—to balance physical constraints, representation costs, and computational requirements across diverse research frontiers.