---
title: Parallel Mechanisms in Integrated Systems
url: https://www.emergentmind.com/topics/parallel-mechanisms
type: topic
---

# Parallel Mechanisms in Integrated Systems

Below is a structured, in-depth account of “Simulacra Naturae” organized into eight sections. Wherever appropriate, we include the key equations in LaTeX, describe system diagrams, and tabulate major mappings.  

1. High-Level Overview  
• Concept – Simulacra Naturae is a multisensory media installation that re-materializes 131-channel brain-organoid spike data as an inhabitable ecosystem. Rather than “visualizing” neural time-series in a screen plot, it treats organoid rhythms as co-creative forces that drive:  
 • an artificial-life environmental projection (termites, slime molds, boids),  
 • a 16.2-channel spatial soundscape,  
 • solenoid-struck ceramic vessels,  
 • fiber-optic lighting from LED matrices,  
 • a forest of live tropical plants on mulch and moss.  

• Goals –  
 1. To explore nonhuman agency and collective care through hybrid biological–computational processes.  
 2. To demonstrate real-time coupling of high-density neural data with GPU-accelerated agent-based simulations and generative AI imagery.  
 3. To integrate living plants and crafted clay artifacts as active “actants” in an emergent, multi-modal habitat.  

• Key Contributions –  
 • A real-time pipeline mapping 131 organoid channels onto ~50 million agents across three behavioral models (stigmergic termites, Physarum foragers, Reynolds boids) plus AI diffusion visuals.  
 • A cyber-physical sound system with 27 solenoids striking morphogenic ceramic vessels in synchrony with “backbone” neurons.  
 • A synchronized software/hardware architecture (TouchDesigner, Unity, Processing, Max/MSP, OSC, MQTT, NDI) achieving frame-accurate timing across visuals, audio, and actuation.  
 • A qualitative framework for “distributed creative agency,” centering ecological ethics, empathy, and relational cognition.  

2. Neural Signal Processing Pipeline  
A. Data Acquisition  
• Organoids (human iPSC-derived) interfaced with CMOS MEAs sampling at 20 kHz.  
• Kilosort2 spike-sorting → 131 active neuron channels; 27 “backbone” neurons selected for solenoid actuation.  

B. Preprocessing and Time Scaling  
• Original recording length = 3 minutes (180 k rows at 1 ms resolution).  
• Playback slowed to 90 minutes (factor 30×) for human perceptibility.  
• TouchDesigner master patch reads each row index $t$ and broadcasts via OSC to all subsystems.  

C. Feature Extraction  
• Instantaneous spike indicator for neuron $i$ at time $t$:  
  $$
    s_i(t) = 
      \begin{cases}
        1, & \text{if neuron }i\text{ fires at }t,\\
        0, & \text{otherwise.}
      \end{cases}
  $$  
• Population firing rate:  
  $$
    R(t) = \frac{1}{N}\sum_{i=1}^N s_i(t),
    \qquad N=131.
  $$  
• Burst boundaries extracted as timepoints when $R(t)$ crosses a threshold $\theta_{\rm burst}$.  

D. Mapping to Generative Parameters  
Table 1 summarizes the principal mapping functions used in audio, visuals, and swarm speed:  

Table 1 – Neural→Parameter Mappings  
| Parameter           | Definition                                 | Mapping Function                                 |
|---------------------|--------------------------------------------|--------------------------------------------------|
| Trail deposition    | agent-level pheromone flag                | $T_i(t) = s_i(t)$                                |
| Agent speed         | movement velocity in slime/boid models     | $v_i(t) = v_0 + \alpha\,s_i(t)$                  |
| Solenoid strike     | actuation amplitude                        | $A_j(t) = A_0 + \beta\,s_j(t)$, $j\in[1,27]$      |
| Tone event rate     | sustained guitar density                   | $\lambda_{\rm tone}(R)=\sqrt{R}$                 |
| Grain event rate    | granulation density                        | $\lambda_{\rm grain}(R)=(R)^{-1/6}$              |
| Grain duration      | sample‐grain length                        | $\tau_{\rm grain}(R)=k_1\cdot R + k_2$            |
| Flocking weights    | cohesion/alignment/separation gains        | $w_x(t)=w_x^0 + \gamma_x R(t)$                    |

3. Formal Specification of Agent-Based Simulation  
All digital agents run on GPU compute shaders in Unity with the following abstract state per agent ($i$):  
• Position $\mathbf{x}_i(t)\in\mathbb{R}^2$  
• Velocity $\mathbf{v}_i(t)\in\mathbb{R}^2$  
• Orientation angle $\theta_i(t)$  
• Internal pheromone deposit flag $T_i(t)\in\{0,1\}$  

A. Termite-inspired Stigmergy Model  
1. Environment scalar field $P(\mathbf{x},t)$ (pheromone intensity).  
2. Trail dynamics:  
   $$
     \frac{\partial P}{\partial t}
       = D\,\nabla^2 P - \gamma\,P + \sum_i T_i(t)\,\delta(\mathbf{x}-\mathbf{x}_i(t)).
   $$  
3. Agent update per timestep:  
   pseudocode TermiteStep(i):  
    sense forward, left, right samples of $P$ at angles $\theta_i\pm\Delta\theta$, distance $d_s$  
    if forward ≥ max(left,right) then  
     $\theta_i(t+1)\leftarrow\theta_i(t)$  
    else  
     $\theta_i(t+1)\leftarrow\theta_i(t)\pm\Delta\theta$ (choosing direction of stronger signal)  
    move: $\mathbf{x}_i(t+1)\leftarrow\mathbf{x}_i(t)+v_i(t)\,\bigl[\cos\theta_i,\sin\theta_i\bigr]$  
    deposit: $T_i(t+1)\leftarrow s_i(t+1)$  

B. Physarum-inspired Foraging Model  
Based on Jones (2010), each agent:  
• Samples local chemo-attractant field $C(\mathbf{x},t)$ at offset sensors.  
• Rotates toward highest $C$, deposits a small quantity $\Delta C$ upon movement.  
• Field update:  
  $$
    \frac{\partial C}{\partial t}
      = D_C\nabla^2 C - \gamma_C\,C + \eta\sum_i\delta(\mathbf{x}-\mathbf{x}_i).
  $$  
• Key organoid modulation: sensor angle $\alpha(t)$, sensor distance $d_s(t)$, speed $v_i(t)$ all vary linearly with $R(t)$.  

C. Reynolds-Boid Flocking Model  
Agent‐to‐agent interactions for each pair $(i,j)$ within radius $r_{\rm neigh}$:  
  • Separation: 
    $\mathbf{F}^s_i = \sum_{j\neq i}\frac{-(\mathbf{x}_j-\mathbf{x}_i)}{\|\mathbf{x}_j-\mathbf{x}_i\|}$  
  • Alignment: 
    $\mathbf{F}^a_i = \sum_{j\neq i}\mathbf{v}_j$  
  • Cohesion: 
    $\mathbf{F}^c_i = \sum_{j\neq i}(\mathbf{x}_j-\mathbf{x}_i)$  
Overall acceleration:
  $$
    \mathbf{a}_i = w_s(t)\,\mathbf{F}^s_i + w_a(t)\,\mathbf{F}^a_i + w_c(t)\,\mathbf{F}^c_i,
  $$
with each weight $w_x(t)=w_x^0 + \gamma_x\,R(t)$.  

4. Architecture of the Generative Ecosystem  
A. Software Stack & Data Routing (see Figure 4 interaction diagram)  
• TouchDesigner (Master Clock/OSC publisher): reads organoid rows, broadcasts index $t$.  
• Unity (ALife projections): receives OSC $t$, $s_i(t)$, $R(t)$. Renders termites, slime-mold, boids in real time.  
• Processing (secondary visuals): receives OSC $t$ for generative AI overlays.  
• Second TouchDesigner (AI diffusion): ingests floorplan vectors + organoid firing positions, runs Stable Diffusion 2.1 + LoRA to generate evolving textures.  
• Max/MSP (16.2 audio + solenoid control): receives OSC $t$, extracts pre-encoded .wav data for population rate and burst markers, drives granular/sustain synthesis and 27 solenoids.  
• Network protocols: OSC for low-latency sync, MQTT for optional remote distribution, NDI for texture streaming between machines.  

B. Hardware Components  
• Two desktop workstations, each with NVIDIA RTX 4090, 10 Gbps switch.  
• Projection: one 4K laser floor projector; three 4K laser wall projectors (total resolution ~10,184×2,160).  
• Cyber-physical:  
 – 27 solenoids embedded in clay vessels + glassware, wired to custom driver board.  
 – Two 16×16 RGB LED matrices driving fiber-optic bundles in hydroponic glassware.  
• Environment: hydroponic planters, living tropical plants (Monstera deliciosa, Alocasia, Strelitzia alba, Dracaena, etc.), mulch + artificial moss substrate.  

5. Role of Material Ecologies  
• Spatial Layout – plant placement and visitor corridors derive from topological clusters of backbone neurons (Figure 2 spatial arrangement).  
• Living Plants – large-leaf and bamboo species provide olfactory, tactile, and humidity feedback; they inhabit zones mapped from neural firing neighborhoods.  
• Clay Artifacts – vessels shaped by a rule-based differential-growth algorithm in Grasshopper/Rhino (Python), printed on Potterbot clay printer; post-fired, each has unique resonance profile.  
• Integration – solenoid strikes excite vessel resonances that vary with form, thickness, humidity; fiber optics animate plant edges, blending living and cybernetic.  

6. Emergent Dynamics & Co-Creative Interplay  
• Case Study A (Min 00:15): a burst event cluster ($R(t)\!>\!\theta_{\rm burst}$) rapidly increases slime-mold sensor angle, producing radial “sunburst” trails on floor projection; simultaneously, audio shifts via cue of burst boundary → harmonic transition in C-minor↔Phrygian textures.  
• Case Study B (Min 00:45): sustained high‐frequency firing ($R(t)\approx20$ Hz) drives boid alignment weight up, yielding flocking “wave” visuals wrapping around plant clusters; solenoid strike density ($\lambda_{\rm tone}$) peaks and listeners report feeling “heartbeat” synchrony with visual motion.  
• Quantitative Observation – cross-correlation between $R(t)$ and event density in Channel 4 of the Max/MSP patch: $r=0.78$, $p<0.01$.  
• Emergent Phenomena – visitors describe “morphogenic breathing” as the space expands/contracts in audio amplitude and light intensity, illustrating how co-evolutionary feedback between neurons, agents, and matter produces perception of agency in the nonhuman.  

7. System Diagrams, Tables & Key Equations  
• Figure 2 (Spatial Arrangement) – planar regions correspond to firing clusters.  
• Figure 4 (Interaction Diagram) – TouchDesigner ↔ Unity/Processing ↔ Max/MSP ↔ hardware.  
• Table 1 (Mapping Functions) above.  
• Key field equations for pheromone/chemoattractant and boid forces appear in Section 3.  

8. Ethical, Ecological & Experiential Dimensions  
• Decentralizing Agency – by granting organoid rhythms equal participation in generative processes, the installation challenges anthropocentric authorship.  
• Collective Care – relational cognition frameworks (Latour ANT, Haraway kin-making, Sheldrake’s entangled life) underpin a design that centers attentiveness, mutual shaping, and multispecies empathy.  
• Ecology of Materials – living plants and clay vessels are not mere props but active responders with their own “agencies,” foregrounding material vitality (Ingold, Bennett).  
• Experiential Impact – visitors inhabit a “soft machine” in which sight, sound, touch, and scent are modulated by neural patterns, provoking reflection on the boundaries between mind, matter, and environment.  
• Future Ethical Pathways – authors propose live organoid integration and optional participatory controls for audiences, preserving endogenous neural dynamics while enhancing legibility and care.  

In sum, Simulacra Naturae weaves together high-density neural data, artificial-life simulations, generative AI imagery, spatialized audio, responsive ceramics, and living botanicals into a singular eco-computational environment—one that materializes cognition as a shared, co-creative, and ethically fraught process.

Source: https://www.emergentmind.com/topics/parallel-mechanisms