Zero-to-CAD: Automated CAD Synthesis

• Zero-to-CAD is a workflow that automatically generates fully parameterized CAD models from unstructured inputs using iterative, closed-loop optimization.
• It leverages agentic generation and multimodal reverse engineering to convert textual, image, and point cloud data into interpretable CAD code sequences.
• The system employs rigorous validation and geometric reasoning to ensure high fidelity, manufacturability, and robust performance across complex design tasks.

Zero-to-CAD refers to workflows, algorithms, and research pipelines that automatically produce fully parameterized, executable CAD construction sequences—without human supervision or curated CAD program data—starting from diverse nonparametric or unstructured input modalities such as images, point clouds, 3D scans, or textual descriptions. Modern Zero-to-CAD frameworks combine closed-loop optimization, data-driven learning, and agentic search to bridge from raw sensory or geometric input to editable, interpretable procedural CAD code, supporting downstream tasks such as editing, manufacturing, and automated engineering analysis.

1. Agentic and Closed-Loop Synthesis of CAD Programs

Recent Zero-to-CAD pipelines are distinguished by embedding LLMs or other generative algorithms inside a structured, feedback-driven CAD execution environment, formalized as a Markov decision process (MDP). An explicit state in this MDP includes the current description, partial code sequence, and intermediate geometry, while actions correspond to incrementally appending code lines—each specifying an operation such as sketch, extrude, fillet, or Boolean union.

The core innovation is an iterative process that generates, executes, and validates candidate CAD scripts. On each iteration, the agent:

• Generates the next step of the CAD code using a LLM.
• Executes the current program using a CAD kernel with full geometric and topological validation.
• Observes feedback (success, syntax/runtime error, or geometric/DFM violation).
• Optionally, retrieves additional documentation or error patterns for guided correction.
• Refines the program until all validation checks are satisfied or an attempt limit is reached.

The process self-corrects until a valid, parameterized, and geometrically robust CAD model is synthesized. This loop is crucial for escaping local optima and for achieving high success rates in zero-shot, data-free settings (Ataei et al., 27 Apr 2026, Barkley et al., 27 Mar 2026).

2. Multimodal Reverse Engineering and Optimization

Zero-to-CAD frameworks support a spectrum of inverse problems: text-to-CAD (e.g., natural-language prompts), image-to-CAD, point-cloud-to-CAD, and mesh-to-CAD. Reverse engineering from geometric inputs typically follows a two-stage or cascaded optimization paradigm:

• First, an explicit or implicit parametric CAD program representation is defined—typically as a sequence of operations (sketch, extrude, revolve, fillet, chamfer, Boolean, etc.) with associated geometric arguments.
• Then, hybrid optimization alternates between discrete candidate proposals (“Which operator next?”) and continuous parameter fitting (e.g., extrusion heights, radii) to incrementally assemble and refine the program.

This approach is exemplified by "CADFit," which solves mesh-to-CAD or image-to-CAD via an IoU– and Chamfer–driven objective over CAD programs. At each iteration, candidate operations are simulated in the CAD kernel; continuous parameter sweeps maximize geometric overlap and minimize invalidity. Invalid operations (e.g., ones that violate B-rep constraints or introduce topological artifacts) are pruned immediately (Nehme et al., 2 May 2026).

Modalities for input include:

• Natural language (decomposed into structured JSON plans and feature specifications) (Barkley et al., 27 Mar 2026)
• RGB/RGB-D images (decoded into geometric sketches, mesh proxies, or vector wireframes) (Chen et al., 2024, Chen et al., 7 Apr 2025, You et al., 2024)
• Point clouds (projected through deep, often transformer-based encoders) (Rukhovich et al., 2024, Dupont et al., 2024, Nehme et al., 2 May 2026)
• 2D design drawings via deep learned extraction and vectorization (M et al., 2024)

3. Program Validation, Closed-Loop Correction, and Geometric Reasoning

Geometric validation is pivotal in Zero-to-CAD: ensuring that the generated program compiles, produces a watertight solid, and satisfies all dimensional, topological, and feature constraints implied by the input or prompt.

Two nested correction loops are typical:

• An inner error-resolution loop addresses code-level failures, using traceback-guided matching to knowledge-base error–solution pairs for standard failures (fillet violations, Boolean errors, sketch closings, arc/radius invalidities) and deterministic retrieval of API documentation for correction (Barkley et al., 27 Mar 2026).
• An outer geometric validation loop extracts kernel-level features (bounding boxes $B_i$, volume $V$, face/edge counts, solid validity), producing rendered views and cross-referencing these with an independent vision-language "Judge" for pass/fail and analytic feedback (including high-level shape correctness and explicit dimensional mismatches) (Barkley et al., 27 Mar 2026, Ataei et al., 27 Apr 2026).

Metrics for evaluation include:

• Intersection-over-Union (IoU):

$$\mathrm{IoU}(P, Q) = \frac{\mathrm{vol}(P\cap Q)}{\mathrm{vol}(P\cup Q)}$$

• Chamfer Distance (CD):

$$\mathrm{CD}(P, Q) = \frac{1}{|P|}\sum_{p\in P} \min_{q\in Q} \|p-q\|_2 + \frac{1}{|Q|} \sum_{q\in Q} \min_{p \in P} \|q-p\|_2$$

• F1 Score at a fixed threshold (e.g., 1 mm).

Ablations in several works demonstrate that removing the vision-language judge or geometric validation substantially degrades program fidelity and execution success rate, especially on complex parts (Barkley et al., 27 Mar 2026).

4. Data Synthesis, Scaling, and Dataset Design

Because large collections of real construction-history CAD sequences are rare, modern Zero-to-CAD frameworks rely on synthetic data generation and agentic, feedback-driven corpus construction. Key strategies include:

• Agentic search with documentation and feedback loops: An LLM generates millions of unique, parameterized CadQuery scripts in a closed-loop, repair-and-validate regime, covering a rich vocabulary of operations (extrudes, revolves, lofts, cuts, fillets, chamfers, patterns) (Ataei et al., 27 Apr 2026, Elistratov et al., 18 Feb 2026).
• Evolution-based parameterized generator expansion: Starting from a minimal set of hand-coded primitives, iterative program evolution, VLM-guided edits, and staged geometry/text validation grow the design space toward high complexity (Elistratov et al., 18 Feb 2026).
• Synthetic dataset balancing and augmentation: To mitigate length and operation-type imbalance, tools such as SynthBal generate uniform-length, operation-rich corpora by noise-injection and part swapping, improving performance especially for long or high-complexity sequences (Yu et al., 17 Sep 2025).
• Curated diversity by clustering: Clustering large raw synthetic datasets in geometric embedding space and subsampling ensures high operation, style, and topology diversity for challenging downstream vision-to-CAD learning (Ataei et al., 27 Apr 2026).

This allows the training of vision-language or geometric-predictive models on million-scale paired datasets (rendered images/views and executable scripts), achieving robust generalization to synthetic and out-of-distribution test sets (Ataei et al., 27 Apr 2026, Elistratov et al., 18 Feb 2026, Yu et al., 17 Sep 2025).

5. Downstream Applications and Quantitative Performance

Zero-to-CAD models serve as universal backbone infrastructure for a wide range of engineering and design tasks:

• Image-/Scan-/Mesh-to-Sequence Reconstruction: Inputting images, scanned point clouds, or meshes, and producing executable, interpretable CadQuery code for physical reproduction, manufacturing, and editable modeling (Ataei et al., 27 Apr 2026, Nehme et al., 2 May 2026, Barkley et al., 27 Mar 2026, Rukhovich et al., 2024, Chen et al., 2024).
• Industrial-grade complexity: Through agentic and evolutionary code synthesis, modern datasets and models cover parametric operations well beyond simple sketch–extrude, including fillets, chamfers, lofts, sweeps, and patterns (Elistratov et al., 18 Feb 2026, Ataei et al., 27 Apr 2026).
• Editing, Design-for-Manufacturability (DFM), and Meta-Design: Generated parametric code enables downstream editing, semantic intent manipulation, and integration with DFM pipelines.
• Interactive semantic parameterization: Zero-shot neurosymbolic reparameterization enables designers to explore meaningful variations of reference models along designer-intent axes without pre-annotated datasets (Kodnongbua et al., 2023).

Empirical metrics at scale (selected):

• Image-to-CAD on Zero-to-CAD dataset (Ataei et al., 27 Apr 2026): Qwen3-VL-2B fine-tuned achieves $82.1\%$ success, median $\mathrm{IoU}=0.847$, mean CD = $0.0143$.
• CADSmith (Barkley et al., 27 Mar 2026): median F1 scores up to $0.9846$, median $\mathrm{IoU}=0.9629$, mean CD $0.74$ mm on 100 prompts.
• CADEvolve-M (Elistratov et al., 18 Feb 2026): DeepCAD $V$0, Fusion360 $V$1, invalidity $V$2.
• CADFit (mesh→CAD, "Hard" ABC): $V$3, CD $V$4, IR $V$5 (Nehme et al., 2 May 2026).

Ablative and cross-dataset results consistently show modern closed-loop, multi-agent pipelines achieve near-zero invalid output, superior geometric fidelity, and industrial-complexity coverage previously unattainable in single-pass, dataset-oracle, or mesh-only methods (Barkley et al., 27 Mar 2026, Ataei et al., 27 Apr 2026, Elistratov et al., 18 Feb 2026, Nehme et al., 2 May 2026).

6. Limitations and Open Challenges

Despite enabling zero-data, high-fidelity CAD synthesis, current frameworks face several foundational limitations:

• Binary reward shaping: Most pipelines rely on binary valid/invalid feedback in closed-loop synthesis. Integrating richer design objectives (stiffness, balance, manufacturability constraints) remains open (Ataei et al., 27 Apr 2026, Barkley et al., 27 Mar 2026).
• Design intent recovery: While geometric and syntax correctness can be achieved, recovering implicit designer intent (e.g., semantic constraints, families of variation) without human-provided examples poses fundamental challenges (Kodnongbua et al., 2023).
• Synthetic-to-real gap: Although vision-CAD models pre-trained on synthetic data generalize to some OOD or real images, stylistic conventions and feature realism sometimes lag behind human-annotated data (Ataei et al., 27 Apr 2026, Chen et al., 7 Apr 2025).
• Operation coverage and code validity: Certain operations with intricate feasibility conditions (e.g., complex lofts, non-manifold Booleans, intricate patterns) remain hard to synthesize robustly without advanced geometric validators or hybrid symbolic-neural corrections (Yu et al., 17 Sep 2025, Nehme et al., 2 May 2026).
• Scalability and multimodality: Integrating higher-order differential constraints, richer semantic modalities (e.g., engineering drawings, specifications), or direct photometric supervision requires further research (Yu et al., 17 Sep 2025, M et al., 2024, Chen et al., 2024).

Future work centers on integrating differentiable kernels for end-to-end proxy losses, expanding operation vocabularies, enforcing domain- or physical constraints, and merging symbolic, neural, and evolutionary optimization for maximal robustness and expressivity.

---

References:

• "Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data" (Ataei et al., 27 Apr 2026)
• "CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validation" (Barkley et al., 27 Mar 2026)
• "CADEvolve: Creating Realistic CAD via Program Evolution" (Elistratov et al., 18 Feb 2026)
• "CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization" (Nehme et al., 2 May 2026)
• "GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancing" (Yu et al., 17 Sep 2025)
• "CAD-Recode: Reverse Engineering CAD Code from Point Clouds" (Rukhovich et al., 2024)
• "SE-CADNet: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operations" (Li et al., 2023)
• "Zero-shot CAD Program Re-Parameterization for Interactive Manipulation" (Kodnongbua et al., 2023)
• "Advanced Knowledge Extraction of Physical Design Drawings, Translation and conversion to CAD formats using Deep Learning" (M et al., 2024)
• "CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images" (Chen et al., 7 Apr 2025)
• "TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Clouds" (Dupont et al., 2024)