2000 character limit reached
Sketch Vision: Artificial Intelligence with Sight for Imagination (2312.12270v1)
Published 19 Dec 2023 in cs.GR
Abstract: Visual design relies on seeing things in different ways, acting on them, and seeing results to act again. Parametric design tools are often not robust to design changes that result from sketching over the visualization of their output. We propose a sketch to 3d workflow as an experiment medium for evaluating neural networks and their latent spaces as a representation that is robust to overlay sketching.
- Aish, R. First build your tools. Inside Smartgeometry: Expanding the Architectural Possibilities of Computational Design (2013), 36–49.
- Learning to generate line drawings that convey geometry and semantics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2022), pp. 7915–7925.
- Coons, S. A. An outline of the requirements for a computer-aided design system. In Proceedings of the May 21-23, 1963, spring joint computer conference (1963), pp. 299–304.
- Messy talk and clean technology: communication, problem-solving and collaboration using building information modelling. The Engineering Project Organization Journal 1, 2 (2011), 83–93.
- Computer vision: a modern approach. prentice hall professional technical reference, 2002.
- Image style transfer using convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (2016), pp. 2414–2423.
- Visualizing making: Shapes, materials, and actions. Design Studies 41 (2015), 29–50.
- Arbitrary style transfer in real-time with adaptive instance normalization. In Proceedings of the IEEE international conference on computer vision (2017), pp. 1501–1510.
- Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (2017), pp. 1125–1134.
- Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision (2016), Springer, pp. 694–711.
- Shap-e: Generating conditional 3d implicit functions. arXiv preprint arXiv:2305.02463 (2023).
- Making grammars: from computing with shapes to computing with things. Design Studies 41 (2015), 8–28.
- Collecting a large-scale dataset of fine-grained cars.
- Llach, D. C. Builders of the Vision: Software and the Imagination of Design. Routledge, 2015.
- Boosting monocular depth estimation models to high-resolution via content-adaptive multi-resolution merging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2021), pp. 9685–9694.
- Minsky, M. Society of mind. Simon and Schuster, 1988.
- Mitchell, W. J. The logic of architecture: Design, computation, and cognition. JSTOR, 1990.
- Automatic re-topology and uv remapping for 3d scanned objects based on neural network. In Proceedings of the 31st International Conference on Computer Animation and Social Agents (2018), pp. 48–52.
- Machines’ perception of space: employing 3d isovist methods and a convolutional neural network in architectural space classification.
- Learning transferable visual models from natural language supervision. In International conference on machine learning (2021), PMLR, pp. 8748–8763.
- Embodied prototyping: exploration of a design-fabrication framework for large-scale model manufacturing. Computer-Aided Design and Applications 13, 1 (2016), 124–137.
- Steinfeld, K. Dreams may come.
- Stiny, G. Shape: talking about seeing and doing. MIt Press, 2006.
- Sutherland, I. Structure in drawings and the hidden-surface problem. Reflections on computer aids to design and architecture (1975), 73–85.
- Terzidis, K. Algorithmic architecture. Routledge, 2006.
- Investigation on the use of illuminated clay in automotive styling. In 6th International Conference on Computer-Aided Industrial Design and Conceptual Design (CAID&CD), Delft, NETHERLANDS (2005), Citeseer, pp. 514–519.
- Disn: Deep implicit surface network for high-quality single-view 3d reconstruction. In NeurIPS (2019).
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.