4Doodle: Two-handed Gestures for Immersive Sketching of Architectural Models (2405.18887v3)
Abstract: Three-dimensional immersive sketching for content creation and modeling has been studied for some time. However, research in this domain mainly focused on CAVE-like scenarios. These setups can be expensive and offer a narrow interaction space. Building more affordable setups using head-mounted displays is possible, allowing greater immersion and a larger space for user physical movements. This paper presents a fully immersive environment using bi-manual gestures to sketch and create content freely in the virtual world. This approach can be applied to many scenarios, allowing people to express their ideas or review existing designs. To cope with known motor difficulties and inaccuracy of freehand 3D sketching, we explore proxy geometry and a laser-like metaphor to draw content directly from models and create content surfaces. Our current prototype offers 24 cubic meters for movement, limited by the room size. It features infinite virtual drawing space through pan and scale techniques and is larger than the typical 6-sided cave at a fraction of the cost. In a preliminary study conducted with architects and engineers, our system showed a clear promise as a tool for sketching and 3D content creation in virtual reality with a great emphasis on bi-manual gestures.
- 1998. Aiding orientation performance in virtual environments with proprioceptive feedback. In Virtual Reality Annual International Symposium, 1998. Proceedings., IEEE 1998, IEEE, 28–33.
- 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics, ACM, New York, NY, USA, I3D ’97, ACM, 35–ff.
- 2004. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, USA.
- 2011. A multimode immersive conceptual design system for architectural modeling and lighting. In 3D User Interfaces (3DUI), 2011 IEEE Symposium on, ACM, 15–18.
- 2012. Mockup builder: Direct 3d modeling on and above the surface in a continuous interaction space. In Proceedings of Graphics Interface 2012, GI ’12, Canadian Information Processing Society, 173–180.
- 2000. Towards immersive modeling - challenges and recommendations: A workshop analyzing the needs of designers. In In Proc. of the 6th Eurographics Workshop on Virtual Environments, Eurographics, 145–156.
- 1996. Aperture based selection for immersive virtual environments. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST ’96, ACM, 95–96.
- 2009. Sketch-based interfaces and modeling (sbim): Investigating three-dimensional sketching for early conceptual design-results from expert discussions and user studies. Comput. Graph. 33, 4 (Aug.), 462–473.
- 2013. Mastering digital materiality in immersive modelling. In Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling, SBIM ’13, ACM, 15–22.
- Kallio, K. 2005. 3d6b editor: Projective 3d sketching with line-based rendering. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, The Eurographics Association, 73–79.
- 2001. Cavepainting: A fully immersive 3d artistic medium and interactive experience. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, I3D ’01, ACM, 85–93.
- 2008. Scientific sketching for collaborative vr visualization design. IEEE Transactions on Visualization and Computer Graphics 14, 4 (July), 835–847.
- kheng Lim, C. 2003. An insight into the freedom of using a pen: Pen-based system and pen-and-paper. In In Proc. 6th Asian Design International Conference.
- 2004. Possibilities and limitations of immersive free-hand expression: A case study with professional artists. In Proceedings of the 12th Annual ACM International Conference on Multimedia, MULTIMEDIA ’04, ACM, 504–507.
- Mäkelä, W. 2004. Drawing, painting, and sculpting in the air: Development studies about an immersive free-hand interface for artists. worksop paper. In in IEEE VR 2004, IEEE.
- 2009. Sketch-based modeling: A survey. Computers & Graphics 33, 1, 85–103.
- 2010. Shape modeling with sketched feature lines in immersive 3d environments. In Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SBIM ’10, 127–134.
- 1997. Image plane interaction techniques in 3d immersive environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics, ACM, New York, NY, USA, I3D ’97, ACM, 39–ff.
- 1996. The go-go interaction technique: Non-linear mapping for direct manipulation in vr. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST ’96, 79–80.
- 2007. Improve: Collaborative design review in mobile mixed reality. In Virtual Reality, R. Shumaker, Ed., vol. 4563 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 543–553.
- 1995. Virtual reality on a wim: Interactive worlds in miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, CHI ’95, 265–272.
- 2010. Investigating the learnability of immersive free-hand sketching. In Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SBIM ’10, 135–142.
- 2009. Augmented reality in-situ 3d sketching of physical objects. In Intelligent UI Workshop on Sketch Recognition, ACM.
- Fernando Fonseca (4 papers)
- Daniel Mendes (5 papers)
- Alfredo Ferreira (4 papers)
- Joaquim Jorge (27 papers)
- Maurício Sousa (8 papers)