Squidgets: Sketch-based Widget Design and Direct Manipulation of 3D Scene (2402.06795v1)
Abstract: Squidgets or 'sketch-widgets' is a novel stroke-based UI framework for direct scene manipulation. Squidgets is motivated by the observation that sketch strokes comprising visual abstractions of scene elements implicitly provide natural handles for the direct manipulation of scene parameters. Configurations of such strokes can further be explicitly drawn by users to author custom widgets associated with scene attributes. Users manipulate a scene by simply drawing strokes: a squidget is selected by partially matching the drawn stroke against both implicit scene contours and explicitly authored curves, and used in-situ to interactively control scene parameters associated with the squidget. We present an implementation of squidgets within the 3D modeling animation system Maya, and report on an evaluation of squidget creation and manipulation, by both casual users and professional artists.
- Crossy: a crossing-based drawing application. In Steven Feiner and James A. Landay, editors, Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, Santa Fe, NM, USA, October 24-27, 2004, pages 3–12. ACM, 2004.
- Inverse kinematics techniques in computer graphics: A survey. Computer Graphics Forum, 37:35–58, 09 2018.
- ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models. In Proc. User Interface Software and Technology, 2008.
- Line drawings from 3d models: A tutorial. Found. Trends. Comput. Graph. Vis., 11(1–2):1–159, sep 2019.
- Mouse, tactile, and tangible input for 3d manipulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, page 4727–4740, New York, NY, USA, 2017. Association for Computing Machinery.
- E. A. Bier. Skitters and jacks: Interactive 3d positioning tools. In Proc. I3D 86, pages 183–196, 1986.
- E. A. Bier. Snap-dragging in three dimensions. In Proc. I3D 1990, pages 193–204, 1990.
- 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., USA, 2004.
- Sketchimo: Sketch-based motion editing for articulated characters. ACM Trans. Graph., 35(4), jul 2016.
- Active contours without edges. IEEE Transactions on image processing, 10(2):266–277, 2001.
- The mental canvas: A tool for conceptual architectural design and analysis. In Proceedings of the 15th Pacific Conference on Computer Graphics and Applications, PG ’07, page 201–210, USA, 2007. IEEE Computer Society.
- The line of action: An intuitive interface for expressive character posing. ACM Trans. Graph., 32(6), nov 2013.
- Non-photorealistic rendering. CRC Press, 2001.
- Aaron Hertzmann. Introduction to 3d non-photorealistic rendering: Silhouettes and outlines. Non-Photorealistic Rendering. SIGGRAPH, 99(1), 1999.
- Spatial keyframing for performance-driven animation. In ACM SIGGRAPH 2007 Courses, SIGGRAPH ’07, page 25–es, New York, NY, USA, 2007. Association for Computing Machinery.
- Teddy: A sketching interface for 3d freeform design. SIGGRAPH ’99, pages 409–416, New York, NY, USA, 1999. ACM Press/Addison-Wesley Publishing Co.
- Computational support for sketching in design: A review. Foundations and Trends in Human-Computer Interaction, 2:1–93, 01 2009.
- Optimizing ui layouts for deformable face-rig manipulation. ACM Trans. Graph., 40(4), jul 2021.
- Direct manipulation blendshapes. IEEE Computer Graphics and Applications, 30(4):42–50, 2010.
- Line drawings via abstracted shading. ACM Trans. Graph., 26(3):18, 2007.
- Dag amendment for inverse control of parametric shapes. ACM Transactions on Graphics, 40(4):173:1–173:14, 2021.
- A survey on 3d virtual object manipulation: From the desktop to immersive virtual environments. Computer Graphics Forum, 38(1):21–45, 2019.
- Meshless deformations based on shape matching. ACM transactions on graphics (TOG), 24(3):471–478, 2005.
- A sketch-based interface for detail-preserving mesh editing. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH), 24(3):1142–1147, 2005.
- Juxtaform: Interactive visual summarization for exploratory shape design. ACM Trans. Graph., 42(4), jul 2023.
- Wires: A geometric deformation technique. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’98, 1998.
- Sketching and Composing Widgets for 3D Manipulation. Computer Graphics Forum, 27(2):301–310, 2008.
- Ivan E. Sutherland. Sketch pad a man-machine graphical communication system. In Proceedings of the SHARE Design Automation Workshop, DAC ’64, pages 6.329–6.346, New York, NY, USA, 1964. ACM.
- James T Todd. The visual perception of 3d shape. Trends in cognitive sciences, 8(3):115–121, 2004.
- Shortstraw: A simple and effective corner finder for polylines. SBIM, 8:33–40, 2008.
- Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, UIST ’07, page 159–168, New York, NY, USA, 2007. Association for Computing Machinery.
- Object-oriented drawing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, page 4610–4621, New York, NY, USA, 2016. Association for Computing Machinery.
- True2form: 3d curve networks from 2d sketches via selective regularization. ACM Transactions on Graphics, 33(4), 2014.
- Sketch: An interface for sketching 3d scenes. In Proc. SIGGRAPH ’96, pages 163–170, 1996.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.