CreatureCreator: Co-Creating 3D Models with AI for Video Games via Sculpting and Drawing
Creating 3D assets is essential for game development. Modeling requires time and technical skills, and fast prototyping is challenging, especially for novice designers. To make complex 3D modeling more accessible while strengthening creativity, we present CreatureCreator, a tool that enables users to generate 3D models from an image of a created artifact. We investigated two input modalities: drawing with pen and paper and sculpting with clay. Adding an analog input modality to the generation process could lower the entry barrier for diverse user groups, enabling intuitive and creative modeling. In a within-subject study with game design-experienced participants (n=20), both modalities scored highly for user experience, engagement, and creativity support, with the clay input especially valued for its generated models and enhanced sense of control. The interaction workflow supports playful exploration by allowing users to experiment with parameters and using AI as a production and/or ideation partner.