Type of Publication: Article in Collected Edition

"Computer, Generate!” – Investigating User Controlled Generation of Immersive Virtual Environments

Author(s):

Liebers, Carina; Pfützenreuter, Niklas; Auda, Jonas; Gruenefeld, Uwe; Schneegass, Stefan

Title of Anthology:

HHAI 2024: Hybrid Human AI Systems for the Social Good

pages:

213-227

Publisher:

IOS Press

Location(s):

Malmö

Publication Date:

2024

Digital Object Identifier (DOI):

doi:10.3233/FAIA240196

Fulltext:

"Computer, Generate!” – Investigating User Controlled Generation of Immersive Virtual Environments (1.62 MB)

Link to complete version:

https://doi.org/10.3233/FAIA240196

Citation:

Download BibTeX

Abstract

For immersive experiences such as virtual reality, explorable worlds are often fundamental. Generative artificial intelligence looks promising to accelerate the creation of such environments. However, it remains unclear how existing interaction modalities can support user-centered world generation and how users remain in control of the process. Thus, in this paper, we present a virtual reality application to generate virtual environments and compare three common interaction modalities (voice, controller, and hands) in a pre-study (N = 18), revealing a combination of initial voice input and continued controller manipulation as best suitable. We then investigate three levels of process control (all-at-once, creation-before-manipulation, and step-by-step) in a user study (N = 27). Our results show that although all-at-once reduced the number of object manipulations, participants felt more in control when using the step-by-step approach.