A system to bring real time reconstructions of objects into the virtual environment for use in interaction-intensive applications
Bottone, Michael Anthony
MetadataShow full item record
Bringing real objects into the virtual world has been shown to increase usability and presence in virtual reality applications. This paper presents a system to generate a real time virtual reconstruction of real world user interface elements for use in a head mounted display based driving simulator. Our system uses sensor fusion algorithms to combine data from depth and color cameras to generate an accurate, detailed, and fast rendering of the user’s hands while using the simulator. We tested our system and show in our results that the inclusion of real objects in the virtual environment increases the immersion, presence, and usability of the simulation. Our system can also be used to bring other real objects into the virtual world, especially when accuracy, detail, and real time updates are desired.