Note: the demo video needs to be played using Youtube

Introduction

In order to improve the efficiency of virtual software development and testing, we propose a VR visual programming toolkit based on gesture interaction. Considering that VR developers need to switch frequently between different operating environments during debugging, we suggest unifying the development and debugging of VR software in a virtual environment. Because of the low precision of keyboard input in VR, the applicability of text language in VR programming is poor. We propose a graphical language.

By modularizing common functions, developers can quickly edit program block diagrams through gestures and quickly test in plain clothes. On this basis, a visual programming toolkit under Unity environment is developed. Currently, the toolkit supports editing simple UI components and Shader in VR.

UI Editing Module

For more information,:Research on Visual Programming System of Gesture Interaction Interface in VR

The emergence of virtual reality (VR) brings great challenges to user interface design. Due to the lack of systematic summary of the characteristics of virtual reality environment and user interface model, it hinders us from developing mature design tools. The purpose of this work is to build a VR interface development system based on gesture interaction and visual programming. Through the analysis of the interface features and interaction characteristics in the three-dimensional environment, a set of efficient user interface development process is formed. This workflow can easily develop and debug the 3D interface in VR.

Note: the demo video needs to be played using Youtube