Note: Demo videos require Youtube to play

Project Overview

To improve the efficiency of virtual environment development, we developed an innovative VR visual programming toolkit based on gesture interaction. Addressing the pain point of VR developers needing to frequently switch operating environments during debugging, we unified VR software development and debugging work in the virtual environment. Considering the limitations of keyboard input in VR environments and the low applicability of traditional text programming languages, we proposed a new graphical programming solution.

By modularizing common functions, developers can quickly build program diagrams through intuitive gesture operations and achieve instant editing and testing. Based on this concept, we developed a complete visual programming toolkit in the Unity environment. Currently, this toolkit successfully supports visual programming of UI components and Shaders in VR environments.

UI Editing Module

Details: Research on Visual Programming System of Gesture Interaction Interface in VR

The rise of Virtual Reality (VR) technology has brought new challenges to user interface design. Currently, the development of mature design tools is constrained by the lack of systematic research on VR environment characteristics and user interface models. This project is dedicated to building a VR interface development system that integrates gesture interaction and visual programming. Through in-depth analysis of interface features and interaction characteristics in three-dimensional environments, we have established an efficient user interface development workflow that significantly improves the development and debugging efficiency of 3D interfaces in VR environments.

Note: Demo videos require Youtube to play