An experimental plugin has been proposed for the KWin compositor that turns KDE into a desktop environment for virtual reality systems. The plugin allows the interface to be formed not on a physical monitor but in the form of virtual screens in a 3D space, which can be interacted with through augmented reality glasses or 3D headsets.
It supports floating windows, integration of physical and virtual screens, arbitrary positioning of screens in 3D space, control via keyboard without the need for a mouse or VR controllers, and user position tracking mode. The rendering utilizes the Qt Quick 3D Xr module, tied to the OpenXR runtime. The Monado platform was tested as the runtime in conjunction with Rokid Max augmented reality glasses and HP G2, as well as server WiVRn with the Quest 3 3D headset.
To facilitate input, a KwinVrInputDevice has been implemented that allows pointer movement similar to a mouse, but without the limitations of the output area. The standard capabilities of KWin have been utilized for window placement in 3D space, slightly modified for pop-ups and extended with the ability to move windows beyond the output boundaries. It requires applying patches to Qt and XWayland. Most patches have already been accepted into the Qt codebase and will be included in releases 6.10.2 and 6.11, with only 4 patches remaining unincorporated.
Source: opennet.ru
