How Wireless Edge transformation will aid in the development of photorealistic mobile augmented reality systems.
(Extended Reality, XR) already provides users with revolutionary capabilities, but achieving even greater realism and a new level of immersion, considering the performance and cooling limitations of thin portable gadgets, is quite a non-trivial task.
A Look into the Future: Sleek and Stylish Augmented Reality Glasses
With the transformation of Wireless Edge systems (wireless systems operating at the intersection of network and gadget), a new era of distributed computing will begin, where 5G technologies, on-device data processing, and edge cloud computing will be actively used. This transformation is expected to help find optimized solutions.
The Best of Both Worlds
What if we could take all the advantages of mobile XR devices and combine them with the performance of PC-based XR systems? Mobile augmented reality gadgets are the future of XR, as they can be used anywhere and anytime, without prior preparation and wires. While the implementation of PC-based XR cannot be considered the future of augmented reality, it has a significant advantage – it is not limited by power consumption and cooling efficiency, allowing for more intensive computations. With 5G networks offering lower latency and high bandwidth, we plan to harness the best of both approaches. Distributing computational tasks using 5G technologies will deliver the best of both worlds – an unlimited mobile XR experience and photorealistic graphics in thin and affordable XR headsets. As a result, users will experience 'limitless' possibilities in every sense, as they will be able to connect to augmented reality wherever they want, and the level of immersion in XR applications will be even higher.
Technologies of limitless augmented reality aim to combine the best of mobile XR devices and PC-connected devices
Enhancing the efficiency of augmented reality data processing on the device
Working with graphics in augmented reality systems requires significant computational power and is sensitive to response time. A systematic approach is essential for proper distribution of calculations. Let’s explore how the use of edge cloud computing can enhance device processing more effectively, creating limitless augmented reality systems with photorealistic graphics (more detailed information is available in our ).
When a user of the XR system turns their head, the device processing determines the head's position and sends this data to the edge cloud via a 5G channel with minimal delay and high-quality service metrics. This system uses the received head position data to perform partial rendering of the next frame, encode the data, and send it back to the XR headset. The headset then decodes the latest received packet and, using regularly updated data on changes in head position, continues visualizing and adjusting the image to minimize the motion-to-photon latency (the delay between a user's head position change and the image change in the headset). It’s important to note that according to this metric, all processing must be completed within a time frame not exceeding 20 milliseconds. Exceeding this threshold causes user discomfort and reduces the level of immersion in augmented reality.
Device computations are complemented by edge cloud computing and a 5G channel with low response time.
As you can see, achieving a quality immersive effect in XR requires a systematic solution with low response times and high reliability, making 5G networks with their minimal latency and high bandwidth critically important for XR. As 5G networks advance and their coverage increases, users will be able to enjoy photorealistic graphics in XR applications in many locations and can be confident that a premium standalone XR experience will remain accessible through effective on-device computing.
And this is a key point that deserves to be emphasized once again: data processing on the device remains a crucial factor in any scenario. In offline mode, on-device computing handles all calculations related to XR. When working in conjunction with edge cloud computing, on-device processing will enable XR headsets to deliver energy-efficient, high-performance visualization and low-latency tracking.
Creating 'limitless' augmented reality
Qualcomm Technologies is already working on high-performance autonomous mobile XR solutions and remains a leader in worldwide. But we cannot bring our vision of 'limitless' XR to life alone. We actively collaborate with the largest players in the XR and 5G ecosystems, including OEMs, content creators, service providers, and infrastructure partners, as the separate rendering architecture is a systemic solution.
Participants in the XR and 5G ecosystems must work together to make 'limitless' XR technology a reality
As a result of synergies, all participants in the XR ecosystem will reap significant benefits from its active development, and this benefit is termed 'consumer adoption growth.' For example, telecom operators will gain certain advantages from the overall transformation of Wireless Edge, but let's focus on the benefits specifically from the evolution of limitless XR. Firstly, with the advent of 5G networks, enhanced broadband will increase capacity, reduce latency, and ensure guaranteed quality of service, enabling the emergence of richer and more interactive XR applications. Secondly, as operators increase capacities for edge cloud computing, they will be able to offer entirely new services to the mass market, such as XR applications with photorealistic graphics.
We believe that a significant advantage will be the new revolutionary user experience, including collaborative real-time interaction, multiplayer games with photorealistic graphics, a new generation of video supporting six degrees of freedom, immersive educational applications, and personalized shopping like never before. These prospects inspire us, and we look forward to fruitful collaboration with other ecosystem participants — this work will help turn our XR vision into reality.
Source: habr.com
