Siemens Healthineers launched the Cinematic Reality App designed for Apple Vision Pro that enables users to view immersive, interactive holograms of the human body captured through medical scans.
RT’s Three Key Takeaways
- Siemens Healthineers launched the Cinematic Reality app for Apple Vision Pro, enabling immersive, interactive 3D visualization of human anatomy from medical scans for applications like surgical planning, medical education, and patient communication.
- The app leverages Apple Vision Pro’s spatial computing and intuitive gesture controls, allowing users to zoom, rotate, and interact with photorealistic renderings directly within their real-world environment without needing an external computer.
- Designed for clinical and educational purposes, the app uses advanced rendering algorithms optimized for Apple Silicon, offering potential future applications in interdisciplinary collaboration, preoperative planning, and enhancing patient understanding of medical scans.
Siemens Healthineers launched a Cinematic Reality App designed for Apple Vision Pro that enables users such as surgeons, medical students, and patients to view immersive, interactive holograms of the human body captured through medical scans in their real-world environment.
Visualizing the renderings through the app could assist in surgical planning and medical education, or help patients visualize procedures. The Cinematic Reality app is now available on the Apple App Store.
“Cinematic Reality gives people the opportunity to immerse themselves in a world of photorealistic renderings of the human anatomy,” said Christian Zapf, head of Digital and Automation at Siemens Healthineers. “Apple Vision Pro perfectly presents that three-dimensional experience, combined with great flexibility and standalone use. We see great potential for the technology for clinical as well as educational purposes.”
Apple Vision Pro, the company’s first spatial computer, seamlessly blends digital content with the user’s physical world. Intuitive gestures allow users to interact with apps by simply looking at them, tapping their fingers to select, flicking their wrist to scroll, or using a virtual keyboard or dictation to type. Using the Cinematic Reality app on Apple Vision Pro allows users to zoom into details of clinical images, enlarging content and rotating around a rendering of the human body, and provides basic two-dimensional reading tools such as scrolling. Cinematic Reality app users can simply visualize clinical cases directly through the native app without connecting to an additional computer.
The Cinematic Reality app is designed to take advantage of the power of Apple Silicon and Metal, laying a strong foundation for future development. The app helps to provide a more realistic way of visualizing organs or body parts, making it possible to better explain clinical cases to patients, discuss clinical questions around referrals, or educate medical students. In the future, this could assist surgeons in preoperative planning, facilitate interdisciplinary communication between specialists in different fields, or help nonradiologists and patients to better understand scans and conditions.
“We have further optimized our existing algorithm of Cinematic Reality to allow computationally intense methods to run on Apple Vision Pro’s M2 processor,” said Sebastian Krueger, lead developer of Cinematic Reality at Siemens Healthineers. “The rendering technique is used to simulate the way light interacts with objects in a virtual environment, producing highly realistic lighting and reflections in the resulting images.”
Source: Siemens Healthineers
1 Cinematic Reality for Apple Vision Pro is a prototype. It is under development and not commercially available. Its future availability cannot be guaranteed.
Image: ID 337802846 © Ifeelstock | Dreamstime.com Apple Vision Pro VR Headset Hero Shot. Paris, France – Sep 20, 2024: The iconic Apple Vision Pro spatial computer displayed prominently, blending digital content with physical space using revolutionary technology