Early this morning, the WWDC23 Global Developers Conference officially opened.
At the conference, Apple demonstrated new systems including iOS 17, iPadOS 17, watchOS 10 and macOS Sonoma. In terms of hardware, Apple released the 15-inch MacBook Air, Mac Studio with M2 Ultra and Mac Pro.
Additionally, Apple released its first spatial computing device, the Apple Vision Pro .
The Apple Vision Pro runs on Apple's latest operating system, visionOS , which Apple calls "the first operating system designed for spatial computing ."
At an architectural level, visionOS shares core modules with macOS and iOS, but adds a "real-time subsystem" for handling interactive visual effects on Apple Vision Pro.
The visionOS architecture diagram is as follows:
The basic concepts of visionOS are "windows (Windows), volumes (Volumes) and spaces (Spaces)".
After entering visionOS, by default, the user's vision appears in the Shared Space, which is the public space. At this time, it is similar to the desktop, and the user has one of many desktop views. When the user's vision gets the focus and the view is clicked, the screen will change from plane to stereo, that is, from Windows to Volumes. All the bottom layers are consistent with iOS App, consisting of three layers: SwiftUI, RealityKit and ARKit.
The three-dimensional interface of visionOS frees applications from the boundaries of traditional displays, allowing them to appear side-by-side at different scales. The user interface dynamically responds to natural light, casting shadows to help convey a sense of scale and distance.
visionOS will include apps from Adobe (Lightroom specifically), Microsoft (Teams and Office), Cisco (WebEx) Zoom, and other major developers -- including Unity apps that run natively on Vision Pro . There are medical software for viewing anatomical renderings and engineering applications for visualizing physical phenomena such as airflow on top of real-world objects.
Additionally, visionOS supports EyeSight, which projects the Vision Pro wearer's eyes onto the headset's curved external display. Apple also highlighted Optic ID, a new security system in visionOS that uses iris scanning for authentication. This data is encrypted and works with the Secure Enclave, a subsystem integrated into Apple's SoC.
Finally, take a look at the developer toolkit of visionOS, the core is SwiftUI + Xcode + Reality Composer + Unity.
See https://developer.apple.com/visionos/ for details .