visionOS
![]() | |
![]() Home View in visionOS | |
Developer | Apple Inc. |
---|---|
OS family | Unix-like, based on Darwin (BSD), iOS, iPadOS |
Working state | Current |
Initial release | February 2, 2024 |
Latest release | 1.3[1] (July 29, 2024 ) [±] |
Latest preview | 2.0 beta 8[2] (August 28, 2024 ) [±] |
Marketing target | Mixed reality headsets, Apple Vision Pro |
Platforms | ARMv8-A |
Kernel type | Hybrid (XNU) |
License | Proprietary software with open-source components |
Official website | developer |
Support status | |
Supported |
visionOS is a mixed reality operating system derived primarily from iPadOS core frameworks (including UIKit, SwiftUI, ARKit and RealityKit), and MR-specific frameworks for foveated rendering and real-time interaction.[3][4] It was developed by Apple Inc. exclusively for its Apple Vision Pro mixed reality headset. It was unveiled on June 5, 2023, at Apple's WWDC23 event alongside the reveal of the Apple Vision Pro.[5] The software released on February 2, 2024, shipping with the Apple Vision Pro.[6]
History
[edit]Apple has reportedly been working on and conceptualizing visionOS throughout the 2010s and early 2020s.[7] Internally codenamed Borealis,[8] it was officially revealed to the public at Apple's WWDC23 event alongside the Vision Pro. Apple stated the two would release in early 2024.[9] App Store guidelines for the operating system similarly state that developers should refer to visionOS software as "spatial computing experiences" or "vision apps", and avoid the use of terms such as "augmented reality" and "mixed reality".[10][11]
During the event, The Walt Disney Company announced plans to develop spatial computing apps for visionOS;[12] Disney+ currently offers features such as streaming of selected titles in stereoscopic 3D, and they also offer 3D environments based on the El Capitan Theatre and locations from Disney-owned franchises.[13]
The operating system was initially planned to be released as xrOS before the name was changed reportedly days before the release, after the WWDC23 keynote and developer sessions had already been filmed.[14] On January 8, 2024, Apple announced that the Vision Pro with visionOS would be available in the US on February 2, 2024, with pre-orders beginning on January 19.[15]
Developer tools
[edit]From June 5–12, 2023, Apple released 35 free virtual sessions covering visionOS development as part of WWDC23. On June 21, 2023, Apple released Xcode 15 Beta 2, which was the first Xcode beta to include a software development kit for visionOS and Reality Composer Pro, a tool to create 3D content for visionOS.[16] Xcode 15 launched without these features, which were eventually added in Xcode 15.2 on January 8, 2024,[17][18] the same day that Apple started accepting submissions for the visionOS App Store.[18]
During the WWDC23 keynote, Apple revealed it was working with Unity Technologies to support the Unity engine on visionOS,[19][20] and that Unity would be releasing development tools for 3D games on Vision Pro, which launched in beta on July 19, 2023.[21]
Features
[edit]visionOS uses a 3D user interface navigated via finger tracking, eye tracking, and speech recognition. For example, the user can click an element by looking at it and pinching two fingers together, move the element by moving their pinched fingers, and scroll by flicking their wrist. Apps are displayed in floating windows that can be arranged in 3D space. visionOS supports a virtual keyboard for text input, the Siri virtual assistant, and external Bluetooth peripherals including Magic Keyboard, Magic Trackpad, and gamepads.[22][23]
During visionOS setup, a user can create a digital persona by taking off the headset and scanning their face with it. Users can use this persona during FaceTime calls, and see other participants' personas if they are using visionOS.[24] From visionOS 1.1, the ability to see personas in 3D moving around and interacting with apps was added, dubbed 'Spatial Personas.'[25]
The Photos app supports presenting spatial video, depth-mapped 3D video recorded on Vision Pro or iPhone 15 Pro, by adapting the video's depth to the user's head movements.[26]
At launch, visionOS shipped with 13 pre-installed 3D 360° background animated environments with accompanying ambient sounds, including optional day and night scenes of Yosemite National Park; Haleakalā National Park; Joshua Tree National Park; Mount Hood National Forest; Lake Vrangla near Drammen, Norway; and the Moon.[27]
The Apple TV app offers 3D films; the company announced that over 150 films would be available in 3D at launch, at no additional charge to users that rent or purchase the films on iTunes Store.[28]
WebXR, an API for mixed reality experiences through web browsers, is supported in Safari.[29]
visionOS users can also access their Mac with a resizable 4K virtual display that appears after looking at the computer; this will be extended to an 8K ultrawide in visionOS 2, according to Apple.[30][31][32][33][34]
Supported apps
[edit]visionOS is backwards compatible with existing iOS and iPadOS apps, which are rendered in windows within the user environment and are automatically compatible with visionOS's input system.[15][35] The developers of iOS and iPadOS apps have the option to opt out of visionOS compatibility. Apple claims that over 1 million apps from iOS and iPadOS are available on visionOS.[15] In addition to iPadOS and iOS apps, over 600 native visionOS apps have been developed specifically for the platform at launch, according to Apple.[36] Apple also claims 100 Apple Arcade games will be compatible with visionOS at launch, the majority of which can make use of visionOS's gamepad compatibility.[23][37][38]
Many popular productivity apps have released fully-optimized visionOS versions, including Microsoft 365 apps (Teams, Word, Excel, PowerPoint, Outlook, etc.), Adobe Lightroom, Slack, Zoom, and Webex.[39] Many streaming apps are also optimized for the platform, such as Max, Disney+, Prime Video, Paramount+, and ESPN.[40]
Some of the most popular entertainment apps for iOS and iPadOS including Netflix, Spotify, and YouTube have not made their iOS or iPadOS apps available to run on visionOS, recommending users instead use their respective websites on Safari.[41] YouTube has announced that a visionOS app is "on [the] roadmap."[42]
Apple-made apps that come preinstalled on visionOS include Mail, Messages, Mindfulness, Apple Music, Apple TV, Notes, Photos, and Freeform.
Reception
[edit]Pre-launch
[edit]Before the February 2024 launch, Apple gave controlled demos of the Apple Vision Pro to many technology journalists, some of whom have praised its multitasking capabilities and input methods, while lamenting that the software is only available on expensive hardware.[43] Other reviewers have focused on the software's spatial videos feature and high resolution, while questioning what the software's main use case will be.[44] Speculation from journalists noted ongoing disputes from the developers of popular apps regarding the commissions charged by Apple for in-app purchases through apps distributed on the App Store as a potential cause for many not developing visionOS-native versions.[45]
Release
[edit]Many reviews praised visionOS even while criticizing the hardware. Some reviews even mentioned features more advanced than the Apple Vision Pro hardware, such as eye and hand tracking.[46] Almost all key reviews praised the window mechanics and experience.[47][46]
Version history
[edit]Release | Initial release date |
---|---|
visionOS 1 | February 2, 2024 |
visionOS 2 | Q3-Q4 2024 |
Previous release | Current release | Current beta release |
visionOS 1
[edit]visionOS 1 is the first major version of visionOS. It was announced in WWDC 2023 on June 5, 2023,[48] and was released on February 2, 2024, shipping with the Apple Vision Pro.[49]
Table of versions: visionOS 1.x | ||||
---|---|---|---|---|
Version | Build | Release date | Features | |
1.0[50] | 21N307 | Initial release | Initial release on Apple Vision Pro.
| |
1.0.1[51] | 21N311 | January 23, 2024 | Minor bug fixes | |
1.0.2[52] | 21N323 | January 31, 2024 | Patches WebKit flaw that could be exploited, leading to arbitrary code execution[53] | |
1.0.3[54] | 21N333 | February 12, 2024 | Bug fixes and adds an option to reset device if passcode is forgotten | |
1.1[55] | 21O211 | March 7, 2024 | ||
1.1.1[58] | 21O224 | March 21, 2024 | Bug fixes and security updates[59] | |
1.1.2[60] | 21O231 | April 9, 2024 | Bug fixes[61] | |
1.2 | 21O589 | June 10, 2024 | Bug fixes[62] | |
1.3 | 21O771 | July 29, 2024 | Bug fixes and security improvements[63] |
visionOS 2
[edit]visionOS 2 is the second major version of visionOS. It was announced in WWDC 2024 on June 10, 2024.[64][65][66]
Table of versions: visionOS 2.x | ||||
---|---|---|---|---|
Version | Build | Release date | Features | |
2.0 beta 8[67] | 22N5318a | August 28, 2024 | [68] |
See also
[edit]References
[edit]- ^ Clover, Juli (July 29, 2024). "Apple Releases visionOS 1.3". MacRumors. Retrieved July 30, 2024.
- ^ Clover, Juli (August 28, 2024). "Apple Seeds Eighth visionOS 2 Beta to Developers". MacRumors. Retrieved September 1, 2024.
- ^ Wiggers, Kyle (June 5, 2023). "visionOS is Apple's latest operating system". TechCrunch. Retrieved June 7, 2023.
- ^ "WWDC 2023 Biggest Reveals: Vision Pro Headset, iOS 17, MacBook Air and More". CNET. Retrieved June 7, 2023.
- ^ "Everything Apple Announced at WWDC 2023". Wired. June 5, 2023.
- ^ Samantha Murphy Kelly (February 2, 2024). "Apple's Vision Pro headset hits US stores today. Here's what you need to know". CNN.
- ^ Mickle, Tripp (January 19, 2024). "Apple Takes a Humble Approach to Launching Its Newest Device". The New York Times. ISSN 0362-4331. Retrieved January 20, 2024.
- ^ "Apple Will Talk Up Its Mixed-Reality Headset in 2023 But Not Much Else". Bloomberg.com. January 8, 2023. Retrieved January 27, 2024.
- ^ Robertson, Adi (June 5, 2023). "Apple Vision Pro is Apple's new $3,499 AR headset". The Verge. Retrieved January 20, 2024.
- ^ Evans, Jonny (January 9, 2024). "How to think about Apple and spatial computing". Computerworld. Archived from the original on February 3, 2024. Retrieved January 16, 2024.
- ^ "Apple asks developers not to refer to their visionOS apps as 'AR' or 'VR'". 9to5mac. January 8, 2024. Archived from the original on February 5, 2024. Retrieved January 16, 2024.
- ^ Weatherbed, Jess (June 5, 2023). "Disney Plus is coming to Apple's Vision Pro headset". The Verge. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
- ^ Goldsmith, Jill (January 16, 2024). "Apple Vision Pro Unveils Disney+ Features, More Streaming Apps & 3D Movies As Bob Iger Calls Mixed Reality Headset "A Revolutionary Platform"". Deadline. Retrieved January 16, 2024.
- ^ "Apple visionOS was called 'xrOS' before last-minute change, WWDC23 keynote and developer sessions confirm it". The Apple Post. June 9, 2023. Retrieved October 13, 2023.
- ^ a b c "Apple Vision Pro available in the U.S. on February 2". Apple Newsroom. Retrieved January 20, 2024.
- ^ "visionOS SDK now available - Latest News - Apple Developer". developer.apple.com. Retrieved January 20, 2024.
- ^ "Apple releases Xcode 15.2". AppleInsider. January 8, 2024. Retrieved January 20, 2024.
- ^ a b "Apple Releases New Versions of TestFlight and Xcode With Vision Pro Support, Starts Accepting visionOS Apps". MacRumors. January 8, 2024. Retrieved January 20, 2024.
- ^ Novet, Jordan (June 5, 2023). "Unity stock jumps 17% on Apple Vision Pro partnership". CNBC. Retrieved June 7, 2023.
- ^ Warren, Tom (June 5, 2023). "Microsoft Word, Excel, and Teams are all coming to Apple's new Vision Pro headset". The Verge. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
- ^ "What you need to know about Unity PolySpatial and visionOS". Unity Blog. Retrieved January 20, 2024.
- ^ Goode, Lauren (June 5, 2023). "Apple's Mixed-Reality Headset, Vision Pro, Is Here". Wired. Retrieved June 5, 2023.
- ^ a b Peters, Jay (June 5, 2023). "Apple announces visionOS, the operating system for its Vision Pro headset". The Verge. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
- ^ Axon, Samuel (June 6, 2023). "Hands-on with Apple Vision Pro: This is not a VR headset". Ars Technica. Retrieved June 7, 2023.
- ^ Song, Victoria (April 2, 2024). "Now Apple Vision Pro Personas can float freely across different apps". The Verge. Retrieved April 4, 2024.
- ^ Peters, Jay (September 12, 2023). "The iPhone 15 Pro and Pro Max will let you film spatial video you can watch on the Vision Pro". The Verge. Retrieved January 20, 2024.
- ^ "Apple's first visionOS beta outlines 13 VR 'Environments,' app limitations". Macworld. Retrieved February 5, 2024.
- ^ Spangler, Todd (January 16, 2024). "Apple Vision Pro Will Feature 150-Plus 3D Movies at Launch, Immersive Originals, Disney+, Amazon Prime Video and More". Variety. Retrieved January 26, 2024.
- ^ Lang, Ben (June 20, 2023). "Apple Vision Pro Will Support WebXR for Fully Immersive Experiences in the Browser". Road to VR. Retrieved June 24, 2023.
- ^ "Your Mac and Apple Vision Pro: What You Can Do (and What You Can't)". MacRumors. January 11, 2024. Retrieved January 22, 2024.
- ^ "Mac Virtual Display is limited in Vision Pro – but there's a workaround". 9To5Mac. June 7, 2023. Retrieved January 22, 2024.
- ^ "How Apple Vision Pro Works With the Mac". MacRumors. June 6, 2023. Retrieved January 22, 2024.
- ^ ">With Mac Virtual Display, users can even bring the powerful capabilities of the... | Hacker News". news.ycombinator.com. Retrieved January 22, 2024.
- ^ "visionOS 2 Preview". Apple (Australia). August 31, 2024. Archived from the original on August 23, 2024. Retrieved August 31, 2024.
- ^ Roth, Emma (June 10, 2023). "The Vision Pro's biggest advantage isn't Apple's hardware". The Verge. Retrieved August 27, 2023.
- ^ "Apple announces more than 600 new apps built for Apple Vision Pro". Apple Newsroom. Retrieved February 3, 2024.
- ^ Peters, Jay (June 5, 2023). "Apple announces visionOS, the operating system for its Vision Pro headset". The Verge. Retrieved June 7, 2023.
- ^ Parrish, Ash (June 5, 2023). "Apple's new VR headset will feature over 100 Apple Arcade games at launch". The Verge. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
- ^ updated, James Bentley last (January 8, 2024). "Every Apple Vision Pro app we've heard about so far". iMore. Retrieved January 20, 2024.
- ^ "Apple Announces Streaming Services and Sports Apps Available on Vision Pro at Launch". MacRumors. January 16, 2024. Retrieved January 20, 2024.
- ^ Gurman, Mark (January 18, 2024). "Bloomberg - YouTube and Spotify Won't Launch Apple Vision Pro Apps, Joining Netflix". www.bloomberg.com. Retrieved January 20, 2024.
- ^ Patel, Nilay (February 5, 2024). "YouTube says a Vision Pro app is 'on the roadmap'". The Verge. Retrieved February 6, 2024.
- ^ "I've Worn Apple's Vision Pro Headset 4 Times. Here's What You Need to Know Before Buying". CNET. Retrieved January 20, 2024.
- ^ Song, Victoria (January 16, 2024). "Apple Vision Pro hands-on, again, for the first time". The Verge. Retrieved January 20, 2024.
- ^ Pierce, David (January 20, 2024). "The Vision Pro's first killer app is the web, whether Apple likes it or not". The Verge. Retrieved January 24, 2024.
- ^ a b Patel, Nilay (January 30, 2024). "Apple Vision Pro review: magic, until it's not". The Verge. Retrieved February 5, 2024.
- ^ "Apple Vision Pro Review: A Mind-Blowing Look at an Unfinished Future". CNET. Retrieved February 5, 2024.
- ^ "Everything Apple Announced at WWDC 2023". Wired. June 5, 2023.
- ^ Samantha Murphy Kelly (February 2, 2024). "Apple's Vision Pro headset hits US stores today. Here's what you need to know". CNN.
- ^ "About visionOS 1 Updates". Apple Support. February 2, 2024. Retrieved February 11, 2024.
- ^ "Apple Releases visionOS 1.0.1 Ahead of Vision Pro Launch". MacRumors. January 23, 2024. Retrieved February 11, 2024.
- ^ Michael, Simon. "Vision Pro isn't out yet but Apple has already patched a serious zero-day flaw". Macworld. Retrieved February 11, 2024.
- ^ "About visionOS 1 Updates". Apple Support. February 2, 2024. Retrieved February 11, 2024.
- ^ "Apple Releases visionOS 1.0.3 With Reset Option for Forgotten Passcode". MacRumors. February 12, 2024. Retrieved February 12, 2024.
- ^ Hall, Zac (March 7, 2024). "visionOS 1.1 update for Apple Vision Pro now available with MDM support, improved Persona, more". 9to5Mac. Retrieved March 7, 2024.
- ^ "Apple Starts Improving Vision Pro Personas in visionOS 1.1 Beta". MacRumors. February 6, 2024. Retrieved February 11, 2024.
- ^ "visionOS 1.1 Beta 3 Release Notes". Apple Developer Documentation. Retrieved February 25, 2024.
- ^ "Apple Releases visionOS 1.1.1 With Bug Fixes". MacRumors. March 21, 2024. Retrieved March 24, 2024.
- ^ "About the security content of visionOS 1.1.1". Apple Support. March 25, 2024. Retrieved March 28, 2024.
- ^ "Apple Releases visionOS 1.1.2 With Bug Fixes and Revised visionOS 1.2 Beta". MacRumors. April 9, 2024. Retrieved April 9, 2024.
- ^ "About visionOS 1 Updates". Apple Support. April 9, 2024. Retrieved April 9, 2024.
- ^ "visionOS 1.2 Release Notes". developer.apple.com. June 10, 2024. Retrieved June 10, 2024.
- ^ "Apple Releases visionOS 1.3". MacRumors. July 29, 2024. Retrieved July 30, 2024.
- ^ Davis, Wes (June 10, 2024). "Apple announces visionOS 2, with 3D photo transformations and ultrawide Mac display". The Verge.
- ^ "Apple Announces visionOS 2 With Improvements to Mac Virtual Display, Travel Mode, and More". MacRumors. June 10, 2024.
- ^ "Introducing visionOS 2: An overview of what's new and features". Kaipkada. June 10, 2024.
- ^ Clover, Juli (August 28, 2024). "Apple Seeds Eighth visionOS 2 Beta to Developers". MacRumors. Retrieved September 1, 2024.
- ^ "visionOS 2 Beta 8 Release Notes". developer.apple.com. Retrieved September 1, 2024.