Preface
This article explains the concepts of VR (virtual reality), AR (augmented reality), and MR (mixed reality). First published in Zhihu column VR · AR · MR and science fiction .
table of Contents
- The meaning and differences of VR, AR and MR
- The concept and meaning of other abbreviations
- Current technological level
- Concepts in Science Fiction
- The future development in my mind
The meaning and differences of VR, AR and MR
First, let's look at the definition of AR, VR, and MR in foreign integration.
VR: The full name is Virtual Reality, virtual reality.
VR devices are all wearable (such as VR glasses), which allows you to see a 360-degree virtual environment without dead ends, making you feel like you are in another place, or in a video or a game.
AR: The full name is Augmented Reality, augmented reality (extended reality).
AR devices can be wearable (such as Google Glass) or non-wearable (such as mobile phones and tablets with lenses).
Wearing AR devices can project text or models in front of your eyes. These projections cannot interact with the environment.
However, non-wearable AR devices that can simply recognize the specified picture (or QR code) through the lens and turn it into an animation also belong to AR. Common examples include holding a tablet to read the patterns in the book into animation. However, AR cannot distinguish between the scene and the object, and it will not know that the monster is on the side of the table, and it will fall off after two more steps. In its eyes everything is just background.
MR: Mixed Reality, mixed reality (mixed reality).
Hybrid, as the name suggests, is to mix the concept of AR and VR. First of all, the vast majority of MR equipment is wearable.
A simple MR device can recognize the scene and put a model in the middle of the room, so no matter where you go to look, the model is still in the same location. In a further MR, the model is no longer superimposed on the perspective of reality, but interacts with the environment, and even like the real thing, it can be covered by other real things. If you put the model behind the door, closing the door will block the model. The current MR equipment does not have the ability of the latter, so MR still has a lot of room for improvement.
Generally, MR has the function of AR.
Regardless of VR, AR, and MR, they are only the concept of perspective (eye) in the five senses, and there is no classification of other sensory feelings such as touch.
2. The concept and meaning of other abbreviations
XR: Extend Reality, which includes AR, MR and VR.
AV: Augmented Virtual enhances virtuality, just like using AR in VR, allowing real objects to appear from VR. Sometimes the actions of other users can be seen in VR. Although the principle is different from that of displaying objects, the concept is similar.
CR: Cinematic Reality movie reality, which is similar to MR, was proposed by Magic Leap and has expired.
AVR: Augmented Virtual Reality, meaning similar to MR, proposed by Oculus.
TR: Transmogrified Reality, proposed by Google and not used.
DR: Diminished Reality eliminates reality. Contrary to AR, DR makes objects that exist in reality disappear from the computer. Developed by Ilmenau University of Technology, Germany
ARG: Alternate Reality Game (intrusive virtual reality game). It has nothing to do with AR/VR. It is an interactive game based on the real world. It usually contains multimedia and game elements. By the way, there is also another The related word is LARP (Reality Role-Playing Game), this is a bit off topic, and I may talk about it later in the column.
3. Current level of technology
Google Glass (2014): Basic AR, projecting informative content in front of your eyes, superimposed on the perspective of reality.
Microsoft HoloLens (2015, 2019): The current standard MR can interact with the environment, and most of the computer software can be run by projection, such as Skype video calls. This projection generally only uses AR. In addition, HoloLens can display the model, the effect is similar to the following Minecraft Earth. Some HoloLens use more MR, such as RoboRaid, the monsters in the game will climb out on the wall in reality. If you are interested, you can watch the video below. In addition, HoloLens has a HoloTour function. It can be seen here that HoloLens is powerful. However, there are still many problems with HoloLens hardware. It is too heavy and environment recognition can only recognize indoors. The display content cannot be seen in the sun/too light environment. The main problem is that it can The viewing angle is not large enough, and the immersion is not great.
HTC Vive (2015, Pro2018), Oculus Rift (2016, S 2019): The existing standard host VR head-mounted display allows you to walk around in the virtual world and see around 360°. The hand controller allows you to manipulate objects of electronic content. Achieve an immersive environment experience.
HTC Vive Focus (2019), Oculus Quest (2019): Existing standard all-in-one VR head-mounted displays, which are different from the host VR, the host VR needs to be connected to the host computer with a cable, and the all-in-one VR is an internal computer .
Virtuix omni (2015): Universal treadmill accessories. With HTC Vive + Omni, you can move around freely in VR without being restricted by the environment and cable length.
Leap Motion (2016): Leap is very good at tracking hand movements, but its own VR does not sell well. There are versions compatible with HTC Vive and Oculus Rift. HTC Vive + Leap experience is better than using HTC's hand controller it is good.
Pokémon Go (2016): AR is so basic that it can't be more basic, even that the AR function of Pokémon Go just changes the background to the rear lens.
Super Dimensional MR: If there is only a card, it is AR, just like Alipay’s Marked AR with similar AR functions, but if multiple cards are used in the game, it is MR.
Minecraft Earth (2019): The biggest difference between Minecraft Earth and Pokémon Go is that Earth can perform environment recognition and Markless AR. In Pokémon Go, in the battle interface after the AR function is turned on, no matter where the camera is moved, Pokemon is still on the camera. center. In the AR interface of Earth, the grass can be fixed in one place, leave and enter the lens range again. You can also go around to the back of the grass. This is the biggest difference between AR and MR at present.
example:
HoloLens game RoboRaid
HTC Touch, Live! + Virtuix with all diligence
Pokémon Go
From left to right, it can be seen that the game did not recognize the three-dimensional structure of the environment after Pokemon appeared, and the back of it would not be seen by turning the lens direction, because the lens image is just the background for the computer.
Minecraft Earth
From left to right, you can see that after the grass is placed, the game can recognize the environment and fix it at this position, but it cannot yet recognize the obstruction and is blocked by the obstruction.
4. Concepts in science fiction works
(pending upgrade)
5. Future development in my mind
Here I will talk about the mature development of VR, MR, and AR in my eyes. (pending upgrade)