The difference between AR, VR and MR;
Augmented Reality (AR): Overlay digitally created content in the user's real world.
Virtual reality (VR): shielding the real world and creating a fully digital and immersive experience for users.
Mixed Reality (MR): Create content by superimposing numbers with which you can interact in the real world of users.
The following table can help you understand this difference more clearly:
So Poké mon Go is MR? Because you can subdue Pocket Monster (Interactive)? Don't get me wrong, sir, the above-mentioned "creating content with numbers that can interact with it" is not simply creating information by clicking on the numbers that pop up to get more information, or just taking over the pocket monster. The digital creation content generated by MR can be combined with the actual images in the real world, and can be enlarged, reduced, rotated and even edited. The following can give you a better understanding of what MR is.
Have you noticed that when you watch a 3D digital image in a movie, the image will not rotate with your movement, so you can move the position to view or edit the image from the back, top and bottom, which is impossible in AR or even most VR applications.
Incidentally, even whether Pokémon Go is AR is controversial. Because in theory, AR should generate or bring out digital creative content by identifying some real-world images, while PokémonGo brings out digital images by location positioning, so many people think that Pokémon Go can only be called a location-based game at best, not AR. In this respect, I don't think we should be too picky, or you can call it a location-based AR game.
In recent years, AR has changed from a mode in which only smart phones or tablets can point to real things in the real world and let applications identify and bring out relevant information to a mode in which AR glasses can achieve the same function. Moreover, because there is no need to use mobile devices, it is more convenient to use, and AR glasses should gradually become a new trend of AR applications.
VR wearable devices (such as HTC VIVE, Playstation VR ...) allow gamers not only to play video games on the screen, but also to enter the 3D real-life environment. However, its disadvantage is that it blocks the image of the real world, so unless there is a well-designed sensor, its application in education and training will mostly be limited to watching 3D digital content.
MR combines AR and VR, so the introduction of Microsoft Hololens and other devices not only makes AR applications by going up one flight of stairs (interactive), but also makes VR applications more integrated into daily work and life.
Application of AR, VR and MR in Education and Training
We divide the application of these emerging technologies in education and training into three parts:
Education: refers to imparting knowledge, including school education and workplace education.
Training: refers to the training of functions or skills, including schools and workplaces.
Performance support: refers to providing relevant important information to help complete the work when needed, which can usually be used in combination with the previous paragraph.
This introduction will not be limited to school education. We will also list some applications in different fields outside the school to help you understand the infinite potential and charm of these emerging technologies, which will also help you think about how to use these technologies. The application of AR/VR/MR is infinitely broad, and then it depends on everyone's imagination and practice.
For convenience, we will indicate whether each application belongs to education (E), training (T) or performance support (PS). Examples of applications that do not belong to these three categories (such as entertainment, consumption, marketing, therapy, etc.). ) is omitted in this article.
medical treatment
AR/VR/MR has attracted more and more attention in the medical field (hospitals and medical schools) for two reasons:
1. Save time/reduce cost (E/T/PS):
At present, many medical schools/hospitals have used AR/VR/MR for teaching or surgical training. In teaching, students wear AR/VR glasses to watch 3D human structures and organs, and even "take out" an organ for more careful observation. In surgical training, students or interns wear AR/VR glasses and practice surgery on virtual corpses through 3D holographic dissection procedures. This can save students ten hours in the traditional corpse laboratory. More practically, it is generally not easy to obtain, so surgical simulation can reduce the burden of hospitals or schools in this regard.
2. Collaboration (T/PS)
Professors, senior doctors (directors), and even doctors or experts in remote places can give advice or instructions to doctors through the images (we call them POV, Point-of-Point) on the AR/MR glasses worn by doctors who perform surgery or diagnosis, and doctors can see these suggestions or instructions from the display screen on the glasses.
Of course, there are more than these applications. The following are some other application examples:
Drug use: even without training, help medical staff to confirm the correct drugs. This simplifies the needs of pharmacists and doctors and reduces the chance of misuse of drugs. (PS)
Intravenous injection: assist nurses to find veins for intravenous injection. There is no doubt that AR glasses can help you see those veins that are invisible to the naked eye, reducing the time of medical staff and the pain of patients. (PS)
Pre-treatment: The doctor on duty in the emergency room of the hospital can make a preliminary diagnosis of the patient through the POV of the medical staff on the ambulance or at the scene of the accident and the data returned by the testing instrument, and give the medical staff the instructions of preliminary medical treatment, so as to increase and decrease the survival chances of the patient and expand the injury. Therefore, perhaps in the future, AR glasses will be placed next to fire extinguishers or AEDs (automatic external cardiac defibrillators) in public places, but when they are taken out, they will be connected to the automatic call service center 1 19/ 120 through Wifi, so that users can provide immediate assistance or instructions from remote fire fighters or medical personnel, such as using fire extinguishers to extinguish fire sources. (PS)
American military police training, the US military is the main promoter of educational technology, because they want to train troops quickly and efficiently. A few years ago, the US military began to use AR/VR and other technologies to train soldiers to fight, operate weapons, or repair weapons, vehicles and other equipment.
Wearing AR glasses and using AR for weapon operation training or equipment maintenance can avoid mistakes, and at the same time improve the training and maintenance speed, so that new soldiers can get started quickly. (T/PS)
Of course, AR can also be applied to combat. Let me give you a familiar example. A few years ago, the Apache helicopter incident that caused a lot of noise in Taiwan Province Province, if you don't just pay attention to the actress, you should have noticed this helmet worth more than 60,000 dollars. Why is that helmet so expensive? It is precisely because this tactical helmet can display and project 12 cockpit information (such as weapon aiming or night vision goggles) on the monocular screen in the right eye, which is convenient for pilots to read all important information quickly. Other fighter pilots and tank drivers' helmets can also use AR to quickly grasp important information or carry out attacks. (T/PS)
The biggest advantage of using VR for combat training is that you can design a variety of situations. People who have served in the army should also know very well that the terrain and features on the field training ground of the army are so few, but VR can be used to design the required situation and terrain features as needed, and the imaginary enemy is no longer just a humanoid card. (ton)
Using AR/VR technology to train soldiers to fight, operate weapons or maintain equipment has a more important advantage, that is, all the processes will also be recorded, and information such as whether the operation is correct and whether the aiming is accurate will be recorded and analyzed, so as to provide appropriate training for training units and let soldiers who need improvement improve their own shortcomings.
Of course, similar concepts are not limited to the training of military talents. Those who encounter dangers in their work, such as public security and fire fighting, can use this technology to provide simulation training in various situations, so as to improve their correct and rapid handling and protection of their own safety when they really encounter situations in the future. (T/PS)
Police wearing AR glasses can help identify wanted criminals or stolen cars by connecting the database and image recognition of the crime center, and fight crime more efficiently. (PS)
Technical maintenance service
AR can provide immediate assistance and help maintenance personnel to do equipment maintenance and troubleshooting, covering almost all the work you can think of, such as factory machine maintenance, office copier maintenance, elevator maintenance, telecom maintenance, automobile maintenance and so on. Through AR smart glasses and exclusive applications, detailed steps can be provided for maintenance personnel so that they can follow them for inspection and maintenance. Of course, this is also a very useful tool for the training of new recruits. (T/PS)
Can't solve the problem on the spot? It doesn't matter, the application will call the senior technicians in the company to guide the field personnel to troubleshoot or remotely assist in replacing parts. AR/MR can let remote experts see the POV seen by field personnel, and directly indicate the position of parts to be processed on the display screen of AR/MR lens of field personnel by calling or displaying words and pictures, so as to guide them to carry out repair work. (PS)
The biggest advantage of using AR/MR glasses is that field personnel no longer need to point at the equipment to be repaired with their mobile phones or tablets in their hands, or listen to or watch the company's instructions, so their hands can be used for maintenance work. Of course, if you don't have AR/MR glasses, you can use a mobile phone or a tablet, but it's inconvenient to hold them by hand.
Don't think that only maintenance personnel can use this technology, and consumers themselves can of course. In the future, you can repair photocopiers, cars and electrical appliances, and replace reverse osmosis filters ... as long as there is a suitable AR application, you can do it yourself.
As early as 2007, BMW developed AR glasses and related applications, providing technicians in its maintenance factory with the ability to repair and replace auto parts. On 20 15, Hyundai Motor Company launched the application of owner AR technical manual. As long as you use a smartphone or tablet, the owner can get information on how to maintain oil, brake oil and air filter. The application provides movies, displays 3D superimposed images of various areas (when car owners scan their vehicles in different locations) and other information related to cars. (PS)
school education
Using AR/VR can provide immersive multi-sensory experience for students at all levels, which is more effective than traditional methods such as lectures, word cards or textbooks. Here are a few examples for reference:
When teaching planets in the solar system, AR/MR/VR is used to display the 3D planetary motion picture, and students can click on a planet with the controller to bring out more detailed information. (E/PS)
The geography class uses AR/MR/VR to display the 3D earth. Students can watch from all angles, and click on a country to bring up the detailed information of that country. (E/PS)
In chemistry class, VR is used to let students simulate the experimental process first, so that students can be familiar with the steps and wrong operations that may cause explosion or fire, thus effectively avoiding dangerous accidents in real experiments. (electronics/technology/technology)
Textbooks or extracurricular books can cooperate with mobile devices or ar glasses to display 3D stereoscopic images and related information on specific pages, which can increase students' impression, make students easier to understand and enhance their interest in class or study. (E/PS)
Architecture students no longer need to spend time making design models, but only need to match mobile devices or AR/MR glasses and appropriate applications to present their designs in 3D, which is beautiful and accurate, and there is no need to copy models when designing and modifying, saving a lot of time. (PS)
Are newcomers unfamiliar with the campus? Often get lost in the classroom? No problem, the AR application can guide you to your designated building or classroom. (Note: Some shops or commercial buildings have started to use similar applications to provide guidance. In the future, when you go to supermarkets, hypermarkets or shopping centers, you can use the AR application to directly guide you to the display location of the goods you want to buy or the stores you want to visit, so that you don't have to look around for the location of the goods or stores. (PS)
Art and talent wear VR to visit famous zoos, museums or historical sites, landmarks or buildings mentioned in textbooks, enjoy at your own speed, and even deepen your impression and understanding with animation. The application will provide detailed information on the screen according to what you are currently watching.
Did you bring some inspiration? Yes, it used to be tiring to arrange outdoor teaching, and I had to worry about the weather or be afraid of accidents. In the near future, all these can be done in the classroom (some museums have begun to provide similar services), and outdoor teaching will probably become a historical term. At worst, it's a little unreal. On the bright side, it can save a lot of money for schools and parents. (E/PS)
In talent learning, AR glasses can help guide you to learn musical instruments, painting, carving, knitting and other talents according to the steps. Especially for students who have just started to learn musical instruments, with the help of AR glasses and related applications, fingering and music scores of various musical instruments can be displayed, and the process can be practiced, corrected and recorded, so that novices can easily get started. (England/Thailand)
Fitness/exercise
When you ride a bike, run or walk outdoors, AR glasses can instantly display heartbeat, fatigue, calorie consumption, goals and other more displayed information, such as maps and GPS positioning.
In the future, in the gym, you can no longer just watch the TV screen hanging in front of you running, riding a bike or doing weight training. You can choose to ride, ski, row or run on the Seine or other sections you want to experience through VR (or MR) headphones. Bicycles, treadmills and other fitness equipment will adjust the angle, resistance and even feel the vibration of the ground or river according to the virtual position you experience. Is this kind of sports experience fascinating? Of course, all relevant information will also be displayed on the device screen.
Of course, schools can also enjoy the benefits brought by such applications. For example, VR can be used to train goalkeeper defense, baseball batting practice, tennis swing and other training, so that it is not affected by the weather, or it can only be trained by clicking on indoor venues.
Let's call it a day. In addition to education and training, the application of AR/VR/MR in life is infinitely broad and full of imagination. The author thinks that AR/MR will be the mainstream in the future, because they are not divorced from the real world, so they are easier to integrate into real life, education and work. AR can be used flexibly on mobile devices (especially mobile phones), and AR glasses can be made very light, and the price continues to drop. Therefore, AR should become an indispensable portable tool in future life. If paired with AI (artificial intelligence), it is more like a personal assistant. The main application of VR will create a virtual immersive experience, with high cost, danger, or experience that is not easy to get in the real world as the main application requirements.