The so-called augmented reality AR is simply to superimpose virtual animation effects on real objects. Lightform device will first automatically align and scan the real objects in 3D, and connect to the projector to superimpose virtual effects around the real objects, thus creating a magical AR effect. If the projector projects light with virtual effect on the display frame of watches and glasses, a flowing wave effect will appear. In this way, you can see the dreamy AR effect that is virtually superimposed on the real thing without wearing any AR glasses.
Lightform computer can automatically align your content, scan it in 3D, then connect it to the projector and apply "AR Magic" to your object to create a very unique and charming scene. It doesn't need a head display or even a plane to project. It can be said that Lightform computer is a technology that does not need virtual reality headphones. It turns any inanimate object into a screen, and the light blurs the boundary between physics and numbers.
Bilal Zuberi, a partner of Lux Capital, said: "Lightform builds a bridge between virtual and reality by integrating them. They bring human creativity into our physical world, so all surfaces can come alive in a magical way. "
Lightform's team has been committed to developing augmented reality optical equipment, which is also the main technology behind the project. Lightform believes that the projected light is much more interesting than the screen of a tablet because it can cover the existing environment. At the same time, they also hope that designers can seamlessly integrate digital content with existing materials and structures, and most importantly, this small device can save a lot of costs.
The team also cooperated with Microsoft Research Institute, and Microsoft called for creating a device that can project the entire TV screen onto the wall and turn the whole room into a huge 3D touch screen. At the same time, they are also developing an interactive tactile experience for Disney Fantasy Project.
In fact, projection mapping is not a brand-new technology. The new projection technology "Illumination Room" exhibited by Microsoft as early as CES 20 13 is actually the most famous research project of projection mapping (also called light curing rapid projection). The principle of Illumination Room is to combine Kinect for Windows camera sensor with a projector, so that we can integrate the virtual and physical worlds by blurring the boundary between the screen content and our environment. Kinect is responsible for capturing the user's coordinate position and action in the room, and the XBox game device calculates the game screen according to the collected data, and then projects it into the room through the projector. The whole process is completed by real-time calculation without any image preprocessing. Microsoft once claimed that Illumiroom technology can cover the interactive game experience to every corner of the room: in a gun battle, the war will splash out from the screen. When the game enters the snow scene, there will be snowflakes falling in the room in front of you.
Although the light room project has been used for many years, it has not been popularized. The key is still limited by projection technology. First, the previous projectors were not only expensive, bulky, but also easily broken, and the light bulbs needed to be replaced regularly. Secondly, projection mapping involves complex workflow, and there are many advanced softwares, so it is difficult and demanding to operate. However, with the rapid development of projection technology, LED and laser projection no longer need to replace the light bulb, which makes the projector have a long life and lower use cost. At the same time, micro-projection technologies such as MEMS and Pico can make the projection volume smaller and can be easily embedded in other devices. Under this premise, Lightform and HoloLamp are now engaged in AR projection development, which just happens to catch up with the good times, so it can make the projection mapping process more convenient, the effect is better and the deployment is more convenient.
The reason why Lightform can develop successful products is related to the experience of its founder. Brett Jones, CEO and co-founder of Lightform, is one of the principal researchers of Microsoft Lighting Project. Raj Sodhi, chief strategy officer and co-founder, was involved in the Disney research project Aireal, which created tactile feedback through "an air ring that can maintain shape and speed and can sail long distances". They have profound research and technical precipitation in 3D technology, interactive tactile feedback technology, 3D scanning, virtual image overlay algorithm and so on. Coupled with Brett Jones' dream and persistent pursuit of AR technology, they have achieved their career.
Brett Jones thinks that projectors are advanced at present, but they are still "stupid". They don't know what they are projecting. What Lightform has to do is to make the projector "smart". Projection mapping involves a complex workflow using a variety of advanced software. From initial scanning to 3D animation to on-site calibration, each step requires different artists or technicians. Lightform is currently working hard to further optimize the software and simplify the setup process of CAVE installation, thus providing users with smarter solutions.
Lightform has actually used this technology to build a CAVE system, which has been deployed in the stores of 15 major retailers. Thanks to the good prospects of this product in the future, Lightform has just announced that it has received a seed round financing of $2.6 million, with funds from Lux Capital, Seven Seas Partners, several angel investors and the National Science Foundation of the United States. With these funds, Lightform can further improve its products without being busy with delivery. According to Pjtime.com, Lightform aims to make a formal reservation for its products this summer, and plans to provide software to simplify the process of deploying these settings. The goal is to quickly turn "real-world 3D scanning into eye-catching sports content".
Brett Jones, co-founder and executive director of Lightform, mentioned where he got the inspiration for this AR technology. "When I was in the Disney Fantasy Project eight years ago, I saw a projection AR demonstration, which is the most shocking VR/AR demonstration I have ever seen. The system projects a complete forest, with lightning and rain, butterflies fluttering gently and waterfalls flowing continuously. My colleague threw my ID card into the waterfall, and I found it wet. But the problem is that the cost of demonstration needs millions, and only Disney can do it. At that time, I knew I wanted this technology to be everywhere. "