Although he was one of the first on the mobile AR train with Project Tango, some may have felt that Google dropped the ball in that area. Showing more interest in AR than in VR, Apple has been promoting the practical applications of its ARKit structure since day one, enabling experiments such as placing furniture in your room to test it, improving the mapping and navigation tools, and so on. . Of course, there is always room for some extravagant uses, like the new AR Spaces that you can add to your video clips using the latest Clips application.
One of the first uses of AR on phones is stickers that you can put on your face or follow your head. Subsequent iterations place 3D objects within the real world, often with the ability to detect whether they are on a table or on the floor and to place themselves behind other objects, such as sofas or shelves. The latter application depends heavily on knowledge of the depth of real-world objects, an achievement that Apple is now sporting thanks to its special hardware on the latest iPhones and iPads.
This hardware is the LiDAR, of course, more powerful than its normal depth sensor or the 3D Time-of-Flight (ToF) camera found on most phones. In this specific application, Apple’s combination of hardware and software allows devices to not only determine the shape of a room, but also the objects within it, their position and their distance from the camera. In short, it knows which objects are ahead and in the background and even works to move people or animals.
Version 3.1 of the Clips video editing app for iOS and iPadOS takes advantage of this integration in its new AR Spaces feature. Users will be able to see a live preview of special AR effects that will be placed correctly on floors, walls and, most importantly, behind people and furniture. These effects include Disco, Confetti and Stardust, just to name a few, and can even be mixed with other stickers and text labels already available in Clips.
Apple’s announcement about the new AR Spaces for Clips with LiDAR technology also brings good news about new content every month. Monthly updates will add filters, stickers and posters to meet all needs, especially seasonal ones. And for those who like to stay on top of the latest news from Clips, the app now offers optional notifications when new content is added to the library.