In order to help promote the development of augmented reality technology for more applications of its ToF sensing elements, Sony recently provided developers with an open-source software tool set called “ToF AR”, which allows developers to easily create a tool that can accurately recognize hands and fingers Augmented reality app content with subtle movements.
Sony stated that the open source software tool set corresponding to the “ToF AR” used by its ToF sensing components will be compatible with the Unity game engine, as well as Google ARCore and Apple ARKit, so it can be combined with more game content and can also be applied to Various software services.
In addition to recognizing the subtle movements of hands and fingers, the functional part can also recognize body movements smoothly. At the same time, it corresponds to the 3D modeling linkage, and can seamlessly fit the augmented reality content and the shooting background according to information such as depth of field and distance. This creates a more realistic virtual-real integration effect.
In the application of this technology, in addition to being used in augmented reality games, it can also be used in applications such as virtual makeup try-on, virtual shoe-testing, or in the construction of virtual furniture that is actually placed at home. Under the camera, the user becomes a virtual character and interacts with other people online.
At present, this development tool has provided the Vtuber idol cultivation “Virtual Cinderella Project” jointly launched by Sony Music, Shanghai Kuanyu Digital Technology, the operating unit of bilibili, and former AKB48 member Rina Shihara. Cinderella Project).
