"DuSee is a natural extension of AI", Baidu launched AR Application Platform DuSee

According to The Verge report, Baidu released DuSE, an AR platform developed for smartphones , at the 2016 Baidu Smart Marketing Solutions Conference yesterday. It is reported that the platform can use existing smartphone hardware to "understand" the real-world 3D environment so that the images generated by the mobile phone can interact with the real world. The product was jointly developed by Baidu Deep Learning Institute (IDL) and Baidu's search product and marketing team.

Currently AR applications on the market, such as Pokemon GO, simply superimpose computer-generated images on the screen of the real world. And Baidu said, DuSee is to use the computer and visual depth technical study to understand exactly what the live image, enabling augmented reality objects to interact in real time based on image content. Lin Yuanqing, director of the Baidu Deep Learning Institute, said that they will also combine AR with speech recognition and natural language processing.

In the conference, Bai End Chief Scientist Wu Enda mentioned:

DuSee is a natural extension of Baidu's AI research. It uses sophisticated computer vision and deep learning techniques to understand and enhance certain scenarios. Better AR needs to be achieved through better AI.

Given Baidu's mobile search has hundreds of millions of active users, DuSee will integrate with Baidu's applications. At the same time, the DuSee platform can be used in scenarios such as interactive advertising, marketing, education, manufacturing, interior design, etc. Currently, DuSee-based marketing solutions have been developed for Mercedes-Benz and L’Oreal, and demos have been demonstrated:

With the DuSee enabled smart phone, the 2D map of Shanghai can be transformed into a cartoonized 3D image.

A virtual petal pattern appears on a shampoo ad, which is like modifying a face with a filter.

In general, DuSee provides users with a relatively new way of interacting with traditional media, which can be achieved only through smartphones and software without the need to wear additional AR heads. But only from a functional perspective, Baidu DuSee has little difference with current augmented reality applications. In contrast, Google's Tango platform uses more sophisticated camera technology.

Baidu has not yet announced when DuSee will be released, but officials said that the platform will be integrated into Baidu’s most important applications.