Zao went viral in China this weekend for its realistic face-swapping videos, but after controversy about its user policy, WeChat restricted access to the app on its messaging platform.
Users can still upload videos they created with Zao to WeChat, but if they try to download the app or send an invite link to another WeChat user, a message is displayed that says “this web page has been reported multiple times and contains security risks. To maintain a safe online environment, access to this page has been blocked.”
Developed by a unit of Momo, one of China’s most popular dating apps, Zao creates videos that replace the faces of celebrities in scenes from popular movies, shows and music videos with a selfie uploaded by the user.
In case you haven’t heard, #ZAO is a Chinese app which completely blew up since Friday. Best application of ‘Deepfake’-style AI facial replacement I’ve ever seen.
Here’s an example of me as DiCaprio (generated in under 8 secs from that one photo in the thumbnail) pic.twitter.com/1RpnJJ3wgT
— Allan Xia (@AllanXia) September 1, 2019
By going viral quickly and being very easy to use (Zao’s videos can be generated from a single selfie, though it suggests that users upload photos from several angles for better results), the app has also focused more attention on deepfake technology and how it can potentially be used to spread misinformation or harass people.
Zao was released last Friday and quickly became the top free iOS app in China, according to App Annie. A statement posted on Sept. 1 to Zao’s Weibo account says “we completely understand everybody’s concerns about the privacy issue. We are aware of the issue and we are thinking about how to fix the problems, we need a little time.” Its terms and conditions now say user-generated content will only be used by the company to improve the app and that all deleted content will be removed from its servers.