Facebook Algorithms Help Internet Companies Find Duplicate Videos and Images to Fight Inappropriate Content

Facebook announced about opening source code of two algorithms, which can determine the degree of identity for photos and videos, even if they have been slightly modified. The social network actively uses these algorithms to combat content containing materials related to the exploitation of children, terrorist propaganda and various forms of violence. Facebook notes that it has shared this technology for the first time, and the company hopes that with its help other large portals and services, small software development studios and non-profit organizations will be able to more effectively combat the spread of inappropriate media content on the global Web.

Facebook Algorithms Help Internet Companies Find Duplicate Videos and Images to Fight Inappropriate Content

β€œWhen we find a piece of inappropriate content, technology can help us find all of its duplicate content and prevent it from spreading,” write Facebook head of security Antigone Davis and vice president of integrity Guy Rosen in a post. dedicated to the fourth annual Facebook Child Safety Hackathon. "For those who already use their own or other content matching technology, our technologies can provide another layer of protection, making security systems much more powerful."

Facebook claims that the two published algorithms - PDQ and TMK+PDQ - were designed to work with huge amounts of data and are based on existing models and implementations, including pHash, Microsoft's PhotoDNA, aHash and dHash. For example, the PDQ algorithm for photo comparison was inspired by pHash but developed entirely from scratch by developers at Facebook, while the TMK+PDQF video matching algorithm was created jointly by the Facebook AI Research Group and scientists from the University of Modena and Reggio Emilia in Italy.

Both algorithms analyze the files they are looking for thanks to short digital hashes, unique identifiers that help determine whether two files are the same or similar, even without the original image or video. Facebook notes that these hashes can be easily shared with other companies and non-profits, as well as industry partners through the Global Internet Forum on Counter Terrorism (GIFCT), so all companies with an interest in online security will also be able to remove content that Facebook has flagged as insecure. if it is uploaded to their services.

The development of PDQ and TMK+PDQ followed release of the aforementioned PhotoDNA 10 years ago in an attempt to combat child pornography online by Microsoft. Also more recently, Google launched the Content Safety API, an artificial intelligence platform designed to detect online child sexual abuse material in order to make the work of human moderators more efficient.

In turn, Facebook CEO Mark Zuckerberg has long argued that AI will significantly reduce the number of abuses committed by millions of unscrupulous Facebook users in the near future. Indeed, published in May Facebook Community Standards Compliance Report the company said that AI and machine learning helped to significantly reduce the number of published prohibited materials in six of the nine categories of such content.



Source: 3dnews.ru

Add a comment