Jonas Mayer works in the Innovation Hacking Team of TNG Technology Consulting where his main focus lies on creating innovative showcases and prototypes in both soft- and hardware. Since 2018 he's been working on numerous projects ranging from real-time deepfakes, over mixed reality art experiences, all the way to autonomous miniature drones.
Prior to joining TNG, Jonas studied Informatics: Games Engineering at the TU Munich. Apart from the obvious game projects throughout the course of his studies, he focused mainly on artificial intelligence and high performance computing.
Imagine looking into a mirror, but not to see your own face. Instead, you are looking in the eyes of Barack Obama or Angela Merkel. Your facial expressions are seamlessly transferred to that other person's face in real time.
The TNG Innovation Hacking Team has managed to create a prototype that transfers faces from one person to another in real time based on Deepfakes. Neural networks detect faces within a video input, then translate them and integrate them back to the video output. Through this technique it is possible to project deceptively real imitations onto other people. For this purpose, we used Keras trained autoencoder networks and various face recognition algorithms.
In this talk, the TNG Innovation Hacking Teaming will give an entertaining and vivid introduction into the world of real-time Deepfakes. In doing so, they particularly focus on the deep learning techniques used in within the application. Several live demonstrations will complete this event.