Google introduced AutoFlip, a smart video cropping framework

Google company presented open framework autoflip, intended for framing video, taking into account the displacement of key objects. AutoFlip uses machine learning techniques to track objects in the frame and is designed as an add-on to the framework MediaPipewhich uses TensorFlow. Code spreads licensed under Apache 2.0.

On widescreen video, objects are not always in the center of the frame, so a fixed edge cut is not always sufficient. AutoFlip tracks the activity of people and objects in the frame, and dynamically shifts the crop window to optimally capture key elements of the scene (for example, if there are several people in the frame and one of them is talking or moving, then the focus of the crop may be on that person).

Source: opennet.ru