Release of the FFmpeg 4.3 multimedia package with Vulkan graphics API support

After ten months of development is available multimedia package FFmpeg 4.3, including a set of applications and a collection of libraries for operations on various multimedia formats (recording, converting and decoding audio and video formats). The package is distributed under LGPL and GPL licenses, and FFmpeg development is carried out concurrently with the project MPlayer.

From the changes, added in FFmpeg 4.3, the following can be highlighted:

• Support for a graphic API has been added Vulkan;
• On the Vulkan platform for Linux, a codec has been implemented that uses AMD AMF/VCE engines for acceleration, as well as standard filter options avgblur_vulkan, overlay_vulkan, scale_vulkan and chromaber_vulkan;
• Support for the API VDPAU (Video Decode and Presentation) for hardware acceleration of VP9 video processing has been provided;
• Support for AV1 video encoding using the library librav1e, written in Rust and developed by the Xiph and Mozilla communities;
• For mp4 media containers, support for lossless multichannel audio codec TrueHD and a codec for three-dimensional sound MPEG-H 3D;
• Support for the protocols ZeroMQ and RabbitMQ (AMQP 0-9-1);
• In Linux, the transition has been made from the frame server for non-linear video stream editing (virtual video codec) AvxSynth, which has been abandoned for 5 years, to the current fork AviSynth+;
• A parser for images in WebP format has been included;
• Decoders for MJPEG and VP9 have been implemented, using hardware acceleration mechanisms Intel QSV (Quick Sync Video), as well as a VP9 encoder based on Intel QSV;
• Support for subtitle styles in the 3GPP Timed Text Subtitles format has been expanded;
• A wrapper encoder over the API Microsoft Media Foundation;
• An ADPCM encoder for audio data used in games by Simon & Schuster Interactive has been added;
• New decoders have been added: PFM, IMM5, Sipro ACELP.KELVIN, mvdv, mvha, mv30, NotchLC, Argonaut Games ADPCM, Rayman 2 ADPCM, Simon & Schuster Interactive ADPCM, High Voltage Software ADPCM, ADPCM IMA MTF, CDToons, Siren, DERF DPCM and CRI HCA;
• A media container packager (muxer) streamhash has been added, and the ability to package pcm and pgs into m2ts containers has been implemented;
• Demuxers for media containers have been added: AV1 with extensions from the application B,
  Argonaut Games ASF, Real War KVAG, Rayman 2 APM, LEGO Racers ALP (.tun and .pcm), FWSE, DERF, CRI HCA, Pro Pinball Series Soundbank;
• New filters:
  • v360 — transforms 360-degree video into various formats;
  • scroll — scrolls video horizontally or vertically at a specified speed;
  • photosensitivity — removes bright flashes and abrupt brightness changes from the video that could potentially trigger an epileptic seizure;
  • arnndn — a speech noise suppression filter using recurrent neural networks;
  • bilateral — performs spatial smoothing while preserving edges;
  • maskedmin and maskedmax — merges two video streams based on differences with a third stream;
  • median — a noise suppression filter that selects the median pixel from a rectangle fitting within a specified radius;
  • AV1 frame merge — merging frames in the AV1 stream;
  • axcorrelate — calculates normalized cross-correlation between two audio streams;
  • thistogram — calculates and outputs the color distribution histogram in the video;
  • freezeframes — replaces a set of frames in the video with specific frames from another stream;
  • xfade and xfade_opencl —
    crossfade with transition from one video stream to another;
  • afirsrc — generates FIR coefficients using the frequency sampling method;
  • pad_opencl — adds padding to the image;
  • cas — applies the CAS (Contrast Adaptive Sharpen) sharpening filter to the video;
  • anlms — applies the normalized algorithm LMS (Least mean squares) to the first audio stream, computing coefficients based on differences with the second stream;
  • overlay_cuda — places a piece of one video over another;
  • tmedian — a noise suppression filter using median pixels from several successive frames;
  • maskedthreshold — filters pixels by comparing the difference between two video streams with a threshold value;
  • asubboost — boosts the frequencies for the subwoofer;
  • pcm_rechunk — repackages PCM audio considering the specified sample rate or bit rate;
  • scdet — detects scene changes in the video (for example, to detect motion in the frame);
  • gradients — generates a video stream with gradients;
  • sierpinski — generates a video stream with fractals Sierpiński;
  • untile — separates video composed of pieces into individual images;
  • dblur — implements directional blur.

Source: opennet.ru