Release of the FFmpeg 4.3 multimedia package with support for the Vulkan graphics API

After ten months of development available multimedia package ffmpeg 4.3, which includes a set of applications and a collection of libraries for operations on various multimedia formats (recording, converting and decoding audio and video formats). The package is distributed under the LGPL and GPL licenses, the development of FFmpeg is carried out adjacent to the project MPlayer.

Of changes, added in FFmpeg 4.3, we can highlight:

• Added graphics API support Vulkan;
• Based on Vulkan for Linux, an encoder has been implemented that uses AMD AMF / VCE engines for acceleration, as well as typical filter options avgblur_vulkan, overlay_vulkan, scale_vulkan and chromaber_vulkan;
• API enabled VDPAU (Video Decode and Presentation) for hardware acceleration of video processing in VP9 format;
• Added the ability to encode AV1 video using the library librav1ewritten in Rust and developed by the Xiph and Mozilla communities;
• Support for lossless multi-channel audio codec is implemented for mp4 media containers True HD and codec for XNUMXD sound MPEG-H 3D;
• Added support for protocols ZeroMQ и Rabbit MQ (AMQP 0-9-1);
• In Linux, a transition was made from the frameserver for non-linear editing of video streams (virtual video codec) AvxSynth, which has been in an abandoned state for 5 years, to the current fork Avi Synth+;
• Includes parser for images in WebP format;
• Implemented MJPEG and VP9 decoders using hardware acceleration mechanism Intel QSV (Quick Sync Video) as well as VP9 encoder based on Intel QSV;
• Extended support for subtitle styles in 3GPP Timed Text Subtitles format;
• Added encoder-binding over API Microsoft Media Foundation;
• Added an ADPCM encoder for audio data used in Simon & Schuster Interactive games;
• Added new decoders: PFM, IMM5, Sipro ACELP.KELVIN, mvdv, mvha, mv30, NotchLC, Argonaut Games ADPCM, Rayman 2 ADPCM, Simon & Schuster Interactive ADPCM, High Voltage Software ADPCM, ADPCM IMA MTF, CDToons, Siren, DERF DPCM and CRI HCA;
• Added streamhash media container packer (muxer) and implemented the ability to pack pcm and pgs into m2ts containers;
• Added unpackers of media containers (demuxer): AV1 with extensions from the application B,
  Argonaut Games ASF, Real War KVAG, Rayman 2 APM, LEGO Racers ALP (.tun and .pcm), FWSE, DERF, CRI HCA, Pro Pinball Series Soundbank;

• New filters:
  • v360 - converts 360-degree video to various formats;
  • scroll - scrolls the video horizontally or vertically at a specified speed;
  • photosensitivity - removes bright flashes and sharp changes in brightness from the video, which can potentially cause an epileptic seizure;
  • arnnndn — speech noise suppression filter using a recurrent neural network;
  • bilateral — performs spatial smoothing with preservation of edges;
  • maskadmin и maskedmax - merge two video streams based on differences with the third stream;
  • median — a noise suppression filter that selects a median pixel from a rectangle that fits into the specified radius;
  • AV1 frame merge — merging frames in the AV1 stream;
  • axcorrelate - calculates the normalized cross-correlation between two audio streams;
  • thistogram - calculates and displays a histogram of the distribution of colors in the video;
  • freezeframes - replaces a set of frames on the video with certain frames from another stream;
  • xfade и xfade_opencl —
    cross fading with transition from one video stream to another;

  • afirsrc – generates FIR coefficients using frequency sampling method;
  • pad_opencl - adds padding to the image;
  • case — applies a CAS (Contrast Adaptive Sharpen) sharpening filter to the video;
  • anlms - applies a normalized algorithm LMS (Least mean squares) to the first audio stream, calculating coefficients based on differences with the second stream;
  • overlay_cuda - places a piece of one video on top of another;
  • tmedian - Noise suppression filter using median pixels from several successful frames;
  • maskedthreshold — selects pixels when filtering based on comparing the difference between two video streams with a threshold value;
  • asubboost - amplifies the frequencies for the subwoofer;
  • pcm_rechunk — repackages PCM-audio taking into account the specified sampling rate or packet rate;
  • scdet - detects changes in the scene on the video (for example, to determine the movement in the frame);
  • gradients — generates a video stream with gradients;
  • sierpinsky — generates a video stream with fractals Sierpinsky;
  • untile - parses the video, composed of pieces, into separate images;
  • dblur — implements directional blur.

Source: opennet.ru