{"id":101431,"date":"2021-09-27T10:22:47","date_gmt":"2021-09-27T08:22:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/pervyj-stabilnyj-reliz-utility-dlya-zagruzki-web-kontenta-gnu-wget2"},"modified":"2021-09-27T10:22:47","modified_gmt":"2021-09-27T08:22:47","slug":"pervyj-stabilnyj-reliz-utility-dlya-zagruzki-web-kontenta-gnu-wget2","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/news\/pervyj-stabilnyj-reliz-utility-dlya-zagruzki-web-kontenta-gnu-wget2","title":{"rendered":"The first stable release of the GNU Wget2 web content downloading utility","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"
After three and a half years of development, the first stable release of the GNU Wget2 project has been presented, which is a complete overhaul of the GNU Wget program designed for automating the recursive downloading of content. GNU Wget2 is designed and rewritten from scratch and is notable for extracting the core functionality of the web client into the libwget library, which can be used independently in applications. The utility is licensed under GPLv3+, while the library is under LGPLv3+. <\/p>\n
Instead of gradually reworking the existing codebase, it was decided to rewrite everything from scratch and establish a separate Wget2 branch to embody ideas for restructuring, expanding functionality, and implementing changes that break compatibility. Except for the discontinuation of support for the FTP protocol and the WARC format, wget2 can act as a transparent replacement for the classic wget utility in most situations. <\/p>\n
At the same time, wget2 has some documented differences in behavior, provides about 30 additional options, and has discontinued support for several dozen options. This includes stopping the processing of options such as \u2014ask-password, \u2014header, \u2014exclude-directories, \u2014ftp*, \u2014warc*, \u2014limit-rate, \u2014relative, and \u2014unlink. <\/p>\n
Key innovations include: <\/p>\n
\n
Extracting functionality into the libwget library.\n
Transitioning to a multithreaded architecture.\n
The ability to install multiple connections in parallel and download in multiple streams. This includes the possibility of parallelizing the download of a single file by breaking it into blocks using the \u2014chunk-size option.\n
Support for the HTTP\/2 protocol.\n
Using the HTTP header If-Modified-Since to download only changed data.\n
Transitioning to the use of external bandwidth throttling tools, such as trickle.\n
Support for the Accept-Encoding header, compressed data transfer, and compression algorithms including brotli, zstd, lzip, gzip, deflate, lzma, and bzip2.\n
Support for TLS 1.3, the OCSP (Online Certificate Status Protocol) for checking revoked certificates, the HSTS (HTTP Strict Transport Security) mechanism for enforcing redirection to HTTPS, and HPKP (HTTP Public Key Pinning) for binding certificates.\n
The ability to use GnuTLS, WolfSSL, and OpenSSL as backends for TLS.\n