Yekutanga yakagadzikana kuburitswa kwekushandisa yekurodha GNU webhu zvemukati Wget2

Mushure memakore matatu nehafu ebudiriro, yekutanga kuburitswa kwakagadzikana kweiyo GNU Wget2 purojekiti yakaunzwa, ichigadzira yakanyatsogadziridzwa vhezheni yechirongwa chekugadzirisa otomatiki kudhawunirodha kweGNU Wget zvemukati. GNU Wget2 yakagadzirwa uye kunyorwazve kubva pakutanga uye yakakosha pakufambisa basa rekutanga remutengi wewebhu muraibhurari ye libwget, inogona kushandiswa zvakasiyana mumashandisirwo. Chishandiso chine rezinesi pasi peGPLv3+, uye raibhurari ine rezinesi pasi pe LGPLv3+.

Panzvimbo pekugadzirisa zvishoma nezvishoma iyo iripo kodhi base, zvakasarudzwa kudzoreredza zvese kubva kutanga uye kumisikidza yakaparadzana Wget2 bazi kuti iite mazano ekugadzirisazve, kuwedzera mashandiro uye kuita shanduko dzinoputsa kuenderana. Kunze kwekudzikisira kweiyo FTP protocol uye iyo WARC fomati, wget2 inogona kuita seyakajeka kutsiva kweiyo classic wget utility mumamiriro mazhinji.

Izvo zviri kutaurwa, wget2 ine zvimwe zvakanyorwa mutsauko wehunhu, inopa makumi matatu ekuwedzera sarudzo, uye inomira kutsigira akati wandei sarudzo. Kusanganisira kugadzirisa sarudzo dzakadai se "-ask-password", "-header", "-exclude-directories", "-ftp*", "-warc*", "-limit-rate", "-relative" yave. yakamisa " uye "--unlink".

Zvitsva zvakakosha zvinosanganisira:

  • Kufambisa kushanda kune libwget raibhurari.
  • Shanduko kune akawanda-akarukwa architecture.
  • Kugona kumisikidza akawanda ekubatanidza mune yakafanana uye kurodha kune akawanda tambo. Izvo zvakare zvinogoneka kufananidza kurodha kwefaira rimwe rakakamurwa kuita mabhuroko uchishandisa iyo "-chunk-saizi" sarudzo.
  • HTTP/2 protocol rutsigiro.
  • Shandisa iyo Kana-Yakagadziridzwa-Kubva HTTP musoro kuti utore chete iyo yakagadziridzwa data.
  • Chinja kushandisa ekunze bandwidth miganho senge trickle.
  • Tsigiro yeBvuma-Encoding musoro, yakamanikidzwa kuendesa data, uye brotli, zstd, lzip, gzip, deflate, lzma, uye bzip2 compression algorithms.
  • Tsigiro yeTLS 1.3, OCSP (Online Certificate Status Protocol) yekutarisa zvitupa zvakabviswa, HSTS (HTTP Strict Transport Security) nzira yekumanikidza kudzoserwa kuHTTPS neHPKP (HTTP Public Key Pinning) yekusunga zvitupa.
  • Kugona kushandisa GnuTLS, WolfSSL uye OpenSSL semashure eTLS.
  • Tsigiro yekukurumidza kuvhurwa kweTCP yekubatanidza (TCP FastOpen).
  • Yakavakirwa-mukati Metalink fomati rutsigiro.
  • Tsigiro yemazita epasirese domain (IDNA2008).
  • Iko kugona kushanda panguva imwe chete kuburikidza akati wandei proxy maseva (rukova rumwe ruchatakurwa kuburikidza neimwe proxy, uye yechipiri kuburikidza neimwe).
  • Yakavakirwa-mukati tsigiro yemafeed enhau muAtom neRSS mafomati (semuenzaniso, wekutarisa uye kudhawunirodha link). RSS/Atom data inogona kutorwa kubva kufaira remunharaunda kana netiweki.
  • Tsigiro yekutora maURL kubva kuSitemaps. Kuvepo kwevaparidzi vekutora zvinongedzo kubva kuCSS uye XML mafaera.
  • Tsigiro yekuraira kwe'kusanganisira' mumafaira ekugadzirisa uye kugovera zvigadziriso pamafaira akati wandei (/etc/wget/conf.d/*.conf).
  • Yakavakirwa-mukati DNS query caching mechanism.
  • Kugona kwekudzokorora zvemukati nekushandura gwaro encoding.
  • Accounting ye "robots.txt" faira panguva yekudzokorora kudhawunirodha.
  • Yakavimbika yekunyora modhi ine fsync () kufona mushure mekuchengetedza data.
  • Iko kugona kutangazve yakavhiringidzwa TLS zvikamu, pamwe necache uye chengetedza TLS sesheni paramita kune faira.
  • "--input-file-" maitiro ekurodha maURL anouya kuburikidza neyakajairwa kupinza rwizi.
  • Kutarisa chiyero cheCokie ichipesana nedhairekitori reruzhinji domain suffixes (Public Suffix Rondedzero) yekuzviparadzanisa kubva kune imwe neimwe nzvimbo dzakasiyana dzakabatwa mune imwecheteyo yechipiri-level domain (semuenzaniso, "a.github.io" uye "b.github. io").
  • Inotsigira kurodha ICEcast/SHOUTcast kutenderera.

Source: opennet.ru

Voeg