ProHoster > Блог > ozi ịntanetị > Mwepụta kwụsiri ike nke izizi maka nbudata ọdịnaya webụ GNU Wget2

Mwepụta kwụsiri ike nke izizi maka nbudata ọdịnaya webụ GNU Wget2

Ka afọ atọ na ọkara nke mmepe gachara, ewepụtala ntọhapụ kwụsiri ike nke mbụ nke ọrụ GNU Wget2, na-emepe ụdị mmemme emegharịrị kpamkpam maka ịmegharị nbudata ọdịnaya GNU Wget ugboro ugboro. Emebere GNU Wget2 wee degharịa ya site na ọkọ ma bụrụ ama ama maka ibugharị ọrụ bụ isi nke onye ahịa wee banye n'ọbá akwụkwọ libwget, nke enwere ike iji ya na ngwa. Enyere ikike ikike n'okpuru GPLv3+, yana ọbá akwụkwọ ahụ nwere ikikere n'okpuru LGPLv3+.

Kama iji nwayọọ nwayọọ rụgharịa ntọala koodu dị adị, e kpebiri imegharị ihe niile site na ọkọ wee guzobe alaka Wget2 dị iche iji mejuputa echiche maka nhazigharị, ịba ụba ọrụ na ime mgbanwe na-emebi ndakọrịta. Ewezuga nbibi nke protocol FTP na usoro WARC, wget2 nwere ike rụọ ọrụ dị ka ihe nnọchi anya maka akụrụngwa wget kpochapụwo n'ọtụtụ ọnọdụ.

Nke a na-ekwu, wget2 nwere ụfọdụ esemokwu edekọtara na omume, na-enye ihe dị ka nhọrọ 30 ọzọ, ma kwụsị ịkwado ọtụtụ nhọrọ iri na abuo. Gụnyere nhazi nhọrọ dị ka “-ask-password”, “-header”, “-exclude-directories”, “-ftp*”, “-warc*”, “-limit-rate”, “-relation kwụsịrị " na "--unlink".

Ihe ohuru ohuru gunyere:

  • Ịkwaga arụmọrụ na ọba akwụkwọ libwget.
  • Ntugharị gaa n'ime ụlọ nwere ọtụtụ eriri.
  • Ikike ịmepụta ọtụtụ njikọ n'otu oge na budata na ọtụtụ eri. Ọ ga-ekwe omume ime ka nbudata nke otu faịlụ kewara n'ime ngọngọ site na iji nhọrọ "-chunk-size".
  • Nkwado protocol HTTP/2.
  • Jiri nkụnye eji isi mee HTTP Ọ bụrụ-Egbanwere-Ebe ọ bụ na ibudata naanị data emezigharịrị.
  • Gbanwee na iji ihe mgbochi bandwidth mpụga dị ka aghụghọ.
  • Nkwado maka isi nnabata nnabata-encoding, mbufe data abịakọrọ, na brotli, zstd, lzip, gzip, deflate, lzma, na bzip2 algọridim mkpakọ.
  • Nkwado maka TLS 1.3, OCSP (Online Certificate Protocol) maka ịlele asambodo ewepụrụ, HSTS (HTTP Strict Transport Security) usoro maka ịmanye redirection na HTTPS na HPKP (HTTP Public Key Pinning) maka njide akwụkwọ.
  • Ikike iji GnuTLS, WolfSSL na OpenSSL dị ka ndabere maka TLS.
  • Nkwado maka mmeghe ngwa ngwa nke njikọ TCP (TCP FastOpen).
  • Nkwado usoro Metalink arụnyere n'ime ya.
  • Nkwado maka aha ngalaba mba ụwa (IDNA2008).
  • Ikike nke ịrụ ọrụ n'otu oge site na ọtụtụ sava proxy (a ga-ebufe otu iyi site na otu proxy, nke abụọ site na nke ọzọ).
  • Nkwado arụnyere n'ime maka faili ntanetịime akụkọ n'ụdị Atom na RSS (dịka ọmụmaatụ, maka nyocha na nbudata njikọ). Enwere ike ibudata data RSS/Atom site na faịlụ mpaghara ma ọ bụ na netwọkụ.
  • Nkwado maka iwepụ URL na saịtị saịtị. Nnweta nke nzacha maka iwepụta njikọ na faịlụ CSS na XML.
  • Nkwado maka ntuziaka 'gụnyere' na faịlụ nhazi yana nkesa ntọala n'ofe faịlụ dị iche iche (/etc/wget/conf.d/*.conf).
  • Usoro nchekwa nchekwa ajụjụ DNS arụnyere n'ime ya.
  • Enwere ike ịmegharị ọdịnaya site n'ịgbanwe ntinye akwụkwọ.
  • Ịnye ajụjụ maka faịlụ "robots.txt" n'oge nbudata ugboro ugboro.
  • Ọnọdụ ide nwere ntụkwasị obi na oku fsync() mgbe echekwara data.
  • Ikike ịmalitegharị oge TLS kwụsịrị, yana cache na chekwaa paramita oge TLS na faịlụ.
  • Ụdị "--input-file-" maka ibunye URL na-abịa site na iyi ntinye ọkọlọtọ.
  • Na-enyocha oke kuki ahụ megide akwụkwọ ndekọ aha suffixes ngalaba ọha (Ndepụta Suffix Ọhaneze) iji kewapụ onwe ha na saịtị dị iche iche akwadoro n'otu ngalaba ọkwa nke abụọ (dịka ọmụmaatụ, “a.github.io” na “b.github. io").
  • Na-akwado nbudata ICEcast/SHOUTcast nkwanye.

isi: opennet.ru

Tinye a comment