Ajiyayyen Sashe na 7: Kammalawa

Ajiyayyen Sashe na 7: Kammalawa

Wannan bayanin kula yana kammala zagayowar game da madadin. Zai tattauna ƙungiyar ma'ana ta uwar garken sadaukarwa (ko VPS), dacewa don wariyar ajiya, kuma zai ba da zaɓi don dawo da sabar da sauri daga madadin ba tare da raguwa mai yawa ba a yayin bala'i.

Asalin bayanai

Sabar da aka keɓe galibi tana da aƙalla rumbun kwamfyuta guda biyu waɗanda ke aiki don tsara tsarin RAID na matakin farko ( madubi). Wannan yana da mahimmanci don samun damar ci gaba da aiki da uwar garken idan diski ɗaya ya gaza. Idan wannan uwar garken sadaukarwa ce ta yau da kullun, ana iya samun mai sarrafa RAID na hardware daban tare da fasahar caching mai aiki akan SSD, ta yadda ban da rumbun kwamfyuta na yau da kullun, ana iya haɗa ɗaya ko fiye SSDs. Wani lokaci ana ba da sabobin da aka keɓe, waɗanda faifan gida suna ɗauke da SATADOM kawai (kananan faifan diski, tsarin filasha da ke da alaƙa da tashar jiragen ruwa ta SATA), ko ma ƙaramin filashin na yau da kullun (8-16GB) wanda aka haɗa da tashar ciki ta musamman, da kuma Ana ɗaukar bayanai daga tsarin ajiya , an haɗa ta hanyar hanyar sadarwa mai mahimmanci (Ethernet 10G, FC, da dai sauransu), kuma akwai sabar da aka keɓe waɗanda aka ɗora su kai tsaye daga tsarin ajiya. Ba zan yi la'akari da irin waɗannan zaɓuɓɓukan ba, tunda a irin waɗannan lokuta aikin tallafawa uwar garken a hankali yana wucewa ga ƙwararrun da ke kula da tsarin ajiya; yawanci akwai fasahohin mallakar mallaka daban-daban don ƙirƙirar hotuna, haɓakawa da sauran abubuwan farin ciki na mai sarrafa tsarin. , an tattauna a sassan da suka gabata na wannan silsilar. Girman tsararrun faifai na uwar garken da aka keɓe na iya kaiwa dubun-duba terabytes, ya danganta da lamba da girman faifai da aka haɗa da uwar garken. A cikin yanayin VPS, juzu'i sun fi dacewa: yawanci ba su wuce 100GB ba (amma kuma akwai ƙari), kuma jadawalin kuɗin fito na irin wannan VPS na iya zama mafi tsada fiye da sabar sadaukarwa mafi arha daga mai ɗaukar hoto iri ɗaya. VPS galibi yana da faifai guda ɗaya, saboda za'a sami tsarin ajiya (ko wani abu mai ƙarfi) a ƙarƙashinsa. Wani lokaci VPS yana da faifai da yawa tare da halaye daban-daban, don dalilai daban-daban:

  • ƙananan tsarin - don shigar da tsarin aiki;
  • babba - adana bayanan mai amfani.

Lokacin da kuka sake shigar da tsarin ta amfani da kwamitin kulawa, ba a sake rubuta faifai tare da bayanan mai amfani ba, amma faifan tsarin ya cika gaba ɗaya. Hakanan, a cikin yanayin VPS, mai ɗaukar hoto na iya ba da maɓallin da ke ɗaukar hoto na yanayin VPS (ko diski), amma idan kun shigar da tsarin aikin ku ko manta kunna sabis ɗin da ake so a cikin VPS, wasu. na data iya har yanzu a rasa. Baya ga maɓalli, galibi ana ba da sabis ɗin ajiyar bayanai, galibi iyakance sosai. Yawanci wannan asusu ne tare da samun dama ta hanyar FTP ko SFTP, wani lokacin tare da SSH, tare da harsashi mai tsiri (misali, rbash), ko ƙuntatawa kan aiwatar da umarni ta hanyar maɓallan izini (ta hanyar ForcedCommand).

An haɗa uwar garken da aka keɓe zuwa cibiyar sadarwa ta tashoshi biyu masu saurin 1 Gbps, wani lokacin waɗannan na iya zama katunan da gudun 10 Gbps. VPS galibi yana da hanyar sadarwa guda ɗaya. Mafi sau da yawa, cibiyoyin bayanai ba su iyakance saurin hanyar sadarwa a cikin cibiyar bayanai ba, amma suna iyakance saurin shiga Intanet.

Babban nauyin irin wannan sabar sadaukarwa ko VPS shine sabar gidan yanar gizo, bayanai, da sabar aikace-aikace. Wani lokaci ana iya shigar da ƙarin sabis na taimako daban-daban, gami da sabar gidan yanar gizo ko bayanai: injin bincike, tsarin saƙo, da sauransu.

Sabar da aka shirya ta musamman tana aiki azaman sarari don adana kwafin ajiya; za mu rubuta game da shi dalla-dalla daga baya.

Ƙungiya mai ma'ana na tsarin faifai

Idan kuna da mai sarrafa RAID, ko VPS tare da faifai ɗaya, kuma babu zaɓi na musamman don aiki na tsarin faifan diski (misali, diski mai sauri daban don bayanan bayanai), duk sarari kyauta yana rarraba kamar haka: bangare ɗaya. an ƙirƙira shi, kuma an ƙirƙiri rukunin ƙarar LVM a samansa, an ƙirƙiri ƙididdiga da yawa a ciki: 2 ƙananan ƙananan girman guda ɗaya, ana amfani da su azaman tushen fayil ɗin tushen (canza su ɗaya bayan ɗaya yayin sabuntawa don yiwuwar saurin juyawa, An samo ra'ayin daga Ƙididdigar rarraba Linux), wani kuma shine don swap partition, sauran sararin sararin samaniya ya kasu kashi ƙananan ƙananan , ana amfani da shi azaman tushen tsarin fayil don cikakkun kwantena, faifai don inji mai mahimmanci, fayil. tsarin asusun a / gida (kowane asusu yana da nasa tsarin fayil), tsarin fayil don kwantena aikace-aikace.

Muhimmiyar bayanin kula: kundin dole ne ya kasance gabaɗaya da kansa, watau. kada ya dogara da juna ko a kan tushen fayil tsarin. A cikin yanayin injina ko kwantena, ana lura da wannan batu ta atomatik. Idan waɗannan kwantenan aikace-aikace ne ko kundayen adireshi na gida, yakamata kuyi tunani game da raba fayilolin sanyi na sabar gidan yanar gizo da sauran ayyuka ta yadda za a kawar da dogaro tsakanin kundin kamar yadda zai yiwu. Misali, kowane rukunin yanar gizon yana gudana daga mai amfani da kansa, fayilolin daidaitawar rukunin yanar gizon suna cikin kundin adireshin gida na mai amfani, a cikin saitunan uwar garken yanar gizo, fayilolin daidaitawar rukunin yanar gizo ba a haɗa su ta hanyar /etc/nginx/conf.d/.conf, da, misali, /gida//configs/nginx/*.conf

Idan akwai faifai da yawa, zaku iya ƙirƙirar tsarin RAID na software (kuma saita caching ɗin sa akan SSD, idan akwai buƙata da dama), akan sama zaku iya gina LVM gwargwadon ƙa'idodin da aka gabatar a sama. Hakanan a wannan yanayin, zaku iya amfani da ZFS ko BtrFS, amma yakamata kuyi tunani sau biyu game da wannan: duka biyun suna buƙatar mafi mahimmancin tsarin kula da albarkatu, kuma ban da, ZFS ba a haɗa shi da kwaya ta Linux ba.

Ba tare da la’akari da tsarin da aka yi amfani da shi ba, yana da kyau koyaushe a ƙididdige madaidaicin saurin rubuta canje-canje zuwa faifai, sannan ƙididdige adadin sarari kyauta wanda za a tanadar don ƙirƙirar hotuna. Misali, idan uwar garken namu ta rubuta bayanai a gudun megabytes 10 a sakan daya, kuma girman dukkan bayanan ya kai terabyte 10 - lokacin aiki tare zai iya kaiwa rana guda (awanni 22 - wannan shine nawa za a iya canja wurin girman irin wannan girma). akan hanyar sadarwa 1 Gbps) - yana da daraja ajiyar kusan 800 GB . A zahiri, adadi zai zama ƙarami; zaku iya raba shi cikin aminci ta adadin adadin ma'ana.

Ajiyayyen na'urar uwar garken ajiya

Babban bambanci tsakanin uwar garken don adana kwafin ajiyar kuɗi shine manyan diski masu arha kuma masu ɗan jinkiri. Tun da HDDs na zamani sun riga sun ketare mashigin 10TB a cikin faifai ɗaya, wajibi ne a yi amfani da tsarin fayil ko RAID tare da checksums, saboda lokacin sake gina tsararru ko maido da tsarin fayil (kwanaki da yawa!) faifai na biyu na iya gazawa saboda. don ƙara kaya. A kan faifai masu ƙarfin har zuwa 1TB wannan ba shi da hankali sosai. Don sauƙin bayanin, Ina ɗauka cewa sararin diski ya kasu kashi biyu na kusan girman daidai (sake, misali, ta amfani da LVM):

  • kundin da ya dace da sabar da ake amfani da su don adana bayanan mai amfani (a madadin na ƙarshe da aka yi za a tura su don tabbatarwa);
  • kundin da aka yi amfani da shi azaman ma'ajiyar BorgBackup (bayanai don madadin za su tafi kai tsaye nan).

Ka'idar aiki ita ce, an ƙirƙiri kuɗaɗe daban-daban don kowane uwar garken don ma'ajiyar BorgBackup, inda bayanai daga sabar yaƙi za su tafi. Ma'ajiyar ajiyar suna aiki ne ta hanyar append-kawai, wanda ke kawar da yuwuwar share bayanai da gangan, kuma saboda cirewa da tsaftacewa lokaci-lokaci na ma'ajin daga tsoffin ma'ajin (kwafi na shekara-shekara ya rage, kowane wata don shekarar da ta gabata, mako-mako don watan ƙarshe, kowace rana don makon da ya gabata, maiyuwa a lokuta na musamman - sa'a guda don ranar ƙarshe: jimlar 24 + 7 + 4 + 12 + kowace shekara - kusan kwafi 50 ga kowane uwar garken).
Ma'ajiyar BorgBackup ba sa kunna yanayin append-kawai; maimakon haka, ForcedCommand a cikin .ssh/authorized_keys ana amfani da wani abu kamar haka:

from="адрес сервера",command="/usr/local/bin/borg serve --append-only --restrict-to-path /home/servername/borgbackup/",no-pty,no-agent-forwarding,no-port-forwarding,no-X11-forwarding,no-user-rc AAAAA.......

Hanyar da aka ƙayyade ta ƙunshi rubutun nannade a saman borg, wanda, ban da ƙaddamar da binary tare da sigogi, kuma yana fara aikin maido da kwafin ajiyar bayan an cire bayanan. Don yin wannan, rubutun nannade yana ƙirƙirar fayil ɗin tag kusa da ma'ajiyar da ta dace. Ajiyayyen na ƙarshe da aka yi ana mayar da shi ta atomatik zuwa daidaitaccen ƙarar ma'ana bayan an kammala aikin cika bayanai.

Wannan ƙira yana ba ku damar tsaftace bayanan da ba dole ba lokaci-lokaci, sannan kuma yana hana sabar yaƙi goge wani abu akan uwar garken ajiyar ajiya.

Tsarin Ajiyayyen

Mai ƙaddamar da wariyar ajiya shine uwar garken sadaukarwa ko VPS kanta, tun da wannan makirci yana ba da ƙarin iko akan tsarin madadin a ɓangaren wannan uwar garke. Da farko, an ɗauki hoton yanayin tsarin tushen fayil ɗin aiki, wanda aka ɗora kuma ana loda shi ta amfani da BorgBackup zuwa uwar garken ajiyar ajiya. Bayan an gama kama bayanai, za a cire hoton hoton kuma an goge shi.

Idan akwai ƙaramin rumbun adana bayanai (har zuwa 1 GB na kowane rukunin yanar gizon), ana yin jujjuya bayanai, wanda aka adana a cikin juzu'in ma'ana mai dacewa, inda sauran bayanan na wannan rukunin yanar gizon suke, amma don jujjuwar ta kasance. ba samuwa ta hanyar uwar garken yanar gizo. Idan ma'ajin bayanai sun yi girma, ya kamata ka saita cire bayanan "zafi", misali, ta amfani da xtrabackup don MySQL, ko aiki tare da WAL tare da umarni_command a PostgreSQL. A wannan yanayin, za a dawo da bayanan bayanan daban daga bayanan rukunin yanar gizon.

Idan ana amfani da kwantena ko injunan kama-da-wane, yakamata ku saita wakilin qemu-bako, CRIU ko wasu fasaha masu mahimmanci. A wasu lokuta, ba a buƙatar ƙarin saituna sau da yawa - kawai muna ƙirƙirar hotuna na ƙididdiga masu ma'ana, waɗanda ake sarrafa su ta hanyar da za a iya ɗauka ta yanayin tsarin fayil ɗin tushen. Bayan an ɗauki bayanan, ana share hotuna.

Ana aiwatar da ƙarin aiki akan uwar garken ma'ajiyar ajiyar waje:

  • Ana duba maajiyar ƙarshe da aka yi a kowane ma'ajiyar ajiya,
  • an duba kasancewar fayil ɗin alama, yana nuna cewa an kammala aikin tattara bayanai,
  • an faɗaɗa bayanan zuwa madaidaicin ƙarar gida,
  • an share fayil ɗin tag

Tsarin dawo da uwar garke

Idan babban uwar garken ya mutu, to, an ƙaddamar da irin wannan uwar garken sadaukarwa, wanda ke yin takalma daga wasu daidaitattun hoto. Mai yuwuwa zazzagewar za ta gudana ne a kan hanyar sadarwar, amma ƙwararrun cibiyar bayanai da ke kafa uwar garken na iya kwafin wannan ma'auni nan da nan zuwa ɗaya daga cikin faifai. Zazzagewar yana faruwa a cikin RAM, bayan haka aikin dawo da farawa:

  • ana buƙatar haɗa na'urar toshe ta hanyar iscsinbd ko wata yarjejeniya mai kama da ita zuwa ƙarar ma'ana da ke ɗauke da tushen tsarin sabar da ta mutu; Tun da tushen fayil ɗin dole ne ya zama ƙanana, wannan matakin ya kamata a kammala a cikin 'yan mintuna kaɗan. Ana kuma dawo da bootloader;
  • An sake ƙirƙira tsarin kundin ma'ana na gida, ana haɗe ƙididdiga masu ma'ana daga uwar garken ajiyar ta amfani da module dm_clone kernel module: dawo da bayanai ya fara, kuma ana rubuta canje-canje nan da nan zuwa diski na gida.
  • an ƙaddamar da akwati tare da duk faifan diski na zahiri - aikin uwar garken an dawo da shi gabaɗaya, amma tare da raguwar aiki;
  • bayan an gama aiki tare da bayanai, an cire haɗin ma'auni na ma'ana daga uwar garken ajiya, an kashe akwati, kuma an sake kunna uwar garken;

Bayan sake kunnawa, uwar garken zai sami duk bayanan da ke wurin a lokacin da aka ƙirƙiri madadin, kuma za ta haɗa da duk canje-canjen da aka yi yayin aikin dawo da su.

Sauran labarai a cikin jerin

Ajiyayyen, Sashe na 1: Me yasa ake buƙatar madadin, bayyani na hanyoyin, fasaha
Ajiyayyen Sashe na 2: Bita da gwada kayan aikin madadin tushen rsync
Ajiyayyen Sashe na 3: Bita da Gwajin kwafi, kwafi
Ajiyayyen Sashe na 4: Bita da gwaji zbackup, restic, borgbackup
Ajiyayyen Sashe na 5: Gwajin Bacula da Ajiyayyen Veeam don Linux
Ajiyayyen: sashi bisa buƙatar masu karatu: bita na AMANDA, UrBackup, BackupPC
Ajiyayyen Sashe na 6: Kwatanta Kayan Ajiyayyen
Ajiyayyen Sashe na 7: Kammalawa

Ina gayyatar ku don tattauna zaɓin da aka tsara a cikin sharhi, na gode da hankalin ku!

source: www.habr.com

Add a comment