Backup Chikamu 7: Mhedziso

Backup Chikamu 7: Mhedziso

Ichi chinyorwa chinopedzisa kutenderera nezve backup. Ichakurukura zvine musoro kurongeka kwesevha yakatsaurirwa (kana VPS), yakanakira backup, uye ichapawo sarudzo yekukurumidza kudzoreredza sevha kubva kune backup pasina kuderera kwakawanda kana pakaitika njodzi.

Data yekutanga

Sevha yakatsaurirwa kazhinji ine angangoita maviri madhiraivha anoshanda kuronga yekutanga-level RAID array (girazi). Izvi zvinodikanwa kuti ukwanise kuenderera mberi nekushandisa sevha kana imwe dhisiki ikatadza. Kana iyi iri sevha yakazvitsaurira yenguva dzose, panogona kunge paine yakaparadzana hardware RAID controller ine inoshanda caching tekinoroji paSSD, kuitira kuti mukuwedzera kune akajairwa madhiraivha, imwe kana akawanda SSD anogona kubatana. Dzimwe nguva maseva akazvitsaurira anopihwa, umo ega madhisiki emunharaunda ari SATADOM (madiki madhisiki, akarongeka flash drive yakabatana neSATA chiteshi), kana kunyange yakajairika diki (8-16GB) flash drive yakabatana kune yakakosha chiteshi chemukati, uye iyo dhata inotorwa kubva mugadziriro yekuchengetedza, yakabatana kuburikidza neyakatsaurirwa yekuchengetedza network (Ethernet 10G, FC, nezvimwewo), uye kune maseva akazvitsaurira anotakurwa zvakananga kubva kune yekuchengetedza system. Ini handingatarise sarudzo dzakadai, sezvo muzviitiko zvakadaro basa rekutsigira sevha rinopfuura zvakanaka kune nyanzvi inochengetedza sisitimu yekuchengetera; kazhinji kune akasiyana tekinoroji tekinoroji ekugadzira zvipfupi, akavakirwa-mukati deduplication uye mamwe mafaro eiyo system administrator. , yakakurukurwa muzvikamu zvakapfuura zveiyi nhevedzano. Hvhoriyamu yedhisiki yakatsaurirwa server's array inogona kusvika makumi akati wandei ematerabytes, zvichienderana nehuwandu uye saizi yemadhisiki akabatana neserver. Panyaya yeVPS, mavhoriyamu acho ane mwero: kazhinji haapfuure 100GB (asi kune zvakare akawanda), uye mutero weVPS yakadaro inogona kudhura zvakanyanya kupfuura yakachipa yakatsaurwa maseva kubva kune imwechete hoster. VPS kazhinji ine dhisiki imwe, nekuti pachave neiyo yekuchengetedza system (kana chimwe chinhu hyperconverged) pasi payo. Dzimwe nguva VPS ine akati wandei madhisiki ane hunhu hwakasiyana, nekuda kwezvinangwa zvakasiyana:

  • diki system - yekuisa iyo yekushandisa system;
  • hombe - kuchengetedza data remushandisi.

Paunodzosera sisitimu uchishandisa control panel, dhisiki ine data yemushandisi haina kunyorwa, asi system disk inozadzwa zvachose. Zvakare, kana iri VPS, mugadziri anogona kupa bhatani rinotora mufananidzo weiyo VPS (kana dhisiki), asi kana iwe ukaisa yako yega sisitimu yekushandisa kana kukanganwa kumisa basa raunoda mukati meVPS, zvimwe. yedata inogona kuramba yakarasika. Pamusoro pebhatani, sevhisi yekuchengetedza data inowanzo kupihwa, kazhinji kazhinji kushomeka. Kazhinji iyi iakaundi ine mukana kuburikidza neFTP kana SFTP, dzimwe nguva pamwe neSSH, ine goko rakabviswa-pasi (semuenzaniso, rbash), kana kurambidzwa kuita mirairo kuburikidza nemvumo_keys (kuburikidza neForcedCommand).

Sevha yakatsaurirwa yakabatana kunetiweki nezviteshi zviviri zvine kumhanya kwe1 Gbps, dzimwe nguva aya anogona kunge ari makadhi ane kumhanya kwegumi Gbps. VPS kazhinji ine imwe network interface. Kazhinji, nzvimbo dzedata hadzikisi kumhanya kwetiweki mukati me data data, asi dzinodzikamisa kumhanya kweInternet.

Iyo yakajairika mutoro weiyo yakazvitsaurira sevha kana VPS iwebhu server, dhatabhesi, uye sevha yekushandisa. Dzimwe nguva akasiyana ekuwedzera masevhisi ekubatsira anogona kuiswa, kusanganisira yewebhu server kana dhatabhesi: yekutsvaga injini, mail system, nezvimwe.

Iyo yakanyatsogadzirirwa sevha inoita senzvimbo yekuchengetedza makopi ekuchengetedza; isu tichanyora nezvazvo mune zvakadzama gare gare.

Zvinonzwisisika sangano re disk system

Kana iwe uine RAID controller, kana VPS ine dhisiki rimwe chete, uye hapana yakakosha yakasarudzika yekushanda kweiyo disk subsystem (semuenzaniso, yakaparadzana dhisiki yedhatabhesi), nzvimbo yese yemahara inokamurwa seizvi: chikamu chimwe chete. inogadzirwa, uye boka revhoriyamu reLVM rinogadzirwa pamusoro payo, mavhoriyamu akati wandei anogadzirwa mairi: 2 madiki madiki akaenzana, anoshandiswa semudziyo faira system (yakashandurwa imwe neimwe panguva yekugadziridza kuitira mukana wekukurumidza kudzosera kumashure, iyo pfungwa yakatorwa kubva kuCalculate Linux kugovera), imwe ndeyekuchinjisa partition, iyo yakasara yemahara nzvimbo yakakamurwa kuita mavhoriyamu madiki, anoshandiswa semudzi faira system yemidziyo yakazara-yakazara, dhisiki yemashini chaiwo, faira. masisitimu emaakaundi mukati / kumba (akaundi yega yega ine yayo faira system), mafaira masisitimu emidziyo yekushandisa.

Chinyorwa chakakosha: mavhoriyamu anofanira kunge akazara ega, i.e. haifanirwe kutsamira pane imwe neimwe kana pamudzi faira system. Panyaya yemashini chaiwo kana midziyo, iyi poindi inocherechedzwa otomatiki. Kana aya ari midziyo yekushandisa kana madhairekitori epamba, iwe unofanirwa kufunga nezve kuparadzanisa mafaera ekugadzirisa ewebhu server uye mamwe masevhisi nenzira yekubvisa kutsamira pakati pemavhoriyamu zvakanyanya sezvinobvira. Semuenzaniso, saiti yega yega inomhanya kubva kune yayo mushandisi, iyo saiti yekumisikidza mafaera ari mudhairekitori remusha remushandisi, muwebhu server marongero, saiti yekumisikidza mafaira haina kubatanidzwa kuburikidza /etc/nginx/conf.d/.conf, uye, semuenzaniso, /home//configs/nginx/*.conf

Kana pane madhisiki akati wandei, unogona kugadzira software RAID array (uye gadzirisa caching yayo paSSD, kana paine chinodiwa uye mukana), pamusoro payo iwe unogona kuvaka LVM maererano nemitemo yakarongwa pamusoro. Uyewo munyaya iyi, unogona kushandisa ZFS kana BtrFS, asi unofanira kufunga kaviri pamusoro peizvi: zvose zvinoda nzira yakakomba kune zviwanikwa, uye kunze kwekuti, ZFS haina kubatanidzwa neLinux kernel.

Pasinei nechirongwa chinoshandiswa, inogara ichifanirwa kufungidzira pachine nguva yekumhanyisa kukurumidza kwekunyora shanduko kumadhisiki, uyezve kuverenga huwandu hwenzvimbo yemahara iyo ichachengeterwa kugadzira snapshots. Semuenzaniso, kana sevha yedu ichinyora data nekumhanya kwema megabytes gumi pasekondi, uye saizi yedhata yese arrabytes gumi terabytes - nguva yekuwiriranisa inogona kusvika pazuva (maawa makumi maviri nemaviri - iyi ndiyo yakawanda sei vhoriyamu ichaendeswa. pamusoro petiweki 10 Gbps) - zvakakodzera kuchengetedza nezve 10 GB . Muchokwadi, iyo nhamba ichave idiki; iwe unogona kuiparadzanisa zvakachengeteka nehuwandu hwemavhoriyamu anonzwisisika.

Chengetedza chengetedzo server mudziyo

Musiyano mukuru pakati pesevha yekuchengetedza makopi ekuchengetedza madhisiki akakura, akachipa uye anononoka. Sezvo maHDD emazuva ano akatoyambuka bhara re 10TB mune rimwe dhisiki, zvinodikanwa kushandisa faira masisitimu kana RAID ine cheki, nekuti panguva yekuvaka patsva kweiyo array kana kudzoreredzwa kweiyo faira system (mazuva akati wandei!) kuwedzera mutoro. Pamadhisiki ane huwandu hunosvika 1TB izvi zvaisanyanya kuoma. Kuti ive nyore tsananguro, ndinofungidzira kuti dhisiki nzvimbo yakakamurwa kuita zvikamu zviviri zveakaenzana saizi (zvakare, semuenzaniso, kushandisa LVM):

  • mavhoriyamu anoenderana nemaseva anoshandiswa kuchengetedza data remushandisi (yekupedzisira backup yakaitwa ichaiswa pavari kuti ionekwe);
  • mavhoriyamu anoshandiswa seBorgBackup repositories (data re backups richaenda zvakananga pano).

Nheyo yekushanda ndeyekuti mavhoriyamu akapatsanurwa anogadzirwa kune yega yega sevha yeBorgBackup repositories, uko data kubva kumasevha ekurwa ichaenda. Iwo matura anoshanda muappend-chete modhi, iyo inobvisa mukana wekudzima data nemaune, uye nekuda kwekudonhedza uye nguva nenguva kucheneswa kwezvinyorwa kubva kumabhakopu ekare (makopi epagore anoramba aripo, pamwedzi wegore rapfuura, vhiki nevhiki kumwedzi wapfuura, zuva nezuva svondo rapfuura, pamwe muzviitiko zvakakosha - awa yega yezuva rekupedzisira: yakazara 24 + 7 + 4 + 12 + gore negore - angangoita makumi mashanu makopi kune yega sevha).
BorgBackup repositories haigone append-chete modhi; pachinzvimbo, ForcedCommand mu.ssh/authorized_keys inoshandiswa seizvi:

from="адрСс сСрвСра",command="/usr/local/bin/borg serve --append-only --restrict-to-path /home/servername/borgbackup/",no-pty,no-agent-forwarding,no-port-forwarding,no-X11-forwarding,no-user-rc AAAAA.......

Iyo nzira yakatsanangurwa ine wrapper script pamusoro peborg, iyo, pamusoro pekutangisa bhinari nemaparamita, zvakare inotanga maitiro ekudzoreredza kopi yekuchengetedza mushure mekunge data yabviswa. Kuti uite izvi, iyo wrapper script inogadzira tag faira padivi peinoenderana repository. Iyo yekupedzisira backup yakaitwa inodzoserwa otomatiki kune inoenderana inonzwisisika vhoriyamu mushure mekunge nzira yekuzadza data yapera.

Iyi dhizaini inobvumidza iwe kuti ugare uchichenesa zvisingakoshi, uye zvakare inodzivirira kurwisa maseva kubva pakudzima chero chinhu pane backup yekuchengetedza server.

Backup process

Muvambi weiyo backup ndiyo yakatsaurirwa sevha kana VPS pachayo, sezvo chirongwa ichi chinopa kutonga kwakawanda pamusoro peiyo backup maitiro pane iyi server. Kutanga, mufananidzo weiyo inoshanda midzi faira system inotorwa, iyo inokwidziridzwa uye kurodha uchishandisa BorgBackup kune backup yekuchengetedza server. Mushure mekutora data kwapera, mufananidzo wacho unoburitswa uye unobviswa.

Kana paine dhatabhesi diki (kusvika 1 GB yesaiti yega yega), dhata redhata rinogadzirwa, iro rinochengetwa mune rakakodzera vhoriyamu inonzwisisika, uko kusara kwe data yesaiti imwe chete iripo, asi kuitira kuti kurasira . haiwanikwe kuburikidza newebhu server. Kana iyo dhatabhesi yakakura, iwe unofanirwa kugadzirisa "inopisa" yekubvisa data, semuenzaniso, uchishandisa xtrabackup yeMySQL, kana kushanda neWAL ine archive_command muPostgreSQL. Muchiitiko ichi, dhatabhesi ichadzoserwa zvakasiyana kubva kune saiti data.

Kana midziyo kana muchina chaiwo uchishandiswa, unofanira kugadzirisa qemu-muenzi-agent, CRIU kana mamwe matekinoroji anodiwa. Mune zvimwe zviitiko, mamwe marongero kazhinji asingadiwi - isu tinongogadzira snapshots yemavhoriyamu ane musoro, ayo anozogadziriswa nenzira imwechete semufananidzo weiyo midzi faira system. Mushure mekunge data yatorwa, mifananidzo inobviswa.

Rimwe basa rinoitwa pane backup yekuchengetedza server:

  • iyo yekupedzisira backup yakaitwa mune yega yega repository inotariswa,
  • kuvapo kwefaira rechiratidzo kunotariswa, zvichiratidza kuti nzira yekuunganidza data yapera,
  • iyo data inowedzerwa kune inoenderana vhoriyamu yenzvimbo,
  • iyo tag faira inodzimwa

Server recovery process

Kana iyo huru sevha ikafa, ipapo sevha yakatsaurirwa yakafanana inotangwa, iyo bhutsu kubva kune imwe yakajairika mufananidzo. Zvingangoitika kuti kurodha kuchaitika pamusoro petiweki, asi iyo data data tekinoroji inomisikidza sevha inogona kubva ipapo kukopa iyi yakajairika mufananidzo kune imwe yedhisiki. Iko kurodha kunoitika mu RAM, mushure meizvozvo maitiro ekudzoreredza anotanga:

  • chikumbiro chinoitwa kubatanidza block mudziyo kuburikidza neiscsinbd kana imwe yakafanana protocol kune inonzwisisika vhoriyamu ine midzi faira system yeakafa server; Sezvo iyo midzi faira system inofanirwa kunge iri diki, danho iri rinofanira kupedzwa mumaminitsi mashoma. Iyo bootloader yakadzorerwa zvakare;
  • chimiro chemavhoriyamu anonzwisisika emunharaunda anogadzirwazve, mavhoriyamu anonzwisisika akasungirirwa kubva kune backup server uchishandisa dm_clone kernel module: kudzoreredza data kunotanga, uye shanduko dzinonyorwa pakarepo kumadhisiki emunharaunda.
  • mudziyo unotangwa nemadhisiki ese aripo emuviri - mashandiro evhavha anodzoreredzwa zvizere, asi nekuita kwakadzikira;
  • mushure mekubatanidza data kwapera, mavhoriyamu anonzwisisika kubva kune backup server anobviswa, mudziyo unodzimwa, uye sevha inotangwazve;

Mushure mekutangazve, sevha ichava nedata yese yaivepo panguva iyo backup yakasikwa, uye ichasanganisira zvese shanduko dzakaitwa panguva yekudzoreredza maitiro.

Zvimwe zvinyorwa munhevedzano

Backup, chikamu 1: Nei backup ichidiwa, muchidimbu nzira, matekinoroji
Backup Chikamu 2: Kuongorora uye kuyedza rsync-based backup maturusi
Chengetedza Chikamu 3: Ongorora uye Kuyedzwa kweduplicity, duplicati
Backup Chikamu 4: Kuongorora uye kuyedza zbackup, restic, borgbackup
Backup Chikamu 5: Kuedza Bacula uye Veeam Backup yeLinux
Backup: chikamu pakukumbirwa kwevaverengi: wongororo ye AMANDA, UrBackup, BackupPC
Negadziriro yeparutivi Chikamu 6: Kuenzanisa negadziriro yeparutivi Tools
Backup Chikamu 7: Mhedziso

Ndinokukoka iwe kuti ukurukure sarudzo yakarongwa mumashoko, ndinokutendai nekutarisisa kwako!

Source: www.habr.com

Voeg