Daim ntawv no ua tiav lub voj voog txog kev thaub qab. Nws yuav tham txog lub koom haum tsim nyog ntawm tus neeg rau zaub mov mob siab rau (lossis VPS), yooj yim rau thaub qab, thiab tseem yuav muab kev xaiv rau kev kho sai sai rau cov neeg rau zaub mov los ntawm kev thaub qab yam tsis muaj sijhawm poob ntau thaum muaj kev puas tsuaj.
Cov ntaub ntawv los ntawm cov ntaub ntawv
Ib tug neeg rau zaub mov feem ntau muaj tsawg kawg yog ob lub hard drive uas ua haujlwm los npaj thawj qib RAID array (daim iav). Qhov no yog qhov tsim nyog kom muaj peev xwm ua haujlwm txuas ntxiv rau lub server yog tias ib qho disk tsis ua haujlwm. Yog hais tias qhov no yog ib tug neeg rau zaub mov tsis tu ncua, tej zaum yuav muaj ib tug cais kho vajtse RAID maub los nrog active caching technology ntawm SSD, yog li ntawd ntxiv rau cov tsis tu ncua hard drives, ib tug los yog ntau tshaj SSDs yuav txuas nrog. Qee lub sij hawm muaj kev mob siab rau cov servers, uas tsuas yog cov disks hauv zos yog SATADOM (cov disks me me, teeb tsa lub flash drive txuas nrog SATA chaw nres nkoj), lossis txawm tias ib qho me me (8-16GB) flash drive txuas nrog lub chaw tshwj xeeb sab hauv, thiab Cov ntaub ntawv yog muab los ntawm lub kaw lus cia, txuas nrog ntawm lub chaw cia khoom tshwj xeeb (Ethernet 10G, FC, thiab lwm yam), thiab muaj cov servers tshwj xeeb uas thauj khoom ncaj qha los ntawm lub kaw lus cia. Kuv yuav tsis xav txog cov kev xaiv zoo li no, txij li thaum muaj xwm txheej zoo li no, txoj haujlwm ntawm kev thaub qab cov neeg rau zaub mov zoo dhau mus rau tus kws tshaj lij uas tswj hwm lub kaw lus cia; feem ntau muaj ntau yam cuab yeej cuab tam rau kev tsim snapshots, built-in deduplication thiab lwm yam kev xyiv fab ntawm tus thawj tswj hwm. , sib tham nyob rau hauv lub dhau los qhov chaw ntawm no series. Qhov ntim ntawm ib tus neeg rau zaub mov tshwj xeeb lub disk array tuaj yeem ncav cuag ntau kaum ntawm terabytes, nyob ntawm seb tus naj npawb thiab qhov loj ntawm disks txuas nrog lub server. Nyob rau hauv cov ntaub ntawv ntawm VPS, cov ntim yog me me: feem ntau tsis ntau tshaj 100GB (tab sis kuj muaj ntau dua), thiab cov tariffs rau xws li VPS tuaj yeem yooj yim yuav kim dua li pheej yig tshaj servers los ntawm tib lub hoster. Lub VPS feem ntau muaj ib lub disk, vim tias yuav muaj lub kaw lus cia (lossis ib yam dab tsi hyperconverged) hauv qab nws. Qee zaum VPS muaj ntau lub disks nrog cov yam ntxwv sib txawv, rau ntau lub hom phiaj:
- me me - rau kev txhim kho lub operating system;
- loj - khaws cov neeg siv cov ntaub ntawv.
Thaum koj rov nruab qhov system siv cov tswj vaj huam sib luag, lub disk nrog cov neeg siv cov ntaub ntawv tsis tau sau dua, tab sis qhov system disk tau rov ua tiav. Tsis tas li ntawd, nyob rau hauv rooj plaub ntawm VPS, tus tswv tsev tuaj yeem muab lub pob uas siv lub suab ntawm lub xeev ntawm VPS (lossis disk), tab sis yog tias koj nruab koj tus kheej kev khiav haujlwm lossis tsis nco qab qhib qhov kev pabcuam xav tau hauv VPS, qee qhov ntawm cov ntaub ntawv tseem yuav ploj. Ntxiv nrog rau lub pob, cov kev pabcuam khaws cia cov ntaub ntawv feem ntau muaj, feem ntau txwv tsis pub. Feem ntau qhov no yog ib tus account nrog kev nkag los ntawm FTP lossis SFTP, qee zaum nrog rau SSH, nrog lub plhaub stripped-down (piv txwv li, rbash), lossis kev txwv ntawm kev khiav cov lus txib los ntawm kev tso cai_keys (ntawm ForcedCommand).
Ib tus neeg rau zaub mov tshwj xeeb txuas nrog lub network los ntawm ob lub chaw nres nkoj nrog qhov ceev ntawm 1 Gbps, qee zaum cov no tuaj yeem yog daim npav nrog qhov ceev ntawm 10 Gbps. VPS feem ntau muaj ib lub network interface. Feem ntau, cov chaw zov me nyuam tsis txwv lub network ceev hauv cov ntaub ntawv chaw, tab sis lawv txwv qhov ceev ntawm kev siv Internet.
Qhov kev thauj khoom ib txwm ntawm cov neeg rau zaub mov tshwj xeeb lossis VPS yog lub vev xaib server, database, thiab daim ntawv thov server. Qee lub sij hawm muaj ntau yam kev pabcuam ntxiv tuaj yeem raug teeb tsa, suav nrog rau lub vev xaib server lossis database: kev tshawb nrhiav cav, xa ntawv, thiab lwm yam.
Ib tug tshwj xeeb npaj server ua raws li qhov chaw khaws cia cov ntaub ntawv thaub qab; peb yuav sau txog nws kom ntxaws ntxiv tom qab.
Logical koom haum ntawm lub disk system
Yog tias koj muaj RAID maub los, lossis VPS nrog ib lub disk, thiab tsis muaj kev nyiam tshwj xeeb rau kev ua haujlwm ntawm disk subsystem (piv txwv li, cais ceev ceev rau cov ntaub ntawv), txhua qhov chaw pub dawb yog faib raws li hauv qab no: ib qho kev faib tawm. yog tsim, thiab ib pawg LVM ntim tau tsim nyob rau sab saum toj ntawm nws, ntau qhov ntim tau tsim hauv nws: 2 qhov me me ntawm tib qhov loj, siv los ua cov ntaub ntawv hauv paus (hloov ib qho los ntawm ib qho thaum hloov tshiab rau qhov ua tau nrawm nrawm, lub tswv yim tau khaws los ntawm xam Linux faib), lwm tus yog rau kev sib pauv muab faib, qhov seem ntawm qhov chaw pub dawb tau muab faib ua cov ntim me me, siv los ua cov ntaub ntawv hauv paus rau cov ntim puv puv, disks rau cov tshuab virtual, cov ntaub ntawv. systems rau nyiaj hauv / tsev (txhua tus account muaj nws tus kheej cov ntaub ntawv), cov ntaub ntawv kaw lus rau cov ntawv thov ntim.
Cov lus ceeb toom tseem ceeb: ntim yuav tsum yog tus kheej muaj tag nrho, i.e. yuav tsum tsis txhob nyob ntawm ib leeg los yog nyob rau hauv lub hauv paus ntaub ntawv system. Nyob rau hauv cov ntaub ntawv ntawm lub tshuab virtual los yog ntim, qhov taw tes no tau pom zoo. Yog tias cov no yog cov thawv ntawv thov lossis cov npe hauv tsev, koj yuav tsum xav txog kev sib cais cov ntaub ntawv teeb tsa ntawm lub vev xaib server thiab lwm yam kev pabcuam hauv ib txoj hauv kev kom tshem tawm qhov kev cia siab ntawm cov ntim ntau li ntau tau. Piv txwv li, txhua qhov chaw khiav los ntawm nws tus kheej cov neeg siv, cov ntaub ntawv teeb tsa lub vev xaib yog nyob rau hauv cov neeg siv cov npe hauv tsev, hauv lub vev xaib server, cov ntaub ntawv teeb tsa lub vev xaib tsis suav nrog /etc/nginx/conf.d/.conf, thiab, piv txwv li, /home//configs/nginx/*.conf
Yog tias muaj ntau lub disks, koj tuaj yeem tsim software RAID array (thiab teeb tsa nws caching ntawm SSD, yog tias xav tau thiab muaj sijhawm), nyob rau sab saum toj ntawm qhov koj tuaj yeem tsim LVM raws li cov cai tau hais los saum toj no. Tsis tas li hauv qhov no, koj tuaj yeem siv ZFS lossis BtrFS, tab sis koj yuav tsum xav txog ob zaug txog qhov no: ob qho tib si yuav tsum muaj txoj hauv kev loj dua rau cov peev txheej, thiab ntxiv rau, ZFS tsis suav nrog Linux ntsiav.
Txawm li cas los xij ntawm cov tswv yim siv, nws yog ib txwm tsim nyog kwv yees ua ntej qhov kwv yees ceev ntawm kev sau ntawv hloov pauv rau disks, thiab tom qab ntawd suav cov nqi ntawm qhov chaw dawb uas yuav tau tseg rau kev tsim cov duab thaij duab. Piv txwv li, yog tias peb cov neeg rau zaub mov sau cov ntaub ntawv ntawm qhov ceev ntawm 10 megabytes ib ob, thiab qhov loj ntawm tag nrho cov ntaub ntawv array yog 10 terabytes - lub sijhawm synchronization tuaj yeem ncav cuag ib hnub (22 teev - qhov no yog ntau npaum li cas cov ntim yuav raug xa mus. dhau lub network 1 Gbps) - nws tsim nyog tseg txog 800 GB . Hauv kev muaj tiag, daim duab yuav me dua; koj tuaj yeem faib nws yam xyuam xim los ntawm tus naj npawb ntawm cov khoom siv logic.
Thaub qab cia server ntaus ntawv
Qhov sib txawv tseem ceeb ntawm tus neeg rau zaub mov rau khaws cov ntawv luam theej tawm yog nws cov loj, pheej yig thiab qeeb disks. Txij li niaj hnub HDDs twb tau hla 10TB bar hauv ib lub disk, nws yog ib qho tsim nyog yuav tsum siv cov ntaub ntawv los yog RAID nrog cov ntawv txheeb xyuas, vim tias thaum lub sij hawm rov tsim kho cov array lossis kev kho dua tshiab ntawm cov ntaub ntawv (ntau hnub!) thib ob disk yuav ua tsis tiav vim kom nce load. Ntawm cov disks uas muaj peev xwm txog li 1TB qhov no tsis yog rhiab heev. Rau qhov yooj yim ntawm kev piav qhia, kuv xav tias qhov chaw disk tau muab faib ua ob feem ntawm kwv yees li qhov sib npaug (dua, piv txwv li, siv LVM):
- ntim sib xws rau cov servers siv los khaws cov ntaub ntawv neeg siv (qhov kawg thaub qab ua yuav raug xa mus rau lawv rau kev txheeb xyuas);
- ntim siv raws li BorgBackup repositories (cov ntaub ntawv rau thaub qab yuav mus ncaj qha ntawm no).
Lub hauv paus ntsiab lus ntawm kev ua haujlwm yog tias cov ntim cais tau tsim rau txhua tus neeg rau zaub mov rau BorgBackup chaw cia khoom, qhov twg cov ntaub ntawv los ntawm kev sib ntaus sib tua servers yuav mus. Cov chaw khaws cia ua haujlwm nyob rau hauv append-tsuas yog hom, uas tshem tawm qhov muaj peev xwm ntawm txhob txwm rho tawm cov ntaub ntawv, thiab vim yog deduplication thiab tu ncua sij hawm ntawm repositories los ntawm cov qub thaub qab (ib xyoos ib zaug, txhua hli rau xyoo tas los, txhua lub limtiam rau lub hli dhau los, txhua hnub rau lub Lub lim tiam dhau los, tej zaum muaj xwm txheej tshwj xeeb - ib teev rau hnub kawg: tag nrho 24 + 7 + 4 + 12 + txhua xyoo - kwv yees li 50 daim ntawv luam rau txhua tus neeg rau zaub mov).
BorgBackup repositories tsis tso cai append-tsuas yog hom; hloov pauv, ForcedCommand hauv .ssh/authorized_keys yog siv qee yam zoo li no:
from="Π°Π΄ΡΠ΅Ρ ΡΠ΅ΡΠ²Π΅ΡΠ°",command="/usr/local/bin/borg serve --append-only --restrict-to-path /home/servername/borgbackup/",no-pty,no-agent-forwarding,no-port-forwarding,no-X11-forwarding,no-user-rc AAAAA.......Txoj kev uas tau teev tseg muaj ib daim ntawv wrapper nyob rau sab saum toj ntawm borg, uas, ntxiv rau kev tso tawm binary nrog cov tsis muaj, kuj tseem pib cov txheej txheem ntawm kev rov kho cov ntawv thaub qab tom qab cov ntaub ntawv raug tshem tawm. Txhawm rau ua qhov no, daim ntawv wrapper tsim ib daim ntawv cim npe ntawm ib sab ntawm qhov chaw khaws cia. Qhov kawg thaub qab ua tau cia li rov qab mus rau qhov sib thooj ntawm cov ntsiab lus ntim tom qab cov ntaub ntawv sau cov txheej txheem tiav.
Qhov kev tsim no tso cai rau koj los ntxuav cov thaub qab uas tsis tsim nyog, thiab tseem tiv thaiv kev sib ntaus sib tua los ntawm kev rho tawm ib yam dab tsi ntawm cov ntaub ntawv khaws cia.
Txheej txheem thaub qab
Tus pib ntawm kev thaub qab yog tus neeg rau zaub mov tshwj xeeb lossis VPS nws tus kheej, txij li cov tswv yim no muab kev tswj hwm ntau dua ntawm cov txheej txheem thaub qab ntawm ib feem ntawm lub server no. Ua ntej, ib qho snapshot ntawm lub xeev ntawm cov ntaub ntawv hauv paus tseem ceeb raug coj mus, uas yog mounted thiab uploaded siv BorgBackup rau lub backup cia server. Tom qab cov ntaub ntawv capture tiav, lub snapshot yog unmounted thiab deleted.
Yog tias muaj cov ntaub ntawv me me (txog 1 GB rau txhua qhov chaw), cov ntaub ntawv pov tseg tau tsim, uas tau txais kev cawmdim nyob rau hauv qhov tsim nyog cov ntaub ntawv, qhov chaw seem ntawm cov ntaub ntawv rau tib lub xaib yog nyob, tab sis kom cov pob tseg. tsis siv tau los ntawm lub vev xaib server. Yog tias cov ntaub ntawv loj, koj yuav tsum teeb tsa "kub" tshem tawm cov ntaub ntawv, piv txwv li, siv xtrabackup rau MySQL, lossis ua haujlwm nrog WAL nrog archive_command hauv PostgreSQL. Hauv qhov no, cov ntaub ntawv khaws cia yuav rov qab cais tawm ntawm qhov chaw cov ntaub ntawv.
Yog tias siv cov thawv lossis cov tshuab virtual, koj yuav tsum teeb tsa qemu-tus neeg saib xyuas-tus neeg saib xyuas, CRIU lossis lwm yam thev naus laus zis tsim nyog. Hauv lwm qhov xwm txheej, kev teeb tsa ntxiv feem ntau tsis xav tau - peb tsuas yog tsim snapshots ntawm cov ntaub ntawv muaj txiaj ntsig, uas tom qab ntawd ua tiav tib yam li snapshot ntawm lub xeev ntawm cov ntaub ntawv hauv paus. Tom qab cov ntaub ntawv yog coj, cov duab yog deleted.
Kev ua haujlwm ntxiv yog ua tiav ntawm lub chaw khaws ntaub ntawv khaws cia:
- qhov kawg thaub qab ua nyob rau hauv txhua repository yog xyuas,
- lub xub ntiag ntawm cov ntawv cim tau raug kuaj xyuas, qhia tias cov txheej txheem sau cov ntaub ntawv tiav,
- cov ntaub ntawv tau nthuav dav mus rau qhov sib thooj hauv zos ntim,
- cov ntaub ntawv tag yog deleted
Cov txheej txheem rov qab Server
Yog tias tus neeg rau zaub mov tseem ceeb tuag, ces qhov zoo sib xws rau cov neeg rau zaub mov tau pib, uas khau raj los ntawm qee cov duab qauv. Feem ntau yuav yog qhov kev rub tawm yuav tshwm sim hauv lub network, tab sis cov ntaub ntawv chaw kws tshaj lij teeb tsa tus neeg rau zaub mov tuaj yeem luam cov duab qauv tam sim no mus rau ib qho ntawm cov disks. Lub download tshwm sim rau hauv RAM, tom qab uas cov txheej txheem rov qab pib:
- ib qho kev thov yog tsim los txuas ib lub cuab yeej thaiv ntawm iscsinbd lossis lwm cov txheej txheem zoo sib xws rau cov khoom ntim uas muaj cov ntaub ntawv hauv paus ntawm cov neeg rau zaub mov tuag; Txij li thaum cov ntaub ntawv hauv paus system yuav tsum me me, cov kauj ruam no yuav tsum ua kom tiav hauv ob peb feeb. Lub bootloader kuj rov qab los;
- cov qauv ntawm cov logical hauv zos yog rov tsim dua tshiab, cov ntaub ntawv muaj txiaj ntsig tau txuas los ntawm cov neeg siv khoom thaub qab siv dm_clone kernel module: cov ntaub ntawv rov qab pib, thiab cov kev hloov pauv tau sau tam sim ntawd rau hauv zos disks.
- lub thawv tau pib nrog txhua lub cev muaj zog disks - cov neeg rau zaub mov kev ua haujlwm tau rov qab ua tiav, tab sis nrog kev ua haujlwm tsawg;
- Tom qab cov ntaub ntawv synchronization tiav lawm, lub logical ntim ntawm cov neeg rau zaub mov thaub qab raug txiav, lub thawv raug kaw, thiab cov neeg rau zaub mov rov pib dua;
Tom qab rov pib dua, tus neeg rau zaub mov yuav muaj tag nrho cov ntaub ntawv uas nyob ntawd thaum lub sijhawm thaub qab tau tsim, thiab tseem yuav suav tag nrho cov kev hloov pauv uas tau ua thaum lub sijhawm rov ua haujlwm.
Lwm cov ntawv hauv koob
Backup Part 7: Cov Lus Nug
Kuv caw koj los tham txog cov kev xaiv uas tau hais hauv cov lus, ua tsaug rau koj qhov kev mloog!
Tau qhov twg los: www.hab.com