{"id":83100,"date":"2020-05-28T13:42:10","date_gmt":"2020-05-28T11:42:10","guid":{"rendered":"https:\/\/prohoster.info\/blog\/administrirovanie\/bekap-hranilishhe-dlya-tysyach-virtualnyh-mashin-svobodnymi-instrumentami"},"modified":"2020-05-28T13:42:10","modified_gmt":"2020-05-28T11:42:10","slug":"bekap-hranilishhe-dlya-tysyach-virtualnyh-mashin-svobodnymi-instrumentami","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/bekap-hranilishhe-dlya-tysyach-virtualnyh-mashin-svobodnymi-instrumentami","title":{"rendered":"Ruajtje backup p\u00ebr mij\u00ebra makina virtuale me mjete t\u00eb lira","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

\"Ruajtje<\/p>\n

<\/p>\n

P\u00ebrsh\u00ebndetje, koh\u00ebt e fundit m\u00eb ra n\u00eb dor\u00eb nj\u00eb detyr\u00eb interesante p\u00ebr t\u00eb konfiguruar nj\u00eb ruajtje p\u00ebr backup-in e nj\u00eb s\u00ebr\u00eb t\u00eb madhe t\u00eb pajisjeve blok.<\/p>\n

<\/p>\n

\u00c7do jav\u00eb ne b\u00ebjm\u00eb kopje rezerv\u00eb t\u00eb t\u00eb gjitha makinave virtuale n\u00eb cloud-in ton\u00eb, k\u00ebshtu q\u00eb duhet t\u00eb jemi n\u00eb gjendje t\u00eb menaxhojm\u00eb mij\u00ebra kopje rezerv\u00eb dhe ta b\u00ebjm\u00eb k\u00ebt\u00eb sa m\u00eb shpejt dhe efikasht.<\/p>\n

<\/p>\n

Fatkeq\u00ebsisht, konfigurimet standarde RAID5<\/strong>, RAID6<\/strong> n\u00eb k\u00ebt\u00eb rast nuk na p\u00ebrshtaten p\u00ebr shkak se procesi i rikuperimit n\u00eb disqe t\u00eb till\u00eb t\u00eb m\u00ebdhenj si tonat do t\u00eb ishte shum\u00eb i gjat\u00eb dhe me siguri nuk do t\u00eb p\u00ebrfundoj\u00eb kurr\u00eb.<\/p>\n

<\/p>\n

Le t\u00eb shqyrtojm\u00eb cilat jan\u00eb alternativat:<\/p>\n

<\/p>\n

Erasure Coding<\/a><\/noindex><\/strong> \u2014 Analogu i RAID5, RAID6, por me nj\u00eb nivel t\u00eb konfiguruesh\u00ebm pariteti. N\u00eb k\u00ebt\u00eb rast, rezervimi nuk b\u00ebhet p\u00ebr \u00e7do blok, por p\u00ebr secilin objekt ve\u00e7mas. M\u00ebnyra m\u00eb e thjesht\u00eb p\u00ebr t\u00eb provuar erasure coding \u00ebsht\u00eb t\u00eb vendosni minio<\/a><\/noindex>.<\/p>\n

<\/p>\n

DRAID<\/a><\/noindex><\/strong> \u2014 kjo \u00ebsht\u00eb nj\u00eb mund\u00ebsi q\u00eb nuk \u00ebsht\u00eb l\u00ebshuar ende p\u00ebr ZFS. Ndryshe nga RAIDZ, DRAID ka nj\u00eb paritet t\u00eb shp\u00ebrndar\u00eb dhe gjat\u00eb rikuperimit angazhon menj\u00ebher\u00eb t\u00eb gjitha disqet e grumbullit, duke e b\u00ebr\u00eb at\u00eb m\u00eb t\u00eb q\u00ebndruesh\u00ebm ndaj d\u00ebshtimeve t\u00eb disqeve dhe m\u00eb t\u00eb shpejt\u00eb n\u00eb rikuperim pas nj\u00eb defekti. <\/p>\n

<\/a><\/noindex><\/p>\n

\"Ruajtje<\/p>\n

<\/p>\n

\"Ruajtje<\/p>\n

N\u00eb dispozicion kemi nj\u00eb server Fujitsu Primergy RX300 S7<\/strong> me procesor Intel Xeon CPU E5-2650L 0 @ 1.80GHz<\/strong>, me n\u00ebnt\u00eb modulet e memories Samsung DDR3-1333 8Gb PC3L-10600R ECC Registered (M393B1K70DH0-YH9)<\/strong>, raft diskesh Supermicro SuperChassis 847E26-RJBOD1<\/strong>, i lidhur p\u00ebrmes Dual LSI SAS2X36 Expander<\/strong> dhe 45 disqe Seagage ST6000NM0115-1YZ110<\/strong> p\u00ebr 6TB<\/strong> \u00e7do.<\/p>\n

<\/p>\n

Para se t\u00eb marrim vendime, na nevojitet t\u00eb testojm\u00eb gjith\u00e7ka si\u00e7 duhet.<\/p>\n

<\/p>\n

P\u00ebr k\u00ebt\u00eb, u p\u00ebrgatita dhe kreva teste t\u00eb konfiguracioneve t\u00eb ndryshme. P\u00ebrdora minio, i cili sh\u00ebrbeu si nj\u00eb backend S3 dhe e drejtoja n\u00eb m\u00ebnyra t\u00eb ndryshme me numra t\u00eb ndrysh\u00ebm targetesh.<\/p>\n

<\/p>\n

K\u00ebtu kryesisht u testua rasti i minio n\u00eb kodimin e shkat\u00ebrrimit n\u00eb krahasim me RAID-n\u00eb softuerike me t\u00eb nj\u00ebjtin num\u00ebr disqesh dhe disqe pariteti, t\u00eb cilat jan\u00eb: RAID6, RAIDZ2 dhe DRAID2.<\/p>\n

<\/p>\n

P\u00ebr referenc\u00eb: kur e drejtoni minion me nj\u00eb vet\u00ebm target, at\u00ebher\u00eb minio funksionon n\u00eb modalitetin S3-gateway duke ju dh\u00ebn\u00eb sistemin tuaj lokal t\u00eb skedar\u00ebve si nj\u00eb ruajtje S3. N\u00ebse e drejtoni minion me shum\u00eb targete, modaliteti i Kodimit t\u00eb Shkat\u00ebrrimit aktivizohet automatikisht, i cili do t\u00eb shp\u00ebrndaj\u00eb t\u00eb dh\u00ebnat midis targeteve tuaja duke ofruar q\u00ebndrushm\u00ebri ndaj d\u00ebshtimeve.<\/p>\n

N\u00eb m\u00ebnyr\u00eb standarde, minio ndan q\u00ebllimet n\u00eb grupe prej 16 disqesh, ku \u00e7do grup ka 2 paritet. Kjo do t\u00eb thot\u00eb q\u00eb dy disqe mund t\u00eb d\u00ebshtojn\u00eb n\u00eb t\u00eb nj\u00ebjt\u00ebn koh\u00eb pa humbje t\u00eb t\u00eb dh\u00ebnave.<\/p><\/blockquote>\n

P\u00ebr testimin e performanc\u00ebs, p\u00ebrdora 16 disqe me nga 6TB secili dhe shkruaja objekte t\u00eb vogla me madh\u00ebsi 1MB, kjo p\u00ebrshkruante me sakt\u00ebsi ngarkes\u00ebn ton\u00eb t\u00eb ardhshme, pasi t\u00eb gjith\u00eb mjetet moderne p\u00ebr backup ndaj t\u00eb dh\u00ebnave i ndajn\u00eb ato n\u00eb blloqe disa megabajtesh dhe i shkruajn\u00eb n\u00eb k\u00ebt\u00eb m\u00ebnyr\u00eb.<\/p>\n

<\/p>\n

P\u00ebr kryerjen e b\u00ebnchmarkut u p\u00ebrdor utilitari s3bench, i cili u ekzekutua n\u00eb nj\u00eb server t\u00eb larg\u00ebt dhe d\u00ebrgonte n\u00eb minio dhjet\u00ebra mij\u00ebra objekte t\u00eb tilla n\u00eb nj\u00eb qind rrjedha. Pasi q\u00eb u p\u00ebrpoq t\u00eb k\u00ebrkonte ato p\u00ebrs\u00ebri n\u00eb t\u00eb nj\u00ebjt\u00ebn m\u00ebnyr\u00eb.<\/p>\n

<\/p>\n

Rezultatet e b\u00ebnchmarkut jan\u00eb n\u00eb tabel\u00ebn e m\u00ebposhtme:<\/p>\n

<\/p>\n

\"Ruajtje<\/p>\n

<\/p>\n

Si\u00e7 e shohim, minio n\u00eb modin e vet erasure coding punon ndjesh\u00ebm m\u00eb keq n\u00eb shkrim, se sa minio i lan\u00e7uar mbi RAID6 softueror, RAIDZ2 dhe DRAID2 n\u00eb t\u00eb nj\u00ebjt\u00ebn konfigurim.<\/p>\n

<\/p>\n

Ve\u00e7mas, un\u00eb u k\u00ebrkova<\/a><\/noindex> t\u00eb testoja minio mbi ext4 vs XFS. \u00c7udit\u00ebrisht, p\u00ebr llojin tim t\u00eb ngarkes\u00ebs, XFS rezultoi t\u00eb ishte ndjesh\u00ebm m\u00eb e ngadalt\u00eb se ext4.<\/p>\n

<\/p>\n

N\u00eb grupin e par\u00eb t\u00eb testeve, Mdadm tregoi p\u00ebrpar\u00ebsi mbi ZFS, por m\u00eb von\u00eb gmelikov<\/a><\/noindex> ka sugjerova<\/a><\/noindex>, se mund t\u00eb p\u00ebrmir\u00ebsoj performanc\u00ebn e ZFS duke vendosur opsionet e m\u00ebposhtme:<\/p>\n

<\/p>\n

xattr=sa atime=off recordsize=1M<\/code><\/pre>\n
<\/p>\n
dhe pas k\u00ebsaj testet me ZFS u p\u00ebrmir\u00ebsuan nd significantlyesh\u00ebm.<\/p>\n
<\/p>\n
Gjithashtu, mund t\u00eb v\u00ebrehet se DRAID nuk ofron ndonj\u00eb p\u00ebrfitim t\u00eb ve\u00e7ant\u00eb n\u00eb performanc\u00eb krahasuar me RAIDZ, por n\u00eb teori duhet t\u00eb jet\u00eb shum\u00eb m\u00eb i sigurt.<\/p>\n
<\/p>\n
N\u00eb dy testet e fundit, p\u00ebrpiqesha gjithashtu t\u00eb shp\u00ebrngulja metadatat (special) dhe ZIL (log) n\u00eb nj\u00eb pasqyr\u00eb nga SSD. Por shp\u00ebrngulja e metadatat nuk dha ndonj\u00eb p\u00ebrfitim t\u00eb duksh\u00ebm n\u00eb shpejt\u00ebsin\u00eb e shkruajtur, dhe kur shp\u00ebrngulja e ZIL, un\u00eb SSDSC2KI128G8<\/a><\/noindex> u ndesha me nj\u00eb kufi me 100% t\u00eb p\u00ebrdorimit, k\u00ebshtu q\u00eb un\u00eb e konsideroj k\u00ebt\u00eb test si t\u00eb d\u00ebshtuar. Nuk p\u00ebrjashtoj q\u00eb po t\u00eb kisha SSD m\u00eb t\u00eb shpejt\u00eb, ndoshta kjo do t\u00eb p\u00ebrmir\u00ebsonte ndjesh\u00ebm rezultatet e mia, por fatkeq\u00ebsisht nuk i kisha.<\/p>\n
<\/p>\n
N\u00eb fund, vendosa t\u00eb ndalem n\u00eb p\u00ebrdorimin e DRAID dhe pavar\u00ebsisht statusit t\u00eb tij beta, ai \u00ebsht\u00eb zgjidhja m\u00eb e shpejt\u00eb dhe efikase p\u00ebr ruajtje n\u00eb rastin ton\u00eb.<\/p>\n
<\/p>\n
Krijova nj\u00eb DRAID2 t\u00eb thjesht\u00eb n\u00eb konfigurimin me tre grupe dhe dy rezervat e shp\u00ebrndara:<\/p>\n
<\/p>\n
# zpool status data\n  pool: data\n state: ONLINE\n  scan: none requested\nconfig:\n\n    NAME                 STATE     READ WRITE CKSUM\n    data                 ONLINE       0     0     0\n      draid2:3g:2s-0     ONLINE       0     0     0\n        sdy              ONLINE       0     0     0\n        sdam             ONLINE       0     0     0\n        sdf              ONLINE       0     0     0\n        sdau             ONLINE       0     0     0\n        sdab             ONLINE       0     0     0\n        sdo              ONLINE       0     0     0\n        sdw              ONLINE       0     0     0\n        sdak             ONLINE       0     0     0\n        sdd              ONLINE       0     0     0\n        sdas             ONLINE       0     0     0\n        sdm              ONLINE       0     0     0\n        sdu              ONLINE       0     0     0\n        sdai             ONLINE       0     0     0\n        sdaq             ONLINE       0     0     0\n        sdk              ONLINE       0     0     0\n        sds              ONLINE       0     0     0\n        sdag             ONLINE       0     0     0\n        sdi              ONLINE       0     0     0\n        sdq              ONLINE       0     0     0\n        sdae             ONLINE       0     0     0\n        sdz              ONLINE       0     0     0\n        sdan             ONLINE       0     0     0\n        sdg              ONLINE       0     0     0\n        sdac             ONLINE       0     0     0\n        sdx              ONLINE       0     0     0\n        sdal             ONLINE       0     0     0\n        sde              ONLINE       0     0     0\n        sdat             ONLINE       0     0     0\n        sdaa             ONLINE       0     0     0\n        sdn              ONLINE       0     0     0\n        sdv              ONLINE       0     0     0\n        sdaj             ONLINE       0     0     0\n        sdc              ONLINE       0     0     0\n        sdar             ONLINE       0     0     0\n        sdl              ONLINE       0     0     0\n        sdt              ONLINE       0     0     0\n        sdah             ONLINE       0     0     0\n        sdap             ONLINE       0     0     0\n        sdj              ONLINE       0     0     0\n        sdr              ONLINE       0     0     0\n        sdaf             ONLINE       0     0     0\n        sdao             ONLINE       0     0     0\n        sdh              ONLINE       0     0     0\n        sdp              ONLINE       0     0     0\n        sdad             ONLINE       0     0     0\n    spares\n      s0-draid2:3g:2s-0  AVAIL   \n      s1-draid2:3g:2s-0  AVAIL   \n\nerrors: No known data errors<\/code><\/pre>\n
Mir\u00eb, me ruajtjen u merret, tani p\u00ebr at\u00eb se \u00e7far\u00eb do t\u00eb b\u00ebn\u00eb backup. K\u00ebtu menj\u00ebher\u00eb do t\u00eb doja t\u00eb flisja p\u00ebr tri zgjidhje q\u00eb arrin t\u00eb provoj, dhe ato jan\u00eb:<\/p>\n
<\/p>\n
Benji Backup<\/a><\/noindex><\/strong> \u2014 fork Backy2<\/a><\/noindex>, nj\u00eb zgjidhje e specializuar p\u00ebr backup t\u00eb pajisjeve bllokuese, ka nj\u00eb integrim t\u00eb ngusht\u00eb me Ceph. Ajo mund t\u00eb marr\u00eb diff'\u00ebt midis snapshoteve dhe t\u00eb formoj\u00eb nj\u00eb backup inkremental nga to. Mb\u00ebshtet nj\u00eb num\u00ebr t\u00eb madh backend-\u00ebsh ruajtjeje, p\u00ebrfshir\u00eb si lokal ashtu edhe S3. K\u00ebrkon nj\u00eb baz\u00eb t\u00eb ve\u00e7ant\u00eb t\u00eb dh\u00ebnash p\u00ebr ruajtjen e tabel\u00ebs s\u00eb hash-it p\u00ebr deduplication. Nga disavantazhet: \u00ebsht\u00eb shkruar n\u00eb python, ka nj\u00eb CLI paksa t\u00eb paangazhuar.<\/p>\n
<\/p>\n
Borg Backup<\/a><\/noindex><\/strong> \u2014 fork Attic<\/a><\/noindex>, nj\u00eb mjet i njohur dhe i provuar p\u00ebr backup, mund t\u00eb b\u00ebj\u00eb backup t\u00eb t\u00eb dh\u00ebnave dhe i deduplication ato mir\u00eb. Mund t\u00eb ruaj\u00eb backup-et si lokalisht ashtu edhe n\u00eb nj\u00eb server t\u00eb larg\u00ebt p\u00ebrmes scp. Mund t\u00eb b\u00ebj\u00eb backup t\u00eb pajisjeve bllokuese n\u00ebse ekzekutohet me flagun --special<\/code>, nga disavantazhet: kur krijohet nj\u00eb backup, repository plot\u00ebsisht bllokohet, prandaj p\u00ebr \u00e7do makin\u00eb virtuale rekomandohet t\u00eb krijohet nj\u00eb repository i ve\u00e7ant\u00eb, n\u00eb parim kjo nuk \u00ebsht\u00eb nj\u00eb problem, pasi ato krijohen shum\u00eb leht\u00eb.<\/p>\n
<\/p>\n
Restic<\/a><\/noindex><\/strong> \u2014 nj\u00eb projekt n\u00eb rritje aktiv, i shkruar n\u00eb go, mjaft i shpejt\u00eb dhe mb\u00ebshtet nj\u00eb num\u00ebr t\u00eb madh backend-esh p\u00ebr ruajtje, p\u00ebrfshir\u00eb si ruajtjen lokale ashtu edhe scp, S3 dhe shum\u00eb t\u00eb tjera. Vlen t\u00eb theksohet se ka nj\u00eb rest-server<\/a><\/noindex> e krijuar posa\u00e7\u00ebrisht p\u00ebr restic, e cila lejon eksportimin m\u00eb t\u00eb shpejt\u00eb t\u00eb ruajtjes p\u00ebr p\u00ebrdorim t\u00eb larg\u00ebt. Nga t\u00eb gjitha t\u00eb m\u00ebsip\u00ebrmet, m\u00eb p\u00eblqeu m\u00eb shum\u00eb. Mund t\u00eb b\u00ebj\u00eb backup nga stdin. Nuk ka disavantazhe t\u00eb dukshme, por ka disa ve\u00e7ori:<\/p>\n
<\/p>\n