Moni, posachedwapa ndakumana ndi vuto losangalatsa: kukhazikitsa kosungirako zosungirako zida zambiri zama block.
Sabata iliyonse timasunga makina onse omwe ali mumtambo wathu, chifukwa chake tiyenera kusunga masauzande ambiri ndikuzichita mwachangu komanso moyenera momwe tingathere.
Tsoka ilo, masinthidwe okhazikika RAID5, RAID6 pamenepa, sitidzaloledwa kutero, chifukwa kuchira pa disks zazikulu ngati zathu kudzakhala kwautali kwambiri ndipo sikudzatha.
Tiyeni tiwone njira zina zomwe zilipo:
- Zofanana ndi RAID5, RAID6, koma yokhala ndi mulingo wokhazikika. Pachifukwa ichi, kusungirako sikukuchitika osati chipika ndi chipika, koma pa chinthu chilichonse padera. Njira yosavuta yoyesera kuchotsa zolemba ndikukulitsa .
ndi mawonekedwe a ZFS omwe sanatulutsidwe pano. Mosiyana ndi RAIDZ, DRAID ili ndi chipika chogawidwa ndipo, panthawi yochira, imagwiritsa ntchito ma disks onse a gulu nthawi imodzi, zomwe zimapangitsa kuti zikhale bwino kupulumuka kulephera kwa disk ndikuchira msanga pambuyo polephera.
Seva ilipo Fujitsu Primergy RX300 S7 ndi purosesa Intel Xeon CPU E5-2650L 0 @ 1.80GHz, ndodo zisanu ndi zinayi za RAM Samsung DDR3-1333 8Gb PC3L-10600R ECC Yolembetsedwa (M393B1K70DH0-YH9), disk shelf Supermicro SuperChassis 847E26-RJBOD1, yolumikizidwa kudzera Dual LSI SAS2X36 Expander ndi 45 diski Chithunzi cha ST6000NM0115-1YZ110 pa 6TB aliyense.
Tisanasankhe chilichonse, choyamba tiyenera kuyesa zonse moyenera.
Kuti ndichite izi, ndidakonzekera ndikuyesa masinthidwe osiyanasiyana. Kuti ndichite izi, ndidagwiritsa ntchito minio, yomwe idakhala ngati S3 backend ndikuyiyambitsa m'njira zosiyanasiyana ndi ziwerengero zosiyanasiyana.
Kwenikweni, mlandu wa minio unayesedwa mu erasure coding vs software raid ndi nambala yofanana ya disks ndi kufanana kwa disks, ndipo izi ndi: RAID6, RAIDZ2 ndi DRAID2.
Kuti mumve zambiri: mukakhazikitsa minio ndi chandamale chimodzi chokha, minio imagwira ntchito munjira yachipata cha S3, ndikupereka mawonekedwe amtundu wanu wamtundu wa S3 yosungirako. Ngati muyambitsa minio ndikufotokozera zolinga zingapo, Erasure Coding mode idzayatsidwa yokha, yomwe imafalitsa deta pakati pa zolinga zanu ndikupereka kulekerera zolakwika.
Mwachikhazikitso, minio imagawaniza zolinga m'magulu a disks 16, ndi magawo awiri pagulu. Iwo. Ma disks awiri amatha kulephera nthawi imodzi popanda kutaya deta.
Kuti ndiyese ntchito, ndinagwiritsa ntchito ma disks 16 a 6TB aliyense ndikulemba zinthu zazing'ono za 1MB kukula kwake, izi zimalongosola molondola katundu wathu wamtsogolo, popeza zida zonse zamakono zosungirako zimagawanitsa deta mu midadada ya megabytes angapo ndikulemba motere.
Kuti tichite chizindikirocho, tidagwiritsa ntchito s3bench, yomwe idakhazikitsidwa pa seva yakutali ndikutumiza zikwizikwi zazinthu zotere ku minio mumizere mazanamazana. Kenako ndinayesetsa kuwapempha kuti abwererenso chimodzimodzi.
Zotsatira za benchmark zikuwonetsedwa patebulo ili:
Monga tikuonera, minio m'njira yakeyake yofufutira imakhala yoyipa kwambiri polemba kuposa minio yomwe ikuyenda pamwamba pa mapulogalamu a RAID6, RAIDZ2 ndi DRAID2 mumasinthidwe omwewo.
Payokha ine kuyesa minio pa ext4 vs XFS. Chodabwitsa, pamtundu wanga wantchito, XFS idakhala yocheperako kuposa ext4.
M'gulu loyamba la mayeso, Mdadm adawonetsa kupambana pa ZFS, koma pambuyo pake kuti mutha kusintha magwiridwe antchito a ZFS pokhazikitsa zotsatirazi:
xattr=sa atime=off recordsize=1Mndipo pambuyo pake mayeso ndi ZFS adakhala bwino kwambiri.
Mutha kuzindikiranso kuti DRAID sapereka phindu lochulukirapo kuposa RAIDZ, koma m'malingaliro iyenera kukhala yotetezeka kwambiri.
M'mayesero awiri omaliza, ndinayeseranso kusamutsa metadata (yapadera) ndi ZIL (logi) pagalasi kuchokera ku SSD. Koma kuchotsa metadata sikunapereke phindu lalikulu pakujambulitsa liwiro, ndipo pochotsa ZIL, wanga kugunda padenga ndikugwiritsa ntchito 100%, ndiye ndimawona kuti mayesowa ndi olephera. Sindikupatula kuti ndikadakhala ndi ma drive othamanga a SSD, ndiye kuti mwina izi zitha kuwongolera zotsatira zanga, koma, mwatsoka, ndinalibe.
Pamapeto pake, ndinaganiza zogwiritsa ntchito DRAID ndipo ngakhale ili ndi beta, ndiyo njira yosungiramo yachangu komanso yothandiza kwambiri kwa ife.
Ndinapanga DRAID2 yosavuta mu kasinthidwe ndi magulu atatu ndi zotsalira ziwiri zogawidwa:
# zpool status data
pool: data
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
data ONLINE 0 0 0
draid2:3g:2s-0 ONLINE 0 0 0
sdy ONLINE 0 0 0
sdam ONLINE 0 0 0
sdf ONLINE 0 0 0
sdau ONLINE 0 0 0
sdab ONLINE 0 0 0
sdo ONLINE 0 0 0
sdw ONLINE 0 0 0
sdak ONLINE 0 0 0
sdd ONLINE 0 0 0
sdas ONLINE 0 0 0
sdm ONLINE 0 0 0
sdu ONLINE 0 0 0
sdai ONLINE 0 0 0
sdaq ONLINE 0 0 0
sdk ONLINE 0 0 0
sds ONLINE 0 0 0
sdag ONLINE 0 0 0
sdi ONLINE 0 0 0
sdq ONLINE 0 0 0
sdae ONLINE 0 0 0
sdz ONLINE 0 0 0
sdan ONLINE 0 0 0
sdg ONLINE 0 0 0
sdac ONLINE 0 0 0
sdx ONLINE 0 0 0
sdal ONLINE 0 0 0
sde ONLINE 0 0 0
sdat ONLINE 0 0 0
sdaa ONLINE 0 0 0
sdn ONLINE 0 0 0
sdv ONLINE 0 0 0
sdaj ONLINE 0 0 0
sdc ONLINE 0 0 0
sdar ONLINE 0 0 0
sdl ONLINE 0 0 0
sdt ONLINE 0 0 0
sdah ONLINE 0 0 0
sdap ONLINE 0 0 0
sdj ONLINE 0 0 0
sdr ONLINE 0 0 0
sdaf ONLINE 0 0 0
sdao ONLINE 0 0 0
sdh ONLINE 0 0 0
sdp ONLINE 0 0 0
sdad ONLINE 0 0 0
spares
s0-draid2:3g:2s-0 AVAIL
s1-draid2:3g:2s-0 AVAIL
errors: No known data errorsChabwino, takonza zosungirako, tsopano tiyeni tikambirane zomwe tithandizire. Apa ndikufuna kuti ndilankhule mwachangu za mayankho atatu omwe ndidatha kuyesa, ndipo awa ndi awa:
- mphanda , yankho lapadera losunga zosunga zobwezeretsera, lili ndi kuphatikiza kolimba ndi Ceph. Itha kusiyanitsa pakati pazithunzi ndikupanga zosunga zobwezeretsera kuchokera kwa iwo. Imathandizira zosungirako zambiri zosungirako, kuphatikiza zonse zam'deralo ndi S3. Pamafunika nkhokwe yapadera kuti isunge deduplication hashi table. Zoyipa: zolembedwa mu python, zimakhala ndi cli yosalabadira pang'ono.
- mphanda , chida chodziwika bwino komanso chotsimikizika chosunga zosunga zobwezeretsera, chimatha kusunga deta ndikuchibwereza bwino. Kutha kusunga zosunga zobwezeretsera kwanuko komanso ku seva yakutali kudzera pa scp. Itha kusunga zida zosunga zobwezeretsera ngati zakhazikitsidwa ndi mbendera --special, imodzi mwa minuses: popanga zosunga zobwezeretsera, chosungiracho chimatsekedwa kwathunthu, kotero tikulimbikitsidwa kuti tipange chosungira chosiyana cha makina aliwonse, makamaka izi sizovuta, mwamwayi zimapangidwira mosavuta.
ndi pulojekiti yomwe ikukula mwachangu, yolembedwa popita, mwachangu kwambiri ndipo imathandizira malo osungira ambiri, kuphatikiza kusungirako kwanuko, scp, S3 ndi zina zambiri. Payokha, ndikufuna kudziwa kuti pali chopangidwa mwapadera kwa restic, yomwe imakulolani kuti mutumize mwachangu kusungirako kuti mugwiritse ntchito kutali. Pa zonsezi, ndimakonda kwambiri. Ikhoza kusunga kuchokera ku stdin. Ilibe zovuta zowoneka bwino, koma pali zinthu zingapo:
-
Choyamba, ndinayesera kuzigwiritsa ntchito pamakina onse osungiramo makina onse (monga Benji) ndipo zinagwira ntchito bwino, koma kubwezeretsanso kunatenga nthawi yayitali, chifukwa ... Nthawi iliyonse musanabwezeretse, restic amayesa kuwerenga metadata ya zosunga zobwezeretsera zonse. Vutoli linathetsedwa mosavuta, monga ndi borg, popanga malo osungiramo makina aliwonse. Njira iyi yatsimikiziranso kuti ndi yothandiza kwambiri pakuwongolera ma backups. Zosungirako zolekanitsa zitha kukhala ndi mawu achinsinsi osiyana kuti mupeze deta, komanso sitiyenera kuchita mantha kuti repo yapadziko lonse ikhoza kusweka mwanjira ina. Mutha kupanga nkhokwe zatsopano mosavuta monga momwe ziliri mu Borg Backup.
Mulimonsemo, kuchotsera kumachitika kokha poyerekeza ndi mtundu wakale wa zosunga zobwezeretsera; zosunga zobwezeretsera zam'mbuyomu zimatsimikiziridwa ndi njira yosungiramo zomwe zatchulidwa, kotero ngati mungasungire zinthu zosiyanasiyana kuchokera ku stdin kupita kumalo wamba, musaiwale kufotokozera mwina
--stdin-filename, kapena tchulani njirayo nthawi iliyonse--parent.
-
Kachiwiri, kuchira ku stdout kumatenga nthawi yayitali kuposa kuchira ku fayilo chifukwa cha mawonekedwe ake ofanana. M'tsogolomu, tikukonzekera kuwonjezera chithandizo chapafupi cha zosunga zobwezeretsera pazida zotchinga.
-
Chachitatu, pakali pano akulimbikitsidwa kugwiritsa ntchito , chifukwa Baibulo 0.9.6 ali cholakwika ndi kuchira yaitali owona lalikulu.
Kuti muyese mphamvu ya zosunga zobwezeretsera komanso kuthamanga kwa kulemba / kubwezeretsa kuchokera ku zosunga zobwezeretsera, ndidapanga chosungirako chosiyana ndikuyesa kusunga chithunzi chaching'ono cha makina enieni (21 GB). Zosunga zobwezeretsera ziwiri zidachitika osasintha choyambirira, pogwiritsa ntchito njira iliyonse yomwe yatchulidwa kuti muwone momwe deta yochotsedwayo idakopera mwachangu / pang'onopang'ono.
Monga tikuwonera, Borg Backup ili ndi chiwongolero chabwino kwambiri chosungirako zosunga zobwezeretsera, koma ndiyotsika pakulemba ndikubwezeretsa liwiro.
Restic idakhala yothamanga kuposa Benji Backup, koma zimatenga nthawi yayitali kuti zibwezeretse ku stdout, ndipo, mwatsoka, sadziwa kulemba mwachindunji ku chipangizo cha block.
Nditapenda ubwino ndi kuipa kwake, ndinaganiza zongoyamba wokhazikika Ρ kupuma-seva ngati njira yabwino kwambiri komanso yodalirika yosunga zobwezeretsera.
Pazenerali mutha kuwona momwe tchanelo cha 10-gigabit chimagwiritsidwira ntchito kwathunthu pazosunga zingapo zomwe zikuyenda nthawi imodzi. Ndikoyenera kudziwa kuti kubwezeredwa kwa disk sikukwera pamwamba pa 30%.
Ndinasangalala kwambiri ndi yankho lomwe ndinalandira!
Source: www.habr.com