Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)

Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)

Iyiphi inguqulo ye-firmware "elungile" futhi "esebenzayo" kakhulu? Uma isistimu yesitoreji iqinisekisa ukubekezelelwa kwamaphutha okungu-99,9999%, ingabe lokho kusho ukuthi izosebenza ngaphandle kokuphazamiseka ngisho nangaphandle kwesibuyekezo sesofthiwe? Noma, ngokuphambene nalokho, ukuze uthole ukubekezelelana okukhulu kwamaphutha, kufanele uhlale ufake i-firmware yakamuva? Sizozama ukuphendula le mibuzo ngokusekelwe kokuhlangenwe nakho kwethu.

Isingeniso esincane

Sonke siyaqonda ukuthi inguqulo ngayinye yesofthiwe, kungaba isistimu yokusebenza noma umshayeli wedivayisi, ngokuvamile iqukethe iziphazamiso nezinye “izici” okungenzeka “zingaveli” kuze kube sekupheleni kwempilo yesevisi yesisetshenziswa, noma “ukuvula” ngaphansi kwezimo ezithile kuphela. Inombolo nokubaluleka kwama-nuances anjalo kuncike kubunkimbinkimbi (ukusebenza) kwesoftware kanye nekhwalithi yokuhlola ngesikhathi sokuthuthukiswa kwayo. 

Ngokuvamile, abasebenzisi bahlala "ku-firmware evela efekthri" (edumile "iyasebenza, ngakho ungaphazamisi ngayo") noma faka njalo inguqulo yakamuva (ngokuqonda kwabo, okwakamuva kusho ukuthi kusebenza kakhulu). Sisebenzisa indlela ehlukile - sibheka amanothi okukhululwa kuyo yonke into esetshenzisiwe efwini le-mClouds bese ukhetha ngokucophelela i-firmware efanelekile yocezu ngalunye lwemishini.

Safinyelela kulesi siphetho, njengoba besho, ngokuhlangenwe nakho. Sisebenzisa isibonelo sethu sokusebenza, sizokutshela ukuthi kungani ukwethembeka okuthenjisiwe okungu-99,9999% kwezinhlelo zokulondoloza akusho lutho uma ungaqapheli ngokushesha izibuyekezo nezincazelo zesofthiwe. Icala lethu lifanele abasebenzisi bezinhlelo zokugcina kusuka kunoma yimuphi umthengisi, njengoba isimo esifanayo singenzeka ngehadiwe kunoma yimuphi umkhiqizi.

Ukukhetha Uhlelo Olusha Lwesitoreji

Ekupheleni konyaka odlule, isistimu yokugcina idatha ethakazelisayo yengezwa nengqalasizinda yethu: imodeli encane evela kulayini we-IBM FlashSystem 5000, ngesikhathi sokuthenga owawubizwa ngokuthi i-Storwize V5010e. Manje isithengiswa ngaphansi kwegama elithi FlashSystem 5010, kodwa empeleni iyisisekelo se-hardware efanayo ne-Spectrum Virtualize efanayo ngaphakathi. 

Ukuba khona kwesistimu yokuphatha ehlanganisiwe, ngendlela, umehluko omkhulu phakathi kwe-IBM FlashSystem. Kumamodeli ochungechunge oluncane, cishe awahlukile kumamodeli akhiqiza kakhulu. Ukukhetha imodeli ethile kunikeza kuphela isisekelo sehadiwe esifanele, izici ezenza kube nokwenzeka ukusebenzisa umsebenzi owodwa noma omunye noma ukunikeza izinga eliphezulu lokukala. Isofthiwe ihlonza ihadiwe futhi inikeza ukusebenza okudingekayo nokwanele kwale nkundla.

Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)IBM FlashSystem 5010

Kafushane mayelana nemodeli yethu engu-5010. Lena isistimu yokugcina izilawuli ezimbili ezingeni lokungena. Ingakwazi ukwamukela amadiski e-NLSAS, SAS, SSD. Ukubekwa kwe-NVMe akutholakali kuyo, njengoba le modeli yokugcina ibekwe ukuze ixazulule izinkinga ezingadingi ukusebenza kwamadrayivu e-NVMe.

Isistimu yokugcina ithengiwe ukuze ifake ulwazi lwengobo yomlando noma idatha engafinyelelwa njalo. Ngakho-ke, isethi ejwayelekile yokusebenza kwayo beyanele kithi: I-Tiering (I-Easy Tier), I-Thin Provision. Ukusebenza kumadiski e-NLSAS ezingeni lika-1000-2000 IOPS nakho bekusanelisa kakhulu.

Okuhlangenwe nakho kwethu - ukuthi asizange sibuyekeze kanjani i-firmware ngesikhathi

Manje mayelana ne-software update ngokwayo. Ngesikhathi sokuthenga, uhlelo beseluvele lunenguqulo ephelelwe yisikhathi kancane yesofthiwe ye-Spectrum Virtualize, okungukuthi, 8.2.1.3.

Sifunde izincazelo ze-firmware futhi sahlela isibuyekezo sokuthi 8.2.1.9. Ukube besisebenza kahle kakhudlwana, lesi sihloko besingeke sibe khona - iphutha belingeke lenzeke ku-firmware yakamuva. Nokho, ngenxa yezizathu ezithile, ukubuyekezwa kwalolu hlelo kuhlehlisiwe.

Njengomphumela, ukubambezeleka okuncane kwesibuyekezo kuholele esithombeni esingemnandi kakhulu, njengasencazelweni ekusixhumanisi: https://www.ibm.com/support/pages/node/6172341

Yebo, ku-firmware yaleyo nguqulo lokho okubizwa nge-APAR (Umbiko Wokuhlaziya Uhlelo Olugunyaziwe) HU02104 wawufanelekile. Kuvela kanje. Ngaphansi komthwalo, ngaphansi kwezimo ezithile, i-cache iqala ukuchichima, bese uhlelo lungena kumodi yokuzivikela, lapho lukhubaza i-I / O ye-pool. Esimweni sethu, kubonakale sengathi kunqanyulwa amadiski angu-3 eqenjini le-RAID kumodi ye-RAID 6. Ukukhipha uxhumano kwenzeka imizuzu engu-6. Okulandelayo, ukufinyelela Kumavolumu Ephulini kuyabuyiselwa.

Uma noma ubani engajwayelene nesakhiwo nokuqanjwa kwamabhizinisi anengqondo kumongo we-IBM Spectrum Virtualize, manje ngizochaza kafushane.

Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)Ukwakheka kwezinto ezinengqondo zesistimu yesitoreji

Amadiski aqoqwa abe ngamaqembu abizwa nge-MDisk (Idiski Ephethwe). I-MDisk ingaba i-RAID yakudala (0,1,10,5,6) noma i-virtualized - i-DRAID (I-RAID Esatshalaliswa). Ukusebenzisa i-DRAID kukuvumela ukuthi ukhuphule ukusebenza kohlu, ngoba... Wonke ama-disks eqenjini azosetshenziswa, futhi isikhathi sokwakha kabusha sizoncishiswa, ngenxa yokuthi amabhlogo athile kuphela azodinga ukubuyiselwa, hhayi yonke idatha evela kudiski ehlulekile.

Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)Ukusatshalaliswa kwamabhulokhi wedatha kuwo wonke amadiski lapho usebenzisa i-Distributed RAID (DRAID) kumodi ye-RAID-5.

Futhi lo mdwebo ubonisa umqondo wokuthi ukwakhiwa kabusha kwe-DRAID kusebenza kanjani lapho kwenzeka iphutha elilodwa lediski:

Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)I-Logic yokwakhiwa kabusha kwe-DRAID lapho idiski eyodwa yehluleka

Okulandelayo, i-MDisks eyodwa noma ngaphezulu yenza lokho okubizwa ngokuthi Iphuli. Ngaphakathi kwechibi elifanayo, akunconywa ukusebenzisa i-MDisk enamazinga ahlukene e-RAID/DRAID kumadiski ohlobo olufanayo. Ngeke singene kulokhu sijule kakhulu, ngoba... sihlela ukukuhlanganisa lokhu kwesinye sezihloko ezilandelayo. Eqinisweni, i-Pool ihlukaniswe ngamavolumu, ethulwa kusetshenziswa iphrothokholi yokufinyelela eyodwa noma enye kuma-host host.

Ngakho, thina, ngenxa yesimo esichazwe ku I-APAR HU02104, ngenxa yokwehluleka okunengqondo kwamadiski amathathu, i-MDisk yayeka ukusebenza, okwaholela ekuhlulekeni kwe-Pool kanye namaVolumu ahambisanayo.

Ngenxa yokuthi lezi zinhlelo zihlakaniphe kakhulu, zingaxhunywa kusistimu yokuqapha esekelwe kumafu ye-IBM Storage Insights, ethumela ngokuzenzakalelayo isicelo sesevisi kusekelo lwe-IBM uma kwenzeka inkinga. Uhlelo lokusebenza luyakhiwa futhi ochwepheshe be-IBM benza ukuhlonza bekude futhi bathinte umsebenzisi wesistimu. 

Ngenxa yalokhu, inkinga yaxazululwa ngokushesha okukhulu futhi kwatholwa isincomo esisheshayo esivela kusevisi yokusekela ukuze kuthuthukiswe isistimu yethu ibe yi-firmware ekhethwe ngaphambilini 8.2.1.9, ngaleso sikhathi eyayisilungisiwe kakade. Kuyaqinisekisa Okuhambisanayo Khipha Inothi.

Imiphumela nezincomo zethu

Njengoba isisho sithi: "konke kuhamba kahle lokho kugcina kahle." I-bug ku-firmware ayizange ibangele izinkinga ezinkulu - amaseva abuyiselwe ngokushesha futhi ngaphandle kokulahlekelwa idatha. Amanye amaklayenti kwakudingeka aqalise kabusha imishini ebonakalayo, kodwa ngokuvamile sasilungiselelwe imiphumela engalungile eyengeziwe, njengoba senza amakhophi asenqolobaneni nsuku zonke azo zonke izici zengqalasizinda nemishini yamakhasimende. 

Sithole isiqinisekiso sokuthi ngisho namasistimu athembekile ano-99,9999% atholakalayo athenjisiwe adinga ukunakwa nokunakekelwa ngesikhathi. Ngokusekelwe kulesi simo, sizenzele iziphetho ezimbalwa futhi sabelane ngezincomo zethu:

  • Kubalulekile ukuqapha ukukhishwa kwezibuyekezo, Amanothi Okukhishwa Kocwaningo ukuze kulungiswe izinkinga okungenzeka zibe bucayi, futhi senze izibuyekezo ezihleliwe ngesikhathi.

    Leli yiphuzu lenhlangano futhi elisobala impela, okubonakala sengathi akufanelekile ukugxila kulo. Nokho, kulo “mhlaba osezingeni” ungakhubeka kalula. Empeleni, yilesi sikhathi esangeza izinkinga ezichazwe ngenhla. Qaphela kakhulu lapho udweba imithetho yokuvuselela futhi uqaphe ukuthotshelwa kwayo ngokucophelela. Leli phuzu lihlobene kakhulu nomqondo "wokuziphatha".

  • Kuhlala kungcono ukugcina isistimu nenguqulo yesofthiwe yakamuva. Ngaphezu kwalokho, lena yamanje akuyona leyo enenombolo enkulu, kodwa yileyo enedethi yokukhishwa kamuva. 

    Isibonelo, i-IBM igcina okungenani ukukhishwa kwesofthiwe okubili kusesikhathini samanje kumasistimu ayo okugcina. Ngesikhathi sokubhala lokhu, lezi zingu-8.2 no-8.3. Izibuyekezo ze-8.2 ziphuma ngaphambi kwesikhathi. Ukubuyekezwa okufanayo kwe-8.3 kuvame ukukhishwa ngokubambezeleka okuncane.

    Ukukhishwa kwe-8.3 kunezinzuzo eziningi zokusebenza, isibonelo, ikhono lokwandisa i-MDisk (kwimodi ye-DRAID) ngokungeza idiski eyodwa noma amaningi amasha (lesi sici sivele kusukela kunguqulo 8.3.1). Lokhu kungukusebenza okuyisisekelo, kepha ku-8.2, ngeshwa, asikho isici esinjalo.

  • Uma kungenakwenzeka ukuvuselela ngesizathu esithile, khona-ke ngezinguqulo zesofthiwe ye-Spectrum Virtualize ngaphambi kwezinguqulo 8.2.1.9 kanye no-8.3.1.0 (lapho isiphazamisi esichazwe ngenhla sifanelekile), ukuze kwehliswe ubungozi bokwenzeka kwaso, ukwesekwa kwe-IBM kuncoma ukukhawulela ukusebenza kwesistimu ezingeni le-pool, njengoba kukhonjisiwe esithombeni esingezansi (isithombe sithathwe kunguqulo ye-Russified ye-GUI). Inani le-10000 IOPS liboniswa njengesibonelo futhi likhethwa ngokuya ngezici zesistimu yakho.

Kungani kubalulekile ukuhlola isofthiwe kusistimu yakho yokugcina ukutholakala okuphezulu (99,9999%)Ikhawulela ukusebenza kwesitoreji se-IBM

  • Kuyadingeka ukubala kahle umthwalo kumasistimu okugcina futhi ugweme ukulayisha ngokweqile. Ukwenza lokhu, ungasebenzisa noma isayizi ye-IBM (uma ukwazi ukuyifinyelela), noma usizo lozakwethu, noma izinsiza zenkampani yangaphandle. Kubalulekile ukuqonda iphrofayili yomthwalo ohlelweni lwesitoreji, ngoba Ukusebenza ku-MB/s naku-IOPS kuyehluka kakhulu kuye okungenani ngamapharamitha alandelayo:

    • uhlobo lokusebenza: funda noma bhala,

    • usayizi webhulokhi yokusebenza,

    • iphesenti lemisebenzi yokufunda nokubhala kukho konke ukusakaza kwe-I/O.

    Futhi, isivinini sokusebenza sithintwa indlela amabhulokhi wedatha afundwa ngayo: ngokulandelana noma ngokulandelana okungahleliwe. Lapho wenza imisebenzi eminingi yokufinyelela idatha ohlangothini lohlelo lokusebenza, kunomqondo wemisebenzi encikile. Kuyancomeka futhi ukukunaka lokhu. Konke lokhu kungasiza ukubona ingqikithi yedatha evela kuzibalo zokusebenza ze-OS, isistimu yokugcina, amaseva/ama-hypervisors, kanye nokuqonda izici zokusebenza zezinhlelo zokusebenza, ama-DBMS kanye nabanye "abathengi" bezinsiza zediski.

  • Futhi ekugcineni, qiniseka ukuthi unama-backups asesikhathini futhi ayasebenza. Isheduli yokusekelayo kufanele ilungiselelwe ngokusekelwe kumanani e-RPO amukelekayo ebhizinisi, futhi ukuhlolwa kobuqotho ngezikhathi ezithile kwezipele kufanele kuqinisekiswe (idlanzana labathengisi be-software eyisipele basebenzise ukuqinisekiswa okuzenzakalelayo emikhiqizweni yabo) ukuze kuqinisekiswe inani elamukelekayo le-RTO.

Ngiyabonga ngokufunda kuze kube sekugcineni.
Sikulungele ukuphendula imibuzo yakho namazwana kumazwana. Futhi Sikumema ukuthi ubhalisele isiteshi sethu se-telegraph, lapho sibambe khona ukukhushulwa okuvamile (izaphulelo ku-IaaS kanye nokunikezwa kwamakhodi okuphromotha kufika ku-100% ku-VPS), bhala izindaba ezithakazelisayo futhi umemezele izihloko ezintsha kubhulogi le-Habr.

Source: www.habr.com

Engeza amazwana