Nei Zvichikosha Kusimbisa Software pane Yako Yepamusoro Kuwanikwa Kuchengetera (99,9999%)

Ndeipi firmware vhezheni ndiyo yakanyanya "chaiyo" uye "kushanda"? Kana iyo yekuchengetedza system ichivimbisa kukanganisa kushivirira kwe99,9999%, zvinoreva here kuti ichashanda isina kukanganiswa kunyangwe isina software yekuvandudza? Kana, pane zvinopesana, kuti uwane yakanyanya kukanganisa kushivirira, iwe unofanirwa kugara uchiisa yazvino firmware? Tichaedza kupindura mibvunzo iyi zvichienderana nezvakaitika kwatiri.

Sumo diki

Tese tinonzwisisa kuti imwe neimwe vhezheni yesoftware, ingave inoshanda sisitimu kana mutyairi wemudziyo, kazhinji ine hurema/bugs uye zvimwe "maficha" anogona "kuoneka" kusvika pakupera kwehupenyu hwesevhisi, kana "kuvhurika" chete pasi pemamwe mamiriro. Huwandu uye kukosha kwemanuances akadaro kunoenderana nekuoma (kushanda) kwesoftware uye pamhando yekuyedzwa panguva yekuvandudzwa kwayo. 

Kazhinji, vashandisi vanogara pa "firmware kubva kufekitari" (iyo yakakurumbira "inoshanda, saka usakanganise nayo") kana kugara uchiisa iyo yazvino vhezheni (mukunzwisisa kwavo, ichangoburwa inoreva zvakanyanya kushanda). Isu tinoshandisa nzira yakasiyana - tinotarisa kuburitsa zvinyorwa zvezvese zvakashandiswa mugore remClouds midziyo uye nyatso sarudza iyo yakakodzera firmware kune imwe neimwe chidimbu chemidziyo.

Takasvika pamhedziso iyi, sezvavanotaura, neruzivo. Tichishandisa muenzaniso wedu wekushanda, tichakuudza kuti nei iyo yakavimbiswa 99,9999% kuvimbika kwekuchengetedza masisitimu hakurevi chinhu kana iwe ukasakurumidza kutarisa magadzirirwo esoftware uye tsananguro. Mhosva yedu yakakodzera vashandisi vekuchengetedza masisitimu kubva kune chero mutengesi, sezvo mamiriro akafanana anogona kuitika nehardware kubva kune chero mugadziri.

Kusarudza New Storage System

Pakupera kwegore rapera, imwe nzira inofadza yekuchengetedza data yakawedzerwa kune zvigadzirwa zvedu: junior model kubva ku IBM FlashSystem 5000 line, iyo panguva yekutenga yainzi Storwize V5010e. Ikozvino inotengeswa pasi pezita reFlashSystem 5010, asi kutaura zvazviri ndiyo imwechete hardware base ine yakafanana Spectrum Virtualize mukati. 

Kuvapo kweiyo yakabatana manejimendi system ndeye, nenzira, musiyano mukuru pakati peIBM FlashSystem. Kune mamodheru eiyo madiki akateedzana, hazvina kumbosiyana nemamodheru eanobereka zvakanyanya. Kusarudza imwe modhi inongopa iyo yakakodzera Hardware base, hunhu hwayo hunoita kuti zvikwanise kushandisa imwe kana imwe mashandiro kana kupa chiyero chepamusoro che scalability. Iyo software inozivisa iyo Hardware uye inopa inodiwa uye yakakwana mashandiro epuratifomu iyi.

IBM FlashSystem 5010

Muchidimbu nezvemuenzaniso wedu 5010. Iyi inopinda-level dual-controller block storage system. Inogona kugamuchira NLSAS, SAS, SSD disks. Kuiswa kweNVMe hakusi kuwanikwa mairi, sezvo iyi modhi yekuchengetera yakamisikidzwa kugadzirisa matambudziko asingade kuita kweNVMe madhiraivha.

Iyo yekuchengetera sisitimu yakatengwa kuti iwane ruzivo rwezvinyorwa kana data risingawanikwe nguva zhinji. Naizvozvo, iyo yakajairwa seti yekushanda kwayo yaikwana kwatiri: Tiering (Easy Tier), Thin Provision. Kuita pamadhisiki eNLSAS pamwero we1000-2000 IOPS kwainyatsotigutsa.

Chiitiko chedu - maitiro atisina kuvandudza firmware nenguva

Iye zvino nezve software yekuvandudza pachayo. Panguva yekutenga, sisitimu yainge yatove neshanduro yechinyakare yeSpectrum Virtualize software, inoti, 8.2.1.3.

Isu takadzidza iyo firmware tsananguro uye takaronga yekuvandudza kune 8.2.1.9. Dai isu takanga tave nehunyanzvi zvishoma, chinyorwa ichi chingadai chisipo - iyo bug ingadai isina kuitika pane ichangoburwa firmware. Nekudaro, nekuda kwezvimwe zvikonzero, kugadziridzwa kweiyo system kwakamiswa.

Nekuda kweizvozvo, kunonoka kushoma kwekuvandudza kwakatungamira kumufananidzo usingafadzi, semutsananguro pane chinongedzo: https://www.ibm.com/support/pages/node/6172341. 

Ehe, muiyo firmware yeiyo vhezheni iyo inonzi APAR (Authorized Program Analysis Report) HU02104 yaive yakakosha. Zvinoratidzika sezvizvi. Pasi pemutoro, pasi pemamwe mamiriro ezvinhu, cache inotanga kufashukira, ipapo sisitimu inoenda mukudzivirira mode, iyo inodzima I / O yedziva. Muchiitiko chedu, zvakaratidzika sekubvisa 3 disks yeboka re RAID mu RAID mode 6. Kubviswa kunoitika kwemaminitsi matanhatu. Tevere, kupinda kuMavhoriyamu muDziva kunodzorerwa.

Kana paine chero munhu asingazive chimiro uye kudoma mazita ezvine musoro mukati meiyo IBM Spectrum Virtualize, ini ndichatsanangura muchidimbu.

Chimiro chekuchengetedza system inonzwisisika zvinhu

Madhisiki anounganidzwa mumapoka anonzi MDisk (Managed Disk). MDisk inogona kunge iri yekirasi RAID (0,1,10,5,6) kana yakasarudzika - DRAID (Distributed RAID). Kushandisa DRAID kunokubvumidza kuti uwedzere kuita kweiyo array, nekuti ... Madhisiki ese ari muboka achashandiswa, uye nguva yekuvakazve ichaderedzwa, nekuda kwekuti mamwe mabhuroki chete achada kudzoserwa, uye kwete ese data kubva kune yakundikana disk.

Kugovera kwe data blocks pamadhisiki kana uchishandisa Distributed RAID (DRAID) muRAID-5 mode.

Uye iyi dhizaini inoratidza pfungwa yekuti DRAID kuvakazve kunoshanda sei kana imwe dhisiki yakundikana:

Logic yeDRAID kuvakazve kana imwe dhisiki yakundikana

Tevere, imwe kana akawanda MDisks anoumba inonzi Dziva. Mukati medziva rimwe chete, hazvikurudzirwe kushandisa MDisk nemazinga akasiyana eRAID/DRAID pamadhisiki emhando imwe chete. Hatisi kuzopinda mune izvi zvakanyanya, nekuti ... tinoronga kukurukura izvi mune imwe yenyaya dzinotevera. Zvakanaka, kutaura zvazviri, Dziva rakakamurwa kuita Mavhoriyamu, ayo anounzwa achishandisa imwe kana imwe block access protocol kune vanogamuchira.

Saka, isu, semugumisiro wemamiriro anotsanangurwa mukati APAR HU02104, nekuda kwekukundikana kunonzwisisika kwema disks matatu, MDisk yakamira kushanda, iyo, zvakare, yakaguma nekukundikana kweDziva uye Mavhoriyamu anowirirana.

Nekuda kwekuti masisitimu aya akangwara, anogona kubatana neIBM Storage Insights gore-based monitoring system, iyo inotumira otomatiki chikumbiro chesevhisi kune IBM rutsigiro kana dambudziko rikaitika. Chikumbiro chinogadzirwa uye IBM nyanzvi dzinoita diagnostics dziri kure uye kubata mushandisi wesystem. 

Nekuda kweizvi, nyaya yacho yakagadziriswa nekukurumidza uye kurudziro yakakurumidza yakagamuchirwa kubva kubasa rekutsigira kuvandudza sisitimu yedu kune yakambosarudzwa firmware 8.2.1.9, iyo panguva iyoyo yakanga yatogadziriswa. Inosimbisa inowirirana Release Note.

Mhinduro uye mazano edu

Sekutaura kunoita chirevo: "zvese zvakanaka zvinopera zvakanaka." Iyo bug mu firmware haina kukonzera matambudziko akakomba - maseva akadzorerwa nekukurumidza uye pasina kurasikirwa kwedata. Vamwe vatengi vaifanira kutangazve machina chaiwo, asi kazhinji isu takanga takagadzirira mimwe mhedzisiro yakaipa, sezvo isu tichigadzira mazuva ese mabhekisheni ezvese zvivakwa zvinhu nemichina yevatengi. 

Isu takagamuchira simbiso yekuti kunyangwe masisitimu akavimbika ane 99,9999% yakavimbiswa kuwanikwa inoda kutariswa uye kugadzirisa panguva. Zvichienderana nemamiriro ezvinhu, takazviitira mhedziso dzakati wandei uye tinogovana mazano edu:

• Izvo zvakakosha kuti utarise kuburitswa kwezvigadziriso, kudzidza Release Notes kuti zvigadziriswe zvezvingangove zvakakomba nyaya, uye kuita zvakarongwa zvigadziriso nenguva.

  Iyi ipfungwa yesangano uye inotonyatsojeka, iyo, zvinoita sekunge, haina kukodzera kutarisa pairi. Nekudaro, pane iyi "yepamusoro pasi" unogona kugumburwa zviri nyore. Chaizvoizvo, yaive nguva ino yakawedzera matambudziko atsanangurwa pamusoro apa. Iva nehanya zvakanyanya paunenge uchigadzira iyo yekuvandudza mirau uye tarisa kutevedzera navo kwete zvishoma. Pfungwa iyi ine chekuita zvakanyanya neiyo pfungwa ye "chirango".

• Nguva dzose zviri nani kuchengeta sisitimu neiyo yazvino software vhezheni. Uyezve, yazvino haisi iyo ine nhamba huru yezita, asi kuti iyo ine zuva rekuburitswa gare gare. 

  Semuyenzaniso, IBM inochengeta kanokwana maviri software kuburitswa kusvika parizvino kune ayo ekuchengetedza masisitimu. Panguva yekunyora uku, idzi ndi8.2 uye 8.3. Zvigadziriso zve8.2 zvinobuda kare. Iyo yakafanana yekuvandudza ye8.3 inowanzoburitswa nekunonoka kudiki.

  Kusunungurwa 8.3 kune nhamba yezvakanaka zvekushanda, semuenzaniso, kukwanisa kuwedzera MDisk (muDRAID mode) nekuwedzera imwe kana mamwe madhisiki matsva (iyi ficha yakaonekwa kubva mushanduro 8.3.1). Uku ndiko kuita kwakaringana kuita, asi muna 8.2, zvinosuruvarisa, hapana chimiro chakadaro.

• Kana zvisingabviri kuvandudza nekuda kwechimwe chikonzero, saka kune shanduro dzeSpectrum Virtualize software isati yasvika shanduro 8.2.1.9 uye 8.3.1.0 (apo bhagi rinotsanangurwa pamusoro rakakodzera), kuderedza njodzi yekuitika kwayo, IBM technical support inokurudzira. kudzikisira mashandiro ehurongwa pamwero wedziva, sezvakaratidzwa mumufananidzo uri pazasi (mufananidzo wakatorwa muRussified vhezheni yeGUI). Iko kukosha kwe10000 IOPS inoratidzwa semuenzaniso uye inosarudzwa maererano nemaitiro ehurongwa hwako.

Kudzikamisa IBM kuchengetedza kuita

• Izvo zvinodikanwa kuti uverenge nemazvo mutoro pane ekuchengetedza masisitimu uye kudzivirira kuwandisa. Kuti uite izvi, unogona kushandisa ingave IBM saizi (kana iwe uchikwanisa kuiwana), kana rubatsiro rwevabatsiri, kana wechitatu-bato zviwanikwa. Izvo zvakakosha kuti unzwisise iyo mutoro profile pane yekuchengetedza system, nekuti Kuita muMB/s uye IOPS kunosiyana zvakanyanya zvichienderana nechero anotevera paramita:

  • rudzi rwekushanda: kuverenga kana kunyora,

  • saizi ye block block,

  • chikamu chekuverenga nekunyora mashandiro muhuwandu hweI/O rwizi.

  Zvakare, kumhanya kwekushanda kunokanganiswa nemaverengerwo e data blocks: sequentially kana mune random order. Paunenge uchiita mabasa akawanda ekuwana data padivi rekushandisa, pane pfungwa yezvinotsamira mashandiro. Zvinokurudzirwawo kufunga izvi. Zvose izvi zvinogona kubatsira kuona huwandu hwemashoko kubva kumabasa ekushanda kweOS, kuchengetedza system, maseva / hypervisors, pamwe nekunzwisisa kwemaitiro ekushanda kwezvikumbiro, DBMSs uye mamwe "vatengi" ve disk resources.

• Uye pakupedzisira, iva nechokwadi chekuve ne backups kusvika nhasi uye kushanda. Iyo backup hurongwa inofanirwa kugadzirwa zvichibva pane inogamuchirika RPO kukosha kwebhizinesi, uye nguva nenguva kutarisa kwekuvimbika kwema backups kunofanirwa kusimbiswa (vashoma kwazvo vatengesi vesoftware backup vane otomatiki verification yakaitwa muzvigadzirwa zvavo) kuve nechokwadi chinogamuchirika RTO kukosha.

Ndinokutendai nekuverenga kusvika kumagumo.
Isu takagadzirira kupindura mibvunzo yako uye makomendi mune mhinduro. Zvakare Tinokukoka iwe kuti unyore kune yedu telegraph chiteshi, iyo yatinobata nguva dzose kukurudzirwa (kuderedzwa paIaaS uye kupa zvipo zvekutengesa makodhi kusvika ku100% paVPS), nyora nhau dzinonakidza uye zivisa zvinyorwa zvitsva paHabr blog.

Source: www.habr.com