Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Mhoroi mose! Nechinyorwa ichi, AERODISK inovhura blog paHabré. Hurray, makomuredhi!

Zvinyorwa zvakapfuura paHabré zvakakurukura mibvunzo nezve dhizaini uye yekutanga kumisikidzwa kwekuchengetedza masisitimu. Muchikamu chino tichakurukura mubvunzo usina kumbovharwa, asi unowanzobvunzwa - pamusoro pekutadza kushivirira kweAERODISK ENGINE kuchengetedza masisitimu. Boka redu richaita zvese kuti ive nechokwadi chekuti AERODISK yekuchengetedza system inomira kushanda, i.e. tyora.

Zvakazoitika kuti zvinyorwa nezve nhoroondo yekambani yedu, nezve zvigadzirwa zvedu, pamwe nemuenzaniso wekubudirira kwekuita zvakatorembera paHabré, iyo Kutenda kukuru kune vatinoshanda navo - TS Solution uye Softline makambani.

Naizvozvo, ini handisi kuzodzidzisa kopi-namira manejimendi hunyanzvi pano, asi ndinongopa zvinongedzo kune izvo zvekutanga zvinyorwa izvi:

Ndinodawo kugovera mashoko akanaka. Asi ini ndichatanga, hongu, nedambudziko. Isu, semutengesi wechidiki, pakati pezvimwe zvinodhura, tinogara takatarisana nenyaya yekuti mainjiniya mazhinji nevatungamiriri havangoziva nzira yekushandisa nemazvo system yedu yekuchengetedza.
Zviripachena kuti kutonga akawanda ekuchengetedza masisitimu anotaridzika zvakafanana kubva pakuona kwemaneja, asi mugadziri wega wega ane maitiro ayo. Uye isu hatina kusarudzika pano.

Naizvozvo, kuitira kurerutsa basa rekudzidzisa nyanzvi dzeIT, takasarudza kuzvipira gore rino kudzidzo yemahara. Kuti tiite izvi, mumaguta makuru mazhinji eRussia tiri kuvhura network yeAERODISK Competence Centers, umo chero nyanzvi yehunyanzvi inofarira inogona kutora kosi zvachose pasina muripo uye kugamuchira chitupa chekutungamira AERODISK ENGINE masisitimu ekuchengetedza.

Mune imwe neimwe yeCompetence Center tichaisa yakazara-yakazara demo stand kubva kuAERODISK yekuchengetedza system uye sevha yemuviri, iyo mudzidzisi wedu achaitisa kudzidziswa kumeso. Isu tichaburitsa hurongwa hwebasa hweCompetence Centers pakuonekwa kwavo, asi isu takatovhura nzvimbo muNizhny Novgorod uye guta reKrasnodar rinotevera. Unogona kusaina kudzidziswa uchishandisa ma link ari pazasi. Heino ruzivo rwazvino rwunozivikanwa nezvemaguta nemazuva:

  • Nizhny Novgorod (YATOVHURA - unogona kusaina pano https://aerodisk.promo/nn/);
    Kusvikira Kubvumbi 16, 2019, unogona kushanyira nzvimbo yacho chero nguva yekushanda, uye musi waApril 16, 2019, kosi huru yekudzidzisa icharongwa.
  • Krasnodar (KUVHURA MUNGUVA pfupi - unogona kusaina pano https://aerodisk.promo/krsnd/ );
    Kubva Kubvumbi 9 kusvika Kubvumbi 25, 2019, unogona kushanyira nzvimbo yacho chero nguva yekushanda, uye muna Kubvumbi 25, 2019, kosi huru yekudzidzisa icharongwa.
  • Екатеринбург (KUVHURA KUTI, tevera ruzivo pane webhusaiti yedu kana paHabré);
    Chivabvu-Chikumi 2019.
  • Новосибирск (tevera ruzivo pane webhusaiti yedu kana paHabré);
    Gumiguru 2019.
  • Красноярск (tevera ruzivo pane webhusaiti yedu kana paHabré);
    Mbudzi 2019.

Uye, chokwadi, kana Moscow isiri kure newe, saka chero nguva unogona kushanyira hofisi yedu muMoscow uye kudzidziswa zvakafanana.

Zvose. Tapedza zvekushambadzira, ngatienderere mberi kune tekinoroji!

PaHabré isu tinogara tichiburitsa zvinyorwa zvehunyanzvi nezve zvigadzirwa zvedu, bvunzo dzemutoro, kuenzanisa, mashandisiro ekushandisa uye zvinonakidza kuita.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Ngozi! Mushure mekuverenga chinyorwa, unogona kuti: zvakanaka, hongu, mutengesi achazviongorora kuti zvese zvishande "ne bang," greenhouse mamiriro, nezvimwe. Ndichapindura: hapana zvakadaro! Kusiyana nevakwikwidzi vedu vekune dzimwe nyika, isu tiri pano, padyo newe, uye iwe unogona kugara uchiuya kwatiri (muMoscow kana chero Central Committee) uye uedze hurongwa hwedu hwekuchengetedza chero nzira. Nokudaro, hazvina musoro kuti isu tigadzirise mhedzisiro yemufananidzo wakakodzera wenyika, nekuti Isu tiri nyore chaizvo kutarisa. Kune avo vane usimbe hwekuenda uye vasina nguva, tinogona kuronga kuyedza kure. Tine lab yakakosha yeizvi. Taura nesu.

ACHTUNG-2! Uyu muedzo hausi muyedzo wemutoro, nekuti apa tinongofunga nezve kushivirira kwemhosva. Mumavhiki mashoma, tichagadzirira kumira kwakasimba uye kuitisa kuyedzwa kwemutoro wekuchengetedza sisitimu, tichiburitsa mhedzisiro pano (nenzira, zvikumbiro zvebvunzo zvinogamuchirwa).

Saka, handei tinozvityora.

test bhenji

Chimiro chedu chine zvinotevera hardware:

  • 1 x Aerodisk Engine N2 storage system (2 controllers, 64GB cache, 8xFC ports 8Gb / s, 4xEthernet ports 10Gb / s SFP +, 4xEthernet ports 1Gb / s); Madhisiki anotevera akaiswa mudura rekuchengetedza:
  • 4 x SAS SSD dhisiki 900 GB;
  • 12 x SAS 10k disks 1,2 TB;
  • 1 x Physical server neWindows Server 2016 (2xXeon E5 2667 v3, 96GB RAM, 2xFC ports 8Gb/s, 2xEthernet ports 10Gb/s SFP+);
  • 2 x SAN 8G chinja;
  • 2 x LAN 10G chinja;

Isu takabatanidza sevha kune yekuchengetedza sisitimu kuburikidza nekuchinja kuburikidza neyese FC uye 10G Ethernet. Dhiyagiramu yekumira iri pazasi.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Izvo zvinhu zvatinoda, seMPIO uye iSCSI initiator, yakaiswa paWindows Server.
Nzvimbo dzakagadzirirwa paFc switch, maVLAN anoenderana anogadziriswa paLAN switch, uye MTU 9000 inoiswa pachiteshi chekuchengetedza, switch, uye host (maitirwo ekuita zvese izvi zvinotsanangurwa muzvinyorwa zvedu, saka isu hatizotsanangure. nzira iyi pano).

Test Methodology

The crash test plan ndeiyi inotevera:

  • Kutarisa kutadza kweFC neEthernet ports.
  • Kukundikana kwesimba kutarisa.
  • Controller kutadza kutarisa.
  • Kutarisa dhisiki kutadza muboka/dziva.

Yese bvunzo ichaitwa pasi pezvakagadzirwa zvinhu, izvo zvatichagadzira neIOMETER chirongwa. Mukufanana, isu tichaita bvunzo dzakafanana, asi pasi pemamiriro ekukopa mafaira makuru kune yekuchengetedza system.

Iyo IOmeter config yakaita seiyi:

  • Verenga/Nyora – 70/30
  • Block - 128k (takafunga kugeza masisitimu ekuchengetedza mumabhuraki makuru)
  • Nhamba yeshinda - 128 (iyo yakafanana zvikuru nemutoro unobereka)
  • Full Random
  • Nhamba yeVashandi - 4 (2 yeFC, 2 yeSCSI)

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba
Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Muedzo une zvinotevera zvinangwa:

  1. Ita shuwa kuti iyo synthetic mutoro uye kopi maitiro haizokanganise kana kukonzera kukanganisa pasi peakasiyana mamiriro ekutadza.
  2. Ita shuwa kuti maitiro ekuchinja zviteshi, controller, nezvimwe zvakaringana otomatiki uye hazvitsvage zviito zvemutongi kana paine kukundikana (kureva, panguva yekutadza, hatisi kutaura nezvekukundikana, hongu).
  3. Ita shuwa kuti ruzivo rwuri mumatanda runoratidzwa nemazvo.

Kugadzirira iyo host uye yekuchengetedza system

Isu takagadzirisa kupinda kwevhavha pane yekuchengetedza sisitimu tichishandisa FC uye Ethernet ports (FC uye iSCSI, zvichiteerana). Vakomana veTS Solution vakatsanangura zvakadzama maitiro ekuita izvi mune yakapfuura chinyorwa (https://habr.com/ru/company/tssolution/blog/432876/) Uye, hongu, hapana akadzima zvinyorwa uye makosi.

Isu takagadzira boka rakasanganiswa tichishandisa madhiraivha ese ataive nawo. 2 SSD madhisiki akawedzerwa kune cache, 2 SSD madhisiki akawedzerwa seyekuwedzera yekuchengetedza tier (Online-tier). Isu takaisa gumi nemaviri SAS12k madhiraivha muRAID-10P (katatu parity) kuti titarise kutadza kwemadhiraivha matatu muboka kamwechete. Rimwe dhisiki rakasiiwa kuti rigadziriswe.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Isu takabatanidza maLUN maviri (imwe kuburikidza neFC, imwe kuburikidza neSCSI).

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Muridzi wemaLUN ese ari maviri Engine-0 controller

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Ngatitange bvunzo

Isu tinogonesa IOMETER neiyo config iri pamusoro.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Isu tinorekodha kubuda kwe1.8 GB/s uye latency ye3 milliseconds. Iko hakuna kukanganisa (Total Error Count).

Panguva imwecheteyo, kubva kudhiraivha yemunharaunda "C" yemuiti wedu, isu tinotanga kukopa maviri makuru 100GB mafaera kuFC uye iSCSI yekuchengetedza LUNs (inotyaira E uye G muWindows), tichishandisa mamwe mainterface.

Pamusoro pane maitiro ekukopa kuLUN FC, pazasi kune iSCSI.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Muedzo #1: Kudzima I/O ports

Isu tinoswedera kune yekuchengetedza sisitimu kubva kumashure))) uye nekufamba kudiki kweruoko tinoburitsa ese FC uye Ethernet 10G tambo kubva kune Engine-0 controller. Zvinoita sokunge mudzimai wekuchenesa ane mop akafamba uye akasarudza kushambidza pasi chaipo apo snot yakanga yakarara uye tambo dzakanga dzakarara (kureva kuti mutongi achiri kushanda, asi I / O ports yakafa).

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Ngatitarisei IOMETER uye kukopa mafaera. Kuburikidza kwakadonhera ku 0,5 GB/s, asi nekukurumidza kudzoka kune yayo yapfuura nhanho (mune 4-5 masekonzi). Hapana zvikanganiso.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Kukopa mafaera hakuna kumira, kune kudonha kwekumhanya, asi haina kutsoropodza (kubva pa840 MB/s yakadonha kusvika 720 MB/s). Kukopa hakuna kumira.

Isu tinotarisa matanda ekuchengetedza system uye tinoona meseji nezvekusavapo kwezviteshi uye otomatiki kutamiswa kweboka.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Iro ruzivo rwepaneru rinotiudzawo kuti zvese hazvina kunaka neFC ports.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Iyo yekuchengetedza sisitimu yakapona kutadza kweI / O ports zvinobudirira.

Muedzo Nhamba 2. Kuvhara mutongi wekuchengetedza

Nenguva isipi (mushure mekubaya tambo kudzoka mugadziriro yekuchengetera) takafunga kupedzisa sisitimu yekuchengetera nekudhonza mutongi kunze kwechassis.

Zvakare isu tinoswedera kune yekuchengetedza sisitimu kubva kumashure (takaifarira))) uye panguva ino tinoburitsa iyo Engine-1 controller, iyo panguva ino muridzi weRDG (kwaakatamira boka).

Mamiriro ezvinhu muIOmeter ndeaya anotevera. I/O yakamira kweanenge masekonzi mashanu. Zvikanganiso hazviunganidzi.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Mushure memasekonzi mashanu, I/O yakatangazve neyakafanana kuburikidza nekubuda, asi nekunonoka kwe5 milliseconds (latencies yakagadziriswa mushure memaminitsi mashoma). Sezvinoonekwa kubva pazvidzitiro, iyo Total kukanganisa kuverenga kukosha ndeye 35, ndiko kuti, pakanga pasina zvikanganiso zvekunyora kana kuverenga.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Ngatitarisei kukopa mafaera edu. Sezvauri kuona, haina kukanganiswa, pakanga paine kudonha kushoma kwekuita, asi zvese zvese zvakadzokera kune imwechete ~ 800 MB/s.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Isu tinoenda kune yekuchengetedza sisitimu uye tinoona kutukwa mune yeruzivo pane iyo Injini-1 controller haipo (zvechokwadi, takaiuraya).

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Isu tinoona zvakare kupinda kwakafanana mumatanda.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Mutongi wekuchengetedza akaponawo kukundikana zvinobudirira.

Muedzo Nhamba 3: Kubvisa simba rekushandisa.

Zvingoitika, takatanga kukopa mafaera zvakare, asi hatina kumisa IOMETER.
Isu tinodhonza magetsi emagetsi.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Imwe yambiro yakawedzerwa kune yekuchengetedza sisitimu mupaneri yeruzivo.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Zvakare mune masensor menyu tinoona kuti ma sensors ane hukama neiyo yakaburitswa kunze magetsi ashanduka akatsvuka.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Iyo yekuchengetedza system inoramba ichishanda. Iko kukundikana kweiyo magetsi ekupa simba hakuiti chero nzira ipi zvayo kukanganisa kushanda kwegadziriro yekuchengetedza; kubva pakuona kwemuenzi, kukurumidza kwekopi uye zviratidzo zveIOMETER zvakaramba zvisina kuchinjwa.

Kukundikana kwesimba kuedza kwakapfuura zvinobudirira.

Pamberi pekuyedzwa kwekupedzisira, takasarudza kudzosa sisitimu yekuchengetera kuhupenyu zvishoma, kudzosera mutongi uye magetsi emagetsi unit, uye zvakare kuisa tambo dzakarongeka, iyo iyo yekuchengetedza sisitimu yatizivisa nezvayo nemufaro zvidhori mune yayo yehutano pani. .

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Muedzo Nhamba 4. Kukundikana kwema disks matatu muboka

Pamberi pebvunzo iyi, takaita imwe nhanho yekugadzirira. Chokwadi ndechekuti ENGINE yekuchengetedza sisitimu inopa chinhu chinobatsira - akasiyana ekuvakazve marongero. TS Solution yakanyora nezve chiitiko ichi pakutanga, asi ngatirangarire hunhu hwayo. Mutariri wekuchengetedza anogona kutsanangura kukosha kwekugovera zviwanikwa panguva yekuvakazve. Pamwe munzira yeI / O kuita, ndiko kuti, kuvakazve kunotora nguva yakareba, asi hapana kudhirowa kwekuita. Kana munzira yekuvakazve kumhanya, asi kubereka kuchaderedzwa. Kana sarudzo yakadzikama. Sezvo mashandiro ekuchengetedza panguva yekuvakazve boka redhisiki inogara iri musoro we admin, isu tichayedza mutemo nekusarura kune I / O kuita uye nekudhura kwekuvakazve kumhanya.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Zvino ngatitarisei kutadza kwe dhisiki. Isu tinogonesawo kurekodha kuLUNs (mafaira uye IOMETER). Sezvo tine boka rine katatu parity (RAID-60P), izvi zvinoreva kuti hurongwa hunofanira kumira kukundikana kwema disks matatu, uye mushure mekukundikana, auto-replacement inofanira kushanda, imwe disk inofanira kutora nzvimbo yeimwe yakakundikana. muRDG, uye kuvakazve kunofanira kutanga pairi.

Tanga. Kutanga, kuburikidza nechitarisiko chekuchengetedza, ngatisimbise madhisiki atinoda kuburitsa (kuitira kuti usapotsa nekudhonza autochange disk).

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Isu tinotarisa chiratidzo pane Hardware. Zvese zvakanaka, tinoona matatu akaoneswa disks.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Uye isu tinoburitsa aya madhisiki matatu.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Ngatitarisei zviri pamugamuchiri. Uye ikoko... hapana chakakosha chakaitika.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba
Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Zviratidzo zvekukopa (zvakakwirira kudarika pakutanga, nokuti cache yakadziya) uye IOMETER haishanduki zvakanyanya pakubvisa ma disks uye kutanga kuvakazve (mukati me5-10%).

Ngatitarisei pane zviri pane yekuchengetedza system.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Mune chimiro cheboka, tinoona kuti nzira yekugadzirisa zvakare yakatanga uye yava pedyo nekupedzwa.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

MuRDG skeleton unogona kuona kuti 2 disks ari mutsvuku, uye imwe yakatotsiviwa. Iyo autoreplacement dhisiki haisisipo; yakatsiva iyo 3rd yakakundikana dhisiki. Kuvakazve kwakatora maminetsi akati wandei, kunyora mafaera apo 3 dhisiki yakakundikana haina kukanganiswa, uye I / O kuita hakuna kuchinja zvakanyanya.

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Crash bvunzo dzeAERODISK ENGINE N2 yekuchengetedza system, kuyedza simba

Iyo dhisiki yekutadza bvunzo yakapfuura zvinobudirira.

mhedziso

Panguva ino, takasarudza kumisa mhirizhonga kune masisitimu ekuchengetedza. Ngatipfupise:

  • FC port failure check - yakabudirira
  • Ethernet port kutadza kutarisa - yakabudirira
  • Controller kutadza kutarisa - kubudirira
  • Simba Kukundikana Test - Kubudirira
  • Kutarisa disk kukundikana muboka reboka - kubudirira

Hapana kana chimwe chekutadza chakamira kurekodha kana kukonzera kukanganisa mumutoro wekugadzira; hongu, pakanga paine kurova kwekuita (uye isu tinoziva nzira yekukukunda, izvo zvatichaita munguva pfupi), asi tichipihwa kuti aya masekonzi, zvinogamuchirwa. Mhedziso: kukanganisa kushivirira kwezvikamu zvose zveAERODISK yekuchengetedza system yakashanda pamwero, pakanga pasina pfungwa dzekukundikana.

Zviripachena, mune chimwe chinyorwa hatigone kuyedza mamiriro ese ekukundikana, asi takaedza kuvhara ayo anozivikanwa zvakanyanya. Naizvozvo, ndapota tumira zvaunofunga, mazano ezvinyorwa zvenguva yemberi uye, hongu, kutsoropodza kwakakwana. Isu tichafara kukurukura (kana zvirinani zvakadaro, huya kukudzidziswa, ini ndinoteedzera hurongwa kana zvikaitika)! Kusvikira miyedzo mitsva!

  • Nizhny Novgorod (YATOVHURA - unogona kusaina pano https://aerodisk.promo/nn/);
    Kusvikira Kubvumbi 16, 2019, unogona kushanyira nzvimbo yacho chero nguva yekushanda, uye musi waApril 16, 2019, kosi huru yekudzidzisa icharongwa.
  • Krasnodar (KUVHURA MUNGUVA pfupi - unogona kusaina pano https://aerodisk.promo/krsnd/ );
    Kubva Kubvumbi 9 kusvika Kubvumbi 25, 2019, unogona kushanyira nzvimbo yacho chero nguva yekushanda, uye muna Kubvumbi 25, 2019, kosi huru yekudzidzisa icharongwa.
  • Екатеринбург (KUVHURA KUTI, tevera ruzivo pane webhusaiti yedu kana paHabré);
    Chivabvu-Chikumi 2019.
  • Новосибирск (tevera ruzivo pane webhusaiti yedu kana paHabré);
    Gumiguru 2019.
  • Красноярск (tevera ruzivo pane webhusaiti yedu kana paHabré);
    Mbudzi 2019.

Source: www.habr.com

Voeg