One-cloud - data center level OS muOdnoklassniki

Hongu, vanhu! Zita rangu ndinonzi Oleg Anastasyev, ndinoshanda kuOdnoklassniki muchikwata chePlatform. Uye kunze kwangu, pane zvakawanda zvehardware zvinoshanda muOdnoklassniki. Tine nzvimbo ina dzedhata dzinenge mazana mashanu racks ane anopfuura 500 zviuru maseva. Pane imwe nguva, takaona kuti kuunzwa kwehurongwa hutsva hwekutarisira kwaizotibvumira kurodha michina zvakanyanya, kufambisa manejimendi ekupinda, otomatiki (re) kugovera zviwanikwa zvekombuta, kukurumidza kutangwa kwemasevhisi matsva, uye nekukurumidza mhinduro. kunjodzi huru.

Chii chakabuda?

Kunze kwangu uye neboka re hardware, kunewo vanhu vanoshanda neiyi hardware: mainjiniya anowanikwa zvakananga munzvimbo dze data; networkers vanogadzira network software; vatariri, kana maSRE, avo vanopa kusimba kwezvivakwa; uye zvikwata zvekusimudzira, chimwe nechimwe chazvo chine basa rechikamu chemabasa eiyo portal. Iyo software yavanogadzira inoshanda seizvi:

Zvikumbiro zvemushandisi zvinogamuchirwa zvese zviri zviviri kumberi kweiyo main portal www.ok.ru, uye pane vamwe, semuenzaniso pamimhanzi API fronts. Kuti igadzirise iyo bhizinesi pfungwa, ivo vanodaidza sevha yekushandisa, iyo, kana ichigadzirisa chikumbiro, inodaidza inodiwa yakakosha microservices - imwe-girafu (girafu rekubatana kwemagariro), mushandisi-cache (cache yemaprofiles emushandisi), nezvimwe.

Imwe neimwe yeaya masevhisi anoiswa pamichina yakawanda, uye imwe neimwe ine vanogadzira vane mutoro wekushanda kwemamodule, mashandiro avo uye kuvandudza tekinoroji. Ese masevhisi aya anomhanya pamaseva ehardware, uye kusvika nguva pfupi yadarika takatangisa chaizvo basa rimwe pasevha, kureva kuti raive rakasarudzika kune rimwe basa.

Nei zvakadaro? Iyi nzira yaive nezvakanakira zvakawanda:

• Kusunungurwa mass management. Ngatitii basa rinoda mamwe maraibhurari, mamwe marongero. Uye ipapo sevha inopihwa kuboka rimwechete chairo, iyo cfengine mutemo weboka iri inotsanangurwa (kana yakatotsanangurwa), uye iyi gadziriso iri pakati uye inotenderedzwa otomatiki kune ese maseva muboka iri.
• Simplified kuongororwa. Ngatiti iwe unotarisa kuwedzera kwemutoro pane yepakati processor uye woona kuti mutoro uyu unogona chete kugadzirwa nebasa rinomhanya pane iyi hardware processor. Kutsvaga munhu wekupomera kunopera nekukurumidza.
• Simplified monitoring. Kana chimwe chinhu chisina kumira zvakanaka neserver, iyo yekutarisa inozvitaura, uye iwe unonyatsoziva kuti ndiani ane mhosva.

Sevhisi inoumbwa neakaverengeka akati wandei inopihwa akati wandei maseva - imwe yega yega. Ipapo iyo komputa sosi yesevhisi yakagoverwa zvakapusa: huwandu hwemaseva iyo sevhisi inayo, huwandu hwakanyanya hwezviwanikwa hwahunogona kushandisa. "Zviri nyore" pano hazvireve kuti zviri nyore kushandisa, asi mupfungwa yekuti kugovera zviwanikwa kunoitwa nemaoko.

Iyi nzira zvakare yakatibvumira kuita specialized iron configurations yebasa rinoshanda pane ino server. Kana basa racho richichengeta data yakawanda, saka tinoshandisa sevha ye4U ine chassis ine 38 disks. Kana basa racho riine computational chete, saka tinogona kutenga yakachipa 1U server. Izvi zvinoshanda nemakomputa. Pakati pezvimwe zvinhu, nzira iyi inotibvumira kushandisa michina mishoma yakapetwa mana ine mutoro unofananidzwa neimwe ine hushamwari social network.

Kubudirira kwakadaro mukushandiswa kwemakomputa zviwanikwa kunofanirwawo kuve nechokwadi chekubudirira kwehupfumi, kana tikaenderera mberi kubva pakufunga kuti chinhu chinodhura zvakanyanya maseva. Kwenguva yakareba, hardware ndiyo yainyanya kudhura, uye takaisa simba rakawanda mukuderedza mutengo we hardware, tichiuya nemhosva yekushivirira algorithms kuderedza hardware kuvimbika zvinodiwa. Uye nhasi tasvika padanho iro mutengo we server warega kuita sarudzo. Kana iwe ukasafunga nezve yazvino exotics, saka iyo chaiyo yekumisikidzwa kwemaseva mune rack haina basa. Iye zvino tine rimwe dambudziko - mutengo wenzvimbo inobatwa nevhavha mu data data, kureva, nzvimbo mu rack.

Taona kuti ndizvo zvazvaiva, takasarudza kuverenga kuti taishandisa sei machira.
Isu takatora mutengo we server ine simba zvakanyanya kubva kune inotenderwa hupfumi, takaverenga kuti ingani maseva akadaro atinogona kuisa muma racks, mangani mabasa atingaite paari zvichienderana neiyo yekare modhi "sevha imwe = basa rimwe" uye yakawanda sei yakadaro. mabasa anogona kushandisa midziyo. Vakaverenga vakayeredza misodzi. Zvakazoitika kuti kushanda kwedu mukushandisa racks kunenge 11%. Mhedziso iri pachena: tinoda kuwedzera kushanda kwekushandisa data data. Zvingaita sekuti mhinduro iri pachena: unofanirwa kumhanya akati wandei mabasa pane imwe sevha kamwechete. Asi apa ndipo panotangira matambudziko.

Misa gadziriso inova yakaoma zvakanyanya - hazvigoneke kugovera chero boka rimwe kune server. Mushure mezvose, ikozvino mabasa akati wandei emirairo yakasiyana anogona kutangwa pane imwe server. Uyezve, iyo gadziriso inogona kunge ichipokana kune akasiyana maapplication. Kuongororwa kunowedzera kuoma: kana iwe ukaona yakawedzera CPU kana dhisiki kushandiswa pane sevha, hauzive kuti nderipi basa riri kukonzera dambudziko.

Asi chinhu chikuru ndechekuti hapana kuparadzaniswa pakati pemabasa anomhanya pamushini mumwe chete. Pano, semuenzaniso, igirafu yeavhareji yekupindura nguva yebasa reseva pamberi uye mushure meimwe computational application yakatangwa pane imwechete server, pasina nzira ine chekuita neyekutanga - nguva yekupindura yebasa guru yakawedzera zvakanyanya.

Zviripachena, iwe unofanirwa kumhanyisa mabasa mungave mumidziyo kana mumashini chaiwo. Sezvo anenge ese emabasa edu achimhanya pasi peOs imwe (Linux) kana kuchinjirwa iyo, isu hatidi kutsigira akawanda akasiyana masisitimu anoshanda. Nekuda kweizvozvo, virtualization haidiwe; nekuda kweiyo yekuwedzera pamusoro, ichave isina kunyatso shanda pane kutakura midziyo.

Sekuitwa kwemidziyo yekumhanyisa mabasa zvakananga pamaseva, Docker mumiriri akanaka: faira system mifananidzo inogadzirisa matambudziko nekupokana masisitimu. Icho chokwadi chekuti mifananidzo inogona kuumbwa nemateru akati wandei inotibvumira kudzikisa zvakanyanya huwandu hwe data inodiwa kuti ivaise pazvivakwa, kuparadzanisa zvikamu zvakajairika muzvikamu zvakasiyana. Ipapo iwo ekutanga (uye akanyanya voluminous) akaturikidzana anozovharirwa nekukasira mukati mese kwese kwezvivakwa, uye kuendesa akawanda akasiyana marudzi ekushandisa uye neshanduro, madiki maturu chete anozofanira kutamiswa.

Uyezve, registry-yakagadzirwa-yakagadzirwa uye tagging yemufananidzo muDocker inotipa zvakagadzirirwa-zvakagadzirwa zvekutanga zvekushandura uye kuendesa kodhi mukugadzira.

Docker, senge chero imwe tekinoroji yakafanana, inotipa imwe nhanho yekuzviparadzanisa nevamwe kunze kwebhokisi. Semuenzaniso, kusarudzika kwekurangarira - mudziyo wega wega unopihwa muganho pakushandiswa kwemushini ndangariro, kupfuura iyo isingadyi. Iwe unogona zvakare kupatsanura midziyo zvichienderana neCPU kushandiswa. Kwatiri, zvisinei, kuvharisa kwakajairika kwakanga kusina kukwana. Asi zvakanyanya pane izvo pazasi.

Kumhanyisa midziyo pamaseva ingori chikamu chedambudziko. Chimwe chikamu chine chekuita nekugamuchira midziyo pamaseva. Iwe unofanirwa kunzwisisa kuti ndeipi mudziyo unogona kuiswa pane iyo server. Iri harisi basa riri nyore kudaro, nekuti midziyo inoda kuiswa pamaseva zvakanyanya sezvinobvira pasina kudzikisa kumhanya kwavo. Kuiswa kwakadaro kunogonawo kuve kwakaoma kubva kune kukanganisa kushivirira maonero. Kazhinji tinoda kuisa zvinyorwa zvebasa rimwechete mumaraki akasiyana kana kunyange mumakamuri akasiyana e data center, kuitira kuti kana rack kana kamuri ikakundikana, hatisi pakarepo kurasikirwa nezvose zvinyorwa zvebasa.

Kugovera midziyo nemaoko haisi sarudzo kana uine 8 zviuru maseva uye 8-16 zviuru zvemidziyo.

Pamusoro pezvo, taida kupa vanogadzira rusununguko rwakawanda mukugova zviwanikwa kuitira kuti vagone kubata masevhisi avo mukugadzira ivo pachavo, pasina rubatsiro rwemutungamiriri. Panguva imwecheteyo, isu taida kuchengetedza kutonga kuitira kuti mamwe madiki sevhisi asashandise zvese zviwanikwa zve data data centers.

Zviripachena, isu tinoda control layer yaizoita izvi otomatiki.

Saka takasvika pamufananidzo wakapfava uye unonzwisisika unoyeukwa nevavaki vese: mativi matatu.

one-cloud masters iboka rakakundikana rinotarisira gore orchestration. Mugadziri anotumira manifest kuna tenzi, iyo ine ruzivo rwese rwunodiwa kuitisa sevhisi. Zvichibva pazviri, tenzi anopa mirairo kune akasarudzwa maminion (michina yakagadzirirwa kumhanyisa midziyo). Maminion ane mumiririri wedu, anogamuchira murairo, anopa mirairo yawo kuDocker, uye Docker inogadzirisa linux kernel kuti itange mudziyo unoenderana. Pamusoro pekuita mirairo, mumiririri anoramba achiudza tenzi nezve shanduko mune ese ari maviri minion muchina uye midziyo inomhanya pairi.

Resource allocation

Zvino ngatitarisei dambudziko rezvakaoma zviwanikwa zvekugovera kune akawanda maminion.

A computing sosi mune rimwe-gore ndeiyi:

• Huwandu hwesimba re processor rinopedzwa nerimwe basa.
• Kuwanda kwekuyeuka kunowanikwa kune basa.
• Network traffic. Imwe neimwe yemaminioni ine chaiyo network interface ine shoma bandwidth, saka hazvibviri kugovera mabasa pasina kufunga nezvehuwandu hwe data yavanotumira pane network.
• Disks. Mukuwedzera, zviri pachena, kune nzvimbo yemabasa aya, tinogoverawo rudzi rwe disk: HDD kana SSD. Madhisiki anogona kushandira nhamba inopera yezvikumbiro pasekondi - IOPS. Naizvozvo, pamabasa anogadzira maIOPS akawanda kupfuura dhisiki rimwe chete rinogona kubata, isu tinogoverawo "spindles" - kureva, dhisiki dhizaini inofanirwa kuchengeterwa basa racho chete.

Zvino kune imwe sevhisi, semuenzaniso wemushandisi-cache, tinogona kurekodha zviwanikwa zvakadyiwa nenzira iyi: mazana mana eprocessor cores, 400 TB yendangariro, 2,5 Gbit/s traffic mumativi ese, 50 TB yeHDD nzvimbo iri pa6 spindles. Kana mune imwe yakajairika fomu seizvi:

alloc:
    cpu: 400
    mem: 2500
    lan_in: 50g
    lan_out: 50g
    hdd:100x6T

Mushandisi-cache sevhisi zviwanikwa zvinongotora chikamu chezvese zviripo zviwanikwa mumagadzirirwo ekugadzira. Naizvozvo, ini ndoda kuve nechokwadi chekuti kamwe kamwe, nekuda kwechikanganiso chemushandisi kana kwete, mushandisi-cache haadye zvakawanda zviwanikwa pane zvakagoverwa kwairi. Kureva kuti tinofanira kuganhura zviwanikwa. Asi chii chatingasungira mugove wacho?

Ngatidzokei kudhiyagiramu yedu yakarerutswa yekudyidzana kwezvikamu uye toidhirowa zvakare nezvimwe zvakawanda - sezvizvi:

Chii chinobata ziso rako:

• Iyo webhu kumberi uye mimhanzi inoshandisa ega masumbu eiyo yakafanana application server.
• Isu tinokwanisa kusiyanisa mativi ane musoro ayo masumbu aya: mafronts, cache, kuchengetedza data uye manejimendi layer.
• Iyo yekumberi ndeye heterogeneous; ine akasiyana anoshanda subsystems.
• Cache inogona zvakare kupararira kune iyo subsystem iyo data yavanochengeta.

Ngatidhirowei mufananidzo zvakare:

Bah! Hongu, tinoona hutungamiri! Izvi zvinoreva kuti iwe unokwanisa kugovera zviwanikwa muzvikamu zvakakura: isa mugadziri ane mutoro kune imwe nzvimbo yehierarchy inoenderana neiyo inoshanda subsystem (se "mimhanzi" iri pamufananidzo), uye batanidza chikamu kune imwecheteyo nhanho yehierarchy. Uhwu hutongi hunotibvumirawo kuronga masevhisi zviri nyore kuti manejimendi ave nyore. Semuyenzaniso, tinopatsanura dandemutande rese, sezvo uku kuri kuunganidzwa kwakakura kwazvo kwemaseva, kuita mapoka madiki akati wandei, anoratidzwa pamufananidzo segroup1, group2.

Nekubvisa mitsara yekuwedzera, tinogona kunyora imwe neimwe node yemufananidzo wedu mune yakapfava fomu: group1.web.mberi, api.music.front, user-cache.cache.

Aya ndiwo maitiro atinosvika kune pfungwa ye "hierarchical queue". Rine zita rakaita se "group1.web.front". A quota yezviwanikwa uye kodzero dzevashandisi inopihwa kwairi. Isu tichapa munhu kubva kuDevOps kodzero dzekutumira sevhisi kumutsara, uye mushandi akadaro anogona kutanga chimwe chinhu mumutsara, uye munhu anobva kuOpsDev achava nekodzero dzekutonga, uye zvino anogona kubata mutsara, kugovera vanhu ipapo, ipai vanhu ava kodzero, nezvimwewo. Masevhisi ari kushanda pamutsara uyu achaitwa mukati mechikamu chemutsetse. Kana iyo queue computing quota isina kukwana kuita masevhisi ese kamwechete, anobva aitwa achitevedzana, nokudaro achigadzira mutsara pachawo.

Ngatinyatso tarisisa masevhisi. Sevhisi ine zita rakanyatsokodzera, iro rinogara richisanganisira zita remutsetse. Ipapo iyo yepamberi sevhisi yewebhu ichava nezita ok-web.group1.web.front. Uye iyo application server sevhisi yainowana ichadaidzwa ok-app.group1.web.front. Sevhisi yega yega ine manifest, iyo inotsanangura ruzivo rwese rwunodiwa pakuiswa pamakina chaiwo: ingani zviwanikwa zvinodyiwa nebasa iri, ndeipi gadziriso inodiwa kwairi, vangani replicas panofanirwa kunge paine, zvivakwa zvekubata kutadza kwebasa iri. Uye mushure mekunge sevhisi yakaiswa zvakananga pamakina, zviitiko zvaro zvinoonekwa. Ivo zvakare vanotumidzwa zvisina kujeka - seyemuenzaniso nhamba uye zita rebasa: 1.ok-web.group1.web.front, 2.ok-web.group1.web.front, ...

Izvi zviri nyore kwazvo: nekutarisa chete pazita remudziyo unomhanya, tinogona kubva tawana zvakawanda.

Zvino ngatitarisei zvakanyanya izvo zviitiko izvi zvinonyatsoita: mabasa.

Basa Kuzviparadzanisa nevamwe Makirasi

Mabasa ese ari mu OK (uye, pamwe, pese pese) anogona kukamurwa kuita mapoka:

• Short Latency Mabasa - prod. Kune mabasa akadaro uye masevhisi, kunonoka kwekupindura (latency) kwakakosha, nekukurumidza sei chimwe nechimwe chezvikumbiro chichagadziriswa nehurongwa. Mienzaniso yemabasa: webhu kumberi, cache, maseva ekushandisa, OLTP chengetedzo, nezvimwe.
• Matambudziko ekuverenga - batch. Pano, kumhanya kwekugadzirisa kwechikumbiro chega chega hakuna kukosha. Kwavari, zvakakosha kuti maverengero mangani basa iri richaita mune imwe nguva (yakareba) yenguva (kuburikidza). Aya achave chero mabasa eMepuReduce, Hadoop, kudzidza muchina, nhamba.
• Background mabasa - idle. Kune mabasa akadai, hapana latency kana throughput yakakosha zvikuru. Izvi zvinosanganisira bvunzo dzakasiyana, kutama, kuverengazve, uye shanduko yedata kubva kune imwe fomati kuenda kune imwe. Kune rimwe divi, iwo akafanana neakaverengerwa, kune rumwe rutivi, hazvina basa kwatiri kuti zvinopedzwa nekukurumidza sei.

Ngationei kuti mabasa akadaro anodya sei zviwanikwa, semuenzaniso, iyo yepakati processor.

Mabasa mapfupi ekunonoka. Basa rakadaro richava neCPU yekushandisa pateni yakafanana neiyi:

Chikumbiro kubva kumushandisi chinogamuchirwa kuti chigadziriswe, basa rinotanga kushandisa ese aripo eCPU cores, anorigadzirisa, anodzosera mhinduro, anomirira kunotevera chikumbiro uye anomira. Chikumbiro chinotevera chakasvika - zvakare takasarudza zvese zvaivepo, takazviverenga, uye takamirira inotevera.

Kuvimbisa hushoma latency yebasa rakadaro, isu tinofanirwa kutora iyo yakanyanya zviwanikwa yainoshandisa uye kuchengetedza iyo inodiwa nhamba yemacores pane minion (muchina unozoita basa racho). Ipapo iyo yekuchengetera fomula yedambudziko redu ichave seizvi:

alloc: cpu = 4 (max)

uye kana tine minion muchina ane 16 cores, ipapo chaizvo mana mabasa akadaro anogona kuiswa pairi. Isu tinonyanya kucherekedza kuti avhareji processor kushandiswa kwemabasa akadaro kunowanzo kuderera - izvo zviri pachena, sezvo chikamu chakakosha chenguva iyo basa rinomirira chikumbiro uye hariite chinhu.

Mabasa ekuverenga. Muenzaniso wavo uchave wakasiyana zvishoma:

Avhareji yeCPU zviwanikwa zvekushandisa kumabasa akadaro yakakwira zvakanyanya. Kazhinji isu tinoda kuti basa rekuverenga ripedze mune imwe nguva yenguva, saka isu tinofanirwa kuchengetedza huwandu hushoma hwema processor hwainoda kuitira kuti kuverenga kwese kupedziswe munguva inogamuchirwa. Yayo reservation formula ichaita seizvi:

alloc: cpu = [1,*)

"Ndokumbira uiise pane imwe minion pane imwechete yemahara musimboti, uyezve yakawanda sezvairi, ichamedza zvese."

Pano kushanda kwekushandisa kwatova nani kupfuura pamabasa nekunonoka kwenguva pfupi. Asi iyo pfuma ichave yakakura kana ukabatanidza ese marudzi emabasa pamushini mumwe we minion uye nekugovera zviwanikwa zvayo pakufamba. Kana basa rine kunonoka kupfupi richida processor, rinorigamuchira nekukasira, uye kana zviwanikwa zvisisadiwe, zvinoendeswa kune iyo computational basa, i.e. chimwe chinhu chakadai:

Asi sei kuzviita?

Kutanga, ngatitarisei prod uye alloc yayo: cpu = 4. Tinofanira kuchengetedza macores mana. MuDocker run izvi zvinogona kuitwa nenzira mbiri:

• Kushandisa sarudzo --cpuset=1-4, kureva kugovera macores mana chaiwo pamushini kune basa racho.
• Kushandisa --cpuquota=400_000 --cpuperiod=100_000, govera chikamu chenguva ye processor, i.e. ratidza kuti 100 ms yega yega yenguva chaiyo basa racho haritore kupfuura 400 ms ye processor nguva. Iwo macores mana akafanana anowanikwa.

Asi ndeipi yeiyi nzira dzakakodzera?

cpuset inotaridzika chaizvo. Iro basa rine macores mana akazvitsaurira, zvinoreva kuti processor cache ichashanda nemazvo sezvinobvira. Izvi zvakare zvine zvazvinoreva: isu taizofanirwa kutora basa rekugovera macalculation pamativi asina kurodha macores emuchina pachinzvimbo cheOS, uye iri ibasa risiri diki, kunyanya kana tikaedza kuisa batch mabasa pane yakadaro. muchina. Miedzo yakaratidza kuti sarudzo ine quota inokodzera zviri nani pano: nenzira iyi sisitimu yekushandisa ine rusununguko rwakawanda pakusarudza musimboti wekuita basa panguva ino uye nguva yepurosesa inogoverwa zvakanyanya.

Ngationei kuti tingaite sei kuchengetedza muDocker zvichibva pahuwandu hushoma hwemacores. Iyo quota yebasa rebatch haichashande, nekuti hapana chikonzero chekudzikamisa iyo yakanyanya, inokwana kungovimbisa hushoma. Uye pano sarudzo inokodzera zvakanaka docker run --cpushares.

Isu takabvumirana kuti kana batch ichida vimbiso kune imwechete core, tobva taratidza --cpushares=1024, uye kana paine angangoita maviri cores, tobva taratidza --cpushares=2048. Cpu migove haipindire munzira ipi neipi nekugoverwa kwe processor nguva chero paine yakakwana. Nekudaro, kana prod isiri kushandisa parizvino ese ayo macores, hapana chinomisa batch mabasa, uye vanogona kushandisa imwe processor nguva. Asi mumamiriro ezvinhu apo pane kushomeka kwema processors, kana prod yapedza ese mana macores ayo uye yasvika quota yayo, yasara processor nguva ichapatsanurwa zvakaenzana kune cpushares, i.e. mune matatu emahara cores, imwe ichave kupihwa basa rine 1024 cpushare, uye maviri asara achapihwa kuita basa ne2048 cpushares.

Asi kushandisa quota uye migove hakuna kukwana. Isu tinofanirwa kuve nechokwadi chekuti basa nekunonoka kupfupi rinogashira pamberi pebasa rebatch pakugovera processor nguva. Pasina kukoshesa kwakadai, basa rebatch rinotora nguva yese ye processor panguva iyo inenge ichidiwa neprod. Iko hakuna midziyo yekuisa pamberi sarudzo muDocker run, asi Linux CPU scheduler marongero anouya anobatsira. Iwe unogona kuverenga pamusoro pavo zvakadzama pano, uye mukati megadziriro yechinyorwa chino tichaenda kuburikidza navo muchidimbu:

• SCHED_OTHER
  Nekumisikidza, ese akajairwa mushandisi maitiro pamushini weLinux anogashira.
• SCHED_BATCH
  Yakagadzirirwa maitiro ekushandisa zvakanyanya. Pakuisa basa pane processor, inonzi activation chirango inounzwa: basa rakadaro kashoma kuwana processor zviwanikwa kana parizvino riri kushandiswa nebasa rine SCHED_OTHER.
• SCHED_IDLE
  Iyo yekumashure maitiro ine yakaderera zvakanyanya kukosha, kunyangwe yakaderera pane yakanaka -19. Isu tinoshandisa yedu open source raibhurari imwe-nio, kuitira kuti uise mutemo unodiwa paunotanga mudziyo nekufona

one.nio.os.Proc.sched_setscheduler( pid, Proc.SCHED_IDLE )

Asi kunyangwe ukasaronga muJava, chinhu chimwe chete chinogona kuitwa uchishandisa chrt command:

chrt -i 0 $pid

Ngatipei muchidimbu mazinga edu ese ekuzviparadzanisa nevamwe mutafura imwe kuti ijekeswe:

Insulation kirasi
Alloc Muenzaniso
Docker run sarudzo
sched_setscheduler chrt*

Prod
cpu = 4
--cpuquota=400000 --cpuperiod=100000
SCHED_OTHER

Chikamu
Cpu = [1, *)
--cpushares=1024
SCHED_BATCH

Wamasimba
Cpu= [2, *)
--cpushares=2048
SCHED_IDLE

*Kana iwe uri kuita chrt kubva mukati memudziyo, ungangoda iyo sys_nice kugona, nekuti nekusarudzika Docker inobvisa iyi kugona kana uchitanga mudziyo.

Asi mabasa anodya kwete chete processor, asiwo traffic, iyo inokanganisa latency ye network basa zvakanyanya kupfuura kugovaniswa kwakashata kweprocessor zviwanikwa. Naizvozvo, isu takazvarwa tinoda kuwana iwo chaiwo mufananidzo wetraffic. Ndokunge, kana prod basa rinotumira mamwe mapaketi kunetiweki, tinodzikamisa iyo yakanyanya kumhanya (formula alloc: lan=[*,500mbps) ), iyo prod inogona kuita izvi. Uye kune batch isu tinovimbisa chete iyo yakaderera throughput, asi usaganhure iyo yakanyanya (formula alloc: lan=[10Mbps,*) ) Muchiitiko ichi, prod traffic inofanirwa kugashira pamberi pebatch mabasa.
Pano Docker haina chero maprimitives atinogona kushandisa. Asi zvinouya kuzotibatsira Linux Traffic Control. Takakwanisa kuwana chigumisiro chaidiwa nerubatsiro rwechirango Hierarchical Fair Service Curve. Nerubatsiro rwayo, tinosiyanisa makirasi maviri etraffic: yepamusoro-yekutanga prod uye yakaderera-yekutanga batch/isimbe. Nekuda kweizvozvo, iyo gadziriso yeinobuda traffic yakaita seiyi:

pano 1:0 ndiyo "mudzi qdisc" yechirango chehsfc; 1: 1 - hsfc kirasi yemwana ine yakazara bandwidth muganho we8 Gbit / s, pasi iyo makirasi emwana emidziyo yese akaiswa; 1:2 - kirasi yemwana yehsfc yakajairika kune ese mabhechi uye asina basa mabasa ane "simba" muganhu, inokurukurwa pazasi. Iwo asara ehsfc makirasi evana makirasi akatsaurirwa kune parizvino arikumhanyisa midziyo ine miganho inoenderana nekuratidzira kwavo - 450 uye 400 Mbit/s. Yega yega hsfc kirasi inopihwa qdisc queue fq kana fq_codel, zvichienderana neLinux kernel vhezheni, kudzivirira kurasikirwa kwepaketi panguva yekuputika kwemotokari.

Kazhinji, tc chirango chinoshanda kuisa pamberi chete inobuda traffic. Asi isu tinoda kukoshesa traffic inouya zvakare - mushure mezvose, rimwe batch basa rinogona kusarudza nyore chiteshi chese chiri kuuya, kugamuchira, semuenzaniso, batch hombe yedata rekuisa mepu&kuderedza. Kune izvi tinoshandisa module ifb, iyo inogadzira iyo ifbX chaiyo interface kune yega yega network uye inodzosera traffic inouya kubva kune inoenda kune inobuda traffic paifbX. Kupfuurirazve, kune ifbX, dzidziso dzese dzakafanana dzinoshanda kudzora traffic inobuda, iyo iyo hsfc gadziriso ichave yakafanana:

Munguva yezviyedzo, takaona kuti hsfc inoratidza zvakanakisa mhedzisiro apo iyo 1: 2 kirasi yevasina-kutanga batch / isina basa traffic yakaganhurirwa pamichina mishoma kusapfuura imwe nzira yemahara. Zvikasadaro, isiri-yekutanga traffic ine yakawandisa kukanganisa pane latency yeprod mabasa. miniond inosarudza huwandu hwazvino hwemahara bandwidth sekondi yega yega, kuyera avhareji yekushandisa traffic yeese prod-mabasa eiyo minion yakapihwa. uye kuibvisa kubva kunetiweki interface bandwidth ine muganhu muduku, i.e.

Mabhendi anotsanangurwa akazvimiririra kune anouya uye anobuda traffic. Uye maererano nehutsva hutsva, miniond inogadzirisa iyo isiri-yekutanga kirasi muganho 1: 2.

Nekudaro, isu takaita ese matatu makirasi ekuzviparadzanisa nevamwe: prod, batch uye idle. Aya makirasi anokanganisa zvakanyanya maitiro ekuita kwemabasa. Naizvozvo, isu takasarudza kuisa hunhu uhu pamusoro pehutongi, kuitira kuti kana tichitarisa zita remutsetse wehumambo zvinobva zvajeka zvatiri kubata nazvo:

Shamwari dzedu dzese dandemutande и mumhanzi ma front anozoiswa mu hierarchy pasi pe prod. Semuenzaniso, pasi pebatch, ngatiise sevhisi music catalog, iyo nguva nenguva inounganidza bhuku remateki kubva pane seti ye mp3 mafaera akaiswa kuOdnoklassniki. Muenzaniso webasa riri pasi pekusashanda ungave music transformer, iyo inogadzirisa huwandu hwemhanzi.

Nemitsetse yekuwedzera yakabviswa zvakare, tinogona kunyora mazita edu ebasa zvakapfava nekuwedzera kirasi yekuzviparadzanisa nevamwe kusvika kumagumo ezita rebasa rakazara: web.front.prod, catalog.music.batch, transformer.music.idle.

Uye zvino, tichitarisa zita rebasa racho, hatinzwisisi chete kuti rinoita basa rei, asiwo kirasi yaro yekuzviparadzanisa nevamwe, zvinoreva kukosha kwayo, nezvimwe.

Zvese zvakanaka, asi pane chokwadi chinorwadza. Hazvibviri kuparadzanisa zvachose mabasa ari kushanda pamushini mumwe.

Zvatakakwanisa kuzadzisa: kana batch ichidya zvakanyanya chete CPU zviwanikwa, ipapo iyo yakavakirwa-mukati Linux CPU scheduler inoita basa rayo nemazvo, uye hapana chinombokanganisa pane prod basa. Asi kana iri batch basa rinotanga kushanda nesimba nekuyeuka, ipapo kuwirirana kunotooneka. Izvi zvinoitika nekuti iyo prod basa "yakagezwa kunze" ye processor's memory cache - semhedzisiro, cache inopotsa inowedzera, uye processor inogadzirisa basa reprod zvishoma nezvishoma. Batch rakadaro basa rinogona kuwedzera latency yeyakajairwa prod mudziyo ne10%.

Kuparadzanisa traffic kwakatonyanya kuoma nekuda kwekuti makadhi etiweki emazuva ano ane mutsara wemukati wemapakiti. Kana iyo packet kubva pabatch basa yasvika ipapo kutanga, zvino ichave yekutanga kutumirwa pamusoro petambo, uye hapana chinogona kuitwa nezvazvo.

Mukuwedzera, isu takangokwanisa kugadzirisa dambudziko rekuisa mberi TCP traffic: iyo hsfc nzira haishandi kuUDP. Uye kunyangwe muchiitiko cheTCP traffic, kana batch basa richiburitsa traffic yakawanda, izvi zvinopawo nezve 10% kuwedzera mukunonoka kweiyo prod basa.

kukanganisa kushivirira

Chimwe chezvinangwa pakugadzira gore-rimwe kwaive kugadzirisa kukanganisa kushivirira kweOdnoklassniki. Naizvozvo, chinotevera ndinoda kufunga zvakadzama zvinokwanisika zviitiko zvekutadza uye tsaona. Ngatitangei neyakapusa mamiriro - kutadza kwemudziyo.

Iyo mudziyo pachayo inogona kukundikana munzira dzakawanda. Izvi zvinogona kuve imwe mhando yekuyedza, bug kana kukanganisa mumanifest, nekuda kweiyo prod basa rinotanga kushandisa zviwanikwa zvakawanda kupfuura zvakaratidzwa mumanifest. Isu takanga tine nyaya: mugadziri akaita imwe yakaoma algorithm, akaigadzirisa kakawanda, akazvifunga uye akavhiringika zvekuti dambudziko rakazopedzwa nenzira isiri-diki. Uye sezvo basa reprod rine chinzvimbo chepamusoro kupfuura mamwe ese pamionni imwechete, yakatanga kushandisa zvese zviripo processor zviwanikwa. Mumamiriro ezvinhu aya, kuzviparadzanisa nevamwe, kana kuti CPU nguva quota, yakachengetedza zuva. Kana basa rikagoverwa quota, basa racho haringadyi zvakawanda. Naizvozvo, batch uye mamwe mabasa eprod aimhanya pamushini mumwe chete haana kucherechedza chero chinhu.

Dambudziko rechipiri rinogona kuitika ndiro rinodonha. Uye pano restart marongero tiponese, munhu wese anozviziva, Docker pachayo inoita basa rakakura. Anenge ese mabasa eprod ane anogara achitangazve mutemo. Dzimwe nguva tinoshandisa on_failure yebasa rebatch kana kugadzirisa midziyo yeprod.

Chii chaungaita kana mudiki wese asipo?

Zviripachena, mhanyisa mudziyo pane mumwe muchina. Chikamu chinonakidza apa ndicho chinoitika kune IP kero (es) yakapihwa mugaba.

Tinogona kugovera midziyo yakafanana nekero yeIP semichina minion inomhanyisa midziyo iyi. Zvino, kana mudziyo wavhurwa pane mumwe muchina, IP kero yayo inoshanduka, uye vatengi vese vanofanirwa kunzwisisa kuti mudziyo watama, uye zvino vanofanirwa kuenda kune imwe kero, iyo inoda yakaparadzana Service Discovery service.

Service Discovery iri nyore. Kune akawanda mhinduro pamusika weakasiyana madhigirii ekushivirira kukanganisa pakuronga registry yebasa. Kazhinji mhinduro dzakadai dzinoshandisa mutoro wekuenzanisa, chengetedza imwe gadziriso muchimiro cheKV kuchengetedza, nezvimwe.
Nekudaro, isu tinoda kudzivirira kudiwa kwekushandisa yakaparadzana registry, nekuti izvi zvinoreva kuunza yakakosha sisitimu inoshandiswa nemasevhisi ese mukugadzira. Izvi zvinoreva kuti iyi inzvimbo inogona kutadza, uye iwe unofanirwa kusarudza kana kugadzira mhinduro inoshivirira zvakanyanya, izvo zviri pachena kuti zvakaoma, zvinotora nguva uye zvinodhura.

Uye imwe hombe dhizaini: kuitira kuti yedu yekare zvivakwa zvishande neitsva, isu taizofanira kunyora zvachose mabasa ese kushandisa imwe mhando yeSevhisi Discovery system. Kune ROTI yebasa, uye mune dzimwe nzvimbo hazvigoneke kana zvasvika kune yakaderera-level zvishandiso zvinoshanda paOS kernel level kana zvakananga nehardware. Kuitwa kweichi chiitiko uchishandisa yakagadziriswa mhinduro mapatani, senge side-mota zvingareva mune dzimwe nzvimbo mutoro wekuwedzera, mune dzimwe - complication yekushanda uye mamwe mamiriro ekukundikana. Hatina kuda kuomesa zvinhu, saka takasarudza kushandisa Sevhisi Discovery sarudzo.

Mune rimwe-gore, iyo IP inotevera mudziyo, kureva kuti yega yega chiitiko ine yayo IP kero. Kero iyi ndeye "static": inopihwa kune yega yega kana sevhisi yatanga kutumirwa kune gore. Kana sevhisi yaive nenhamba dzakasiyana dzezviitiko mukati mehupenyu hwayo, ipapo pakupedzisira ichapihwa akawanda IP kero sezvaive nepamusoro zviitiko.

Zvadaro, kero idzi hadzishanduki: dzinopihwa kamwe chete uye dzinoramba dziripo muhupenyu hwese hwesevhisi mukugadzira. IP kero dzinotevera midziyo pane network. Kana mudziyo ukaendeswa kune imwe minion, ipapo kero inoitevera.

Nekudaro, iyo mepu yezita resevhisi kune rondedzero yayo yeIP kero inoshanduka kashoma. Kana iwe ukatarisa zvakare pamazita ezviitiko zvebasa zvatakataura pakutanga kwechinyorwa (1.ok-web.group1.web.front.prod, 2.ok-web.group1.web.front.prod, ...), tichaona kuti akafanana neFQDNs anoshandiswa muDNS. Ndizvozvo, kumepu mazita ezviitiko zvebasa kune avo IP kero, isu tinoshandisa iyo DNS protocol. Uyezve, iyi DNS inodzosa ese akachengeterwa IP kero emidziyo yese - ese ari kushanda uye akamira (ngatitii matatu akadzokorora anoshandiswa, uye isu tine kero shanu dzakachengetwa ipapo - ese ari mashanu achadzoserwa). Vatengi, vagamuchira ruzivo urwu, vanoedza kumisikidza chinongedzo nezvose zvishanu replicas - uye nokudaro vanosarudza avo vari kushanda. Iyi sarudzo yekuona kuwanikwa inovimbika zvakanyanya; haisanganisi kana DNS kana Service Discovery, zvinoreva kuti hapana matambudziko akaoma kugadzirisa mukuona kukosha kweruzivo uye kukanganisa kushivirira kweaya masisitimu. Uyezve, mumasevhisi akakosha ayo kushanda kweiyo portal yese kunoenderana, isu hatigone kushandisa DNS zvachose, asi ingo pinza IP kero mukugadzirisa.

Kuita kufambisa kwakadaro kweIP kuseri kwemidziyo kunogona kunge kusiri diki - uye isu tichatarisa kuti inoshanda sei nemuenzaniso unotevera:

Ngatitii tenzi-gore rimwe anopa murairo kune minion M1 kumhanya 1.ok-web.group1.web.front.prod ine kero 1.1.1.1. Inoshanda pane minion SHIRI, iyo inoshambadzira kero iyi kune yakakosha maseva nzira reflector. Iyo yekupedzisira ine chirongwa cheBGP ine network network, iyo nzira yekero 1.1.1.1 paM1 inoshandurwa. M1 nzira mapaketi mukati memudziyo uchishandisa Linux. Kune matatu enzira anoratidza maseva, sezvo ichi chiri chikamu chakaomarara cheimwe-gore zvivakwa - pasina ivo, network mune rimwe-gore haishande. Isu tinovaisa mumaraki akasiyana, kana zvichibvira ari mumakamuri akasiyana enzvimbo yedata, kuderedza mukana wevose vatatu vanokundikana panguva imwe chete.

Ngatifungei kuti kubatana pakati peiyo-gore tenzi uye M1 minion kwarasika. Iyo-yegore tenzi zvino achaita pane fungidziro yekuti M1 yakundikana zvachose. Ndiko kuti, ichapa murairo kuM2 minion kuti itange web.group1.web.front.prod nekero yakafanana 1.1.1.1. Iye zvino tine nzira mbiri dzinopesana pane network ye 1.1.1.1: paM1 uye paM2. Kuti tigadzirise kusawirirana kwakadaro, tinoshandisa Multi Exit Discriminator, iyo inotsanangurwa muchiziviso cheBGP. Iyi inhamba inoratidza huremu hwenzira yakashambadzirwa. Pakati pemakwara anopesana, nzira ine yakaderera MED kukosha ichasarudzwa. Iyo-yegore tenzi inotsigira MED sechikamu chakakosha chemudziyo IP kero. Kwenguva yekutanga, kero yakanyorwa neMED = 1 000 yakakura zvakakwana. Mumamiriro ezvinhu akadaro ekufambisa chigadziko chekukurumidzira, tenzi anoderedza MED, uye M000 ichatogamuchira murairo wekuzivisa kero 2 neMED = 1.1.1.1 999. Chiitiko chinomhanya paM999 chicharamba chiripo munyaya iyi hapana chinobatanidzwa, uye zvimwe kuguma kwake kunotifadza zvishoma kusvikira kubatanidzwa natenzi kwadzorerwa, apo iye achamiswa sechinyakare kutora.

tsaona

Yese data centre manejimendi masisitimu anogara achibata kutadza kudiki zvinogamuchirika. Kufashukira kwemidziyo ndiyo yakajairika pese pese.

Ngatitarisei mabatiro atinoita emergency, sekutadza kwemagetsi mune imwe kana mamwe makamuri e data data.

Tsaona inorevei kune data center management system? Chekutanga pane zvese, uku kutadza kukuru kwekamwe-kwenguva kwemakina mazhinji, uye iyo control system inoda kutamisa akawanda midziyo panguva imwe chete. Asi kana njodzi yacho yakakura kwazvo, saka zvinogona kuitika kuti mabasa ese haagone kugoverwazve kune mamwe maminion, nekuti iyo resource resource yedata data inodonha pasi pe100% yemutoro.

Kazhinji tsaona dzinoperekedzwa nekukundikana kwekutonga layer. Izvi zvinogona kuitika nekuda kwekukundikana kwemidziyo yayo, asi kazhinji nekuda kwekuti njodzi hadzina kuedzwa, uye iyo control layer pachayo inowira nekuda kwekuwedzera mutoro.

Chii chaungaita pamusoro peizvi zvose?

Kutama kwevanhu vazhinji kunoreva kuti kune huwandu hukuru hwezviitwa, kutama, uye kutumirwa kunoitika muzvivakwa. Kutama kwega kwega kunogona kutora nguva inodikanwa kuendesa uye kuburitsa mifananidzo yezvigaba kune vatevedzeri, kutanga nekutanga midziyo, nezvimwewo. Naizvozvo, zvinoshuviwa kuti mabasa akanyanya kukosha atangwe asati anyanya kukosha.

Ngatitarisei zvakare kuhurongwa hwemasevhisi atinoziva uye toedza kusarudza kuti ndeapi mabasa atinoda kutanga taita.

Ehe, aya ndiwo maitiro anobatanidzwa zvakananga mukugadzirisa zvikumbiro zvevashandisi, i.e. prod. Tinoratidza izvi ne kuisa pamberi - nhamba inogona kugoverwa kumutsara. Kana mutsara uine zvakakosha zvakanyanya, masevhisi ayo anoiswa pekutanga.

Pane prod tinopa zvakakosha zvakanyanya, 0; pabatch - zvishoma pasi, 100; pane zvisina basa - kunyange yakaderera, 200. Zvinonyanya kukosha zvinoshandiswa hierarchically. Ese mabasa akadzikira muhuerarchy anozove neakakosha anoenderana. Kana tichida kuti cache mukati me prod itange kuvhurwa pamberi pemberi, tobva tapa zvinonyanya kukosha kune cache = 0 uye kumberi subqueues = 1. Kana, semuenzaniso, isu tichida iyo main portal kuti itange kuvhurwa kubva kumberi, uye mimhanzi pamberi chete. ipapo, ipapo tinogona kugovera yakaderera yekutanga kune yekupedzisira - 10.

Dambudziko rinotevera nderekushaya zvekushandisa. Saka, huwandu hukuru hwemidziyo, horo dzese dze data data, dzakatadza, uye takatangisa masevhisi akawanda zvekuti ikozvino hapana zviwanikwa zvakakwana kune wese munhu. Iwe unofanirwa kusarudza kuti ndeapi mabasa ekubayira kuitira kuti uchengetedze makuru akakosha masevhisi achimhanya.

Kusiyana nekuisa pamberi, isu hatigone kubaira zvisina tsarukano mabasa ese ebatch; mamwe acho akakosha pakushanda kweiyo portal. Naizvozvo, isu takasimbisa zvakasiyana kuregererwa kwekutanga mabasa. Kana yaiswa, basa repamusoro-soro rinogona kufanomirira, kureva kumira, basa rekutanga rakaderera kana kusisina vamiriri vemahara. Muchiitiko ichi, basa rine zvakakosha zvishoma richaramba risina kuiswa, i.e. hapachazovi neminion yakakodzera kune iyo ine zvakakwana zvemahara zviwanikwa.

Muhutungamiriri hwedu, zviri nyore kwazvo kudoma preemption preemption sekuti prod and batch tasks inotungamira kana kumisa mabasa asina basa, asi kwete mumwe nemumwe, nekudoma chinokosheswa chekusaita chakaenzana ne200. Sezvakaita muchiitiko chekuisa pekutanga, isu tinogona kushandisa hierarchy yedu kutsanangura mitemo yakaoma kunzwisisa. Semuyenzaniso, ngatiratidzei kuti tinopira mimhanzi basa kana tisina zviwanikwa zvakakwana zveiyo main web portal, tichiisa zvakakosha kune dzinoenderana node dzakaderera: 10.

Dc yese tsaona

Sei iyo data data yese ingatadza? Element. Yaiva post yakanaka dutu rakakanganisa basa re data data. Izvo zvinhu zvinogona kutorwa sevanhu vasina pekugara vakambopisa optics mune akawanda, uye iyo data data yakarasika zvachose kuonana nedzimwe nzvimbo. Chikonzero chekukundikana chinogonawo kuva chinhu chevanhu: mushandisi achabudisa murairo wakadaro kuti iyo yose data data ichawa. Izvi zvinogona kuitika nekuda kwebug hombe. Kazhinji, nzvimbo dze data dzinodonha hazvishamisi. Izvi zvinoitika kwatiri kamwe pamwedzi mishoma.

Uye izvi ndizvo zvatinoita kudzivirira chero munhu kubva ku tweeting #alive.

Nzira yekutanga ndeyekuzviparadzanisa nevamwe. Imwe neimwe yegore-imwe muenzaniso yakasarudzika uye inogona kubata michina mune imwe chete data data. Ndiko kuti, kurasikirwa kwegore nekuda kwebhugi kana zvisirizvo opareta mirairo ndiko kurasikirwa kweimwe chete data data. Isu takagadzirira izvi: isu tine redundancy policy umo replicas yemashandisirwo uye data iri munzvimbo dzese dzedata. Isu tinoshandisa kukanganisa-kushivirira dhatabhesi uye nguva nenguva kuyedza kutadza.
Kubva nhasi tine nzvimbo ina dzedata, zvinoreva mana akaparadzana, akasarudzika zviitiko zvegore rimwe.

Iyi nzira haingodziviriri pakutadza kwemuviri, asi inogona kudzivirira kubva mukukanganisa kwemushandisi.

Chii chimwe chinogona kuitwa nechinhu chemunhu? Kana mushandisi akapa gore rimwe zano risinganzwisisike kana rinogona kuva nengozi, anogona kungoerekana akumbirwa kugadzirisa dambudziko diki kuti aone kuti akafunga zvakanaka sei. Semuenzaniso, kana iyi iri imwe mhando yekumira kweakawanda replicas kana kungoita zvisinganzwisisike kuraira - kuderedza nhamba yezvinyorwa kana kushandura zita remufananidzo, uye kwete chete nhamba yeshanduro mune itsva manifest.

Migumisiro

Zvinosiyanisa zvegore rimwe:

• Hierarchical uye inoonekwa yekupa zita chirongwa chebasa uye midziyo, izvo zvinokutendera kuti unokurumidza kuziva kuti basa racho nderei, rinei nechokuita uye kuti rinoshanda sei uye kuti ndiani ane basa raro.
• Isu tinoshandisa yedu nzira yekubatanidza prod- uye batch-mabasa pamaminion kuvandudza kushanda kwemuchina wekugovana. Panzvimbo pecpuset tinoshandisa CPU quotas, migove, CPU scheduler marongero uye Linux QoS.
• Zvaisaita kutsaura zvachose midziyo inomhanya pamushini mumwe chete, asi kuwirirana kwavo kunoramba kuri mukati me20%.
• Kuronga masevhisi kuita hierarchy kunobatsira neotomatiki kudzoreredza njodzi uchishandisa kuisa uye kusachengetedzwa kwekutanga.

FAQ

Sei tisina kutora mhinduro yakagadzirwa?

• Makirasi akasiyana ekuzviparadzanisa ega basa anoda akasiyana mantiki kana akaiswa pamaminion. Kana mabasa eprod achigona kuiswa nekungochengeta zviwanikwa, ipapo batch uye mabasa asina basa anofanirwa kuiswa, kuronda mashandisirwo chaiwo ezviwanikwa pamichina minion.
• Iko kudikanwa kwekurangarira zviwanikwa zvinodyiwa nemabasa, akadai se:
  • network bandwidth;
  • marudzi uye "spindles" emadhisiki.
• Iko kudikanwa kwekuratidza zvinokoshesa masevhisi panguva yekupindura kwechimbichimbi, kodzero uye quotas yemirairo yezviwanikwa, iyo inogadziriswa uchishandisa hierarchical queues mune rimwe-gore.
• Kudiwa kwekupihwa mazita emidziyo yemidziyo kuderedza nguva yekupindura njodzi nezviitiko
• Iko kusagoneka kweimwe-nguva yakapararira kushandiswa kweSevhisi Discovery; iko kudiwa kwekugarisana kwenguva yakareba nemabasa anobatwa pane Hardware host - chimwe chinhu chinogadziriswa ne "static" IP kero inotevera midziyo, uye, nekudaro, kudiwa kwekubatanidzwa kwakasarudzika nehombe network network.

Ese mabasa aya angada kugadziridzwa kwakakosha kwemhinduro dziripo kuti dzienderane nesu, uye, taongorora huwandu hwebasa, takaona kuti tinogona kugadzira mhinduro yedu neinoda mari yevashandi. Asi mhinduro yako ichave iri nyore kushanda uye kusimudzira - haina zvimiro zvisina basa zvinotsigira mashandiro atisingade.

Kune avo vanoverenga mitsetse yekupedzisira, ndinokutendai nekushivirira kwako uye kutarisa!

Source: www.habr.com