Uku kuenderera mberi kwenyaya refu nezve nzira yedu ine minzwa yekugadzira ine simba, yakakwira-mutoro sisitimu inovimbisa kushanda kweiyo Exchange. Chikamu chekutanga chiri pano:
Kukanganisa kusinganzwisisike
Mushure mekuedzwa kwakawanda, iyo yakagadziridzwa yekutengesa uye yekuchenesa sisitimu yakaiswa mukushanda, uye isu takasangana nebug pamusoro payo isu taigona kunyora detective-mystical nyaya.
Nguva pfupi mushure mekutangisa pane main server, imwe yekutengeserana yakagadziriswa nekanganiso. Nekudaro, zvese zvaive zvakanaka pane backup server. Zvakazoitika kuti nyore masvomhu kushanda kwekuverenga exponent pane huru server yakapa mhedzisiro yakaipa kubva mukupokana chaiko! Takaenderera mberi netsvagiridzo yedu, uye murejista yeSSE2 takawana mutsauko mune imwe diki, iyo ine basa rekutenderedza kana uchishanda nenhamba dzinoyangarara.
Isu takanyora yakapusa bvunzo yekushandisa kuverenga exponent ine inotenderedza bit set. Zvakazoitika kuti mushanduro yeRedHat Linux yatakashandisa, pakanga paine tsikidzi mukushanda nebasa remasvomhu apo bhiti rakashata rakaiswa. Isu takashuma izvi kuRedHat, mushure mechinguva takagamuchira chigamba kubva kwavari ndokuchibvisa. Iko kukanganisa kwacho hakuna kuzoitika, asi zvanga zvisingazivikanwe kuti zvishoma izvi zvakabva kupi? Basa racho ndiro raiva nebasa racho fesetround kubva mumutauro weC. Takanyatsoongorora kodhi yedu mukutsvaga iyo yaifungidzirwa kukanganisa: takaongorora zvese zvinogoneka mamiriro; akatarisa mabasa ese akashandisa kutenderera; akaedza kuburitsa chikamu chakakundikana; akashandisa ma compilers akasiyana ane sarudzo dzakasiyana; Kuongorora kwakasimba uye kwakasimba kwakashandiswa.
Chikonzero chekukanganisa hachina kuwanikwa.
Vakabva vatanga kutarisa hardware: vakaita load test ye processors; akaongorora RAM; Isu takatomhanyisa bvunzo dzezvisingafungidzike mamiriro e-multi-bit kukanganisa muchitokisi chimwe. Zvakashaya basa.
Pakupedzisira, takagadzirisa dzidziso kubva kunyika yefizikisi yepamusoro-simba: imwe simba guru-guru rakabhururuka richienda munzvimbo yedu yedata, yakaboora rusvingo rwekesi, yakarova processor uye yakakonzera kuti trigger latch inamire mukati chaimo. Iyi dzidziso isina musoro yainzi "neutrino." Kana iwe uri kure nechikamu chefizikisi: neutrinos inenge isingadyidzane nenyika yekunze, uye zvirokwazvo haigone kukanganisa kushanda kwe processor.
Sezvo zvakanga zvisingabviri kuwana chikonzero chekukundikana, sevha "inogumbura" yakabviswa kubva pakushanda kana zvikaitika.
Mushure menguva yakati, takatanga kuvandudza iyo inopisa yekuchengetedza system: isu takaunza iyo inonzi "inodziya yekuchengetedza" (inodziya) - asynchronous replicas. Ivo vakagamuchira rukova rwekutengeserana kwaigona kuwanikwa munzvimbo dzakasiyana dze data, asi kudziya hakuna kuita kudyidzana nemamwe maseva.
Izvi zvakaitirwei? Kana iyo backup server ikatadza, saka inodziya yakasungirirwa kune main server inova iyo itsva backup. Ndiko kuti, mushure mekukundikana, iyo sisitimu hairambe iine imwe huru server kusvika pakupera kwechikamu chekutengesa.
Uye apo iyo vhezheni itsva yesystem yakayedzwa uye ikaiswa mukushanda, iyo inotenderedza bit kukanganisa yakaitika zvakare. Uyezve, nekuwedzera kwenhamba yemaseva anodziya, kukanganisa kwakatanga kuoneka kakawanda. Panguva imwe cheteyo, mutengesi akanga asina chinhu chokuratidza, sezvo pakanga pasina ufakazi chaihwoihwo.
Munguva yekuongorora kunotevera kwemamiriro ezvinhu, imwe dzidziso yakasimuka kuti dambudziko rinogona kunge rakabatana neOS. Isu takanyora chirongwa chakareruka chinodaidza basa mune risingaperi loop fesetround, inorangarira mamiriro azvino uye anoitarisa kuburikidza nehope, uye izvi zvinoitwa mushinda dzakawanda dzinokwikwidza. Tasarudza maparamendi ekurara uye nenhamba yetambo, takatanga kugara tichiburitsa kutadza mushure memaminitsi mashanu ekumhanyisa utility. Nekudaro, tsigiro yeRed Hat haina kukwanisa kuiburitsa. Kuyedzwa kwemamwe maseva edu kwakaratidza kuti avo chete vane mamwe ma processor ndivo vanogona kukanganisa. Panguva imwecheteyo, kuchinja kune kernel itsva kwakagadzirisa dambudziko. Pakupedzisira, isu takangotsiva OS, uye chikonzero chechokwadi chebug chakaramba chisina kujeka.
Uye kamwe kamwe gore rapfuura chinyorwa chakabudiswa paHabrΓ© "" Mamiriro ezvinhu anotsanangurwa mauri aive akafanana neyedu, asi munyori akaenderera mberi nekuferefeta ndokuisa dzidziso yekuti chikanganiso chiri mumicrocode. Uye kana Linux kernels ichigadziridzwa, vagadziri vanovandudzawo iyo microcode.
Kuwedzera kuvandudzwa kwehurongwa
Kunyangwe isu takabvisa chikanganiso, iyi nyaya yakatimanikidza kuti titarise zvakare magadzirirwo ehurongwa. Mushure mezvose, isu hatina kudzivirirwa kubva pakudzokorora kwezvipembenene zvakadaro.
Nheyo dzinotevera dzakaumba hwaro hwekuvandudzwa kunotevera kune reservation system:
- Iwe haugone kuvimba nemunhu. Masevha anogona kusashanda nemazvo.
- Majority reserve.
- Kuve nechokwadi chekubvumirana. Sekuwedzera kunonzwisisika kune ruzhinji kuchengetedza.
- Kukundikana kaviri kunogoneka.
- Vitality. Iyo itsva inopisa yekumira chirongwa haifanirwe kunge yakashata kupfuura yapfuura. Kutengeserana kunofanirwa kuenderera mberi pasina kukanganisa kusvika sevha yekupedzisira.
- Kuwedzera kudiki kwe latency. Chero nguva yekuzorora inosanganisira kurasikirwa kukuru kwemari.
- Minimal network yekudyidzana kuchengetedza latency yakaderera sezvinobvira.
- Kusarudza itsva master server mumasekonzi.
Hapana mhinduro iripo pamusika yakatikodzera, uye iyo Raft protocol yakanga ichiri mudiki, saka takagadzira yedu mhinduro.
Networking
Pamusoro peiyo reservation system, takatanga kugadzirisa network yekudyidzana. Iyo I/O subsystem yaive nemaitiro mazhinji, ayo aive nemhedzisiro yakaipisisa pajitter uye latency. Nemazana ematanho ekubata TCP kubatana, isu takamanikidzwa kugara tichichinja pakati pavo, uye pachiyero chemicrosecond uku kunotora nguva. Asi chakanyanya kushata ndechekuti kana maitiro akagamuchira pakiti yekugadziriswa, yaitumira kune imwe SystemV mutsara wobva wamirira chiitiko kubva kune imwe SystemV mutsara. Zvisinei, kana pane nhamba huru ye node, kuuya kweTCP packet itsva mune imwe nzira uye kugamuchirwa kwedheta mumutsara mune imwe kunomiririra zviitiko zviviri zvinokwikwidzana zve OS. Muchiitiko ichi, kana pasina mapurosesa emuviri anowanikwa kune ese ari maviri mabasa, imwe ichagadziriswa, uye yechipiri ichaiswa mumutsara wakamirira. Hazvibviri kufanotaura migumisiro.
Mumamiriro ezvinhu akadaro, dynamic process prepriest control inogona kushandiswa, asi izvi zvinoda kushandiswa kweiyo resource-intensive system call. Nekuda kweizvozvo, isu takachinjira kune imwe tambo tichishandisa classic epoll, izvi zvakawedzera kumhanya uye zvakaderedza kutengeserana nguva. Isu takabvisawo nzira dzakasiyana dzekutaurirana netiweki uye kutaurirana kuburikidza neSystemV, zvakanyanya kudzikisa huwandu hwenharembozha uye takatanga kudzora zvakakoshesesa mashandiro. PaI / O subsystem chete, zvaikwanisika kuchengetedza anenge 8-17 microseconds, zvichienderana nemamiriro ezvinhu. Ichi chirongwa chine tambo imwe chete chakashandiswa chisina kuchinjika kubva ipapo; imwe epoll tambo ine margin inokwana kusevhisi zvese zvinongedzo.
Transaction Processing
Kukura kuri kuita sisitimu yedu kwaida kusimudzira zvinenge zvese zvikamu zvaro. Asi, zvinosuruvarisa, kumira mukukura kwema processor wachi kumhanya mumakore achangopfuura hakuchaite kuti zvikwanise kuyera maitiro musoro-pamusoro. Naizvozvo, isu takasarudza kupatsanura maitiro eInjini kuita nhanho nhatu, neinobatikana kwazvo iri iyo njodzi yekutarisa system, iyo inoongorora kuwanikwa kwemari mumaakaundi uye inogadzira iyo kutengeserana pachayo. Asi mari inogona kunge iri mumari dzakasiyana, uye zvaive zvakafanira kufunga kuti ndechipi chikonzero chekugadziriswa kwezvikumbiro kunofanira kugoverwa.
Mhinduro ine musoro ndeyekuipatsanura nemari: imwe sevha inotengesa nemadhora, imwe mumapaundi, uye chetatu mumaeuro. Asi kana, nechirongwa chakadaro, kutengeserana kuviri kunotumirwa kutenga mari dzakasiyana, ipapo dambudziko rechikwama desynchronization richamuka. Asi kuwiriranisa kwakaoma uye kunodhura. Nokudaro, zvingave zvakarurama kuparadzanisa zvakasiyana newallet uye zvakasiyana nezviridzwa. Nenzira, kuchinjisa kwakawanda kwekuMadokero hakuna basa rekutarisa njodzi zvakanyanya sezvatinoita, saka kazhinji izvi zvinoitwa kunze kwenyika. Taifanira kuita online verification.
Ngatitsanangure nemuenzaniso. Mutengesi anoda kutenga madhora makumi matatu, uye chikumbiro chinoenda kune kusimbiswa kwekutengeserana: tinotarisa kana mutengesi uyu achibvumirwa kune iyi nzira yekutengesa uye kana ane kodzero dzinodiwa. Kana zvinhu zvose zvakarongeka, chikumbiro chinoenda kune ngozi yekuongorora hurongwa, i.e. kutarisa kukwana kwemari yekupedzisa kutengeserana. Pane chinyorwa chekuti mari inodiwa ikozvino yakavharwa. Chikumbiro chacho chinobva chaendeswa kune iyo yekutengesa system, iyo inobvumira kana kusabvumira kutengeserana. Ngatitii kutengeserana kwakatenderwa - ipapo iyo njodzi yekuongorora system inoratidza kuti mari haina kuvharwa, uye rubles anoshanduka kuita madhora.
Kazhinji, iyo njodzi yekutarisa sisitimu ine yakaoma algorithms uye inoita huwandu hukuru hwekuverengera zvakanyanya zviwanikwa, uye haingotarise "account balance", sezvazvingaite sekutanga kuona.
Patakatanga kupatsanura maitiro eInjini mumatanho, takasangana nedambudziko: iyo kodhi yaivepo panguva iyoyo yakanyatso shandisa dhata rakafanana pamatanho ekusimbisa uye ekusimbisa, izvo zvaida kunyorazve kodhi yese base. Nekuda kweizvozvo, isu takakwereta hunyanzvi hwekugadzirisa mirairo kubva kune ma processors emazuva ano: chimwe nechimwe chazvo chakakamurwa kuita nhanho diki uye akati wandei zviito zvinoitwa mukuenderana mune imwe kutenderera.
Mushure mekugadzirisa kudiki kwekodhi, isu takagadzira pombi yeparallel transaction process, umo kutengeserana kwakakamurwa kuita 4 nhanho dzepombi: kupindirana kwetiweki, kusimbiswa, kuuraya uye kuburitswa kwemhedzisiro.
Ngatitarisei muenzaniso. Tine maviri ekugadzirisa masisitimu, serial uye parallel. Yekutanga kutengeserana inosvika uye inotumirwa kuti isimbiswe mune ese masystem. Chechipiri chekutengeserana chinosvika pakarepo: mune imwe nzira inofananidzwa inokurumidza kutorwa kushanda, uye mune inoteedzana system inoiswa mumutsara wakamirira kutengeserana kwekutanga kuti ipfuure nepakati pekugadzirisa ikozvino. Ndiko kuti, mukana mukuru wekugadziriswa kwepombi ndeyekuti isu tinogadzirisa mutsara wekutengesa nekukurumidza.
Aya ndiwo maitiro atakaita iyo ASTS + system.
Chokwadi, hazvisi zvese zvakatsetseka nemaconveyors zvakare. Ngatitii tine transaction inobata data arrays mune yakavakidzana transaction; iyi ndiyo mamiriro ekuchinjana. Kutengeserana kwakadaro hakugone kuitwa mupombi nekuti kunogona kukanganisa vamwe. Mamiriro ezvinhu aya anonzi data hazard, uye kutengeserana kwakadaro kunongogadziriswa zvakasiyana: kana "kukurumidza" kutengeserana mumutsara kwapera, pombi inomira, iyo system inogadzirisa "inononoka" kutengeserana, uye inotangazve pombi. Sezvineiwo, chikamu chekuchinjana kwakadaro mukuyerera kwese kudiki kwazvo, saka pombi inomira kashoma zvekuti haikanganisi kuita kwese.
Ipapo takatanga kugadzirisa dambudziko rekufananidza tambo nhatu dzekuuraya. Mhedzisiro yacho yaive sisitimu yakavakirwa pane ring buffer ine masaizi-yakamisikidzwa maseru. Mune ino sisitimu, zvese zviri pasi pekugadzirisa kumhanya; data haina kuteedzerwa.
- Ese anouya network mapaketi anopinda padanho rekugovera.
- Isu tinoaisa muhurongwa uye tinomaka seanowanikwa padanho #1.
- Chechipiri chekutengeserana chasvika, chinowanikwa zvakare kune nhanho Nha.
- Yekutanga tambo yekugadzira inoona kutengeserana kuripo, kuagadzirisa, uye oaendesa kune chinhanho chinotevera chechipiri chekugadzirisa shinda.
- Inobva yagadzirisa kutengeserana kwekutanga uye inomira sero rinoenderana
deleted- yave kuwanikwa kushandiswa kutsva.
Mutsetse wose unogadziriswa nenzira iyi.
Kugadziriswa kwechikamu chimwe nechimwe kunotora mayunitsi kana makumi emamicroseconds. Uye kana tikashandisa yakajairwa OS kuwiriranisa zvirongwa, ipapo isu ticharasikirwa yakawanda nguva pakuyananisa pachayo. Ndosaka takatanga kushandisa spinlock. Nekudaro, iyi yakaipa kwazvo fomu mune chaiyo-nguva sisitimu, uye RedHat haakurudzire kuita izvi, saka isu tinoshandisa spinlock ye 100 ms, tozochinja kune semaphore mode kuti tibvise mukana wekufa.
Nekuda kweizvozvo, takawana kuita kweanosvika mamirioni masere ekutengeserana pasekondi. Uye chaizvoizvo mwedzi miviri gare gare mukati nezve LMAX Disruptor takaona tsananguro yedunhu rine mashandiro akafanana.
Ikozvino panogona kuve netambo dzakawanda dzekuuraya pane imwe nhanho. Zvese zvekutengeserana zvakagadziriswa chimwe nechimwe, muhurongwa hwavakagamuchirwa. Nekuda kweizvozvo, peak performance yakawedzera kubva ku18 zviuru kusvika ku50 zviuru zvekutengeserana pasekondi.
Exchange risk management system
Iko hakuna muganho kune kukwana, uye munguva pfupi takatanga zvechizvino-zvino: mukati meiyo ASTS +, takatanga kufambisa manejimendi enjodzi uye ekugadzirisa masisitimu ekuita zvinhu zvinozvimiririra. Isu takagadzira dhizaini yemazuva ano inochinjika uye itsva hierarchical njodzi modhi, uye takaedza kushandisa kirasi pese pazvaibvira. fixed_point panzvimbo ye double.
Asi dambudziko rakabva ramuka: nzira yekuyananisa sei bhizinesi logic yave ichishanda kwemakore akawanda uye kuiendesa kune itsva system? Nekuda kweizvozvo, yekutanga vhezheni yeiyo prototype yehurongwa hutsva yaifanira kusiiwa. Yechipiri vhezheni, iyo parizvino iri kushanda mukugadzira, yakavakirwa pane imwechete kodhi, inoshanda mune zvese zvekutengesa uye njodzi zvikamu. Panguva yekusimudzira, chinhu chakanyanya kuoma kuita git merge pakati peshanduro mbiri. Watinoshanda naye Evgeniy Mazurenok akaita oparesheni iyi svondo rega rega uye nguva yega yega aituka kwenguva yakareba.
Pakusarudza hurongwa hutsva, isu taifanira kubva tagadzirisa dambudziko rekudyidzana. Pakusarudza bhazi re data, zvaive zvakafanira kuve nechokwadi kugadzikana jitter uye kushoma latency. Iyo InfiniBand RDMA network yaive yakanyatsokodzera izvi: avhareji yenguva yekugadzirisa ndeye 4 nguva yakaderera pane 10 G Ethernet network. Asi chakanyanya kutifadza waive mutsauko mumaperesenti - 99 uye 99,9.
Ehe, InfiniBand ine matambudziko ayo. Chekutanga, imwe API yakasiyana - ibverbs pachinzvimbo chezvigadziko. Chechipiri, pane anenge asina kuwanikwa akawanda akavhurika sosi meseji mhinduro. Takaedza kugadzira yedu prototype, asi zvakazonetsa, saka takasarudza mhinduro yekutengesa - Confinity Low Latency Messaging (yaimbova IBM MQ LLM).
Ipapo basa rekuparadzanisa zvakanaka hurongwa hwengozi rakamuka. Kana iwe ukangobvisa iyo Risk Injini uye ukasagadzira yepakati node, saka kutengeserana kubva kune maviri masosi kunogona kusanganiswa.
Iwo anodaidzwa kuti Ultra Low Latency mhinduro ane maitiro ekugadzirisa zvakare: kutengeserana kubva kune maviri masosi kunogona kurongeka mune inodiwa kurongeka pawakagamuchira; izvi zvinoitwa uchishandisa yakaparadzana chiteshi chekuchinjana ruzivo nezve odha. Asi isu hatisati tashandisa iyi modhi: inoomesa maitiro ese, uye mune akati wandei mhinduro haitsigirwe zvachose. Pamusoro pezvo, kutengeserana kwega kwega kwaizofanirwa kupihwa nguva dzinoenderana, uye muchirongwa chedu iyi nzira yakaoma kuita nemazvo. Naizvozvo, isu takashandisa chirongwa chekare nemeseji broker, kureva, ine dispatcher inogovera mameseji pakati peRisk Injini.
Dambudziko rechipiri raive rakabatana nekuwana kwevatengi: kana paine akati wandei Njodzi Magedhi, mutengi anofanirwa kubatana kune yega yega, uye izvi zvinoda shanduko kune mutengi layer. Isu taida kubva pane izvi panguva ino, saka yazvino Risk Gateway dhizaini inoita iyo yese data rwizi. Izvi zvinodzikamisa zvakanyanya kuburitsa, asi zvinorerutsa zvakanyanya kusanganisa system.
Kudzokorora
Sisitimu yedu haifanirwe kunge iine kana imwe poindi yekutadza, kureva kuti, zvese zvikamu zvinofanirwa kudzokororwa, kusanganisira meseji broker. Isu takagadzirisa dambudziko iri tichishandisa CLLM system: ine RCMS cluster umo ma dispatchers maviri anogona kushanda mune master-slave mode, uye kana imwe ikakundikana, iyo system inochinja kune imwe.
Kushanda ne backup data center
InfiniBand yakagadziridzwa kuti ishande setiweki yemunharaunda, ndiko kuti, yekubatanidza rack-mount equipment, uye InfiniBand network haigoni kuiswa pakati penzvimbo mbiri dzakaparadzirwa nzvimbo dze data. Naizvozvo, isu takashandisa bhiriji / dispatcher, iyo inobatanidza kune meseji chengetedzo kuburikidza neyakajairwa Ethernet network uye inodzosera zvese kutengeserana kune yechipiri IB network. Patinenge tichida kutama kubva panzvimbo yedata, tinogona kusarudza kuti ndeipi nzvimbo yedata yekushanda nayo ikozvino.
Migumisiro
Zvese zviri pamusoro hazvina kuitwa kamwechete; zvakatora akati wandei kudzokorora kugadzira dhizaini nyowani. Isu takagadzira iyo prototype mumwedzi, asi zvakatora anopfuura makore maviri kuti ipinde mumamiriro ekushanda. Takaedza kuwana yakanakisa kuwirirana pakati pekuwedzera transaction processing nguva uye kuwedzera system kuvimbika.
Sezvo sisitimu yacho yakagadziridzwa zvakanyanya, takaita kudzoreredza data kubva kune maviri akazvimirira masosi. Kana iyo meseji chitoro isiri kushanda nemazvo nekuda kwechimwe chikonzero, unogona kutora iyo yekutengeserana log kubva kune yechipiri sosi - kubva kuRisk Injini. Iyi nheyo inocherechedzwa muhurongwa hwese.
Pakati pezvimwe zvinhu, isu takakwanisa kuchengetedza mutengi API kuitira kuti pasave nemabroker kana chero ani zvake angazoda kwakakosha kugadziridzwa kwekuvaka kutsva. Taifanira kushandura mamwe mainterfaces, asi pakanga pasina chikonzero chekuita shanduko huru kune yekushanda modhi.
Isu takadaidza iyo yazvino vhezheni yepuratifomu yedu Rebus - sechidimbu chezviviri zvinonyanya kucherechedzwa zvitsva mukuvaka, Risk Injini uye BUS.
Pakutanga, taida kugovera chikamu chekuchenesa chete, asi mugumisiro wacho wakanga uri gadziriro huru yakaparadzirwa. Vatengi vanogona ikozvino kupindirana neiyo Trade Gateway, iyo Clearing Gateway, kana zvese zviri zviviri.
Zvatakawana pakupedzisira:
Yakaderedza latency level. Nehuwandu hudiki hwekutengesa, iyo system inoshanda zvakafanana neyakapfuura vhezheni, asi panguva imwechete inogona kumirisana nemutoro wakanyanya.
Peak performance yakawedzera kubva ku50 zviuru kusvika 180 zviuru zvekutengeserana pasekondi. Kumwe kuwedzera kunokanganiswa nerukova rwega rwekuenzanisa.
Pane nzira mbiri dzekumwe kuvandudza: kufananidzira kuenzanisa uye kushandura nzira iyo inoshanda neGateway. Iye zvino ese Magedhi anoshanda zvinoenderana nechirongwa chekudzokorora, icho, pasi pemutoro wakadaro, chinomira kushanda zvakajairika.
Chekupedzisira, ndinogona kupa zano kune avo vari kupedzisa mabhizinesi masisitimu:
- Gadzirira zvakaipisisa nguva dzose. Matambudziko anogara achimuka zvisingatarisirwi.
- Kazhinji hazvibviri kukurumidza kugadzirisa zvivakwa. Kunyanya kana iwe uchida kuwana kuvimbika kwakanyanya pane akawanda maratidziro. Kuwanda kwemanodhi, ndiko kuwedzera kwezviwanikwa zvinodiwa pakutsigira.
- Zvese zvetsika uye zvevaridzi zvigadziriso zvinoda zvimwe zviwanikwa zvekutsvaga, rutsigiro nekugadzirisa.
- Usaverengera kugadzirisa nyaya dzekuvimbika kwehurongwa uye kudzoreredza mushure mekutadza; funga nezvazvo padanho rekutanga rekugadzira.
Source: www.habr.com