19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo

Ngo-July 11-12, kuzoba nengqungquthela eSt Hydraezinikele ekuthuthukisweni kwezinhlelo ezihambisanayo nezisabalalisiwe. Into nge-Hydra ukuthi ihlanganisa ososayensi abaphambili (abavame ukutholakala kuphela ezingqungqutheleni zesayensi zakwamanye amazwe) kanye nonjiniyela abaziwayo ababenza uhlelo olulodwa olukhulu ezimpambanweni zezesayensi nokusebenza.

IHydra ingenye yezingqungquthela zethu ezibaluleke kakhulu eminyakeni yamuva. Yandulelwe ukulungiselela okunzima kakhulu, ukukhethwa kwezikhulumi nemibiko. ngayo ngesonto eledlule habrointerview waphuma nomqondisi we-JUG.ru Group, u-Alexey Fedorov (23 dela).

We sekushiwo mayelana nabahlanganyeli abathathu ababalulekile, abasunguli bethiyori yezinhlelo ezisatshalaliswa - uLeslie Lamport, uMaurice Herlihy noMichael Scott. Sekuyisikhathi sokukhuluma kabanzi ngalo lonke uhlelo!

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo

Ukugqugquzela

Uma uhlela, khona-ke indlela eyodwa noma enye ubhekana ne-multithreading kanye ne-computing esabalalisiwe. Ochwepheshe emikhakheni efanelekile basebenza nabo ngokuqondile, kodwa ngokungagunci, ukusatshalaliswa kusibheka kusuka yonke indawo: kunoma iyiphi ikhompuyutha enamakhompiyutha amaningi noma isevisi esabalalisiwe, kunokuthile okwenza izibalo ngokuhambisana.

Kunezingqungquthela eziningi ezihlanganisa izici ezithile zohlelo lohlelo lokusebenza. Ngakolunye uhlangothi lwe-spectrum, sinezikole ezikhethekile zesayensi, ngefomethi yezinkulumo, eziveza amanani amakhulu wethiyori eyinkimbinkimbi. Ngokwesibonelo, ngesikhathi esifanayo neHydra eSt. Isikole se-SPTDC. Engqungqutheleni yakwaHydra, sizamile ukuhlanganisa umkhuba onzima, nesayensi, nakho konke okusempambanweni yomgwaqo.

Cabanga ngalokhu: siphila esikhathini esimangalisayo lapho ungahlangana khona nabasunguli bomkhakha wesayensi nobunjiniyela esisebenza kuwo bukhoma. Izazi zefiziksi ngeke zihlangane no-Newton noma u-Einstein - isitimela sesihambile. Kodwa labo abadale izisekelo zemfundiso yezinhlelo ezisabalalisiwe, basungula izilimi ezithandwayo zokuhlela, futhi okokuqala ngqa konke lokhu kuhlanganiswe kuma-prototypes asebenzayo namanje bahlala eduze kwethu. Laba bantu abakayishiyi imisebenzi yabo phakathi nendawo, njengamanje benza imisebenzi yangempela emanyuvesi nezinkampani ezidume umhlaba wonke, futhi bayimithombo yolwazi nolwazi olukhulu kakhulu namuhla.

Ngakolunye uhlangothi, ithuba lokuhlangana nabo ngokuvamile lihlala liwumcabango nje kuphela: abambalwa bethu abangahlala beqapha imicimbi yomphakathi kwenye iNyuvesi yaseRochester ukuze baphuthume e-USA futhi babuyele esifundweni sikaMichael Scott. Ukuvakashela wonke amalungu e-Hydra ngokuvamile kungaba yinhlanhla encane, ngaphandle kokuchitha isikhathi esichithwa (yize kuzwakala njengokufuna okuthakazelisayo).

Ngakolunye uhlangothi, sinonjiniyela abaningi abaphezulu abasebenza ezinkingeni zangempela zezinhlelo ezisabalalisiwe njengamanje, futhi banokuthile okufanele bakutshele. Kodwa nansi inkinga - bona sebenzanesikhathi sabo siyigugu. Yebo, uma ungumsebenzi weMicrosoft, Google noma JetBrains, amathuba okuhlangana nezikhulumi ezaziwayo emcimbini wangaphakathi akhula kakhulu, kodwa ngokuvamile - cha, akwenzeki nsuku zonke.

Ngale ndlela, ingqungquthela yeHydra ifeza umsebenzi obalulekile iningi lethu elingeke liwenze lilodwa - endaweni eyodwa futhi ngesikhathi esisodwa, lihlanganisa ndawonye abantu imibono yabo noma ukuxhumana nabo okungashintsha impilo yakho. Ngiyavuma ukuthi akuwona wonke umuntu odinga izinhlelo ezisabalalisiwe, ezinye izinto eziyisisekelo eziyinkimbinkimbi. Ungahlela ama-CRUD ku-PHP impilo yakho yonke futhi ujabule ngokuphelele. Kodwa ubani oyidingayo - leli yithuba lakho.

Sekudlule isikhathi esiningi selokhu kumenyezelwe okokuqala kwengqungquthela yaseHydra ngoHabré. Ngalesi sikhathi, mningi umsebenzi owenziwe - futhi manje, sinohlu cishe yonke imibiko. Awekho ama-algorithms avilaphayo anentambo eyodwa, i-hardcore esabalalisiwe nje emsulwa! Ake siqedele ngamagama ajwayelekile, sibone ukuthi siphetheni manje.

Amanothi abalulekile

Amaphuzu abalulekile aqala futhi aphethe izinsuku zengqungquthela. Ngokuvamile inhloso yenkulumo eyisihluthulelo yokuvula iwukubeka umoya ojwayelekile kanye nesiqondiso senkomfa. Inkulumo eyisihluthulelo yokuvala idweba umugqa futhi ichaze ukuthi singaphila kanjani ngolwazi namakhono esiwathole ngezinsuku zengqungquthela. Isiqalo nesiphetho: okukhunjulwa kakhulu, futhi ngokuvamile, kunenani elikhulayo.

I-Cliff Click- I-H2O isabalalise i-algorithm ye-K/V

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UCliff uyinganekwane emhlabeni weJava. Ngasekupheleni kweminyaka yama-90s, we-PhD thesis, wabhala iphepha elibizwa "Ukuhlanganisa Ukuhlaziya, Ukuhlanganisa Ukuthuthukisa", okwathi ngemva kwesikhathi esithile kwaba yisisekelo se-HotSpot JVM Server Compiler. Eminyakeni emibili kamuva, wayesevele esebenza e-Sun Microsystems ku-JVM futhi wabonisa umhlaba wonke ukuthi i-JIT inelungelo lokuba khona. Yonke le ndaba yokuthi i-Java ingenye yezikhathi ezisheshayo zesimanje ezinokulungiselelwa okuhlakaniphe kakhulu nokushesha kakhulu ivela ku-Cliff Click. Ekuqaleni, kwakukholelwa ukuthi uma kukhona okutholakala ku-compiler static, awukwazi ngisho nokuzama ukuyifaka. Ngenxa yomsebenzi kaCliff neqembu, zonke izilimi ezintsha zaqala ukudalwa ngombono wokuhlanganisa i-JIT ngokuzenzakalelayo. Yiqiniso, lokhu kwakungewona umsebenzi womuntu oyedwa, kodwa uCliff wadlala indima ebaluleke kakhulu kuwo.

Enkulumweni eyisihluthulelo, uCliff uzokhuluma ngomunye umsebenzi wakhe - H20, inkundla yenkumbulo yokufundwa kwemishini esabalalisiwe nengakala yezinhlelo zokusebenza zezimboni. Ngokunemba kakhudlwana, mayelana nesitoreji esabalalisiwe samapheya enani elingukhiye ngaphakathi kwaso. Lesi isitoreji esishesha kakhulu esinezinto eziningi ezithakazelisayo (uhlu oluqondile lungaphakathi incazelo) ezivumela ukusetshenziswa kwezixazululo ezifanayo kuzibalo zokusakaza idatha enkulu.

Enye inkulumo azoyikhuluma uCliff ithi Okuhlangenwe nakho kwe-Azul Hardware Transactional Memory. Enye ingxenye biography yakhe - iminyaka eyishumi usebenza e-Azul, lapho avuselela khona futhi athuthukisa izinto eziningi ku-Azul hardware kanye nesitaki sobuchwepheshe: abahlanganisi be-JIT, isikhathi sokugijima, imodeli yentambo, ukuphatha amaphutha, ukukhwabanisa kwesitaki, ukuphazamiseka kwehadiwe, ukulayishwa kwekilasi, nokunye nokunye - kahle, uthola umqondo.

Ingxenye ethakazelisa kakhulu yaqala lapho benza i-hardware yebhizinisi elikhulu - ikhompyutha enkulu yokusebenzisa i-Java. Kwakuyinto entsha, eklanyelwe i-Java, enezidingo ezikhethekile - izithiyo zenkumbulo zokufunda ukuqoqwa kukadoti ongamile kancane, ama-arrays anokuhlolwa kwemingcele, izingcingo ezibonakalayo ... Obunye ubuchwepheshe obubanda kunazo zonke inkumbulo ye-hardware transactional. I-L1 yonke yanoma yimaphi ama-cores angu-864 ingabamba iqhaza ekubhaleni kokuthengiselana, okubaluleke kakhulu ekusebenzeni ngezingidi ku-Java (amabhlogo avumelanisiwe angasebenza ngokuhambisana, inqobo nje uma kungekho ukungqubuzana kwenkumbulo yangempela). Kodwa umbono omuhle washayisana neqiniso elibuhlungu - futhi kulo mbiko, u-Cliff uzokutshela ukuthi kungani i-HTM ne-STM zingazifanelekeli kahle izidingo ezingokoqobo zekhompyutha enezintambo eziningi.

UMichael Scott- Izakhiwo zedatha ekabili

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UMichael Scott - USolwazi weComputer Science eNyuvesi yaseRochester, okwamxhumanisa naye isiphetho iminyaka engu-34 kakade, futhi eNyuvesi yakubo yaseWisconsin-Madison, wayengumphathi iminyaka emihlanu. Wenza ucwaningo emkhakheni wezinhlelo ezihambisanayo nezisabalaliswayo kanye nokwakhiwa kolimi futhi ufundisa lokhu kubafundi.

Umhlaba wonke uyamazi uMichael ngenxa yencwadi yokufunda "I-Pragmatics yolimi lokuhlela", uhlelo lwakamuva olushicilelwe kamuva nje - ngo-2015. Umsebenzi wakhe "Ama-algorithms okuvumelanisa okukalayo kuma-multiprocessors enkumbulo eyabiwe" kutholiwe Umklomelo we-Dijkstra njengomunye odume kakhulu emkhakheni we-computing esabalalisiwe kanye amanga obala e-University of Rochester Online Library. Ungase futhi umazi njengombhali we-algorithm efanayo kaMichael-Scott evela "Ama-algorithms Elayini Alula, Ashesha, Futhi Angokoqobo Okungavimbi kanye Nokuvimbela".

Ngokuqondene nomhlaba we-Java, leli yicala elikhethekile: kanye no-Doug Lea, uthuthukise lawo ma-algorithms angavimbeli kanye nolayini abavumelanayo imitapo yolwazi ye-Java esebenza kuyo. Yilokhu okuzobe kumayelana nesihloko esithi “Dual data structures” - ukwethulwa kwalezi zakhiwo ku-Java SE 6 kusivumele ukuthi sithuthukise ukusebenza izikhathi ezingu-10. java.util.concurrent.ThreadPoolExecutor. Uma unentshisekelo kusenesikhathi ukuthi ziyini lezi "Dual data structures", khona-ke kukhona umsebenzi ohlobene.

UMaurice Herlihy- Ama-Blockchains kanye nekusasa lekhompiyutha esabalalisiwe

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UMaurice Herlihy - Owine izindondo ezimbili ze-Dijkstra. Esokuqala esomsebenzi "Ukuvumelanisa Okungalindeli" (Brown University), kanti eyesibili, yakamuva kakhulu - "Inkumbulo Yokwenziwayo: Ukusekelwa Kwezakhiwo Zezakhiwo Zedatha Engakhiyiwe" (Virginia Tech University). Umklomelo we-Dijkstra unikezwa ngemisebenzi ukubaluleka kwayo nomthelela oye wabonakala okungenani iminyaka eyishumi, futhi kusobala ukuthi uMaurice ungomunye wochwepheshe abadume kakhulu kulo mkhakha. Njengamanje unguprofesa eBrown University futhi unerekhodi elide lendima yezinto azifezile.

Kulo mbhalo oyisihluthulelo wokuvala, uMaurice uzokhuluma ngethiyori kanye nokusebenza kwezinhlelo ezisatshalaliswa ze-blockchain ngokombono wama-classics we-computing esabalalisiwe nokuthi yenza lula izinkinga eziningi ezihlobene. Lo mbiko ugxile kuphela esihlokweni senkomfa - hhayi nhlobo mayelana nokuduma kwezimayini, kodwa kunalokho mayelana nokuthi ulwazi lwethu lungasetshenziswa kanjani ngendlela emangalisayo ngempumelelo nangokufanele maqondana nemisebenzi eyahlukene.

NgoJulayi 2017, uMaurice usevele wafika eRussia esikoleni se-SPTDC, wabamba iqhaza kumhlangano we-JUG.ru, futhi okurekhodiwe kungabukwa ku-YouTube:

Uhlelo oluyinhloko

Bese kuba nokubuyekezwa okufushane kwemibiko efakwe ohlelweni. Eminye yemibiko ichazwe kabanzi lapha, eminye kafushane. Izincazelo ezinde ziye ikakhulukazi emibikweni yolimi lwesiNgisi edinga izixhumanisi zamaphepha esayensi, amagama aku-Wikipedia, nokunye. Uhlu oluphelele lungaba bheka kuwebhusayithi yenkomfa. Uhlu olukusayithi luzobuyekezwa futhi lwengezwe.

Leslie Lamport- I-Q & A

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Leslie Lamport ungumbhali oyiphayona we-computing esabalalisiwe. I-LaTeX imele "Lamport TeX". Nguye owaqala ngqa, emuva ngo-1979, wethula lo mqondo ukungaguquguquki, nesihloko sakhe "Indlela Yokwenza Ikhompyutha Ye-Multiprocessor Esebenzisa Ngokufanelekile Izinhlelo Zokusebenza Eziningi" uthole umklomelo we-Dijkstra.

Lena ingxenye engavamile kakhulu yohlelo ngokwefomethi, ngoba akuwona ngisho umbiko, kodwa iseshini yemibuzo nezimpendulo. Lapho ingxenye ebalulekile yezethameli isivele ijwayele (noma ingajwayelana) nazo zonke izinhlobo zemisebenzi esekelwe kumbono kaLamport, izihloko nemibiko yakhe, kubaluleke kakhulu ukusebenzisa sonke isikhathi esitholakalayo ekuxhumaneni okuqondile.

Umbono ulula - ubuka imibiko emibili ku-YouTube: "Ukuhlelwa Kufanele Kube Ngaphezu Kokubhala Ikhodi" и "Uma Ungabhali Uhlelo, Ungasebenzisi Ulimi Lokuhlela" futhi ulungiselele okungenani umbuzo owodwa, bese uLeslie ephendula.

Eyokuqala kulawa mavidiyo amabili esinawo kakade waphenduka inkabi. Uma ungenalo ihora lesikhathi sokubuka ividiyo, ungayifunda yonke ngokushesha ngefomu lombhalo.

Qaphela: Kunamavidiyo amaningi ku-YouTube no-Leslie Lamport. Ngokwesibonelo, kukhona okuhle kakhulu Isifundo se-TLA+. Inguqulo engaxhunyiwe ku-inthanethi yaso sonke isifundo itholakala kokuthi ikhasi lasekhaya lombhali, futhi ku-YouTube uyithululile ukuze ibukwe kalula kumadivayisi eselula.

UMartin Kleppman - Ivumelanisa idatha kuwo wonke amadivayisi womsebenzisi ukuze kuhlangatshezwane nayo

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UMartin Kleppmann ungumcwaningi eNyuvesi yaseCambridge osebenza nge-CRDT kanye nokuqinisekiswa okusemthethweni kwe-algorithm. Incwadi kaMartin "Ukudizayina izinhlelo zokusebenza ezidinga idatha", eyanyatheliswa ngo-2017, yabonakala iphumelele kakhulu futhi yashaya izinhlu ezithengiswa kakhulu emkhakheni wokugcinwa kwedatha nokucubungula. Kevin Scott, CTO at Microsoft wake wathi: “Le ncwadi kufanele ibe imfuneko konjiniyela abaklami. Lesi isisetshenziswa esiyivelakancane esihlanganisa ithiyori nokuzijwayeza ukusiza onjiniyela baklame futhi basebenzise ingqalasizinda yedatha namasistimu ngobuchule.” Okufanayo kushiwo ngumdali we-Kafka ne-CTO Confluent, uJay Kreps.

Ngaphambi kokudlulela ocwaningweni lwezemfundo, uMartin wasebenza embonini futhi wasungula iziqalo ezimbili eziphumelelayo:

  • Okuvumelanayo, okuzinikele ekuboniseni iphrofayili yomphakathi yoxhumana nabo be-imeyili, i-LinkedIn eyathenga ngo-2012;
  • I-Go Test It, isihloli sewebhusayithi esizenzakalelayo seziphequluli eziningi esathengwa yiRedGate ngo-2009.

Ngokuvamile, nakuba uMartin engaziwa kakhulu kunama-keynoters ethu, usekwazile ukufaka isandla ekuthuthukiseni i-computing esabalalisiwe kanye nasembonini.

Kule nkulumo, uMartin uzokhuluma ngesihloko esiseduze nocwaningo lwakhe lwezemfundo. Ku-Google Amadokhumenti nakosofa ofanayo wamadokhumenti ababhalisa ngokubambisana, elithi "co-authoring" lisho umsebenzi wokuphindaphinda: umsebenzisi ngamunye unomfanekiso wakhe wedokhumenti eyabelwe, abe eseyilungisa, futhi zonke izinguquko zithunyelwa ngenethiwekhi kwabanye. yababambe iqhaza. Izinguquko ezingaxhunyiwe ku-inthanethi kumadokhumenti zibangela ukungqubuzana kwedokhumenti yesikhashana ngokuphathelene nabanye ababambiqhaza, futhi ukuvumelanisa kabusha kudinga ukusingatha ukungqubuzana. Kukhona nje lokhu Izinhlobo Zedatha Ephindaphindwayo Engenangxabano (CRDT), eqinisweni, iyinto entsha, ingqikithi yayo eyakhiwa ngo-2011 kuphela. Le nkulumo idingida okwenzeka kusukela ngaleso sikhathi emhlabeni we-CRDT, yiziphi intuthuko yakamuva, idingida indlela yokwakha izinhlelo zokusebenza zasekhaya kuqala ngokujwayelekile, kanye nokusetshenziswa komtapo wolwazi ovulekile. Automerge ngokuqondene.

Ngesonto elizayo sizoshicilela inhlolokhono enkulu noMartin ku-Habré, kuzoba mnandi.

Pedro Ramalhete - Izakhiwo zedatha ezingalindi kanye nokwenziwe okungalindi

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Pedro usebenza e-Cisco futhi ubelokhu enza ama-algorithms ahambisanayo kule minyaka eyishumi edlule, okuhlanganisa izindlela zokuvumelanisa, izakhiwo zedatha ezingakhiyiwe kanye nezokulinda, nakho konke ongakucabanga ngalesi sihloko. Izintshisekelo zakhe zamanje zocwaningo nezobunjiniyela zigxile ku-Universal Constructions, i-Software Transactional Memory, i-Persistent Memory, kanye nobuchwepheshe obufanayo bokuvumela izinhlelo zokusebenza ezifanele, ezingalawuleki, nezibekezelela amaphutha. Futhi ungumbhali webhulogi eyaziwa kabanzi emibuthanweni emincane Concurrency Freaks.

Iningi lezinhlelo zokusebenza ezinezintambo eziningi manje sezisebenzisa izakhiwo zedatha efanayo, kusukela ekusebenziseni ulayini wemilayezo phakathi kwabalingisi kuya kuzakhiwo zedatha ezinenkomba ezitolo zamanani angukhiye. Basebenze ngempumelelo ku-Java JDK iminyaka eminingi, futhi kancane kancane bengezwa ku-C ++.

Indlela elula yokusebenzisa ukwakheka kwedatha ehambisanayo ukuqaliswa kwe-serial (okunochungechunge olulodwa) lapho izindlela zivikelwe yi-mutexes. Lokhu kutholakala kunoma yimuphi ujun, kodwa kunezinkinga ezisobala zokukala nokusebenza. Ngesikhathi esifanayo, izakhiwo zedatha ezingakhiyiwe futhi ezingalindi azigcini nje ngokuphatha amaphutha kangcono, kodwa futhi zinephrofayili yokusebenza engcono - nokho, ukuthuthukiswa kwazo kudinga ubuchwepheshe obujulile nokuzivumelanisa nezimo ezithile zokusetshenziswa. Umugqa owodwa ongalungile wekhodi wanele ukuphula yonke into.

Ungaqinisekisa kanjani ukuthi ngisho nomuntu ongeyena uchwepheshe angakwazi ukuklama futhi asebenzise izakhiwo zedatha ezinjalo? Kuyaziwa ukuthi noma iyiphi i-algorithm elandelanayo ingenziwa iphephe noma yiyiphi umklamo wendawo yonke, noma inkumbulo yokwenziwayo. Okokuqala, bangehlisa umkhawulo wokungena ukuze baxazulule le nkinga. Kodwa-ke, zombili izixazululo zivame ukuholela ekusetshenzisweni okungasebenzi kahle. U-Pedro uzokhuluma ngokuthi bakwazi kanjani ukwenza lezi zakhiwo zisebenze kahle kakhulu nokuthi zingasetshenziswa kanjani kuma-algorithms abo.

U-Heidi Howard- Ukukhulula ukuvumelana okusabalalisiwe

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UHeidi Howard, njengoMartin, ungumcwaningi wezinhlelo ezisatshalaliswa eNyuvesi yaseCambridge. Ubuchwepheshe bakhe buwukuvumelana, ukubekezelela amaphutha, ukusebenza kanye nokuvumelana okusatshalaliswa. Waziwa kakhulu ngokwenza kwakhe i-algorithm ye-Paxos ebizwa ngokuthi I-Paxos eguquguqukayo.

Khumbula ukuthi I-Paxos - umndeni wezivumelwano zokuxazulula inkinga yokuvumelana kunethiwekhi yamakhompiyutha angathembekile, ayesekelwe emsebenzini kaLeslie Lamport. Ngakho-ke, ezinye zezikhulumi zethu zisebenza emisebenzini eyayihlongozwe ezinye izikhulumi zethu - futhi lokhu kuhle kakhulu.

Ikhono lokuthola ukuvumelana phakathi kwababungazi abaningi—lokukhuluma, ukukhetha abaholi, ukuvimba, noma ukuxhumanisa—kuyindaba ebalulekile ezinhlelweni ezisabalalisiwe zanamuhla. I-Paxos manje iyindlela eyinhloko yokuxazulula izinkinga zokuvumelana, futhi kunocwaningo oluningi oluzungezile ukuze kunwetshwe futhi kusetshenziswe ngokugcwele i-algorithm yezidingo ezihlukahlukene ezingokoqobo.

Kulo mbiko, sizophinde sivakashele isisekelo setiyori se-Paxos, siphumuze izimfuneko zokuqala futhi senze i-algorithm ibe jikelele. Sizobona ukuthi i-Paxos, empeleni, ingenye yezinketho phakathi kohlu olukhulu lwezindlela zokuvumelana, nokuthi amanye amaphuzu ku-spectrum nawo awusizo kakhulu ekwakheni izinhlelo ezinhle ezisabalalisiwe.

Alex Petrov - Yehlisa izindleko zakho zokugcina nge-Transient Replication kanye ne-Cheap Quorums

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Alex ungumchwepheshe wedathabheyisi kanye nesitoreji futhi, okubaluleke kakhulu, uzinikele ku- Cassandra. Njengamanje usebenza no-O'Reilly encwadini yeDatabase Internals.

Okwamasistimu ane ekugcineni ukuvumelana (ngegama lesi-Russian - “ekugcineni kuyahambisana”), ngemva kokuphahlazeka kwenodi noma ukuhlukana kwenethiwekhi, le nkinga elandelayo idinga ukuxazululwa: qhubeka ufeza izicelo, udele ukuvumelana, noma wenqabe ukuzisebenzisa futhi udele ukutholakala. Kulolu hlelo, amakhoramu, amasethi angaphansi agqagqene amanodi nokuqinisekisa ukuthi okungenani inodi eyodwa iqukethe inani lakamuva, kungaba yisixazululo esihle sonqenqema. Kungenzeka ukusinda ekuhlulekeni nasekulahlekelweni kokuxhumeka kwamanye ama-node ngenkathi uqhubeka nokuphendula ngamavelu akamuva kakhulu.

Nokho, yonke into inenani layo. Isikimu sokuphindaphinda ikhoramu sisho izindleko ezikhuphukile zokugcina: kufanele ugcine idatha engasasebenzi kumanodi amaningi ngesikhathi esisodwa ukuze uqinisekise ukuthi amakhophi anele ayatholakala uma kwenzeka inkinga. Kuvele ukuthi awukwazi ukugcina yonke idatha kuzo zonke izifaniso. Ungakwazi ukunciphisa umthwalo endaweni yokugcina uma ugcina idatha kuphela engxenyeni yamanodi, futhi usebenzise amanodi akhethekile (I-Transient Replica) ngezimo zokwehluleka ukuphatha.

Ngokuqhubeka kombiko, sizocubungula I-Replicas yoFakazi, uhlelo lokuphindaphinda olusetshenziswe ku I-Spanner и I-Megastore, kanye nokuqaliswa kwalo mqondo ku-Apache Cassandra ngaphansi kwamagama Ukuphindaphinda Kwesikhashana & Ikhoramu Ezishibhile.

UDmitry Vyukov - Ama-goroutines aveziwe

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UDmitry ungunjiniyela kwa-Google osebenza ku-C/C++ kanye nokuhlola okuguquguqukayo kwe-Go - Ikheli/Inkumbulo/I-ThreadSanitizer namathuluzi afanayo e-Linux kernel. Unikele ngesihleli se-goroutine esikhwehlelayo, umhloli wenethiwekhi, kanye nomqoqi wezibi ngesikhathi esisodwa ku-Go. Unguchwepheshe we-multithreading, umbhali wama-algorithms amasha angavimbeli ayishumi nambili futhi ungumnikazi we Ibhande Elimnyama Intel.

Manje kancane mayelana nombiko ngokwawo. Ulimi lwe-Go lunosekelo lwendabuko lokufunda okuningi ngendlela yama-goroutines (imicu engasindi) namashaneli (olayini be-FIFO). Ngenxa yalezi zindlela, kulula kakhulu futhi kuyajabulisa kubasebenzisi ukubhala izinhlelo zokusebenza zesimanje ezinezihloko eziningi, futhi kubukeka njengomlingo. Njengoba siqonda, awukho umlingo lapha. Kulo mbiko, u-Dmitry uzohlolisisa ubunkimbinkimbi bomhleli we-Go futhi abonise izimfihlo zokusebenzisa lo “mlingo”. Okokuqala, uzonikeza umbono wezingxenye eziyinhloko zomhleli, ukuthi usebenza kanjani. Okulandelayo, sizobhekisisa izici ezithile, njengesu lokupaka / ukungapaki kanye nokusingatha izingcingo zesistimu yokuvinjwa. Ekugcineni, u-Dmitry uzokhuluma kancane mayelana nentuthuko engenzeka kumhleli.

UDmitry Bugaichenko - Ukusheshisa Ukuhlaziywa Kwegrafu Esabalalisiwe nge-Probabilistic Sketches nokunye

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Dmitry usesebenze ekukhishweni kwemisebenzi cishe iminyaka eyi-9, ngaphandle kokulahlekelwa ukuxhumana nenyuvesi kanye nomphakathi wesayensi. Ukuhlaziywa kwedatha enkulu ku-Odnoklassniki kwakuyithuba eliyingqayizivele kuye lokuhlanganisa ukuqeqeshwa kwethiyori kanye nesisekelo sesayensi nokuthuthukiswa kwemikhiqizo yangempela, edingekayo.

Ukuhlaziywa kwegrafu esabalalisiwe kuye kwaba futhi kuhlala kuwumsebenzi onzima: lapho kudingekile ukuthola ulwazi mayelana nokuxhumeka kwe-vertex engumakhelwane, idatha ngokuvamile kufanele idluliselwe phakathi kwemishini, okuholela ekwandeni kwesikhathi sokwenza kanye nomthwalo kunethiwekhi. ingqalasizinda. Kule nkulumo, sizobona ukuthi ungathola kanjani ukusheshisa okubalulekile kokucubungula usebenzisa izakhiwo zedatha engenzeka noma amaqiniso afana nokulingana kwegrafu yobungane kunethiwekhi yokuxhumana nabantu. Konke lokhu kuboniswa ngezibonelo zekhodi ye-Apache Spark.

UDenis Rystsov - Yehlisa izindleko zakho zokugcina nge-Transient Replication kanye ne-Cheap Quorums

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo UDenis - unjiniyela I-Cosmos DB, uchwepheshe wokuqinisekisa imodeli engaguquguquki, ama-algorithms okuvumelana, kanye nemisebenzi esabalalisiwe. Manje usebenza e-Microsoft, futhi ngaphambi kwalokho wayehlanganyela ezinhlelweni ezisatshalaliswa e-Amazon naseYandex.

Kulo mbiko, sizojwayelana namaphrothokholi okwenziwayo asabalalisiwe asungulwe eminyakeni embalwa edlule, angasetshenziswa ohlangothini lweklayenti ngaphezu kwanoma isiphi isitolo sedatha esisekela ukubuyekezwa okunemibandela (qhathanisa futhi usethe). Okubalulekile ukuthi impilo ayipheli ngokuzibophezela kwezigaba ezimbili, ukuthengiselana kunganezelwa phezu kwanoma iyiphi isizindalwazi - ezingeni lesicelo, kodwa izivumelwano ezihlukene (2PC, Percolator, RAMP) zinokuhwebelana okuhlukile futhi azinikezwanga. Mahhala.

U-Alexey Zinoviev - Akuwona wonke ama-algorithms e-ML agcina esepharadesi elisabalalisiwe

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Alexei (zaleslaw) uyisikhulumi sethu eside futhi eyilungu lamakomiti ezinhlelo kwezinye izingqungquthela. Umqeqeshi oprakthiza e-EPAM Systems, futhi ube ngumngane no-Hadoop / Spark kanye nenye idatha enkulu kusukela ngo-2012.

Kule nkulumo, u-Alexey uzokhuluma ngezinkinga zokulungisa ama-algorithms wokufunda komshini wakudala ukuze asabalaliswe ngokususelwa kulwazi lwakhe nge-Apache Spark ML, Apache Mahout, Apache Flink ML kanye nolwazi lokudala i-Apache Ignite ML. U-Alexey uzophinde akhulume ngokusetshenziswa kwama-algorithms e-ML asabalalisiwe kulezi zinhlaka.

Futhi ekugcineni, imibiko emibili evela ku-Yandex mayelana ne-Yandex Database.

Vladislav Kuznetsov - I-Yandex Database - sikunikeza kanjani ukubekezelelana kwamaphutha

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Vladislav ungunjiniyela kwa-Yandex eqenjini leplathifomu esabalalisiwe. I-Yandex Database iyi-DBMS enwebeka ngokuvundlile, esabalaliswe nge-geo, ebekezelela amaphutha engakwazi ukumelana nokwehluleka kwamadiski, amaseva, ama-racks, nezikhungo zedatha ngaphandle kokuphazamisa ukungaguquguquki. Ukuqinisekisa ukubekezelelana kwamaphutha, kusetshenziswa i-algorithm yokuvumelana esatshalaliswa ngokuphathelene, kanye nenani lezixazululo zobuchwepheshe, okuxoxwa ngazo ngokuningiliziwe embikweni. Umbiko ungase ube nentshisekelo kubo bobabili abathuthukisi be-DBMS nabathuthukisi bezisombululo ezisetshenzisiwe ezisekelwe ku-DBMS.

Semyon Checherin - Okwenziwayo kusatshalaliswe ku-YDB

19 amakhanda e-hydra. Ukubuka konke okuhle kohlelo U-Semyon ungumthuthukisi oseqenjini leplathifomu esabalalisiwe kwa-Yandex, osebenzela ukuthi kungenzeka kusetshenziswe abaqashi abaningi ukufakwa kwe-YDB.

I-Yandex Database yakhelwe imibuzo ye-OLTP futhi ihlangabezana nezimfuneko ze-ACID zesistimu yokwenziwayo. Embikweni, sizocubungula i-algorithm yokuhlela umsebenzi engaphansi kwesistimu yokwenziwayo ye-YDB. Ake sihlaziye ukuthi yimaphi amabhizinisi abamba iqhaza ekuthengiseni, ngubani owabela i-oda lomhlaba wonke ekuthengeni, ukuthi i-atomicity yomsebenzi, ukwethembeka kanye nezinga eliqinile lokuzihlukanisa lifinyelelwa kanjani. Sisebenzisa isibonelo somsebenzi ojwayelekile, ake sicabangele ukuqaliswa kokwenziwayo kusetshenziswa isibopho sezigaba ezimbili kanye nemisebenzi enqumayo. Ake sixoxe ngokuhlukana kwabo.

Yini okulandelayo?

Uhlelo lwengqungquthela lusaqhubeka nokugcwala imibiko emisha. Ikakhulukazi, silindele umbiko ovela Nikita Koval (ndkoval) kusuka kwaJetBrains kanye Oleg Anastasiev (m0nstermind) kusuka ku-Odnoklassniki. U-Nikita usebenza kuma-algorithms we-coroutines eqenjini le-Kotlin, futhi u-Oleg uthuthukisa izakhiwo nezixazululo zezinhlelo ezilayisha kakhulu endaweni yesikhulumi se-Odnoklassniki. Ngaphezu kwalokho, kune-slot engu-1 ngaphezulu engenalutho ngokwemibandela, namakhandidethi ikomidi lohlelo elisebenzela wona njengamanje.

Ingqungquthela yakwaHydra izoba ngoJulayi 11-12 eSt. Amathikithi angaba thenga kuwebhusayithi esemthethweni. Naka ukutholakala kwamathikithi aku-inthanethi - uma ngesizathu esithile ungakwazi ukufika e-St. Petersburg bukhoma kulezi zinsuku.

Sanibona eHydra!

Source: www.habr.com

Engeza amazwana