19 hydra misoro. Kuongorora kukuru kwepurogiramu

Musangano uchaitika muna July 11-12 muSt Hydra, yakatsaurirwa pakugadzirwa kwemaitiro akafanana uye akagoverwa. Hunyengeri hweHydra ndehwekuti hunobatanidza masayendisiti anotonhorera (anowanzo kuwanikwa chete kumisangano yesainzi yekune dzimwe nyika) uye mainjiniya ane mukurumbira ekudzidzira kuita chirongwa chakakura pamharadzano yesainzi uye maitiro.

Hydra ndeimwe yemisangano yedu yakakosha mumakore mashoma apfuura. Yakatungamirirwa nekugadzirira kwakanyanya, kusarudzwa kwevatauri uye mishumo. Svondo rapfuura pamusoro peizvi Habro interview yakabuda pamwe nemutungamiriri weJUG.ru Group, Alexey Fedorov (23derevo).

Isu tiri zvatoudzwa vanenge vatatu vatori vechikamu vanokosha, vatangi vedzidziso yezvirongwa zvakaparadzirwa - Leslie Lamport, Maurice Herlihy naMichael Scott. Yave nguva yekutaura zvakadzama nezvechirongwa chose!

19 hydra misoro. Kuongorora kukuru kwepurogiramu

Chikonzero

Kana iwe uchibatanidzwa mukuronga, saka imwe nzira kana imwe yauri kubata nemultithreading uye kugovera komputa. Nyanzvi mundima dzakakodzera dzinoshanda navo zvakananga, asi zvisina kujeka, kugovera kuri kutarisa kwatiri kubva kwese kwese: mune chero ma-multi-core komputa kana sevhisi yakagoverwa kune chimwe chinhu chinoita masvomhu zvakafanana.

Kune akawanda makonferensi anovhara akasiyana maficha ekushandisa hurongwa. Kune rumwe rutivi rwechiratidziro, tine zvikoro zvesainzi zvine hunyanzvi zvinoburitsa huwandu hukuru hwedzidziso yakaoma mufomati yehurukuro. Semuenzaniso, mukufanana neHydra muSt SPTDC chikoro. Pamusangano weHydra, takaedza kuunza pamwechete maitiro akaomarara, sainzi, uye zvese pamharadzano yavo.

Funga nezveizvi: tinorarama munguva inoshamisa apo iwe unogona kusangana mumunhu ivo vakatanga sainzi uye engineering yatinodzidza. Mafizikisi haazosangana naNewton kana Einstein - chitima chaenda. Asi pedyo nesu vachiri kurarama avo vakagadzira nheyo dzedzidziso yezvirongwa zvakaparadzirwa, vakagadzira mitauro yakakurumbira yepurogiramu, uye kekutanga vakaisa zvose izvi mukushanda prototypes. Vanhu ava havana kusiya mabasa avo nepakati, parizvino vari kushanda pazvinhu zvinonetsa mumayunivhesiti nemakambani ane mukurumbira pasi rose, uye ndiwo manyuko makuru eruzivo neruzivo nhasi.

Nekune rimwe divi, mukana wekusangana navo kazhinji unongoramba uchingofunga chete: vashoma vedu vanogona kugara vachitarisa zviitiko zveveruzhinji pane imwe University yeRochester, vobva vamhanyira kuUSA nekudzoka kuhurukuro naMichael Scott. Kushanyira nhengo dzese dzeHydra kwaizodhura mari shoma, kusaverengera gomba renguva yakaraswa (kunyangwe zvichinzwika sekuda kunonakidza).

Kune rimwe divi, isu tine mainjiniya mazhinji epamusoro ari kushanda mukutsikirira matambudziko mumasisitimu akagoverwa izvozvi, uye ivo vane zvakawanda zvekutaura. Asi heino dambudziko - ivo Ρ€Π°Π±ΠΎΡ‚Π°ΡŽΡ‚, uye nguva yavo inokosha. Ehe, kana iwe uri mushandi weMicrosoft, Google kana JetBrains, mukana wekusangana nemumwe wevatauri vane mukurumbira pachiitiko chemukati unowedzera zvakanyanya, asi kazhinji, kwete, izvi hazviitike mazuva ese.

Nenzira iyi, Musangano weHydra unoita basa rakakosha iro vazhinji vedu hatigone kuita tega - munzvimbo imwechete uye panguva imwe, rinounza pamwechete vanhu vane mazano kana kudyidzana navo vanogona kushandura hupenyu hwako. Ndinobvuma kuti havasi vese vanoda masisitimu akagoverwa kana zvimwe zvinhu zvakaoma kunzwisisa. Iwe unogona kuronga maCRUDs muPHP kwehupenyu hwako hwese uye ugare uchifara zvizere. Asi ani nani anoida, uyu ndiwo mukana wako.

Nguva yakareba kwazvo yapfuura kubva pakatanga kuziviswa kwemusangano weHydra paHabrΓ©. Munguva iyi, basa rakawanda rakaitwa - uye ikozvino tine runyoro rwezvinenge zvese zvinyorwa. Hapana ane usimbe-akasungwa algorithms, angori akagovaniswa akaomesesa! Ngatipedzei nemashoko akazara tione zvatinazvo pamaoko manje.

Keynotes

Keynotes inotanga uye kupera mazuva emusangano. Kazhinji poindi yenyaya yekuvhura ndeyekumisa mweya mukuru negwara remusangano. Mashoko akakosha ekuvhara anodhirowa mutsara uye anotsanangura kuti tingararama sei neruzivo uye unyanzvi hunowanikwa mukati memusangano. Mavambo nemagumo: izvo zvinoyeukwa zvakanyanya, uye kazhinji, zvakawedzera kukosha.

Cliff Click Iyo H2O yakagovera K/V algorithm

19 hydra misoro. Kuongorora kukuru kwepurogiramu Cliff ingano munyika yeJava. Mukupera kwe90s, kune yake PhD thesis, akanyora bepa rine musoro "Kubatanidza Ongororo, Kubatanidza Optimizations", iyo imwe nguva gare gare yakava hwaro hweHotSpot JVM Server Compiler. Makore maviri gare gare, akanga atoshanda kuSun Microsystems paJVM uye akaratidza nyika yose kuti JIT ine kodzero yekuvepo. Iyi nyaya yese yekuti Java ndeimwe yeanomhanyisa nguva dzemazuva ano ine hungwaru uye nekukurumidza optimizations yakabva kuCliff Click. Pakutanga, zvaitendwa kuti kana chimwe chinhu chinowanikwa kune static compiler, haufanirwe kuyedza kuita jit. Nekuda kwebasa raCliff nechikwata, mitauro mitsva yese yakatanga kugadzirwa nepfungwa yeJIT kuunganidzwa nekukasira. Zvechokwadi, iri rakanga risiri basa remunhu mumwe chete, asi Cliff akaita basa rinokosha zvikuru mariri.

Muchikamu chekutanga, Cliff achataura nezve chimwe chiitiko chake - H20, in-memory platform yekugovera uye scalable muchina kudzidza kune maindasitiri maapplication. Kana kuti zvakanyanya, nezve kugovaniswa kuchengetwa kwekiyi-kukosha pairi mukati mayo. Iyi inzvimbo inokurumidza kukurumidza ine zvakawanda zvinonakidza zvivakwa (iyo chaiyo rondedzero iri mukati tsananguro), iyo inobvumira kushandiswa kwemhinduro dzakafanana mumasvomhu ekukura kwedata.

Mumwe mushumo uyo Cliff achapa ndewe- Iyo Azul Hardware Transactional Memory chiitiko. Chimwe chikamu chehupenyu hwake - makore gumi shanda kuAzul, kwaakagadziridza nekuvandudza zvinhu zvakawanda muAzul hardware uye tekinoroji stack: JIT compilers, runtime, thread model, kukanganisa kubata, stack kubata, hardware kukanganisa, kirasi kurodha, zvichingodaro - zvakanaka, unowana iyo pfungwa.

Chikamu chinonakidza chakatanga pavakagadzira Hardware yebhizinesi hombe - supercomputer yekushandisa Java. Chakanga chiri chinhu chitsva, chakagadzirirwa zvakanangana neJava, ine zvakakosha zvinodiwa - verenga zvipingamupinyi zvekuchengeta marara zvishoma-pause, kurongedza nekutarisa miganhu, kufona chaiko ... Imwe yeanotonhorera matekinoroji ihardware transactional memory. Iyo yese L1 yechero ipi ye864 cores inogona kutora chikamu mukunyora kwekutengeserana, iyo inonyanya kukosha pakushanda nemakiyi muJava (mabhuroko akawiriraniswa anogona kushanda mukuwirirana chero pasina ndangariro chaiyo yekunetsana). Asi iro zano rakanaka rakapwanywa nehukasha chokwadi - uye muhurukuro iyi Cliff achakuudza kuti sei HTM neSTM zvisina kunyatso kuenderana nezvinodiwa zvemakomputa ane tambo dzakawanda.

Michael Scott - Dual data zvimiro

19 hydra misoro. Kuongorora kukuru kwepurogiramu Michael Scott - Purofesa weComputer Science paYunivhesiti yeRochester, uyo akasangana naye atova nemakore makumi matatu nemana, uye kumba kwake University yeWisconsin-Madison, aive dhipatimendi kwemakore mashanu. Anotsvagisa uye anodzidzisa vadzidzi nezve kuenderana uye kugovera hurongwa uye dhizaini yemutauro.

Nyika yese inoziva Michael nekuda kwebhuku "Programming Language Pragmatics", iyo yazvino edition yakabudiswa munguva pfupi yapfuura - muna 2015. Basa rake "Algorithms ye scalable synchronization pane yakagovaniswa-memory multiprocessors" kugamuchirwa Dijkstra Prize seimwe yeanonyanya kuzivikanwa mumunda wekugoverwa komputa uye kureva nhema pachena paYunivhesiti yeRochester Online Library. Iwe unogona zvakare kumuziva semunyori weiyo Michael-Scott algorithm kubva "Ikareruka, Inokurumidza, uye Inoshanda Isiri Kuvharira uye Kuvharira Yakafanana Mutsara Algorithms".

Kana iri nyika yeJava, iyi inyaya yakakosha: pamwe naDoug Lea, akagadzira iyo isiri-yekuvharisa algorithms uye synchronous queues panoshanda Java maraibhurari. Izvi ndizvo chaizvo zvichange zviri zve "Dual data structures" - kuunzwa kwezvimiro izvi muJava SE 6 kwakavandudza mashandiro kagumi. java.util.concurrent.ThreadPoolExecutor. Kana iwe uchinetsekana mberi kuti aya "Dual data zvimiro" chii, saka pane ruzivo nezvazvo basa rakabatana.

Maurice Herlihy - Blockchains uye ramangwana rekugoverwa komputa

19 hydra misoro. Kuongorora kukuru kwepurogiramu Maurice Herlihy - akahwina maviri Dijkstra Prize. Yekutanga ndeyekushanda "Mirira-Yemahara Synchronization" (Brown University), uye yechipiri, ichangopfuura - "Transactional Memory: Rutsigiro Rwekuvaka rweKukiya-Yemahara Data Zvimiro" (Virginia Tech University). Mubairo weDijkstra unoona basa rine kukosha uye kukanganisa kwave kuoneka kweanoda kusvika makore gumi, uye Maurice zviri pachena kuti mumwe wenyanzvi dzine mukurumbira mumunda. Parizvino anoshanda sapurofesa paBrown University uye ane rondedzero-refu yendima yezvaakaita.

Mune ino yekuvhara keynote, Maurice achataura nezve dzidziso uye maitiro e blockchain akagoverwa masisitimu kubva pakuona kweiyo classics yekugoverwa komputa uye kuti inorerutsa sei akawanda ane hukama matambudziko. Uyu mushumo chete pamusoro wehurukuro yemusangano - kwete zvachose pamusoro pemigodhi hype, asi pamusoro pekuti ruzivo rwedu rungashandiswa sei zvinoshamisa zvinobudirira uye zvakakodzera maererano nemhando dzakasiyana dzemabasa.

Muna Chikunguru 2017, Maurice akatouya kuRussia kuzopinda chikoro cheSPTDC, akatora chikamu mumusangano weJUG.ru, uye kurekodha kunogona kutariswa paYouTube:

Main program

Tevere pachava nehwirudzuro pfupi yemishumo inobatanidzwa mupurogiramu. Mimwe mishumo inotsanangurwa pano zvakadzama, dzimwe muchidimbu. Tsanangudzo refu dzakaenda zvakanyanya kumishumo yemutauro wechiRungu yaida zvinongedzo kumapepa esainzi, mazwi paWikipedia, zvichingodaro. Rondedzero yakazara iripo ona pawebhusaiti yemusangano. Rondedzero iri pawebhusaiti ichagadziridzwa uye yowedzerwa.

Leslie Lamport - Mibvunzo & A

19 hydra misoro. Kuongorora kukuru kwepurogiramu Leslie Lamport ndiye munyori weseminal works muakagoverwa komputa. "LaTeX" inomirira "Lamport TeX". Ndiye akatanga, kumashure muna 1979, akaunza pfungwa iyi kuwirirana kunoenderana, uye chinyorwa chake "Maitiro Ekugadzira Multiprocessor Kombuta Inonyatsoita Multiprocess Zvirongwa" akagamuchira Dijkstra Prize.

Ichi ndicho chikamu chisina kujairika chechirongwa maererano nefomati, nekuti haisi kana rondedzero, asi chikamu chemubvunzo nemhinduro. Kana chikamu chakakosha chevateereri chatove chajaira (kana chinogona kujaira) nemhando dzese dzemabasa anobva pa "dzidziso yaLamport", zvinyorwa zvake nemishumo, zvinonyanya kukosha kushandisa nguva yese iripo pakutaurirana kwakananga.

Pfungwa yacho iri nyore - unotarisa mishumo miviri paYouTube: "Kuronga Kunofanira Kunyanya Kupfuura Coding" ΠΈ "Kana Usiri Kunyora Chirongwa, Usashandise Mutauro Wekuronga" uye gadzirira mubvunzo mumwe chete, uye Leslie achipindura.

Yekutanga yemavhidhiyo maviri aya tatova nawo yakashanduka kuita chinyorwa che habro. Kana iwe usina awa yenguva yekuona vhidhiyo, unogona kukurumidza kuiverenga yese muchimiro chemavara.

Ongorora: Kune akawanda akawanda Leslie Lamport mavhidhiyo paYouTube. Somuenzaniso, pane yakanaka TLA + kosi. Imwe vhezheni yeiyi kosi yese isina Indaneti inowanikwa pa peji remunyori, uye akaiisa kuYouTube kuti ionekwe nyore panharembozha.

Martin Kleppmann - Kubatanidza data pamidziyo yemushandisi yekudyidzana kwakagoverwa

19 hydra misoro. Kuongorora kukuru kwepurogiramu Martin Kleppmann muongorori paYunivhesiti yeCambridge ari kushanda paCRDT uye nekuongorora kwakarongeka kwealgorithms. bhuku raMartin "Kugadzira Data-Intensive Applications", yakabudiswa muna 2017, yakaratidza kuva yakabudirira zvikuru uye yakazviita pazvinyorwa zvinotengeswa zvakanyanya mumunda wekuchengetedza nekugadzirisa data. Kevin Scott, CTO kuMicrosoft, akamboti: β€œBhuku rino rinofanira kunge riripo kune mainjiniya esoftware. Ichi chinhu chisingawanikwe chinosanganisa dzidziso uye tsika kubatsira vanogadzira vakangwara mukugadzira nekuita masisitimu nema data system. " Mugadziri weKafka uye CTO yeConfluent, Jay Kreps, akataura zvakafanana.

Asati aenda mukutsvagisa zvedzidzo, Martin akashanda muindasitiri uye akabatanidza maviri akabudirira ekutanga-ups:

  • Rapportive, yakatsaurirwa kuratidza iyo yemagariro profiles kubva kune yako email, iyo LinkedIn yakatenga muna 2012;
  • Enda Kuiedza, sevhisi yekuyedza otomatiki mawebhusaiti mumabhurawuza akasiyana, akatengwa neRedGate muna 2009.

Kazhinji, Martin, kunyangwe asina mukurumbira kupfuura zvinyorwa zvedu, akatokwanisa kuita mupiro mukuvandudza komputa yakagoverwa uye kuindasitiri.

Muhurukuro iyi, Martin achataura nezvenyaya iri padyo netsvakiridzo yake yedzidzo. MuGoogle Docs uye yakafanana gwaro co-editing sofa, "kubatana editing" kunoreva basa rekudzokorora: mushandisi wega wega ane replica yavo yegwaro rakagovaniswa, ravanogadzirisa, uye shanduko dzese dzinotumirwa kunetiweki kune mamwe ese. vatori vechikamu. Kuchinja kumagwaro pasina Indaneti kunotungamirira mukusawirirana kwekanguva kwegwaro maererano nevamwe vatori vechikamu, uye kuwiriranisa zvakare kunoda kugadzirisa kukakavara. Ndizvo chaizvo zvavari kuvapo Mhando dzeData dzisina kusawirirana (CRDT), chokwadi, chinhu chitsva, hunhu hwacho hwakagadzirwa chete muna 2011. Hurukuro iyi inokurukura zvakaitika kubva ipapo munyika yeCRDT, ndedzipi budiriro ichangoburwa, nzira yekugadzira maapplication emunharaunda-yekutanga zvakazara uye kushandiswa kweraibhurari yakavhurika sosi. Automerge zvikuru sei.

Vhiki rinouya tichaburitsa hurukuro refu naMartin paHabrΓ©, zvichave zvinonakidza.

Pedro Ramalhete - Mirira-yemahara data zvimiro uye kumirira-yemahara kutengeserana

19 hydra misoro. Kuongorora kukuru kwepurogiramu Pedro anoshanda kuCisco uye anga achigadzira parallel algorithms kwemakore gumi apfuura kana zvakadaro, kusanganisira nzira dzekubatanidza, kukiya-yemahara uye kumirira-yemahara data zvimiro uye zvese zvaungafungidzira pane iyi nyaya. Tsvagiridzo yake yazvino uye zvido zveinjiniya zvinotarisana neUniversal Constructions, Software Transactional Memory, Persistent Memory uye matekinoroji akafanana anogonesa kuita kwakaringana, scalable uye kukanganisa-kushivirira zvikumbiro. Ndiye zvakare munyori webhurogu inozivikanwa zvakanyanya mumatenderedzwa matete Concurrency Freaks.

Zvishandiso zvakawanda zvakaverengerwa zvino mhanyisa pane dzakafanana dhata zvimiro, kubva mukushandiswa kwemameseji mitsara pakati pevatambi kuenda kune indexed data zvimiro muzvitoro zvakakosha-zvakakosha. Vanga vachishanda zvinobudirira muJava JDK kwemakore akawanda, uye vari kuwedzera zvishoma nezvishoma kuC ++.

Iyo yakapusa nzira yekushandisa inofananidzira data chimiro ndeye inoteedzana (imwe-tambo) kuita umo nzira dzinodzivirirwa nemutexes. Izvi zvinowanikwa kune chero June, asi zvine matambudziko ari pachena nekuyera uye kuita. Panguva imwecheteyo, kukiya-yemahara uye kumirira-yemahara data zvimiro hazvingoite zvirinani nezvikanganiso, asi zvakare zvine zvirinani kuita chimiro - zvisinei, kukura kwavo kunoda hunyanzvi hwakadzama uye kuchinjika kune chaiyo application. Mutsara mumwe usina kunaka wekodhi wakakwana kutyora zvese.

Tingazviita sei zvekuti kunyangwe asiri nyanzvi anogona kugadzira nekushandisa zvimiro zvedata zvakadaro? Izvo zvinozivikanwa kuti chero sequential algorithm inogona kuitwa shinda yakachengeteka uchishandisa chero dhizaini yepasi rose, kana kuti transactional memory. Chimwe chinhu, vanogona kuderedza chipingamupinyi chekupinda mukugadzirisa dambudziko iri. Nekudaro, ese ari maviri mhinduro anowanzo tungamira mukusashanda kuita. Pedro achataura nezvekuti vakakwanisa sei kuita kuti zvigadziriso izvi zvinyatsoshanda uye mashandisiro aungaita maalgorithms ako.

Heidi Howard - Kusunungura yakagovanisa kubvumirana

19 hydra misoro. Kuongorora kukuru kwepurogiramu Heidi Howard ari, saMartin, muongorori akagoverwa masisitimu paYunivhesiti yeCambridge. Hunhu hwake hunoenderana, kushivirira kukanganisa, kuita uye kugoverwa kubvumirana. Iye anozivikanwa zvakanyanya nekusarudzika kwake kwePaxos algorithm inonzi Flexible Paxos.

Yeuka kuti Paxos imhuri yezvibvumirano zvekugadzirisa dambudziko rekubvumirana mune network yemakomputa asina kuvimbika, zvichienderana nebasa raLeslie Lamport. Nekudaro, vamwe vevatauri vedu vari kushanda pamatambudziko akambotaurwa nevamwe vatauri vedu - uye izvi zvinoshamisa.

Kugona kuwana kubvumirana pakati pevazhinji vanogamuchira-yekutaura, sarudzo yemutungamiri, kuvharisa, kana kuronga-inyaya yakakosha mumasisitimu emazuva ano akaparadzirwa. Paxos ikozvino ndiyo nzira huru yekugadzirisa matambudziko ekubvumirana, uye kune kutsvagisa kwakawanda kuri kuitika kwakaitenderedza kuwedzera uye kukwidziridza algorithm kune zvakasiyana siyana zvinodiwa.

Muhurukuro iyi, tichaongororazve hwaro hwedzidziso yePaxos, kudzoreredza izvo zvepakutanga zvinodiwa uye kudzoreredza iyo algorithm. Tichaona kuti Paxos ingori sarudzo imwe chete pakati peyakakura nzira dzekubvumirana, uye kuti mamwe mapoinzi pane spectrum anobatsirawo pakuvaka masisitimu akanaka akagoverwa.

Alex Petrov - Deredza mari yako yekuchengetedza neTransient Replication uye Cheap Quorums

19 hydra misoro. Kuongorora kukuru kwepurogiramu Alex inyanzvi yedatabase uye yekuchengetedza masisitimu, uye zvakatonyanya kukosha kwatiri isu, anozvipira mukati Cassandra. Parizvino ari kushanda pabhuku, Database Internals, naO'Reilly.

Zvemasystem ane pakupedzisira kuenderana (mumutauro wechiRussian - "yekupedzisira kuwirirana"), mushure mekuparara kwenode kana kupatsanurwa kwetiweki, unofanirwa kugadzirisa dambudziko rinotevera: ramba uchiita zvikumbiro, kupira kuwirirana, kana kuramba kuzviita uye kuwanikwa kwechibayiro. Muhurongwa hwakadai, quorums, anopindirana ma subsets emanodhi uye kuona kuti inokwana node imwe ine yazvino kukosha, inogona kuve yakanaka kumucheto mhinduro. Iwe unogona kupona kukundikana uye kurasikirwa kwekubatana kune dzimwe node uchiri kupindura neazvino kukosha.

Zvisinei, zvinhu zvose zvine mutengo wazvo. A quorum replication scheme inoreva kuwedzera mari yekuchengetedza: data rakawandisa rinofanira kuchengetwa pamanode akawanda kamwechete kuve nechokwadi chekuti kune makopi akakwana aripo kana dambudziko raitika. Zvinoitika kuti haufanirwe kuchengetedza data rese pane zvese replicas. Iwe unogona kuderedza mutoro pakuchengetedza kana iwe ukachengeta data chete pachikamu chemanodhi, uye shandisa yakakosha node (Transient Replica) yekutadza kubata mamiriro.

Mukati memushumo tichakurukura Chapupu Replicas, chirongwa chekudzokorora chinoshandiswa mu Kutambanudza ΠΈ mega store, uye kuitwa kweiyi pfungwa muApache Cassandra yakadanwa Kudzokororwa Kwenguva & Yakachipa Quorums.

Dmitry Vyukov - Goroutines pachena

19 hydra misoro. Kuongorora kukuru kwepurogiramu Dmitry mugadziri paGoogle ari kushanda pakuyedzwa kwakasimba kweC/C++ uye Go - Kero/Memory/ThreadSanitizer, uye maturusi akafanana eLinux kernel. Yakapihwa kuGo a scalable goroutine scheduler, network poller, uye yakafanana inounganidza marara. Iye inyanzvi mumultithreading, munyori wegumi nemaviri asina-blocking algorithms uye ndiye muridzi we Black Belt Intel

Iye zvino zvishoma nezveshumo pachayo. Mutauro weGo une rutsigiro rwekuzvarwa rwekuverengera kwakawanda nenzira yegoroutines (shinda dzakareruka) nematashi (mitsetse yeFIFO). Matanho aya anoita kuti zvive nyore kwazvo uye zvinakidze kune vashandisi kunyora zvemazuva ano akawanda-treaded application, uye zvinoita semashiripiti. Sezvatinonzwisisa, hapana mashiripiti pano. Muhurukuro iyi, Dmitry achaongorora kuomarara kweGo scheduler uye kuratidza zvakavanzika zvekushandisa iyi "mashiripiti". Kutanga, achapa mhedziso yezvikamu zvikuru zvemugadziri uye kukuudza kuti zvinoshanda sei. Tevere, isu tinozonyatso tarisisa kune ega maficha senge yekupaka / yekusamisa nzira uye kubata inovharira system mafoni. Pakupedzisira, Dmitry achataura zvishoma pamusoro pezvinogoneka kuvandudzwa kune anoronga.

Dmitry Bugaichenko - Kumhanyisa kumusoro kwakagoverwa graph kuongororwa ne probabilistic sketches nezvimwe

19 hydra misoro. Kuongorora kukuru kwepurogiramu Dmitry akashanda mukushambadzira kweanoda kusvika makore 9 pasina kurasikirwa neyunivhesiti uye nenharaunda yesainzi. Kuongorora kukuru kwedhata muOdnoklassniki kwakava kwaari mukana wakasarudzika wekubatanidza dzidziso yedzidziso uye hwaro hwesainzi nekuvandudza kwechokwadi, mune-inodiwa zvigadzirwa.

Kugovera graph kuongororwa kwave uye kunoramba kuri basa rakaoma: kana zvave zvakakosha kuwana ruzivo nezve kubatanidzwa kweiyo yakavakidzana vertex, iyo data kazhinji inofanirwa kuendeswa pakati pemichina, izvo zvinotungamira kuwedzera nguva yekuuraya uye mutoro pane network network. Muhurukuro iyi, tichaona kuti iwe unogona sei kuwana yakakosha yekumhanyisa kumhanya uchishandisa probabilistic data zvimiro kana chokwadi senge symmetry yehushamwari girafu musocial network. Zvese izvi zvinoratidzwa nemienzaniso yekodhi muApache Spark.

Denis Rystsov - Deredza mari yako yekuchengetedza neTransient Replication uye Cheap Quorums

19 hydra misoro. Kuongorora kukuru kwepurogiramu Denis - mugadziri Cosmos DB, inyanzvi yekutarisa kuenderana modhi, kubvumirana algorithms, uye kugovera kutengeserana. Iye zvino anoshanda kuMicrosoft, uye zvisati zvaitika akashanda pane akagoverwa masisitimu kuAmazon neYandex.

Muhurukuro iyi, tichatarisa kune akagoverwa transaction protocols akagadzirwa mumakore mashoma apfuura, ayo anogona kuitwa kudivi remutengi pamusoro pechero chitoro chedata chinotsigira mamiriro ekugadzirisa (enzanisa uye kuseta). Chinokosha ndechekuti hupenyu hahupere nekuita kwezvikamu zviviri, kutengeserana kunogona kuwedzerwa pamusoro pechero dhatabhesi - padanho rekushandisa, asi mapuroteni akasiyana (2PC, Percolator, RAMP) ane kutengeserana kwakasiyana uye haana kupihwa kwatiri. zvemahara.

Alexey Zinoviev - Haasi ese maML algorithms anoita kuti igoverwe denga

19 hydra misoro. Kuongorora kukuru kwepurogiramu Alexei (zaleslaw) mutauri wenguva refu uye nhengo yemakomiti ehurongwa kune mamwe misangano. Kudzidzira mudzidzisi paEPAM Systems, uye anga ari shamwari naHadoop/Spark uye imwe data hombe kubvira 2012.

Muhurukuro iyi, Alexey achataura nezve matambudziko ekugadzirisa classical muchina kudzidza algorithms kuti aitwe mune yakagoverwa modhi zvichienderana neruzivo rwake rwekushanda neApache Spark ML, Apache Mahout, Apache Flink ML uye ruzivo rwekugadzira Apache Ignite ML. Alexey achataurawo nezve kuitwa kwekugoverwa kweML algorithms mune aya masisitimu.

Uye pakupedzisira, mishumo miviri kubva kuYandex nezveYandex Database.

Vladislav Kuznetsov - Yandex Database - sei isu tinovimbisa kukanganisa kushivirira

19 hydra misoro. Kuongorora kukuru kwepurogiramu Vladislav mugadziri paYandex muboka repuratifomu rakagoverwa. Yandex Database ndeye yakatwasuka scalable, geo-yakagoverwa, kukanganisa-kushivirira DBMS iyo inogona kutsungirira kutadza kwema disks, maseva, racks uye data centers pasina kurasikirwa nekuenderana. Kuve nechokwadi chekushivirira kukanganisa, proprietary algorithm yekuwana yakagoverwa kubvumirana inoshandiswa, pamwe neakawanda ehunyanzvi mhinduro, ayo anokurukurwa zvakadzama mumushumo. Chirevo chinogona kunge chiri chekufarira kune vese vanogadzira DBMS uye vagadziri vemhinduro dzekushandisa zvichibva paDBMS.

Semyon Checherinda - Kutengeswa kwakagoverwa muYDB

19 hydra misoro. Kuongorora kukuru kwepurogiramu Semyon mugadziri muboka rakaparadzirwa repuratifomu paYandex, achishanda pamusoro pekugona kwevazhinji-vanoroja kushandiswa kwekuiswa kweYDB.

Yandex Database yakagadzirirwa OLTP mibvunzo uye inoenderana neACID zvinodiwa kune transactional system. Mumushumo uyu, isu tichafunga nezve transaction kuronga algorithm iri pasi peYDB transaction system. Ngatitarisei kuti ndeapi masangano anotora chikamu mukutengeserana, anopa kurongeka kwepasirese kune kutengeserana, maitirwo eatomicity, kuvimbika, uye danho rakasimba rekuzviparadzanisa rinowanikwa. Tichishandisa dambudziko rakajairwa semuenzaniso, ngatitarisei mashandisirwo ekutengesa tichishandisa maviri-chikamu kuzvipira uye deterministic transactions. Ngatikurukurei kusiyana kwavo.

Chii chinotevera?

Purogiramu yemusangano inopfuurira kuzadzwa nemishumo mitsva. Kunyanya, isu tinotarisira mushumo kubva Nikita Koval (ndkoval) kubva kuJetBrains uye Oleg Anastasyev (m0nstermind) kubva kukambani yeOdnoklassniki. Nikita anoshanda pane algorithms ye coroutines muboka reKotlin, uye Oleg anovandudza zvivakwa uye zvigadziriso zveakakwira-mutoro masisitimu muOdnoklassniki papuratifomu. Pamusoro pezvo, kune 1 imwezve isina mamiriro slot, komiti yechirongwa iri kushanda nevamiriri vayo izvozvi.

Musangano weHydra uchaitika muna Chikunguru 11-12 muSt. Matikiti aripo kutenga pane webhusaiti yepamutemo. Ndokumbira utarise kuwanikwa kweTikiti repamhepo - kana nekuda kwechimwe chikonzero usingakwanisi kusvika kuSt. Petersburg mazuva ano.

Ndokuona kuHydra!

Source: www.habr.com

Voeg