Ngo-July 11-12, kuzoba nengqungquthela eSt
IHydra ingenye yezingqungquthela zethu ezibaluleke kakhulu eminyakeni yamuva. Yandulelwe ukulungiselela okunzima kakhulu, ukukhethwa kwezikhulumi nemibiko. ngayo ngesonto eledlule
We
Ukugqugquzela
Uma uhlela, khona-ke indlela eyodwa noma enye ubhekana ne-multithreading kanye ne-computing esabalalisiwe. Ochwepheshe emikhakheni efanelekile basebenza nabo ngokuqondile, kodwa ngokungagunci, ukusatshalaliswa kusibheka kusuka yonke indawo: kunoma iyiphi ikhompuyutha enamakhompiyutha amaningi noma isevisi esabalalisiwe, kunokuthile okwenza izibalo ngokuhambisana.
Kunezingqungquthela eziningi ezihlanganisa izici ezithile zohlelo lohlelo lokusebenza. Ngakolunye uhlangothi lwe-spectrum, sinezikole ezikhethekile zesayensi, ngefomethi yezinkulumo, eziveza amanani amakhulu wethiyori eyinkimbinkimbi. Ngokwesibonelo, ngesikhathi esifanayo neHydra eSt.
Cabanga ngalokhu: siphila esikhathini esimangalisayo lapho ungahlangana khona nabasunguli bomkhakha wesayensi nobunjiniyela esisebenza kuwo bukhoma. Izazi zefiziksi ngeke zihlangane no-Newton noma u-Einstein - isitimela sesihambile. Kodwa labo abadale izisekelo zemfundiso yezinhlelo ezisabalalisiwe, basungula izilimi ezithandwayo zokuhlela, futhi okokuqala ngqa konke lokhu kuhlanganiswe kuma-prototypes asebenzayo namanje bahlala eduze kwethu. Laba bantu abakayishiyi imisebenzi yabo phakathi nendawo, njengamanje benza imisebenzi yangempela emanyuvesi nezinkampani ezidume umhlaba wonke, futhi bayimithombo yolwazi nolwazi olukhulu kakhulu namuhla.
Ngakolunye uhlangothi, ithuba lokuhlangana nabo ngokuvamile lihlala liwumcabango nje kuphela: abambalwa bethu abangahlala beqapha imicimbi yomphakathi kwenye iNyuvesi yaseRochester ukuze baphuthume e-USA futhi babuyele esifundweni sikaMichael Scott. Ukuvakashela wonke amalungu e-Hydra ngokuvamile kungaba yinhlanhla encane, ngaphandle kokuchitha isikhathi esichithwa (yize kuzwakala njengokufuna okuthakazelisayo).
Ngakolunye uhlangothi, sinonjiniyela abaningi abaphezulu abasebenza ezinkingeni zangempela zezinhlelo ezisabalalisiwe njengamanje, futhi banokuthile okufanele bakutshele. Kodwa nansi inkinga - bona sebenzanesikhathi sabo siyigugu. Yebo, uma ungumsebenzi weMicrosoft, Google noma JetBrains, amathuba okuhlangana nezikhulumi ezaziwayo emcimbini wangaphakathi akhula kakhulu, kodwa ngokuvamile - cha, akwenzeki nsuku zonke.
Ngale ndlela, ingqungquthela yeHydra ifeza umsebenzi obalulekile iningi lethu elingeke liwenze lilodwa - endaweni eyodwa futhi ngesikhathi esisodwa, lihlanganisa ndawonye abantu imibono yabo noma ukuxhumana nabo okungashintsha impilo yakho. Ngiyavuma ukuthi akuwona wonke umuntu odinga izinhlelo ezisabalalisiwe, ezinye izinto eziyisisekelo eziyinkimbinkimbi. Ungahlela ama-CRUD ku-PHP impilo yakho yonke futhi ujabule ngokuphelele. Kodwa ubani oyidingayo - leli yithuba lakho.
Sekudlule isikhathi esiningi selokhu kumenyezelwe okokuqala kwengqungquthela yaseHydra ngoHabré. Ngalesi sikhathi, mningi umsebenzi owenziwe - futhi manje, sinohlu cishe yonke imibiko. Awekho ama-algorithms avilaphayo anentambo eyodwa, i-hardcore esabalalisiwe nje emsulwa! Ake siqedele ngamagama ajwayelekile, sibone ukuthi siphetheni manje.
Amanothi abalulekile
Amaphuzu abalulekile aqala futhi aphethe izinsuku zengqungquthela. Ngokuvamile inhloso yenkulumo eyisihluthulelo yokuvula iwukubeka umoya ojwayelekile kanye nesiqondiso senkomfa. Inkulumo eyisihluthulelo yokuvala idweba umugqa futhi ichaze ukuthi singaphila kanjani ngolwazi namakhono esiwathole ngezinsuku zengqungquthela. Isiqalo nesiphetho: okukhunjulwa kakhulu, futhi ngokuvamile, kunenani elikhulayo.
I-Cliff Click- I-H2O isabalalise i-algorithm ye-K/V
UCliff uyinganekwane emhlabeni weJava. Ngasekupheleni kweminyaka yama-90s, we-PhD thesis, wabhala iphepha elibizwa
Enkulumweni eyisihluthulelo, uCliff uzokhuluma ngomunye umsebenzi wakhe -
Enye inkulumo azoyikhuluma uCliff ithi
Ingxenye ethakazelisa kakhulu yaqala lapho benza i-hardware yebhizinisi elikhulu - ikhompyutha enkulu yokusebenzisa i-Java. Kwakuyinto entsha, eklanyelwe i-Java, enezidingo ezikhethekile - izithiyo zenkumbulo zokufunda ukuqoqwa kukadoti ongamile kancane, ama-arrays anokuhlolwa kwemingcele, izingcingo ezibonakalayo ... Obunye ubuchwepheshe obubanda kunazo zonke inkumbulo ye-hardware transactional. I-L1 yonke yanoma yimaphi ama-cores angu-864 ingabamba iqhaza ekubhaleni kokuthengiselana, okubaluleke kakhulu ekusebenzeni ngezingidi ku-Java (amabhlogo avumelanisiwe angasebenza ngokuhambisana, inqobo nje uma kungekho ukungqubuzana kwenkumbulo yangempela). Kodwa umbono omuhle washayisana neqiniso elibuhlungu - futhi kulo mbiko, u-Cliff uzokutshela ukuthi kungani i-HTM ne-STM zingazifanelekeli kahle izidingo ezingokoqobo zekhompyutha enezintambo eziningi.
UMichael Scott- Izakhiwo zedatha ekabili
Umhlaba wonke uyamazi uMichael ngenxa yencwadi yokufunda
Ngokuqondene nomhlaba we-Java, leli yicala elikhethekile: kanye no-Doug Lea, uthuthukise lawo ma-algorithms angavimbeli kanye nolayini abavumelanayo imitapo yolwazi ye-Java esebenza kuyo. Yilokhu okuzobe kumayelana nesihloko esithi “Dual data structures” - ukwethulwa kwalezi zakhiwo ku-Java SE 6 kusivumele ukuthi sithuthukise ukusebenza izikhathi ezingu-10. java.util.concurrent.ThreadPoolExecutor
. Uma unentshisekelo kusenesikhathi ukuthi ziyini lezi "Dual data structures", khona-ke kukhona
UMaurice Herlihy- Ama-Blockchains kanye nekusasa lekhompiyutha esabalalisiwe
Kulo mbhalo oyisihluthulelo wokuvala, uMaurice uzokhuluma ngethiyori kanye nokusebenza kwezinhlelo ezisatshalaliswa ze-blockchain ngokombono wama-classics we-computing esabalalisiwe nokuthi yenza lula izinkinga eziningi ezihlobene. Lo mbiko ugxile kuphela esihlokweni senkomfa - hhayi nhlobo mayelana nokuduma kwezimayini, kodwa kunalokho mayelana nokuthi ulwazi lwethu lungasetshenziswa kanjani ngendlela emangalisayo ngempumelelo nangokufanele maqondana nemisebenzi eyahlukene.
NgoJulayi 2017, uMaurice usevele wafika eRussia esikoleni se-SPTDC, wabamba iqhaza kumhlangano we-JUG.ru, futhi okurekhodiwe kungabukwa ku-YouTube:
Uhlelo oluyinhloko
Bese kuba nokubuyekezwa okufushane kwemibiko efakwe ohlelweni. Eminye yemibiko ichazwe kabanzi lapha, eminye kafushane. Izincazelo ezinde ziye ikakhulukazi emibikweni yolimi lwesiNgisi edinga izixhumanisi zamaphepha esayensi, amagama aku-Wikipedia, nokunye. Uhlu oluphelele lungaba
Leslie Lamport- I-Q & A
U-Leslie Lamport ungumbhali oyiphayona we-computing esabalalisiwe.
Lena ingxenye engavamile kakhulu yohlelo ngokwefomethi, ngoba akuwona ngisho umbiko, kodwa iseshini yemibuzo nezimpendulo. Lapho ingxenye ebalulekile yezethameli isivele ijwayele (noma ingajwayelana) nazo zonke izinhlobo zemisebenzi esekelwe kumbono kaLamport, izihloko nemibiko yakhe, kubaluleke kakhulu ukusebenzisa sonke isikhathi esitholakalayo ekuxhumaneni okuqondile.
Umbono ulula - ubuka imibiko emibili ku-YouTube:
Eyokuqala kulawa mavidiyo amabili esinawo kakade
Qaphela: Kunamavidiyo amaningi ku-YouTube no-Leslie Lamport. Ngokwesibonelo, kukhona okuhle kakhulu
UMartin Kleppman - Ivumelanisa idatha kuwo wonke amadivayisi womsebenzisi ukuze kuhlangatshezwane nayo
UMartin Kleppmann ungumcwaningi eNyuvesi yaseCambridge osebenza nge-CRDT kanye nokuqinisekiswa okusemthethweni kwe-algorithm. Incwadi kaMartin
Ngaphambi kokudlulela ocwaningweni lwezemfundo, uMartin wasebenza embonini futhi wasungula iziqalo ezimbili eziphumelelayo:
- Okuvumelanayo, okuzinikele ekuboniseni iphrofayili yomphakathi yoxhumana nabo be-imeyili, i-LinkedIn eyathenga ngo-2012;
- I-Go Test It, isihloli sewebhusayithi esizenzakalelayo seziphequluli eziningi esathengwa yiRedGate ngo-2009.
Ngokuvamile, nakuba uMartin engaziwa kakhulu kunama-keynoters ethu, usekwazile ukufaka isandla ekuthuthukiseni i-computing esabalalisiwe kanye nasembonini.
Kule nkulumo, uMartin uzokhuluma ngesihloko esiseduze nocwaningo lwakhe lwezemfundo. Ku-Google Amadokhumenti nakosofa ofanayo wamadokhumenti ababhalisa ngokubambisana, elithi "co-authoring" lisho umsebenzi wokuphindaphinda: umsebenzisi ngamunye unomfanekiso wakhe wedokhumenti eyabelwe, abe eseyilungisa, futhi zonke izinguquko zithunyelwa ngenethiwekhi kwabanye. yababambe iqhaza. Izinguquko ezingaxhunyiwe ku-inthanethi kumadokhumenti zibangela ukungqubuzana kwedokhumenti yesikhashana ngokuphathelene nabanye ababambiqhaza, futhi ukuvumelanisa kabusha kudinga ukusingatha ukungqubuzana. Kukhona nje lokhu
Ngesonto elizayo sizoshicilela inhlolokhono enkulu noMartin ku-Habré, kuzoba mnandi.
Pedro Ramalhete - Izakhiwo zedatha ezingalindi kanye nokwenziwe okungalindi
U-Pedro usebenza e-Cisco futhi ubelokhu enza ama-algorithms ahambisanayo kule minyaka eyishumi edlule, okuhlanganisa izindlela zokuvumelanisa, izakhiwo zedatha ezingakhiyiwe kanye nezokulinda, nakho konke ongakucabanga ngalesi sihloko. Izintshisekelo zakhe zamanje zocwaningo nezobunjiniyela zigxile ku-Universal Constructions, i-Software Transactional Memory, i-Persistent Memory, kanye nobuchwepheshe obufanayo bokuvumela izinhlelo zokusebenza ezifanele, ezingalawuleki, nezibekezelela amaphutha. Futhi ungumbhali webhulogi eyaziwa kabanzi emibuthanweni emincane
Iningi lezinhlelo zokusebenza ezinezintambo eziningi manje sezisebenzisa izakhiwo zedatha efanayo, kusukela ekusebenziseni ulayini wemilayezo phakathi kwabalingisi kuya kuzakhiwo zedatha ezinenkomba ezitolo zamanani angukhiye. Basebenze ngempumelelo ku-Java JDK iminyaka eminingi, futhi kancane kancane bengezwa ku-C ++.
Indlela elula yokusebenzisa ukwakheka kwedatha ehambisanayo ukuqaliswa kwe-serial (okunochungechunge olulodwa) lapho izindlela zivikelwe yi-mutexes. Lokhu kutholakala kunoma yimuphi ujun, kodwa kunezinkinga ezisobala zokukala nokusebenza. Ngesikhathi esifanayo, izakhiwo zedatha ezingakhiyiwe futhi ezingalindi azigcini nje ngokuphatha amaphutha kangcono, kodwa futhi zinephrofayili yokusebenza engcono - nokho, ukuthuthukiswa kwazo kudinga ubuchwepheshe obujulile nokuzivumelanisa nezimo ezithile zokusetshenziswa. Umugqa owodwa ongalungile wekhodi wanele ukuphula yonke into.
Ungaqinisekisa kanjani ukuthi ngisho nomuntu ongeyena uchwepheshe angakwazi ukuklama futhi asebenzise izakhiwo zedatha ezinjalo? Kuyaziwa ukuthi noma iyiphi i-algorithm elandelanayo ingenziwa iphephe noma yiyiphi
U-Heidi Howard- Ukukhulula ukuvumelana okusabalalisiwe
UHeidi Howard, njengoMartin, ungumcwaningi wezinhlelo ezisatshalaliswa eNyuvesi yaseCambridge. Ubuchwepheshe bakhe buwukuvumelana, ukubekezelela amaphutha, ukusebenza kanye nokuvumelana okusatshalaliswa. Waziwa kakhulu ngokwenza kwakhe i-algorithm ye-Paxos ebizwa ngokuthi
Khumbula ukuthi
Ikhono lokuthola ukuvumelana phakathi kwababungazi abaningi—lokukhuluma, ukukhetha abaholi, ukuvimba, noma ukuxhumanisa—kuyindaba ebalulekile ezinhlelweni ezisabalalisiwe zanamuhla. I-Paxos manje iyindlela eyinhloko yokuxazulula izinkinga zokuvumelana, futhi kunocwaningo oluningi oluzungezile ukuze kunwetshwe futhi kusetshenziswe ngokugcwele i-algorithm yezidingo ezihlukahlukene ezingokoqobo.
Kulo mbiko, sizophinde sivakashele isisekelo setiyori se-Paxos, siphumuze izimfuneko zokuqala futhi senze i-algorithm ibe jikelele. Sizobona ukuthi i-Paxos, empeleni, ingenye yezinketho phakathi kohlu olukhulu lwezindlela zokuvumelana, nokuthi amanye amaphuzu ku-spectrum nawo awusizo kakhulu ekwakheni izinhlelo ezinhle ezisabalalisiwe.
Alex Petrov - Yehlisa izindleko zakho zokugcina nge-Transient Replication kanye ne-Cheap Quorums
U-Alex ungumchwepheshe wedathabheyisi kanye nesitoreji futhi, okubaluleke kakhulu, uzinikele ku-
Okwamasistimu ane
Nokho, yonke into inenani layo. Isikimu sokuphindaphinda ikhoramu sisho izindleko ezikhuphukile zokugcina: kufanele ugcine idatha engasasebenzi kumanodi amaningi ngesikhathi esisodwa ukuze uqinisekise ukuthi amakhophi anele ayatholakala uma kwenzeka inkinga. Kuvele ukuthi awukwazi ukugcina yonke idatha kuzo zonke izifaniso. Ungakwazi ukunciphisa umthwalo endaweni yokugcina uma ugcina idatha kuphela engxenyeni yamanodi, futhi usebenzise amanodi akhethekile (I-Transient Replica) ngezimo zokwehluleka ukuphatha.
Ngokuqhubeka kombiko, sizocubungula
UDmitry Vyukov - Ama-goroutines aveziwe
UDmitry ungunjiniyela kwa-Google osebenza ku-C/C++ kanye nokuhlola okuguquguqukayo kwe-Go - Ikheli/Inkumbulo/I-ThreadSanitizer namathuluzi afanayo e-Linux kernel. Unikele ngesihleli se-goroutine esikhwehlelayo, umhloli wenethiwekhi, kanye nomqoqi wezibi ngesikhathi esisodwa ku-Go. Unguchwepheshe we-multithreading, umbhali wama-algorithms amasha angavimbeli ayishumi nambili futhi ungumnikazi we
Manje kancane mayelana nombiko ngokwawo. Ulimi lwe-Go lunosekelo lwendabuko lokufunda okuningi ngendlela yama-goroutines (imicu engasindi) namashaneli (olayini be-FIFO). Ngenxa yalezi zindlela, kulula kakhulu futhi kuyajabulisa kubasebenzisi ukubhala izinhlelo zokusebenza zesimanje ezinezihloko eziningi, futhi kubukeka njengomlingo. Njengoba siqonda, awukho umlingo lapha. Kulo mbiko, u-Dmitry uzohlolisisa ubunkimbinkimbi bomhleli we-Go futhi abonise izimfihlo zokusebenzisa lo “mlingo”. Okokuqala, uzonikeza umbono wezingxenye eziyinhloko zomhleli, ukuthi usebenza kanjani. Okulandelayo, sizobhekisisa izici ezithile, njengesu lokupaka / ukungapaki kanye nokusingatha izingcingo zesistimu yokuvinjwa. Ekugcineni, u-Dmitry uzokhuluma kancane mayelana nentuthuko engenzeka kumhleli.
UDmitry Bugaichenko - Ukusheshisa Ukuhlaziywa Kwegrafu Esabalalisiwe nge-Probabilistic Sketches nokunye
U-Dmitry usesebenze ekukhishweni kwemisebenzi cishe iminyaka eyi-9, ngaphandle kokulahlekelwa ukuxhumana nenyuvesi kanye nomphakathi wesayensi. Ukuhlaziywa kwedatha enkulu ku-Odnoklassniki kwakuyithuba eliyingqayizivele kuye lokuhlanganisa ukuqeqeshwa kwethiyori kanye nesisekelo sesayensi nokuthuthukiswa kwemikhiqizo yangempela, edingekayo.
Ukuhlaziywa kwegrafu esabalalisiwe kuye kwaba futhi kuhlala kuwumsebenzi onzima: lapho kudingekile ukuthola ulwazi mayelana nokuxhumeka kwe-vertex engumakhelwane, idatha ngokuvamile kufanele idluliselwe phakathi kwemishini, okuholela ekwandeni kwesikhathi sokwenza kanye nomthwalo kunethiwekhi. ingqalasizinda. Kule nkulumo, sizobona ukuthi ungathola kanjani ukusheshisa okubalulekile kokucubungula usebenzisa izakhiwo zedatha engenzeka noma amaqiniso afana nokulingana kwegrafu yobungane kunethiwekhi yokuxhumana nabantu. Konke lokhu kuboniswa ngezibonelo zekhodi ye-Apache Spark.
UDenis Rystsov - Yehlisa izindleko zakho zokugcina nge-Transient Replication kanye ne-Cheap Quorums
UDenis - unjiniyela
Kulo mbiko, sizojwayelana namaphrothokholi okwenziwayo asabalalisiwe asungulwe eminyakeni embalwa edlule, angasetshenziswa ohlangothini lweklayenti ngaphezu kwanoma isiphi isitolo sedatha esisekela ukubuyekezwa okunemibandela (qhathanisa futhi usethe). Okubalulekile ukuthi impilo ayipheli ngokuzibophezela kwezigaba ezimbili, ukuthengiselana kunganezelwa phezu kwanoma iyiphi isizindalwazi - ezingeni lesicelo, kodwa izivumelwano ezihlukene (2PC, Percolator, RAMP) zinokuhwebelana okuhlukile futhi azinikezwanga. Mahhala.
U-Alexey Zinoviev - Akuwona wonke ama-algorithms e-ML agcina esepharadesi elisabalalisiwe
U-Alexei (
Kule nkulumo, u-Alexey uzokhuluma ngezinkinga zokulungisa ama-algorithms wokufunda komshini wakudala ukuze asabalaliswe ngokususelwa kulwazi lwakhe nge-Apache Spark ML, Apache Mahout, Apache Flink ML kanye nolwazi lokudala i-Apache Ignite ML. U-Alexey uzophinde akhulume ngokusetshenziswa kwama-algorithms e-ML asabalalisiwe kulezi zinhlaka.
Futhi ekugcineni, imibiko emibili evela ku-Yandex mayelana ne-Yandex Database.
Vladislav Kuznetsov - I-Yandex Database - sikunikeza kanjani ukubekezelelana kwamaphutha
U-Vladislav ungunjiniyela kwa-Yandex eqenjini leplathifomu esabalalisiwe. I-Yandex Database iyi-DBMS enwebeka ngokuvundlile, esabalaliswe nge-geo, ebekezelela amaphutha engakwazi ukumelana nokwehluleka kwamadiski, amaseva, ama-racks, nezikhungo zedatha ngaphandle kokuphazamisa ukungaguquguquki. Ukuqinisekisa ukubekezelelana kwamaphutha, kusetshenziswa i-algorithm yokuvumelana esatshalaliswa ngokuphathelene, kanye nenani lezixazululo zobuchwepheshe, okuxoxwa ngazo ngokuningiliziwe embikweni. Umbiko ungase ube nentshisekelo kubo bobabili abathuthukisi be-DBMS nabathuthukisi bezisombululo ezisetshenzisiwe ezisekelwe ku-DBMS.
Semyon Checherin - Okwenziwayo kusatshalaliswe ku-YDB
U-Semyon ungumthuthukisi oseqenjini leplathifomu esabalalisiwe kwa-Yandex, osebenzela ukuthi kungenzeka kusetshenziswe abaqashi abaningi ukufakwa kwe-YDB.
I-Yandex Database yakhelwe imibuzo ye-OLTP futhi ihlangabezana nezimfuneko ze-ACID zesistimu yokwenziwayo. Embikweni, sizocubungula i-algorithm yokuhlela umsebenzi engaphansi kwesistimu yokwenziwayo ye-YDB. Ake sihlaziye ukuthi yimaphi amabhizinisi abamba iqhaza ekuthengiseni, ngubani owabela i-oda lomhlaba wonke ekuthengeni, ukuthi i-atomicity yomsebenzi, ukwethembeka kanye nezinga eliqinile lokuzihlukanisa lifinyelelwa kanjani. Sisebenzisa isibonelo somsebenzi ojwayelekile, ake sicabangele ukuqaliswa kokwenziwayo kusetshenziswa isibopho sezigaba ezimbili kanye nemisebenzi enqumayo. Ake sixoxe ngokuhlukana kwabo.
Yini okulandelayo?
Uhlelo lwengqungquthela lusaqhubeka nokugcwala imibiko emisha. Ikakhulukazi, silindele umbiko ovela Nikita Koval (
Ingqungquthela yakwaHydra izoba ngoJulayi 11-12 eSt. Amathikithi angaba
Sanibona eHydra!
Source: www.habr.com