Msonkhano udzachitika pa July 11-12 ku St , odzipereka ku chitukuko cha machitidwe ofanana ndi ogawidwa. Chinyengo cha Hydra ndikuti chimagwirizanitsa asayansi ozizira (omwe nthawi zambiri amapezeka pamisonkhano yasayansi yakunja) ndi akatswiri odziwika bwino kukhala pulogalamu imodzi yayikulu pamzere wa sayansi ndi machitidwe.
Hydra ndi imodzi mwamisonkhano yathu yofunika kwambiri m'zaka zingapo zapitazi. Zinatsogoleredwa ndi kukonzekera kwakukulu, kusankha okamba nkhani ndi malipoti. Sabata yatha za izi ndi director wa JUG.ru Gulu, Alexey Fedorov ().
ife pafupifupi ophunzira atatu ofunikira, omwe anayambitsa chiphunzitso cha machitidwe ogawidwa - Leslie Lamport, Maurice Herlihy ndi Michael Scott. Yakwana nthawi yoti tikambirane mwatsatanetsatane za pulogalamu yonse!
Chilimbikitso
Ngati mukuchita nawo mapulogalamu, ndiye kuti njira imodzi kapena yina mukuchita ndi multithreading ndi kugawa makompyuta. Akatswiri m'magawo okhudzidwa amagwira nawo ntchito mwachindunji, koma momveka bwino, kugawa kumatiyang'ana kuchokera kulikonse: mu kompyuta iliyonse yamagulu ambiri kapena ntchito yogawidwa pali chinachake chomwe chimapanga mawerengedwe mofanana.
Pali misonkhano yambiri yomwe imakhudza mbali zosiyanasiyana zamapulogalamu ogwiritsira ntchito. Kumbali ina ya sipekitiramu, tili ndi masukulu apadera asayansi omwe amawulula ziphunzitso zambiri zovuta m'makalasi. Mwachitsanzo, mofanana ndi Hydra ku St. Petersburg pali . Pamsonkhano wa Hydra, tidayesetsa kusonkhanitsa machitidwe ankhanza, sayansi, ndi chilichonse pamzere wawo.
Ganizilani izi: tikukhala mu nthawi yodabwitsa pamene mutha kukumana ndi anthu omwe adayambitsa gawo la sayansi ndi uinjiniya lomwe timaphunzira. Asayansi sangakumane ndi Newton kapena Einstein - sitimayo yachoka. Koma pafupi ndi ife tikukhalabe amene analenga maziko a chiphunzitso cha machitidwe anagawira, anatulukira zilankhulo zodziwika bwino mapulogalamu, ndipo kwa nthawi yoyamba ophatikizidwa izi zonse prototypes ntchito. Anthu awa sanasiye ntchito zawo pang'onopang'ono, pakali pano akugwira ntchito zovuta m'mayunivesite otchuka padziko lonse lapansi ndi makampani, ndipo ndi magwero akuluakulu a chidziwitso ndi zochitika lero.
Kumbali inayi, mwayi wokumana nawo nthawi zambiri umakhala wongopeka chabe: ochepa aife amatha kuyang'anira zochitika zapagulu ku yunivesite ina ya Rochester, ndikuthamangira ku USA ndikubwerera kukakamba ndi Michael Scott. Kuyendera mamembala onse a Hydra kungawononge ndalama zochepa, osawerengera phompho la nthawi yotayika (ngakhale zikumveka ngati kufunafuna kosangalatsa).
Kumbali inayi, tili ndi mainjiniya ambiri apamwamba omwe akugwira ntchito yolimbikitsira zovuta pamakina ogawidwa pakali pano, ndipo ali ndi zambiri zoti anene. Koma apa pali vuto - iwo ntchito, ndipo nthawi yawo ndi yofunika. Inde, ngati ndinu wogwira ntchito ku Microsoft, Google kapena JetBrains, mwayi wokumana ndi m'modzi mwa okamba nkhani pazochitika zamkati ukuwonjezeka kwambiri, koma kawirikawiri, ayi, izi sizichitika tsiku lililonse.
Mwanjira imeneyi, Msonkhano wa Hydra umakwaniritsa ntchito yofunika yomwe ambiri aife sitingathe kuchita tokha - pamalo amodzi komanso nthawi imodzi, imasonkhanitsa anthu omwe malingaliro awo kapena kuyanjana kwawo kungasinthe moyo wanu. Ndikuvomereza kuti si aliyense amene amafunikira machitidwe ogawidwa kapena zinthu zina zovuta. Mutha kukonza ma CRUD mu PHP kwa moyo wanu wonse ndikukhala osangalala. Koma amene angafune, uwu ndi mwayi wanu.
Papita nthawi yayitali kuchokera pomwe chilengezo choyamba cha msonkhano wa Hydra pa HabrΓ©. Panthawiyi, ntchito zambiri zachitika - ndipo tsopano tili ndi mndandanda wa pafupifupi malipoti onse. Palibe ma algorithms aulesi a ulusi umodzi, amangogawaniza olimba! Tiyeni timalize ndi mawu wamba ndikuwona zomwe tili nazo m'manja mwathu tsopano.
Mfundo zazikuluzikulu
Mfundo zazikuluzikulu zimayamba ndi kutha masiku a msonkhano. KaΕ΅irikaΕ΅iri mfundo yaikulu yotsegulira ndiyo kukhazikitsa mzimu wonse ndi chitsogozo cha msonkhanowo. Mawu omalizira amajambula mzere ndikufotokozera momwe tingakhalire ndi chidziwitso ndi luso lomwe tapeza pa msonkhano. Chiyambi ndi mapeto: zomwe zimakumbukiridwa bwino, ndipo kawirikawiri, zawonjezeka kwambiri.
Cliff Dinani
Cliff ndi nthano m'dziko la Java. Chakumapeto kwa zaka za m'ma 90, chifukwa cha chiphunzitso chake cha PhD, adalemba pepala lotchedwa , yomwe patapita nthawi inakhala maziko a HotSpot JVM Server Compiler. Zaka ziwiri pambuyo pake, anali akugwira ntchito kale ku Sun Microsystems pa JVM ndipo adawonetsa dziko lonse kuti JIT ili ndi ufulu wokhalapo. Nkhani yonseyi yokhudzana ndi momwe Java ilili imodzi mwamasewera othamanga kwambiri amakono okhala ndi kukhathamiritsa kwanzeru komanso kwachangu kwambiri idachokera ku Cliff Click. Poyambirira, ankakhulupirira kuti ngati chinachake chikupezeka kwa static compiler, simuyenera kuyesa jit. Chifukwa cha ntchito ya Cliff ndi timu, zilankhulo zonse zatsopano zidayamba kupangidwa ndi lingaliro la JIT kuphatikiza mwachisawawa. Inde, iyi sinali ntchito ya munthu mmodzi, koma Cliff adagwira ntchito yofunika kwambiri.
M'mawu otsegulira, Cliff alankhula za ntchito yake ina - , nsanja yosungiramo makina ophunzirira makina ogawa komanso owopsa pamafakitale. Kapenanso ndendende, za kusungidwa kogawidwa kwa makiyi amtengo wapatali mkati mwake. Uku ndikusungirako mwachangu kwambiri komwe kuli ndi zinthu zambiri zosangalatsa (mndandanda weniweniwo uli mkati ), zomwe zimalola kugwiritsa ntchito njira zofananira pamasamu akusamutsa deta yayikulu.
Lipoti lina lomwe Cliff apereka ndi - . Mbali ina ya mbiri yake - zaka khumi , komwe adasintha ndikusintha zinthu zambiri muzinthu zamtundu wa Azul ndi ukadaulo: ophatikiza a JIT, nthawi yothamanga, mtundu wa ulusi, kuwongolera zolakwika, kuwongolera ma stack, kusokoneza kwa hardware, kutsitsa kalasi, ndi zina zotero - chabwino, mumapeza lingaliro.
Gawo losangalatsa kwambiri lidayamba pomwe adapanga zida zamabizinesi akulu - kompyuta yayikulu kuyendetsa Java. Chinali chinthu chatsopano, chopangidwa makamaka kwa Java, chomwe chili ndi zofunikira zapadera - werengani zolepheretsa kukumbukira zotayira pang'onopang'ono, kufufuza malire, mafoni enieni ... Imodzi mwa matekinoloje ozizira kwambiri ndi hardware transactional memory. L1 yonse yamtundu uliwonse wa 864 imatha kutenga nawo gawo pakulemba, zomwe ndizofunikira kwambiri pogwira ntchito ndi maloko ku Java (ma blocks olumikizidwa amatha kugwira ntchito limodzi malinga ngati palibe mkangano weniweni wamakumbukiro). Koma lingaliro lokongolalo lidaphwanyidwa ndi zowona zowawa - ndipo munkhani iyi Cliff akuwuzani chifukwa chomwe HTM ndi STM sizoyenera kwambiri pazofunikira zamakompyuta amitundu yambiri.
Michael Scott -
- Pulofesa wa Sayansi Yamakompyuta ku Yunivesite ya Rochester, yemwe adamulumikizana naye , ndipo kunyumba kwawo ku University of Wisconsin-Madison, anali woyang'anira kwa zaka zisanu. Iye amafufuza ndi kuphunzitsa ophunzira za kufanana ndi kugawa mapulogalamu ndi chinenero kapangidwe.
Dziko lonse lapansi limamudziwa Michael chifukwa cha bukuli , kope laposachedwa kwambiri lomwe linasindikizidwa posachedwa - mu 2015. Ntchito yake cholandiridwa monga mmodzi wa otchuka kwambiri m'munda wa anagawira kompyuta ndi ku University of Rochester Online Library. Mutha kumudziwanso ngati mlembi wa algorithm ya Michael-Scott kuchokera .
Ponena za dziko la Java, iyi ndi nkhani yapadera: pamodzi ndi Doug Lea, adapanga ma aligorivimu osatsekereza ndi mizere yolumikizana yomwe malaibulale a Java amagwira ntchito. Izi ndi zomwe mawu ofunikira a "Dual data structures" adzakhale - kukhazikitsidwa kwazinthu izi mu Java SE 6 kwasintha magwiridwe antchito ka 10. java.util.concurrent.ThreadPoolExecutor. Ngati mukudzifunsa pasadakhale kuti "Dual data structures" ndi chiyani, ndiye kuti pali zambiri za izo .
Maurice Herlihy -
- wopambana Mphotho ziwiri za Dijkstra. Yoyamba ndi yogwira ntchito (Brown University), ndipo yachiwiri, yaposachedwa kwambiri - (Virginia Tech University). Mphotho ya Dijkstra imazindikira ntchito yomwe kufunikira kwake komanso mphamvu zake zakhala zikuwonekera kwa zaka zosachepera khumi, ndipo Maurice mwachidziwikire ndi m'modzi mwa akatswiri odziwika bwino pantchitoyi. Panopa amagwira ntchito ngati pulofesa ku Brown University ndipo ali ndi mndandanda wautali wazomwe akwaniritsa.
M'mawu omaliza awa, Maurice alankhula za chiphunzitso ndi machitidwe a blockchain omwe amagawira machitidwe kuchokera pamalingaliro akale a makompyuta omwe amagawidwa komanso momwe amachepetsera zovuta zambiri. Ili ndi lipoti lapadera pa mutu wa msonkhano - osati za migodi, koma za momwe chidziwitso chathu chingagwiritsire ntchito modabwitsa komanso moyenera mogwirizana ndi ntchito zosiyanasiyana.
Mu Julayi 2017, Maurice adabwera kale ku Russia kusukulu ya SPTDC, adachita nawo msonkhano wa JUG.ru, ndipo zojambulidwa zitha kuwonedwa pa YouTube:
Pulogalamu yayikulu
Kenako padzakhala chidule chachidule cha malipoti ophatikizidwa mu pulogalamuyi. Malipoti ena akufotokozedwa mwatsatanetsatane apa, ena mwachidule. Kufotokozera kwautali kumapita makamaka ku malipoti a chilankhulo cha Chingerezi omwe amafunikira maulalo a mapepala asayansi, mawu pa Wikipedia, ndi zina zotero. Mndandanda wathunthu ulipo . Mndandanda womwe uli patsamba lino udzasinthidwa ndikuwonjezeredwa.
Leslie Lamport -
Leslie Lamport ndi mlembi wa ntchito za seminal mu computing yogawidwa. imayimira "Lamport TeX". Ndi iye amene poyamba, kumbuyo mu 1979, anayambitsa lingaliro , ndi nkhani yake adalandira Mphotho ya Dijkstra.
Ichi ndi gawo lachilendo kwambiri la pulogalamuyo, chifukwa si lipoti, koma gawo la mafunso ndi mayankho. Pamene gawo lalikulu la omvera likuzoloΕ΅era kale (kapena likhoza kudziwika) ndi mitundu yonse ya ntchito zochokera ku "lingaliro la Lamport", zolemba zake ndi malipoti ake, ndizofunika kwambiri kugwiritsa ntchito nthawi yonse yopezeka pakulankhulana mwachindunji.
Lingaliro ndi losavuta - mumawonera malipoti awiri pa YouTube: ΠΈ ndi kukonzekera funso limodzi, ndipo Leslie ayankhe.
Yoyamba mwa mavidiyo awiriwa tili nawo kale . Ngati mulibe ola la nthawi yowonera kanemayo, mutha kuwerenga zonse mwachangu m'mawu.
Chidziwitso: Pali makanema ambiri a Leslie Lamport pa YouTube. Mwachitsanzo, pali chachikulu . Mtundu wapaintaneti wamaphunziro onsewa ukupezeka pa , ndipo adayiyika pa YouTube kuti muwone mosavuta pazida zam'manja.
Martin Kleppmann -
Martin Kleppmann ndi wofufuza pa yunivesite ya Cambridge akugwira ntchito pa CRDT ndi kutsimikizira kovomerezeka kwa ma algorithms. Buku la Martin , yofalitsidwa mu 2017, idakhala yopambana kwambiri ndipo idalowa pamndandanda wazogulitsa kwambiri pankhani yosungira ndi kukonza deta. Kevin Scott, CTO ku Microsoft, : βBuku ili liyenera kukhala lofunikira kwa akatswiri opanga mapulogalamu. Ichi ndi chida chosowa chomwe chimaphatikiza malingaliro ndi machitidwe kuti athandize opanga mapulogalamu kukhala anzeru popanga ndi kukhazikitsa zida ndi ma data. " Wopanga Kafka ndi CTO wa Confluent, Jay Kreps, adanenanso chimodzimodzi.
Asanalowe mu kafukufuku wamaphunziro, Martin adagwira ntchito m'makampani ndipo adayambitsa zoyambira ziwiri zopambana:
- Mwachidziwitso, odzipereka kuti awonetse mbiri ya anthu omwe amalumikizana nawo kuchokera ku imelo yanu, yomwe LinkedIn idagula mu 2012;
- Go Test It, ntchito yoyesera mawebusayiti pamasamba osiyanasiyana, omwe RedGate adagula mu 2009.
Mwambiri, Martin, ngakhale kuti ndi wocheperako kuposa mawu athu ofunikira, watha kuthandizapo pakupanga makompyuta ogawa komanso makampani.
Munkhani iyi, Martin alankhula za mutu womwe uli pafupi ndi kafukufuku wake wamaphunziro. Mu Google Docs ndi sofa zofananira zolembera zolemba, "kusintha kogwirizana" kumatanthawuza ntchito yobwereza: wogwiritsa ntchito aliyense ali ndi mawonekedwe ake a chikalata chomwe adagawana, chomwe amachisintha, ndipo zosintha zonse zimatumizidwa pa netiweki kumadera ena onse. otenga nawo mbali. Kusintha kwa zolemba zapaintaneti kumabweretsa kusagwirizana kwakanthawi kwa chikalatacho poyerekeza ndi ena omwe atenga nawo gawo, ndipo kuyanjanitsanso kumafuna kuthana ndi mikangano. Ndicho chimodzimodzi chimene iwo alipo (CRDT), kwenikweni, ndi chinthu chatsopano, chomwe chinapangidwa kokha mu 2011. Nkhaniyi ikufotokoza zomwe zakhala zikuchitika kuyambira nthawi imeneyo kudziko la CRDT, zomwe zapita patsogolo posachedwapa, njira yopangira mapulogalamu amtundu woyamba komanso kugwiritsa ntchito laibulale yotseguka. makamaka.
Sabata yamawa tidzasindikiza zokambirana zazitali ndi Martin pa HabrΓ©, zidzakhala zosangalatsa.
Pedro Ramalhete -
Pedro amagwira ntchito ku Cisco ndipo wakhala akupanga ma aligorivimu ofananira kwa zaka khumi zapitazi, kuphatikiza njira zolumikizirana, zopanda zokhoma komanso zopanda kudikirira ndi chilichonse chomwe mungaganizire pamutuwu. Kafukufuku wake wapano ndi zokonda zauinjiniya amayang'ana kwambiri Zomangamanga za Universal, Memory Transactional Memory, Persistent Memory ndi matekinoloje ofanana omwe amalola kugwiritsa ntchito zolondola, zowopsa komanso zololera zolakwika. Ndiyenso mlembi wa blog yomwe imadziwika kwambiri pamabwalo opapatiza .
Mapulogalamu ambiri owerengeka tsopano akuyenda pazida zofananira, kuyambira pamizere ya mauthenga pakati pa ochita zisudzo kupita kumagulu a data omwe amasungidwa m'masitolo ofunika kwambiri. Iwo akhala akugwira ntchito bwino mu Java JDK kwa zaka zambiri, ndipo akuwonjezeredwa pang'onopang'ono ku C ++.
Njira yosavuta yogwiritsira ntchito deta yofanana ndi ndondomeko yotsatizana (yamtundu umodzi) yomwe njira zimatetezedwa ndi mutexes. Izi zitha kupezeka mu June aliyense, koma zimakhala ndi zovuta zowonekera pakukweza ndi magwiridwe antchito. Panthawi imodzimodziyo, mapangidwe a deta opanda zokhoma komanso odikirira samangolimbana ndi zolakwika, komanso amakhala ndi mbiri yabwino - komabe, chitukuko chawo chimafuna ukadaulo wozama komanso kusinthika ku ntchito inayake. Mzere umodzi wolakwika wa code ndi wokwanira kuswa chirichonse.
Kodi tingapange bwanji kuti ngakhale osakhala katswiri azitha kupanga ndi kukhazikitsa ma data otere? Zimadziwika kuti algorithm iliyonse yotsatizana imatha kupangidwa kuti ikhale yotetezeka pogwiritsa ntchito , kapena kukumbukira zochitika. Chifukwa chimodzi, atha kutsitsa chotchinga cholowera kuthetsa vutoli. Komabe, mayankho onse awiriwa nthawi zambiri amabweretsa kusagwira ntchito moyenera. Pedro alankhula za momwe adakwanitsira kupanga mapangidwewa kukhala ogwira mtima komanso momwe mungawagwiritsire ntchito pama algorithms anu.
Heidi Howard -
Heidi Howard ndi, monga Martin, wofufuza machitidwe ku yunivesite ya Cambridge. Zopadera zake ndizokhazikika, kulekerera zolakwika, magwiridwe antchito komanso kugawirana. Amadziwika kwambiri chifukwa cha kuphatikizika kwake kwa algorithm ya Paxos yotchedwa .
Kumbukirani kuti ndi banja la ma protocol kuti athetse vuto la kuvomerezana pa intaneti ya makompyuta osadalirika, kutengera ntchito ya Leslie Lamport. Chifukwa chake, ena mwa okamba athu akugwira ntchito pamavuto omwe adanenedwa poyambirira ndi okamba athu ena - ndipo izi nzodabwitsa.
Kutha kupeza mgwirizano pakati pa osungira angapo - poyankhulira, kusankha atsogoleri, kutsekereza, kapena kugwirizanitsa - ndi nkhani yofunika kwambiri pamachitidwe amakono ogawidwa. Paxos tsopano ndiyo njira yayikulu yothetsera mavuto ogwirizana, ndipo pali kafukufuku wambiri omwe akuchitika mozungulira kuti akulitse ndi kukhathamiritsa ma aligorivimu pazosowa zosiyanasiyana.
Munkhani iyi, tiwonanso maziko azongopeka a Paxos, kumasula zofunikira zoyambilira ndikuwongolera ma aligorivimu. Tiwona kuti Paxos kwenikweni ndi njira imodzi yokha pakati pamitundu yambiri yogwirizana, komanso kuti mfundo zina pamawonekedwe ndizothandiza kwambiri pomanga machitidwe abwino omwe amagawidwa.
Alex Petrov -
Alex ndi katswiri wamakina osungira ndi makina osungira, ndipo chofunikira kwambiri kwa ife, odzipereka . Pano akugwira ntchito pa bukhu, Database Internals, ndi O'Reilly.
Kwa machitidwe ndi (m'mawu achi Russia - "kusagwirizana komaliza"), pambuyo pa kuwonongeka kwa node kapena kugawanika kwa netiweki, muyenera kuthana ndi vuto ili: pitilizani kuchita zopempha, kudzipereka kosasinthasintha, kapena kukana kuzikwaniritsa ndikudzipereka. M'dongosolo loterolo, ma quorum, magawo ang'onoang'ono a node ndikuwonetsetsa kuti mfundo imodzi ili ndi mtengo waposachedwa kwambiri, ikhoza kukhala yankho labwino kwambiri. Mutha kupulumuka zolephereka ndi kutayika kwa kulumikizana ndi ma node ena ndikuyankhabe ndi zikhalidwe zaposachedwa.
Komabe, chilichonse chili ndi mtengo wake. Ndondomeko yobwerezabwereza quorum imatanthawuza kuwonjezereka kwa ndalama zosungirako: deta yowonjezereka iyenera kusungidwa pa mfundo zingapo nthawi imodzi kuti zitsimikizire kuti pali makope okwanira pamene vuto lichitika. Zikuoneka kuti simuyenera kusunga deta zonse pa replicas onse. Mukhoza kuchepetsa katundu pa yosungirako ngati kusunga deta kokha pa mbali ya mfundo, ndi ntchito mfundo zapadera (Transient Replica) kwa kulephera kusamalira zochitika.
Mkati mwa lipotili tidzakambirana , ndondomeko yobwerezabwereza yomwe imagwiritsidwa ntchito mu ΠΈ , ndi kukhazikitsidwa kwa lingaliro ili mu Apache Cassandra wotchedwa .
Wotchedwa Dmitry Vyukov -
Dmitry ndi wopanga ku Google akugwira ntchito yoyesa mwamphamvu C/C++ ndi Go - Address/Memory/ThreadSanitizer, ndi zida zofananira za Linux kernel. Zathandizira ku Go a scalable goroutine scheduler, network poller, ndi ofanana nawo otolera zinyalala. Iye ndi katswiri pa multithreading, mlembi wa khumi ndi awiri ma algorithms atsopano osatsekereza ndipo ndi mwini wake wa Intel.
Tsopano pang'ono za lipoti lokha. Chiyankhulo cha Go chili ndi chithandizo cha komweko pakuwerengera zambiri monga ma goroutines (ulusi wopepuka) ndi ma tchanelo (mizere ya FIFO). Njirazi zimapangitsa kuti zikhale zosavuta komanso zosangalatsa kwa ogwiritsa ntchito kulemba mapulogalamu amakono amitundu yambiri, ndipo amawoneka ngati matsenga. Monga tikumvetsetsa, palibe matsenga pano. M'nkhani iyi, Dmitry adzafufuza zovuta za Go scheduler ndikuwonetsa zinsinsi zakugwiritsa ntchito "matsenga" awa. Choyamba, adzapereka mwachidule zigawo zazikulu za ndondomeko ndikukuuzani momwe zimagwirira ntchito. Kenako, tiyang'ana mwatsatanetsatane mbali zonse monga njira yoyimitsa magalimoto / kuyimitsa magalimoto komanso kuyendetsa mafoni oletsa kuyimitsa. Pomaliza, wotchedwa Dmitry kulankhula pang'ono za kusintha zotheka kwa scheduler.
Wotchedwa Dmitry Bugaichenko -
Dmitry adagwira ntchito yogulitsa ntchito kwa zaka pafupifupi 9 osataya kulumikizana ndi yunivesite komanso gulu lasayansi. Kusanthula kwakukulu kwa data ku Odnoklassniki kunakhala kwa iye mwayi wapadera wophatikiza maphunziro aukadaulo ndi maziko asayansi ndi chitukuko cha zinthu zenizeni, zomwe zimafunikira.
Kugawidwa kwa ma graph kwakhala ndipo kumakhalabe ntchito yovuta: pakafunika kudziwa zambiri za kulumikizana kwa vertex yoyandikana nayo, deta nthawi zambiri imayenera kusamutsidwa pakati pa makina, zomwe zimapangitsa kuti nthawi yowonjezereka iwonongeke komanso kunyamula katundu pa intaneti. Munkhani iyi, tiwona momwe tingapezere liwiro lalikulu pogwiritsira ntchito ma data a probabilistic kapena zowona monga ma symmetry a graph yaubwenzi pamalo ochezera. Zonsezi zikuwonetsedwa ndi zitsanzo zamakhodi ku Apache Spark.
Denis Rystsov -
Denis - wopanga , Katswiri wofufuza zitsanzo zotsatizana, ma aligorivimu ogwirizana, ndi kugawidwa kwa magawo. Panopa amagwira ntchito ku Microsoft, ndipo zisanachitike adagwira ntchito ku Amazon ndi Yandex.
M'nkhani iyi, tiwona njira zogawira zomwe zapangidwa zaka zingapo zapitazi, zomwe zitha kukhazikitsidwa kumbali ya kasitomala pamwamba pa sitolo iliyonse ya data yomwe imathandizira kusintha kokhazikika (yerekezerani ndi kukhazikitsa). Chofunikira ndichakuti moyo sumatha ndi kudzipereka kwa magawo awiri, zogulitsa zitha kuwonjezeredwa pamwamba pa nkhokwe iliyonse - pamlingo wofunsira, koma ma protocol osiyanasiyana (2PC, Percolator, RAMP) ali ndi ma tradeoffs osiyanasiyana ndipo sanapatsidwe kwa ife. kwaulere.
Alexey Zinoviev -
Alexei () ndi wokamba nkhani kwanthawi yayitali komanso membala wa makomiti apulogalamu pamisonkhano ina. Wophunzitsa ku EPAM Systems, ndipo wakhala abwenzi ndi Hadoop/Spark ndi data ina yayikulu kuyambira 2012.
Munkhani iyi, Alexey alankhula za zovuta zosinthira makina ophunzirira makina akale kuti azitha kugawidwa molingana ndi zomwe adakumana nazo akugwira ntchito ndi Apache Spark ML, Apache Mahout, Apache Flink ML komanso chidziwitso chopanga Apache Ignite ML. Alexey adzalankhulanso za kukhazikitsidwa kwa ma aligorivimu a ML omwe adagawidwa pamadongosolo awa.
Ndipo potsiriza, malipoti awiri ochokera ku Yandex okhudza Yandex Database.
Vladislav Kuznetsov
Vladislav ndi wopanga ku Yandex mu gulu logawidwa la nsanja. Yandex Database ndi horizontally scalable, geo-distributed, DBMS yolekerera zolakwika zomwe zingathe kupirira kulephera kwa ma disks, ma seva, ma racks ndi malo osungira deta popanda kutaya kusinthasintha. Kuonetsetsa kulekerera zolakwika, algorithm ya eni eni kuti akwaniritse mgwirizano wogawidwa amagwiritsidwa ntchito, komanso njira zingapo zaukadaulo, zomwe zimakambidwa mwatsatanetsatane mu lipotilo. Lipotilo likhoza kukhala losangalatsa kwa onse opanga DBMS ndi opanga mayankho ogwiritsira ntchito pogwiritsa ntchito DBMS.
Semyon Checherinda -
Semyon ndi wopanga gulu logawidwa ku Yandex, akugwira ntchito kuti athe kugwiritsa ntchito ma lendi ambiri pakuyika kwa YDB.
Yandex Database idapangidwira mafunso a OLTP ndipo imagwirizana ndi zofunikira za ACID pamakina opangira. Mu lipotili, tiwona njira yoyendetsera zinthu zomwe zimagwirizana ndi dongosolo la YDB. Tiyeni tiwone mabungwe omwe amatenga nawo gawo pazogulitsa, omwe amapereka dongosolo lapadziko lonse lapansi pazochita, momwe ma atomiki aatomiki, kudalirika, komanso kukhazikika kodzipatula kumatheka. Pogwiritsa ntchito vuto lodziwika bwino monga chitsanzo, tiyeni tiwone zomwe zikuchitika pogwiritsa ntchito magawo awiri ndikuchitapo kanthu. Tiyeni tikambirane kusiyana kwawo.
Kodi yotsatira?
Pulogalamu ya msonkhano ikupitirizabe kudzazidwa ndi malipoti atsopano. Makamaka, tikuyembekezera lipoti kuchokera Nikita Koval () kuchokera ku JetBrains ndi Oleg Anastasyev () kuchokera ku kampani ya Odnoklassniki. Nikita amagwira ntchito pa ma aligorivimu a coroutines mu gulu la Kotlin, ndipo Oleg akupanga zomanga ndi zothetsera machitidwe olemetsa kwambiri papulatifomu ya Odnoklassniki. Kuphatikiza apo, pali kagawo kamodzi kopanda kanthu, komiti ya pulogalamuyo ikugwira ntchito ndi omwe akufuna pakali pano.
Msonkhano wa Hydra udzachitika pa July 11-12 ku St. Matikiti alipo . Chonde samalani za kupezeka kwa matikiti a pa intaneti - ngati pazifukwa zina simungathe kufika ku St. Petersburg masiku ano.
Tikuwonani ku Hydra!
Source: www.habr.com