Vhiki rapfuura ndakaenda kumusangano weDUMP IT (https://dump-ekb.ru/) muYekaterinburg uye ndinoda kukuudza zvakakurukurwa muzvikamu zveBackend neDevops, uye kana misangano yedunhu yeIT yakakosha kutariswa.
Nikolay Sverchkov kubva Evil Martians nezve Serverless
Chii chaivapo zvakadaro?
Pakazara, musangano uyu waive nezvikamu zve8: Backend, Frontend, Mobile, Testing uye QA, Devops, Design, Science uye Management.
Horo hombe, nenzira, dziri kuSainzi uye Management)) Kune ~ 350 vanhu imwe neimwe. Backend uye Frontend haina kunyanya kudiki. Imba yeDevops yaive diki, asi inoshanda.
Ndakateerera mishumo muzvikamu zveDevops uye Backend uye ndakataura zvishoma nevatauri. Ndinoda kutaura pamusoro pemisoro yakafukidzwa uye kuongorora zvikamu izvi pamusangano.
Vamiririri veSKB-Kontur, DataArt, Evil Martians, Ekaterinburg web studio Flag, Miro (RealTimeBoard) vakataura muzvikamu zveDevops uye Backend. Misoro yakafukidzwa CI/CD, kushanda nemasevhisi emutsetse, kutema miti; Misoro isina server uye kushanda nePostgreSQL muGo yakafukidzwa zvakanaka.
Paivawo nemishumo naAvito, Tinkoff, Yandex, Jetstyle, Megafon, Ak Bars Bank, asi ini ndakanga ndisina nguva yekuenda kwavari mumuviri (mavhidhiyo akarekodhwa uye masiraidhi emishumo haisati yavapo, vanovimbisa kuitumira mukati memavhiki e2. pa dump-ekb.ru).
Devops chikamu
Chakanga chichishamisa ndechokuti chikamu chacho chaiitirwa muhoro dukusa, ine zvigaro zvinenge 50. Vanhu vakanga vakatomira mumigwagwa :) Ndichakuudza nezvemishumo yandakakwanisa kuteerera.
Elastic inorema petabyte
Chikamu chakatanga nemushumo waVladimir Lil (SKB-Kontur) nezveElasticsearch muKontur. Vane yakakura uye yakatakura Elastic (~ 800 TB yedata, ~ 1.3 petabytes ichifunga nezve redundancy). Elasticsearch yemasevhisi ese eKontur ndeye imwe chete, ine 2 zvikwata (e7 uye 9 maseva), uye yakakosha zvekuti Kontur ane yakakosha Elasticsearch injiniya (chaizvoizvo, Vladimir pachake).
Vladimir akagoverawo pfungwa dzake pamusoro pezvakanakira Elasticsearch uye matambudziko ainounza.
Benefits:
- Ese matanda ari munzvimbo imwe, nyore kuwana kwavari
- Kuchengeta matanda kwegore uye nyore kuaongorora
- High speed yekushanda nematanda
- Inotonhorera data kuona kunze kwebhokisi
Matambudziko:
- meseji broker inofanirwa kuve nayo (yeKontur basa rayo rinoitwa naKafka)
- maficha ekushanda neElasticsearch Curator (nguva nenguva akagadzira mutoro wakakwira kubva kumabasa enguva dzose muCurator)
- hapana yakavakirwa-mukati mvumo (chete yeyakaparadzana, yakakura mari, kana seyakavhurika sosi plugins yeakasiyana madhigirii ekugadzirira kugadzirwa)
Paingova neongororo yakanaka chete nezve Open Distro yeElasticsearch :) Nyaya imwechete yemvumo yakagadziriswa ipapo.
Iyo petabyte inobva kupi?Node dzavo dzinosanganisira maseva ane 12*8 Tb SATA + 2*2 Tb SSD. Kuchengetedza kutonhora paSATA, SSD chete kune inopisa cache (inopisa yekuchengetedza).
7+9 maseva, (7 + 9) * 12 * 8 = 1536 Tb.
Chikamu chenzvimbo yacho chakachengeterwa, chakaisirwa kurendu, nezvimwe.
Marogi kubva kunenge makumi mapfumbamwe ekunyorera anotumirwa kuElasticsearch, kusanganisira ese ekuzivisa masevhisi eKontur, Elba, nezvimwe.
Zvimiro zvebudiriro paServerless
Inotevera ishumo naRuslan Serkin kubva kuDataArt nezve Serverless.
Ruslan akataura nezve budiriro neServerless nzira iri muzhinji, uye kuti ndeapi maitiro ayo.
Serverless inzira yekusimudzira umo vanogadzira havabate zvivakwa chero nzira. Muenzaniso - AWS Lambda Serverless, Kubeless.io (Serverless mukati meKubernetes), Google Cloud Functions.
Yakanaka Serverless application ingori basa rinotumira chikumbiro kune Serverless mupi kuburikidza yakakosha API Gateway. Iyo yakanaka microservice, nepo AWS Lambda inotsigirawo nhamba huru yemitauro yemazuva ano yekuronga. Mutengo wekuchengetedza uye kuendesa zvivakwa unova zero mune yevanopa makore, kutsigira zvidiki zvikumbiro zvichave zvakachipa zvakanyanya (AWS Lambda - $ 0.2 / 1 miriyoni zvikumbiro zviri nyore).
Iyo scalability yeakadaro sisitimu inenge yakanaka - mupi wegore anozvitarisira pachawo, Kubeless anoyera otomatiki mukati meKubernetes cluster.
Pane zvinoipira:
- kugadzira maapplication makuru kuri kuramba kuchioma
- pane kuomerwa neprofiling application (iwe unongokwanisa kuwana matanda, asi kwete profiling nenzira yakajairika)
- hapana shanduro
Kutaura chokwadi, ndakanzwa nezveServerless makore mashoma apfuura, asi makore ese aya hazvina kujeka kwandiri kuti ndingaishandisa sei nemazvo. Mushure memushumo waRuslan, kunzwisisa kwakaonekwa, uye mushure memushumo waNikolai Sverchkov (Evil Martians) kubva kuBackend chikamu, yakasimbiswa. Kwakanga kusiri pasina kuti ndakaenda kumusangano :)
CI ndeyevarombo, kana zvakakodzera kunyora CI yako yewebhu studio?
Mikhail Radionov, mukuru weFlag web studio kubva kuYekaterinburg, akataura nezve anozvinyora CI/CD.
Situdiyo yake yabva ku "manual CI / CD" (pinda museva kuburikidza neSSH, ita git kudhonza, dzokorora zana pazuva) kuna Jenkins uye kune yakanyorwa-yega chishandiso chinokutendera kuti utarise kodhi uye kuita kuburitswa kunonzi Pullkins. .
Sei Jenkins asina kushanda? Izvo zvaisapa kukwana kuchinjika nekukasira uye yaive yakaoma kwazvo kugadzirisa.
"Mureza" inokura muLaravel (PHP chimiro). Paaigadzira sevha yeCI/CD, Mikhail nevamwe vake vakashandisa nzira dzaLaravel dzakavakirwa-mukati dzinonzi Telescope uye Envoy. Mhedzisiro iyi sevha muPHP (ndapota cherechedza) iyo inogadzira zvinouya zvikumbiro zvewebhook, inogona kuvaka iyo yekumberi uye yekumashure, kuendesa kune akasiyana maseva, uye taura kuna Slack.
Zvadaro, kuti ukwanise kuita bhuruu/girinhi deploy uye kuva neyunifomu marongero mudev-stage-prod nharaunda, ivo vakachinjira kuDocker. Zvakanakira zvakaramba zvakafanana, mikana yekuita homogenizing nharaunda uye kutumirwa kusina musono kwakawedzerwa, uye kukosha kwekudzidza Docker kushanda nayo nemazvo kwakawedzerwa.
Isu takadzikisa sei huwandu hwesevha yekuburitsa rollbacks ne99%
Chirevo chekupedzisira muchikamu cheDevops chakabva kuna Viktor Eremchenko, Lead devops engineer paMiro.com (yaimbova RealTimeBoard).
RealTimeBoard, iyo Miro timu yemureza chigadzirwa, yakavakirwa pane monolithic Java application. Kuunganidza, kuyedza uye kuendesa pasina nguva yekudzikira ibasa rakaoma. Muchiitiko ichi, zvakakosha kuendesa shanduro yakadaro yekodhi kuitira kuti irege kutenderedzwa kumashure (iyo inorema monolith).
Panzira yekuvaka hurongwa hunokubvumira kuita izvi, Miro akapinda nenzira yaisanganisira kushanda pakuvaka, zvishandiso zvinoshandiswa (Atlassian Bamboo, Ansible, nezvimwewo), uye kushanda pane chimiro chezvikwata (ivo timu yakazvitsaurira yeDevops + akawanda akapatsanura zvikwata zveScrum kubva kuvagadziri veakasiyana profiles).
Nzira yakazova yakaoma uye ine minzwa, uye Victor akagoverana marwadzo akaunganidzwa uye tariro iyo isina kuguma ipapo.
Akahwina bhuku rekubvunza mibvunzo
Backend chikamu
Ndakakwanisa kupinda 2 mishumo - kubva Nikolay Sverchkov (Evil Martians), uyewo nezveServerless, uye kubva Grigory Koshelev (Kontur kambani) nezve telemetry.
Kusashandira vanhuwo zvavo
Kana Ruslan Sirkin akataura nezve izvo Serverless chii, Nikolay airatidza manyorerwo ari nyore achishandisa Serverless, uye akataura nezve izvo zvinokanganisa mutengo uye kumhanya kwekushandisa muAWS Lambda.
Ruzivo runonakidza: iyo yakaderera yakabhadharwa chinhu ndeye 128 Mb yendangariro uye zana ms CPU, inodhura madhora 100. Uyezve, miriyoni imwe yezvikumbiro zvakadaro pamwedzi ndeyemahara.
Mamwe emabasa aNikolai aiwanzopfuura 100 ms muganho (chikumbiro chikuru chakanyorwa muRuby), saka kunyora zvakare muGo kwakapa mari yakanaka.
Vostok Hercules - ita telemetry yakanaka zvakare!
Mushumo wekupedzisira weBackend chikamu kubva kuGrigory Koshelev (Kontur kambani) nezve telemetry. Telemetry zvinoreva matanda, metrics, application traces.
Nechinangwa ichi, Contour anoshandisa anozvinyora maturusi akatumirwa paGithub. Chishandiso kubva mushumo - Hercules, , inoshandiswa kuendesa telemetry data.
Chirevo chaVladimir Lila muchikamu cheDevops chakakurukura nezvekuchengetedza nekugadzirisa matanda muElasticsearch, asi pachine basa rekuburitsa matanda kubva kuzviuru zvezvishandiso uye maapplication, uye zvishandiso seVostok Hercules zvinozvigadzirisa.
Dunhu rakatevera nzira inozivikanwa nevakawanda - kubva kuRabbitMQ kuenda kuApache Kafka, asi hazvisi zvese zviri nyore)) Vaifanira kuwedzera Zookeeper, Cassandra uye Graphite kudunhu. Ini handisi kuzoburitsa zvizere ruzivo rwemushumo uyu (kwete chimiro changu), kana uchifarira, unogona kumirira masiraidhi nemavhidhiyo pawebhusaiti yemusangano.
Inofananidzwa sei nemamwe makonferensi?
Handigoni kuzvienzanisa nemisangano muMoscow neSt. Petersburg, ndinogona kuzvienzanisa nezvimwe zviitiko muUrals uye ne404fest muSamara.
DAMP inobatwa muzvikamu zve8, ichi chinyorwa cheUral conferences. Zvikamu zvakakura kwazvo zveSainzi neKutungamira, izvi zvakare hazvina kujairika. Vateereri muYekaterinburg vakanyatsorongeka - guta rine madhipatimendi makuru ebudiriro yeYandex, Kontur, Tinkoff, uye izvi zvinosiya chiratidzo pamishumo.
Imwe pfungwa inofadza ndeyokuti makambani akawanda ane 3-4 vatauri pamusangano kamwechete (izvi ndizvo zvakaitika naKontur, Evil Martians, Tinkoff). Vazhinji vavo vaive vatsigiri, asi mishumo iri kuenderana nevamwe, aya haasi ekushambadzira mishumo.
Kuenda kana kusaenda? Kana iwe uchigara muUrals kana pedyo, une mukana uye unofarira misoro - hongu, hongu. Kana iwe uri kufunga nezve rwendo rurefu, ini ndaizotarisa misoro yemishumo uye mishumo yemavhidhiyo kubva makore apfuura uye akaita sarudzo.
Imwe mukana wemisangano mumatunhu, sekutonga, ndeyekuti zviri nyore kutaurirana nemukurukuri mushure memishumo; kune vashoma vanyoreri vekutaura kwakadaro.
Kutenda kuDump uye Ekaterinburg! )
Source: www.habr.com