Mlungu watha ndinapita ku msonkhano wa DUMP IT (https://dump-ekb.ru/) ku Yekaterinburg ndipo ndikufuna ndikuuzeni zomwe zinakambidwa m'magawo a Backend ndi Devops, komanso ngati misonkhano ya IT yachigawo ndiyofunika.
Nikolay Sverchkov kuchokera ku Evil Martians za Serverless
Nanga kunali chiyani?
Pazonse, msonkhanowu unali ndi zigawo za 8: Backend, Frontend, Mobile, Testing ndi QA, Devops, Design, Science and Management.
Nyumba zazikulu kwambiri, mwa njira, zili ku Science and Management)) Kwa ~ 350 anthu aliyense. Backend ndi Frontend sizochepa kwambiri. Chipinda cha Devops chinali chaching'ono kwambiri, koma chogwira ntchito.
Ndinamvetsera malipoti mu zigawo za Devops ndi Backend ndipo ndinalankhula pang'ono ndi okamba nkhani. Ndikufuna kulankhula za mitu yomwe yafotokozedwa ndikuwunikanso magawowa pamsonkhano.
Oimira SKB-Kontur, DataArt, Evil Martians, Ekaterinburg web studio Flag, Miro (RealTimeBoard) analankhula mu zigawo za Devops ndi Backend. Mitu yophimbidwa ndi CI/CD, kugwira ntchito ndi mizere, kudula mitengo; Mitu yopanda seva komanso kugwira ntchito ndi PostgreSQL mu Go idaphimbidwa bwino.
Panalinso malipoti a Avito, Tinkoff, Yandex, Jetstyle, Megafon, Ak Bars Bank, koma ndinalibe nthawi yoti ndipite nawo (zojambula mavidiyo ndi slide za malipoti sizinapezeke, akulonjeza kuti adzazitumiza mkati mwa masabata a 2. pa dump-ekb.ru).
Gawo la Devops
Chodabwitsa n’chakuti gawolo linachitikira m’holo yaing’ono kwambiri, yokhala ndi mipando pafupifupi 50. Anthu anali atayima m'mipata :) Ndikukuuzani za malipoti omwe ndinatha kumvetsera.
Elastic yolemera petabyte
Gawoli linayamba ndi lipoti la Vladimir Lil (SKB-Kontur) lokhudza Elasticsearch ku Kontur. Ali ndi Elastic yayikulu komanso yodzaza (~ 800 TB ya data, ~ 1.3 petabytes poganizira redundancy). Elasticsearch pa ntchito zonse za Kontur ndi imodzi, imakhala ndi magulu a 2 (a 7 ndi ma seva 9), ndipo ndiyofunika kwambiri kuti Kontur ali ndi injiniya wapadera wa Elasticsearch (kwenikweni, Vladimir mwiniwake).
Vladimir adagawananso malingaliro ake pazabwino za Elasticsearch ndi zovuta zomwe zimabweretsa.
Pindulani:
- Zipika zonse zili pamalo amodzi, kuzifikira mosavuta
- Kusunga zipika kwa chaka ndi kuzisanthula mosavuta
- Kuthamanga kwakukulu kogwira ntchito ndi zipika
- Mawonekedwe abwino a data kunja kwa bokosi
Mavuto:
- uthenga broker ndioyenera kukhala nawo (kwa Kontur udindo wake umasewera ndi Kafka)
- mawonekedwe ogwirira ntchito ndi Elasticsearch Curator (nthawi zina amapanga katundu wambiri kuchokera ku ntchito zanthawi zonse mu Curator)
- palibe chilolezo chokhazikitsidwa (chokhachokhachokha, ndalama zambiri, kapena ngati mapulagini otseguka okonzeka kupanga)
Panali ndemanga zabwino zokha za Open Distro kwa Elasticsearch :) Nkhani yomweyi ya chilolezo yathetsedwa pamenepo.
Kodi petabyte imachokera kuti?Node zawo zimakhala ndi maseva okhala ndi 12 * 8 Tb SATA + 2 * 2 Tb SSD. Kusungirako kozizira pa SATA, SSD kokha pa cache yotentha (kusungirako kutentha).
7+9 maseva, (7 + 9) * 12 * 8 = 1536 Tb.
Mbali ina ya malowa ndi yosungidwa, yoyikidwa pambali kuti iwonongeke, ndi zina zotero.
Zolemba zochokera kuzinthu pafupifupi 90 zimatumizidwa ku Elasticsearch, kuphatikiza ntchito zonse zochitira malipoti za Kontur, Elba, ndi zina.
Mawonekedwe a chitukuko pa Serverless
Chotsatira ndi lipoti la Ruslan Serkin kuchokera ku DataArt about Serverless.
Ruslan analankhula za zomwe chitukuko ndi njira ya Serverless ili yonse, ndi zomwe zimapangidwira.
Serverless ndi njira yachitukuko yomwe opanga samakhudza zomangamanga mwanjira iliyonse. Chitsanzo - AWS Lambda Serverless, Kubeless.io (Yopanda Ma seva mkati mwa Kubernetes), Google Cloud Functions.
Ntchito yabwino ya Serverless ndi ntchito yomwe imatumiza pempho kwa Wopereka Serverless kudzera pa API Gateway yapadera. Microservice yabwino, pomwe AWS Lambda imathandiziranso zilankhulo zambiri zamakono. Mtengo wosamalira ndikuyika zida zomangira zimakhala zero kwa opereka mitambo, kuthandizira mapulogalamu ang'onoang'ono adzakhalanso otsika mtengo kwambiri (AWS Lambda - $ 0.2 / 1 miliyoni zopempha zosavuta).
Kuchuluka kwa dongosolo lotere kuli pafupifupi kwabwino - wopereka mtambo amadzisamalira yekha, Kubeless sikelo yokha mkati mwa gulu la Kubernetes.
Pali zovuta:
- kupanga mapulogalamu akuluakulu kumakhala kovuta kwambiri
- pamakhala vuto lolemba mbiri (mumapeza zolemba zokha, koma osapanga mbiri mwanthawi zonse)
- palibe kumasulira
Kunena zowona, ndinamva za Serverless zaka zingapo zapitazo, koma zaka zonsezi sizinali bwino kwa ine momwe ndingagwiritsire ntchito molondola. Pambuyo pa lipoti la Ruslan, kumvetsetsa kunawonekera, ndipo pambuyo pa lipoti la Nikolai Sverchkov (Evil Martians) kuchokera ku gawo la Backend, linaphatikizidwa. Sizinapite pachabe kupita ku msonkhano :)
CI ndi ya osauka, kapena ndiyenera kulemba CI yanu pa studio yapaintaneti?
Mikhail Radionov, wamkulu wa studio ya Flag ku Yekaterinburg, adalankhula za CI/CD yodzilemba yokha.
Situdiyo yake yachoka ku "manual CI / CD" (lowani mu seva kudzera pa SSH, chitani git kukoka, bwerezani maulendo a 100 patsiku) kupita ku Jenkins ndi chida chodzilembera nokha chomwe chimakulolani kuyang'anira kachidindo ndikuchita zomwe zimatchedwa Pullkins. .
Chifukwa chiyani Jenkins sanagwire ntchito? Sizinapereke kusinthasintha kokwanira mwachisawawa ndipo zinali zovuta kusintha mwamakonda.
"Mbendera" ikukula mu Laravel (PHP chimango). Popanga seva ya CI / CD, Mikhail ndi anzake adagwiritsa ntchito njira za Laravel zotchedwa Telescope ndi Envoy. Zotsatira zake ndi seva mu PHP (chonde zindikirani) yomwe imayang'anira zopempha zomwe zikubwera, zimatha kupanga kutsogolo ndi kumbuyo, kutumiza kumaseva osiyanasiyana, ndikuwuza Slack.
Kenako, kuti athe kupanga deploy ya buluu/yobiriwira ndikukhala ndi zoikamo zofananira m'malo opangira ma dev-stage-prod, adasinthira ku Docker. Ubwino udakhalabe womwewo, mwayi wogwirizanitsa chilengedwe ndi kutumizidwa mosasunthika zidawonjezedwa, ndipo kufunika kophunzira Docker kuti agwire nawo ntchito moyenera kudawonjezedwa.
Momwe tidachepetsera kuchuluka kwa kutulutsidwa kwa seva ndi 99%
Lipoti lomaliza mu gawo la Devops lidachokera kwa Viktor Eremchenko, Lead devops engineer ku Miro.com (omwe kale anali RealTimeBoard).
RealTimeBoard, chida chodziwika bwino cha timu ya Miro, idakhazikitsidwa ndi pulogalamu ya Java ya monolithic. Kusonkhanitsa, kuyesa ndi kutumiza popanda nthawi yopuma ndi ntchito yovuta. Pankhaniyi, ndikofunikira kuyika mtundu wotere wa kachidindo kotero kuti sayenera kubwezeredwa (ndi monolith yolemera).
Panjira yomanga dongosolo lomwe limakupatsani mwayi wochita izi, Miro adadutsa njira yomwe idaphatikizapo kugwira ntchito pazomangamanga, zida zomwe zimagwiritsidwa ntchito (Atlassian Bamboo, Ansible, etc.), ndikugwira ntchito pamapangidwe amagulu (iwo tsopano ali nawo. gulu lodzipatulira la Devops + magulu ambiri osiyana a Scrum kuchokera kwa opanga mbiri zosiyanasiyana).
Njirayo inakhala yovuta komanso yaminga, ndipo Victor adagawana nawo zowawa zomwe zidasokonekera komanso chiyembekezo chomwe sichinathere pamenepo.
Anapeza buku lofunsa mafunso
Gawo lakumbuyo
Ndinakwanitsa kupita ku malipoti a 2 - kuchokera ku Nikolay Sverchkov (Evil Martians), komanso za Serverless, ndi Grigory Koshelev (kampani ya Kontur) yokhudza telemetry.
Wopanda ntchito kwa anthu wamba
Ngati Ruslan Sirkin adalankhula za zomwe Serverless ndi, Nikolay adawonetsa mapulogalamu osavuta kugwiritsa ntchito Serverless, ndipo adalankhula zambiri zomwe zimakhudza mtengo ndi liwiro la ntchito mu AWS Lambda.
Tsatanetsatane wosangalatsa: chocheperako chomwe chimalipidwa ndi 128 Mb ya kukumbukira ndi 100 ms CPU, imawononga $0,000000208. Komanso, 1 miliyoni zopempha zoterezi pamwezi ndi zaulere.
Zina mwazochita za Nikolai nthawi zambiri zinkadutsa malire a 100 ms (ntchito yaikulu inalembedwa mu Ruby), kotero kuwalembanso mu Go kumapereka ndalama zabwino kwambiri.
Vostok Hercules - pangani telemetry kukhala yabwinonso!
Lipoti laposachedwa la gawo la Backend kuchokera ku Grigory Koshelev (kampani ya Kontur) yokhudza telemetry. Telemetry imatanthawuza zipika, ma metrics, mayendedwe ogwiritsira ntchito.
Pachifukwa ichi, Contour imagwiritsa ntchito zida zodzilemba zokha zomwe zidatumizidwa pa Github. Chida kuchokera ku lipoti - Hercules, , imagwiritsidwa ntchito popereka data ya telemetry.
Lipoti la Vladimir Lila mu gawo la Devops linakambirana za kusunga ndi kukonza zipika mu Elasticsearch, komabe pali ntchito yopereka zipika kuchokera ku zikwi zambiri za zipangizo ndi ntchito, ndi zipangizo monga Vostok Hercules amathetsa.
Deralo lidatsata njira yodziwika ndi ambiri - kuchokera ku RabbitMQ kupita ku Apache Kafka, koma sikuti zonse ndizosavuta)) Anayenera kuwonjezera Zookeeper, Cassandra ndi Graphite kuderali. Sindidzaulula zonse za lipoti ili (osati mbiri yanga), ngati mukufuna, mutha kudikirira zithunzi ndi makanema patsamba la msonkhano.
Kodi zikufanana bwanji ndi misonkhano ina?
Sindingathe kufanizitsa ndi misonkhano ku Moscow ndi St.
DAMP imachitika m'magawo a 8, iyi ndi mbiri yamisonkhano ya Ural. Magawo akulu kwambiri a Sayansi ndi Kasamalidwe, izi ndizachilendo. Omvera ku Yekaterinburg ali opangidwa bwino - mzindawu uli ndi madipatimenti akuluakulu achitukuko ku Yandex, Kontur, Tinkoff, ndipo izi zimasiya chizindikiro pamalipoti.
Mfundo ina yochititsa chidwi ndi yakuti makampani ambiri ali ndi okamba 3-4 pamsonkhano nthawi imodzi (izi zinali choncho ndi Kontur, Evil Martians, Tinkoff). Ambiri aiwo anali othandizira, koma malipoti ndi ofanana ndi ena, awa si malipoti otsatsa.
Kupita kapena kusapita? Ngati mumakhala ku Urals kapena pafupi, muli ndi mwayi ndipo mumakonda mitu - inde, ndithudi. Ngati mukuganiza za ulendo wautali, ndingayang'ane mitu ya malipoti ndi mavidiyo a zaka zapitazo ndipo adapanga chisankho.
Ubwino wina wamisonkhano m'zigawo, monga lamulo, ndikuti ndikosavuta kuyankhulana ndi wokamba nkhani pambuyo pa malipoti; pali ochepa omwe amafunsira kulumikizana koteroko.
Zikomo ku Dump ndi Ekaterinburg! )
Source: www.habr.com