Makon da ya gabata na je taron DUMP IT (https://dump-ekb.ru/) a Yekaterinburg kuma ina so in gaya muku abin da aka tattauna a cikin sassan Backend da Devops, da kuma ko taron IT na yanki ya cancanci kulawa.
Nikolay Sverchkov daga Mugayen Martians game da Serverless
Me ya kasance?
Gabaɗaya, taron yana da sassan 8: Backend, Frontend, Mobile, Testing and QA, Devops, Design, Science and Management.
Manyan dakunan, ta hanya, suna Kimiyya da Gudanarwa)) Domin ~ 350 mutane kowanne. Backend da Frontend ba su da yawa. Dakin Devops shine mafi ƙanƙanta, amma mai aiki.
Na saurari rahotanni a cikin sassan Devops da Backend kuma na yi magana kadan tare da masu magana. Ina so in yi magana game da batutuwan da aka tattauna kuma in sake nazarin waɗannan sassan a taron.
Wakilan SKB-Kontur, DataArt, Evil Martians, Ekaterinburg gidan yanar gizon Flag, Miro (RealTimeBoard) yayi magana a cikin sassan Devops da Backend. Batutuwa sun rufe CI/CD, aiki tare da sabis na layi, shiga; Batutuwa marasa amfani da aiki tare da PostgreSQL a cikin Go an rufe su da kyau.
Akwai kuma rahotannin Avito, Tinkoff, Yandex, Jetstyle, Megafon, Ak Bars Bank, amma ban sami lokacin halartar su ba (ba a samu rikodin bidiyo da nunin faifai na rahotannin ba, sun yi alkawarin buga su cikin makonni 2). da dump-ekb.ru).
Sashe na Devops
Wani abin mamaki shi ne, an gudanar da sashen ne a cikin ƙaramin zauren, kusan kujeru 50. Har ma mutane suna tsaye a cikin magudanar ruwa :) Zan ba ku labarin rahotannin da na sami damar saurare.
Na roba yana auna petabyte
Sashen ya fara da rahoton Vladimir Lil (SKB-Kontur) game da Elasticsearch a Kontur. Suna da na'urar roba mai girma da lodi (~ 800 TB na bayanai, ~ 1.3 petabytes la'akari da sakewa). Elasticsearch na duk ayyukan Kontur ba ɗaya bane, ya ƙunshi gungu 2 (na sabobin 7 da 9), kuma yana da mahimmanci cewa Kontur yana da injiniyan Elasticsearch na musamman (a zahiri, Vladimir kansa).
Vladimir ya kuma bayyana ra'ayinsa game da fa'idodin Elasticsearch da matsalolin da yake kawowa.
Amfani:
- Duk rajistan ayyukan suna wuri guda, samun sauƙin shiga su
- Ajiye rajistan ayyukan na shekara guda da sauƙaƙe nazarin su
- Babban gudun aiki tare da katako
- Cool bayanan gani daga cikin akwatin
Matsaloli:
- Dillalin saƙon dole ne ya kasance (don Kontur Kafka ne ke taka rawa)
- fasali na aiki tare da Elasticsearch Curator (lokaci-lokaci ana ƙirƙira babban kaya daga ayyuka na yau da kullun a cikin Curator)
- babu wani ginannen izini (kawai don daban, babban kuɗi, ko azaman buɗaɗɗen tushen abubuwan buɗaɗɗen matakan shirye-shiryen samarwa)
Akwai tabbataccen bita kawai game da Buɗe Distro don Elasticsearch :) An warware wannan batu na izini a can.
Daga ina petabyte ya fito?Nodes ɗin su sun ƙunshi sabobin masu 12*8 Tb SATA + 2*2 Tb SSD. Adana sanyi akan SATA, SSD kawai don cache mai zafi (ajiya mai zafi).
7+9 sabobin, (7 + 9) * 12 * 8 = 1536 Tb.
Wani ɓangare na sararin yana cikin tanadi, an keɓe shi don sakewa, da sauransu.
Ana aika rajistan ayyukan daga kusan aikace-aikacen 90 zuwa Elasticsearch, gami da duk ayyukan bayar da rahoto na Kontur, Elba, da sauransu.
Siffofin ci gaba a kan Serverless
Na gaba shine rahoton Ruslan Serkin daga DataArt game da Serverless.
Ruslan yayi magana game da menene ci gaba tare da tsarin Serverless gabaɗaya, da menene fasalinsa.
Serverless hanya ce ta ci gaba wanda masu haɓakawa ba sa taɓa abubuwan more rayuwa ta kowace hanya. Misali - AWS Lambda Serverless, Kubeless.io (Serverless in Kubernetes), Google Cloud Services.
Kyakkyawan aikace-aikacen mara Sabis aiki ne kawai wanda ke aika buƙatu zuwa ga mai ba da sabis ta hanyar Ƙofar API ta musamman. Kyakkyawan microservice, yayin da AWS Lambda kuma yana goyan bayan ɗimbin yarukan shirye-shirye na zamani. Kudin kiyayewa da tura abubuwan more rayuwa ya zama sifili a cikin yanayin masu samar da girgije, tallafawa ƙananan aikace-aikacen kuma zai kasance mai arha sosai (AWS Lambda - $ 0.2 / 1 miliyan buƙatun sauƙi).
Matsakaicin irin wannan tsarin yana kusan manufa - mai ba da girgije yana kula da wannan da kansa, Kubeless ma'auni ta atomatik a cikin gungu na Kubernetes.
Akwai rashin amfani:
- haɓaka manyan aikace-aikacen yana ƙara wahala
- akwai wahala tare da bayanin martabar aikace-aikacen (Logs kawai suna samuwa a gare ku, amma ba bayanin martaba a cikin ma'anar da aka saba ba)
- babu siga
A gaskiya, na ji labarin Serverless ’yan shekarun da suka gabata, amma duk waɗannan shekarun ban bayyana a gare ni yadda zan yi amfani da shi daidai ba. Bayan rahoton Ruslan, fahimtar ya bayyana, kuma bayan rahoton Nikolai Sverchkov (Mugayen Martians) daga sashin Backend, an ƙarfafa shi. Ba a banza na je taron ba :)
CI na matalauta ne, ko yana da daraja rubuta naku CI don ɗakin gidan yanar gizo?
Mikhail Radionov, shugaban gidan yanar gizon Flag daga Yekaterinburg, ya yi magana game da CI/CD da aka rubuta da kansa.
Gidan studio ɗinsa ya tafi daga "CI / CD na hannu" (shiga cikin uwar garken ta hanyar SSH, yi git Pull, maimaita sau 100 a rana) zuwa Jenkins kuma zuwa kayan aikin da aka rubuta da kansa wanda ke ba ku damar saka idanu lamba da yin sakewa da ake kira Pullkins. .
Me yasa Jenkins bai yi aiki ba? Bai samar da isasshen sassauci ta tsohuwa ba kuma yana da wahala sosai don keɓancewa.
"Flag" yana tasowa a cikin Laravel (PHP framework). Lokacin haɓaka uwar garken CI/CD, Mikhail da abokan aikinsa sun yi amfani da ingantattun hanyoyin ginannun Laravel da ake kira Telescope da Envoy. Sakamakon shine uwar garken a cikin PHP (a kula) wanda ke aiwatar da buƙatun webhook mai shigowa, na iya gina gaba da baya, tura zuwa sabobin daban-daban, da rahoto zuwa Slack.
Bayan haka, don samun damar yin jigilar shuɗi/kore kuma suna da saitunan iri ɗaya a cikin mahallin abubuwan samarwa-mataki-mataki, sun canza zuwa Docker. Abubuwan da ake amfani da su sun kasance iri ɗaya, an ƙara yuwuwar daidaita yanayin muhalli da turawa marasa ƙarfi, kuma an ƙara buƙatar koyon Docker don yin aiki tare da shi daidai.
Yadda muka rage adadin sakewar uwar garken da kashi 99%
Rahoton ƙarshe a cikin sashin Devops ya fito ne daga Viktor Eremchenko, injiniyan jagora a Miro.com (tsohon RealTimeBoard).
RealTimeBoard, samfurin ƙungiyar Miro, ya dogara ne akan aikace-aikacen Java guda ɗaya. Tattara, gwadawa da tura shi ba tare da raguwa ba aiki ne mai wahala. A wannan yanayin, yana da mahimmanci don tura irin wannan nau'in lambar don kada a sake juyawa (yana da nauyi mai nauyi).
A kan hanyar gina tsarin da zai ba ka damar yin wannan, Miro ya bi ta hanyar da ta haɗa da yin aiki a kan gine-gine, kayan aikin da aka yi amfani da su (Atlassian Bamboo, Mai yiwuwa, da dai sauransu), da kuma aiki a kan tsarin ƙungiyoyi (yanzu suna da. ƙungiyar Devops da aka sadaukar + ƙungiyoyin Scrum da yawa daban-daban daga masu haɓaka bayanan martaba daban-daban).
Hanyar ta zama mai wahala da ƙaya, kuma Victor ya raba raɗaɗin da aka tara da kuma fata wanda bai ƙare a can ba.
Ya ci littafi don yin tambayoyi
Sashin baya
Na gudanar da halartar rahotanni 2 - daga Nikolay Sverchkov (Mugayen Martians), kuma game da Serverless, kuma daga Grigory Koshelev (kamfanin Kontur) game da telemetry.
Marasa uwar garke ga mutane kawai
Idan Ruslan Sirkin yayi magana game da menene Serverless, Nikolay ya nuna aikace-aikace masu sauƙi ta amfani da Serverless, kuma yayi magana game da cikakkun bayanai waɗanda ke shafar farashin da saurin aikace-aikacen AWS Lambda.
Daki-daki mai ban sha'awa: ƙaramin abin da aka biya shine 128 Mb na ƙwaƙwalwar ajiya da 100 ms CPU, farashin $ 0,000000208. Haka kuma, irin waɗannan buƙatun miliyan 1 a kowane wata kyauta ne.
Wasu ayyukan Nikolai sau da yawa sun wuce iyakar 100 ms (an rubuta babban aikace-aikacen a cikin Ruby), don haka sake rubuta su a cikin Go yana ba da kyakkyawan tanadi.
Vostok Hercules - sake yin na'urar daukar hoto mai girma!
Rahoton sabon rahoton sashin baya daga Grigory Koshelev (kamfanin Kontur) game da telemetry. Telemetry yana nufin rajistan ayyukan, awo, alamun aikace-aikace.
Don wannan dalili, Contour yana amfani da kayan aikin da aka rubuta akan Github. Kayan aiki daga rahoton - Hercules, , ana amfani dashi don isar da bayanan telemetry.
Rahoton Vladimir Lila a cikin sashin Devops ya tattauna adanawa da sarrafa rajistan ayyukan a cikin Elasticsearch, amma har yanzu akwai aikin isar da rajistan ayyukan daga dubban na'urori da aikace-aikace, da kayan aiki kamar Vostok Hercules sun warware su.
Da'irar ta bi hanyar da mutane da yawa suka sani - daga RabbitMQ zuwa Apache Kafka, amma ba komai ba ne mai sauƙi)) Dole ne su ƙara Zookeeper, Cassandra da Graphite zuwa kewaye. Ba zan ba da cikakken bayani game da wannan rahoton ba (ba bayanin martaba na ba), idan kuna sha'awar, kuna iya jira nunin faifai da bidiyo akan gidan yanar gizon taron.
Yaya aka kwatanta da sauran taro?
Ba zan iya kwatanta shi da taro a Moscow da St. Petersburg ba, zan iya kwatanta shi da sauran abubuwan da suka faru a cikin Urals da 404fest a Samara.
Ana gudanar da DAMP a cikin sassan 8, wannan rikodin ne don taron Ural. Manyan sassan Kimiyya da Gudanarwa, wannan kuma sabon abu ne. Masu sauraro a Yekaterinburg suna da tsari sosai - birnin yana da manyan sassan ci gaba don Yandex, Kontur, Tinkoff, kuma wannan ya bar alamarsa akan rahotanni.
Wani batu mai ban sha'awa shi ne cewa kamfanoni da yawa suna da masu magana da 3-4 a taron a lokaci daya (wannan shi ne yanayin Kontur, Mugayen Martians, Tinkoff). Yawancinsu sun kasance masu tallafawa, amma rahotanni sun yi daidai da wasu, waɗannan ba rahotannin talla ba ne.
Don tafiya ko a'a? Idan kuna zaune a cikin Urals ko kusa, kuna da damar kuma kuna sha'awar batutuwa - a, ba shakka. Idan kuna tunanin tafiya mai nisa, zan duba batutuwan rahotanni da rahotannin bidiyo daga shekarun baya kuma ya yanke shawara.
Wani fa'idar taro a cikin yankuna, a matsayin mai mulkin, shine yana da sauƙin sadarwa tare da mai magana bayan rahotannin; akwai ƙarancin masu neman irin wannan sadarwar.
Godiya ga Dump da Ekaterinburg! )
source: www.habr.com