Kwiveki ephelileyo ndaya kwinkomfa ye-DUMP IT (https://dump-ekb.ru/) eYekaterinburg kwaye ndifuna ukukuxelela oko kwaxutyushwa kumacandelo e-Backend kunye ne-Devops, kunye nokuba iinkomfa ze-IT zengingqi zifanelekile ukuqwalaselwa.
U-Nikolay Sverchkov ovela kwi-Evil Martians malunga ne-Serverless
Bekukho ntoni phofu?
Iyonke, inkomfa yayinamacandelo e-8: I-Backend, Frontend, Mobile, Testing and QA, Devops, Design, Science and Management.
Iiholo ezinkulu, ngendlela, ziseNzululwazi kunye noLawulo)) Kubantu abangama-350 nganye. I-backend kunye ne-Frontend ayincinci kakhulu. Igumbi le-Devops yayilelona lincinci, kodwa liyasebenza.
Ndamamela iingxelo kumacandelo e-Devops kunye ne-Backend kwaye ndathetha kancinci kunye nezithethi. Ndingathanda ukuthetha ngezihloko ezigutyungelweyo kwaye ndiphonononge la macandelo kwinkomfa.
Abameli be-SKB-Kontur, i-DataArt, i-Evil Martians, i-Ekaterinburg web studio Flag, i-Miro (i-RealTimeBoard) yathetha kumacandelo e-Devops kunye ne-Backend. Izihloko ezigutyungelwe kwi-CI / CD, ukusebenza kunye neenkonzo ze-queue, ukugawulwa kwezihloko ze-Serverless kunye nokusebenza kunye ne-PostgreSQL kwi-Go zahlanganiswa kakuhle.
Kwakukho neengxelo zika-Avito, i-Tinkoff, i-Yandex, i-Jetstyle, i-Megafon, i-Ak Bars Bank, kodwa andizange ndibe nexesha lokuya kubo ngokomzimba (ukurekhodwa kwevidiyo kunye nezilayidi zeengxelo azikafumaneki, bathembisa ukuba baya kuzithumela kwindawo yokulahla- ekb.ru kwiiveki ezi-2).
Icandelo le-Devops
Okwakumangalisayo kukuba eli candelo laliqhutyelwa kweyona holo incinane, enezihlalo ezimalunga nama-50. Abantu bade bema kwiipaseji :) Ndiza kukuxelela ngeengxelo endiye ndakwazi ukuziphulaphula.
I-Elastic enobunzima bepetabyte
Icandelo laqala ngengxelo kaVladimir Lil (SKB-Kontur) malunga ne-Elasticsearch e-Kontur. Zine-Elastic enkulu ngokufanelekileyo kwaye ilayishiwe (~ 800 TB yedatha, ~ 1.3 petabytes ethathela ingqalelo ukungafuneki). I-Elasticsearch yazo zonke iinkonzo ze-Kontur ingatshatanga, iqulathe amaqela ama-2 (yesi-7 kunye ne-9 yeseva), kwaye ibaluleke kakhulu kangangokuba uKontur unobunjineli obukhethekileyo be-Elasticsearch (eneneni, u-Vladimir ngokwakhe).
U-Vladimir wabelane ngeengcinga zakhe malunga neenzuzo ze-Elasticsearch kunye neengxaki ezizisayo.
Inzuzo:
- Zonke iinkuni zikwindawo enye, ukufikelela lula kuzo
- Ukugcina izingodo unyaka kwaye zihlalutye ngokulula
- Isantya esiphezulu sokusebenza kunye nezigodo
- Imbonakalo yedatha epholileyo ngaphandle kwebhokisi
Iingxaki:
- Umthengisi womyalezo kufuneka ubenayo (yeKontur indima yayo idlalwa nguKafka)
- Iimpawu zokusebenza kunye ne-Elasticsearch Curator (iyilwe ngamaxesha athile umthwalo ophezulu ukusuka kwimisebenzi eqhelekileyo kwiCurator)
- akukho sigunyaziso esakhelweyo (kuphela ngemali eyahlukileyo, enkulu kakhulu, okanye njengeeplagi zemithombo evulekileyo yokulungela imveliso)
Kwakukho uphononongo oluhle kuphela malunga ne-Open Distro ye-Elasticsearch :) Umba ofanayo wogunyaziso uye wasonjululwa apho.
Ivela phi i-petabyte?Iinode zabo ziquka iiseva ezine-12 * 8 Tb SATA + 2 * 2 Tb SSD. Ukugcinwa okubandayo kwi-SATA, i-SSD kuphela kwi-cache eshushu (ukugcinwa okushushu).
7+9 abancedisi, (7 + 9) * 12 * 8 = 1536 Tb.
Inxalenye yendawo igcinwe, ibekelwe bucala ukuba ingasebenzi, njl.
Iilogi ezivela malunga nezicelo ze-90 zithunyelwa kwi-Elasticsearch, kuquka zonke iinkonzo zokunika ingxelo ze-Kontur, Elba, njl.
Iimpawu zophuhliso kwi-Serverless
Okulandelayo yingxelo kaRuslan Serkin evela kwiDathaArt malunga ne-Serverless.
U-Ruslan wathetha malunga nokuba yeyiphi intuthuko kunye ne-Serverless approach ngokubanzi, kwaye zeziphi iimpawu zayo.
I-Serverless yindlela yophuhliso apho abaphuhlisi bangazichukumisi iziseko nangayiphi na indlela. Umzekelo - AWS Lambda Serverless, Kubeless.io (Serverless ngaphakathi Kubernetes), Google Cloud Functions.
Usetyenziso olufanelekileyo lwe-Serverless ngumsebenzi nje othumela isicelo kumboneleli ongenaServerless ngeSango elikhethekileyo le-API. I-microservice efanelekileyo, ngelixa i-AWS Lambda ikwaxhasa inani elikhulu leelwimi zangoku zokucwangcisa. Iindleko zokugcina kunye nokuthunyelwa kweziseko zophuhliso ziba zero kwimeko yababoneleli bamafu, ukuxhasa izicelo ezincinci kuya kuba nexabiso eliphantsi kakhulu (AWS Lambda - $ 0.2 / 1 yezigidi zezicelo ezilula).
I-scalability yenkqubo enjalo iphantse ilungile - umboneleli wefu uyazinyamekela ngokwakhe, i-Kubeless isikali ngokuzenzekelayo ngaphakathi kweqela le-Kubernetes.
Kukho izinto ezingeloncedo:
- ukuphuhlisa izicelo ezinkulu kuba nzima ngakumbi
- kukho ubunzima ngezicelo zeprofayili (iilog kuphela ezifumanekayo kuwe, kodwa hayi iprofayile ngendlela eqhelekileyo)
- akukho nguqulelo
Ukunyaniseka, ndivile malunga ne-Serverless kwiminyaka embalwa edlulileyo, kodwa yonke le minyaka yayingacacanga kum indlela yokuyisebenzisa ngokuchanekileyo. Emva kwengxelo kaRuslan, ukuqonda kwabonakala, kwaye emva kwengxelo kaNikolai Sverchkov (i-Evil Martians) evela kwicandelo le-Backend, yahlanganiswa. Akuzange kube lilize ukuba ndiye kwinkomfa :)
I-CI yeyabantu abahluphekayo, okanye ngaba kufanelekile ukuba ubhale eyakho iCI kwisitudiyo sewebhu?
UMikhail Radionov, intloko yesitudiyo sewebhu yeFlegi yaseYekaterinburg, wathetha ngeCI/CD ezibhalayo.
Isitudiyo sakhe siphumile "kwi-manual CI / CD" (ngena kwiseva nge-SSH, yenza i-git pull, phinda amaxesha angama-100 ngosuku) ukuya eJenkins nakwisixhobo esizibhalayo esikuvumela ukuba ujonge ikhowudi kwaye wenze ukukhutshwa okubizwa ngokuba yiPullkins. .
Kwakutheni ukuze uJenkins angasebenzi? Ayikhange ibonelele ngokuguquguquka okwaneleyo ngokungagqibekanga kwaye kwakunzima kakhulu ukuyenza.
"Iflegi" iphuhlisa kwiLaravel (isakhelo se-PHP). Xa uphuhlisa umncedisi we-CI / CD, uMikhail kunye noogxa bakhe basebenzisa iindlela zikaLaravel ezakhelwe ngaphakathi ezibizwa ngokuba yiTelescope kunye noMthunywa. Isiphumo siseva kwi-PHP (nceda uqaphele) eqhuba izicelo ze-webhook ezingenayo, inokwakha i-frontend kunye ne-backend, ithumele kwiiseva ezahlukeneyo, kwaye inike ingxelo kwi-Slack.
Ke, ukuze ukwazi ukwenza iblue/green deploy kwaye ube noseto olufanayo kwindawo yedev-stage-prod, batshintshela kwiDocker. Iinzuzo zahlala zifana, amathuba okwenza i-homogenizing imo engqongileyo kunye nokusasazwa okungenamthungo kongezwa, kunye nesidingo sokufunda iDocker ukusebenza nayo ngokuchanekileyo yongezwa.
Sinciphise njani inani lee-rollbacks zokukhutshwa kweseva nge-99%
Ingxelo yokugqibela kwicandelo le-Devops yayivela ku-Viktor Eremchenko, injineli ye-Lead devops kwi-Miro.com (eyayisakuba yi-RealTimeBoard).
I-RealTimeBoard, imveliso yeflegi yeqela le-Miro, isekwe kwisicelo seJava se-monolithic. Ukuqokelela, ukuvavanya kunye nokuyisebenzisa ngaphandle kwexesha lokuphumla ngumsebenzi onzima. Kule meko, kubalulekile ukuhambisa inguqu enjalo yekhowudi ukwenzela ukuba kungadingeki ukuba iguqulwe (yi-monolith enzima).
Endleleni yokwakha inkqubo evumela ukuba wenze oku, uMiro wahamba kwindlela equka ukusebenza kwi-architecture, izixhobo ezisetyenzisiweyo (i-Atlassian Bamboo, i-Ansible, njl njl), kunye nokusebenza kwisakhiwo samaqela (ngoku banayo. iqela elizinikeleyo leDevops + amaqela amaninzi ahlukeneyo eScrum ukusuka kubaphuhlisi beeprofayile ezahlukeneyo).
Indlela yabanzima kwaye inameva, kwaye uVictor wabelana ngeentlungu eziqokelelweyo kunye nethemba elingazange liphelele apho.
Uphumelele incwadi ngokubuza imibuzo
Icandelo elingasemva
Ndakwazi ukuya kwiingxelo ze-2 - ukusuka ku-Nikolay Sverchkov (i-Evil Martians), kunye ne-Serverless, kunye ne-Grigory Koshelev (inkampani yaseKontur) malunga ne-telemetry.
Ukungabi nanceba kubantu nje
Ukuba uRuslan Sirkin wathetha malunga nokuba yintoni i-Serverless, u-Nikolay wabonisa izicelo ezilula usebenzisa i-Serverless, kwaye wathetha malunga neenkcukacha ezichaphazela iindleko kunye nesantya sezicelo kwi-AWS Lambda.
Iinkcukacha ezinomdla: eyona nto iphantsi ihlawulwe yi-128 Mb yememori kunye ne-100 ms CPU, ixabisa i-$0,000000208. Ngaphezu koko, izicelo ezi-1 zesigidi ngenyanga zisimahla.
Eminye yemisebenzi kaNikolai kaninzi idlula umda we-100 ms (isicelo esiphambili sabhalwa kwiRuby), ngoko ke ukuyibhala kwakhona kwi-Go kunikeze ukonga okuhle kakhulu.
IVostok Hercules - yenza i-telemetry ibe ntle kwakhona!
Ingxelo yakutshanje yecandelo le-Backend evela kuGrigory Koshelev (inkampani yaseKontur) malunga ne-telemetry. I-Telemetry ithetha iilogi, iimethrikhi, umkhondo wosetyenziso.
Ngenxa yale njongo, iContour isebenzisa izixhobo ezizibhalelayo eziposwe kwiGithub. Isixhobo esivela kwingxelo-Hercules, , isetyenziselwa ukuhambisa idatha ye-telemetry.
Ingxelo kaVladimir Lila kwicandelo le-Devops lixubushe ngokugcina kunye nokucubungula izingodo kwi-Elasticsearch, kodwa kusekho umsebenzi wokuhambisa izingodo ezivela kumawaka amaninzi ezixhobo kunye nezicelo, kunye nezixhobo ezifana neVostok Hercules ukuzixazulula.
Isekethe ilandele indlela eyaziwa ngabaninzi - ukusuka kwi-RabbitMQ ukuya kwi-Apache Kafka, kodwa akusiyo yonke into elula)) Kwafuneka bongeze i-Zookeeper, i-Cassandra kunye ne-Graphite kwisiphaluka. Andiyi kutyhila ngokupheleleyo ulwazi kule ngxelo (kungekhona iprofayili yam), ukuba unomdla, unokulinda iislayidi kunye namavidiyo kwiwebhusayithi yenkomfa.
Ithelekisa njani nezinye iinkomfa?
Andikwazi ukuyithelekisa kunye neenkomfa zaseMoscow naseSt.
I-DAMP ibanjwe kumacandelo e-8, le yirekhodi yeenkomfa zase-Ural. Amacandelo amakhulu kakhulu eNzululwazi noLawulo, oku kukwayinto engaqhelekanga. Abaphulaphuli baseYekaterinburg bakhiwe kakuhle - isixeko sinamasebe amakhulu ophuhliso eYandex, eKontur, eTinkoff, kwaye oku kushiya uphawu kwiingxelo.
Enye into enomdla kukuba iinkampani ezininzi zinezithethi ezi-3-4 kwinkomfa kanye (oku kwakunjalo ngeKontur, Evil Martians, Tinkoff). Uninzi lwabo ibingabaxhasi, kodwa iingxelo ziyafana nabanye, ayizongxelo zentengiso ezi.
Ukuhamba okanye ukungahambi? Ukuba uhlala kwii-Urals okanye kufuphi, unethuba kwaye unomdla kwizihloko - ewe, kunjalo. Ukuba ucinga ngohambo olude, ndiza kujonga izihloko zeengxelo kunye neengxelo zevidiyo ezivela kwiminyaka edlulileyo waza wenza isigqibo.
Enye inzuzo yeenkomfa kwimimandla, njengomthetho, kulula ukunxibelelana nesithethi emva kweengxelo;
Enkosi kwi-Dump kunye ne-Ekaterinburg! )
umthombo: www.habr.com
