Nayi nkhani yomwe idasinthiratu njira yanga yantchito ya devops. Kalelo m'nthawi ya Covid isanakwane, kalekale, pamaso pawo, pomwe ine ndi anyamata tinkangokonzekera bizinesi yathu komanso kuchita zinthu mwachisawawa, chopereka china chinagwera m'ngolo yanga.
Kampani yomwe idalemba izi inali kampani yosanthula deta. Ankakonza zopempha masauzande ambiri tsiku lililonse. Adabwera kwa ife ndi mawu akuti: anyamata, tili ndi ClickHouse ndipo tikufuna kusintha kasinthidwe ndi kukhazikitsa kwake. Tikufuna Ansible, Terraform, Docker komanso kuti zonse zisungidwe ku Git. Tikufuna gulu la mfundo zinayi zokhala ndi zofananira ziwiri chilichonse.
Ndilo pempho lokhazikika, pali angapo a iwo, ndipo mufunika njira yabwino yofananira. Tidati "chabwino", ndipo patatha milungu 2-3 zonse zidakonzeka. Iwo adalandira ntchitoyi ndikuyamba kusamukira ku gulu latsopano la Clickhouse pogwiritsa ntchito zofunikira zathu.
Palibe amene ankafuna kapena kudziwa momwe angagwiritsire ntchito Clickhouse. Kenako tinaganiza kuti ili linali vuto lawo lalikulu, choncho siteshoni ya kampaniyo inangololeza gulu langa kuti likonzetse ntchitoyo mmene ndingathere, kuti ine ndekha ndisapitenso kumeneko.
Tidatsagana ndi kusunthaku, ntchito zina zidawuka - kukhazikitsa zosunga zobwezeretsera ndikuwunika. Pa nthawi yomweyi, siteshoni ya kampaniyi inagwirizanitsa ndi ntchito ina, kutisiya ndi mmodzi wa ife - Leonid - monga mtsogoleri. Lenya sanali munthu waluso kwambiri. Wopanga mapulogalamu osavuta omwe adayikidwa mwadzidzidzi kuyang'anira Clickhouse. Zikuoneka kuti imeneyi inali ntchito yake yoyamba yoyangβanira zinthu zina, ndipo ulemu waukuluwo unamβpangitsa kudzimva kukhala wotanganidwa.
Tonse tinayamba kupanga zosunga zobwezeretsera. Ndinapereka lingaliro losunga zoyambira zoyambira nthawi yomweyo. Ingotengani, zipini ndikuponya mwachidwi mu c3. Zambiri ndi golide. Panali njira ina - kusungiranso matebulo okha ku Clickhouse, pogwiritsa ntchito kuzizira ndi kukopera. Koma Lenya anabwera ndi yankho lake.
Adalengeza kuti tikufuna gulu lachiwiri la Clickhouse. Ndipo kuyambira tsopano tidzalemba deta kumagulu awiri - chachikulu ndi zosunga zobwezeretsera. Ndikumuuza, Lenya, sikukhala zosunga zobwezeretsera, koma chofanizira chogwira ntchito. Ndipo ngati deta iyamba kutayika popanga, zomwezo zidzachitika pakusunga kwanu.
Koma Lenya anagwira chiwongolero mwamphamvu ndipo anakana kumvetsera zotsutsa zanga. Tidacheza naye kwa nthawi yayitali pamacheza, koma panalibe chochita - Lenya anali kuyang'anira ntchitoyi, tinkangolembedwa ana mumsewu.
Tidayang'anira momwe gululi lilili ndikulipiritsa ntchito ya oyang'anira. Kuwongolera koyera kwa Clickhouse popanda kulowa mu data. Magulu analipo, ma disks anali abwino, node anali abwino.
Sitinadziwe kuti talandira dongosololi chifukwa cha kusamvana koopsa mkati mwa timu yawo
Woyang'anirayo sanasangalale kuti Clickhouse inali yochedwa ndipo deta nthawi zina imatayika. Anakhazikitsa malo ake ochitira utumiki ntchito yolingalira. Adaziwona momwe angathere ndipo adatsimikiza kuti timangofunika kupanga makina a Clickhouse - ndizo zonse. Koma posakhalitsa zinaonekeratu, sanafune gulu la anthu opembedza konse.
Zonsezi zinakhala zowawa kwambiri. Ndipo chokhumudwitsa kwambiri chinali chakuti linali tsiku langa lobadwa.
Lachisanu madzulo. Ndinasungitsa malo pa malo omwe ndinkakonda kwambiri vinyo ndipo ndinaitana ma homies.
Pafupifupi tisananyamuke, timalandira ntchito yopangira zosintha, timamaliza, zonse zili bwino. Kusintha kwadutsa, clickhouse yatsimikiziridwa. Tikupita kale ku bar, ndipo amatilembera kuti palibe deta yokwanira. Tinawerengera kuti zonse zikuwoneka zokwanira. Ndipo adanyamuka kukasangalala.
Malo odyerawa anali phokoso Lachisanu. Titaitanitsa zakumwa ndi chakudya, tinakhala pa sofa. Nthawi yonseyi, mauthenga anga anali odzaza pang'onopang'ono. Iwo analemba chinachake chokhudza kusowa kwa deta. Ndinaganiza - m'mawa ndi wanzeru kuposa madzulo. Makamaka lero.
Chapafupi ndi eleven anayamba kuyimba. Anali mkulu wa kampaniyo ... "Mwina anaganiza zondiyamikira," ndinaganiza monyinyirika kwambiri, ndipo ndinatenga foni.
Ndipo ndidamva ngati: "Mwasokoneza deta yathu! Ndimakulipirani, koma palibe chomwe chimagwira! Munali ndi udindo pazosunga zosunga zobwezeretsera, ndipo simunachite zoyipa! Tikonze!" - kokha ngakhale ruder.
- Mukudziwa chiyani, tulukani! Lero ndi tsiku langa lobadwa, ndipo tsopano ndimwa, ndipo osachita nawo zinthu zanu zapanyumba za Juni kuchokera ku zinyalala ndi timitengo!
Ndi zomwe sindinanene. M'malo mwake, ndinatulutsa laputopu yanga ndikuyamba ntchito.
Ayi, ndaphulitsa, ndaphulitsa ngati gehena! Anatsanulira caustic "Ndakuuzani" pamacheza - chifukwa zosunga zobwezeretsera, zomwe sizinali zosunga zobwezeretsera, - ndithudi, sizinasunge kalikonse.
Anyamata ndi ine tinaganiza zoyimitsa kujambula ndikuyang'ana chilichonse. Tidaonetsetsa kuti zina mwazinthuzi sizinalembedwe.
Tinasiya kujambula ndikuwerengera kuchuluka kwa zochitika zomwe zinalipo patsiku. Iwo adakweza zambiri, zomwe gawo limodzi mwa magawo atatu okha silinalembedwe. Zigawo zitatu zokhala ndi 2 zofananira chilichonse. Mumayika mizere 100.000 - 33.000 sinalembedwe.
Panali chisokonezo chonse. Aliyense adauzana kuti asiyane mosinthana: Lenya adapita koyamba, ndikutsatiridwa ndi ine komanso woyambitsa kampaniyo. Ndi malo okhawo omwe adalumikizana nawo omwe adayesa kusokoneza mafoni athu ndi makalata athu kuti tipeze yankho la vutoli.
Palibe amene anamvetsa zimene zinali kuchitika
Anyamatawo ndi ine tinangophulika pamene tinazindikira kuti gawo limodzi mwa magawo atatu a deta yonse silinalembedwe kokha, linatayika! Zinapezeka kuti dongosolo la kampaniyo linali motere: pambuyo poyika, deta idachotsedwa mosasinthika, zochitikazo zidawonongeka m'magulu. Ndinalingalira momwe Sergei angasinthire zonsezi kukhala ma ruble otayika.
Tsiku langa lobadwa linatayidwanso mβzinyalala. Tinakhala pa bar ndi kupanga malingaliro, kuyesa kuthetsa chithunzithunzi chomwe chidaponyedwa pa ife. Chifukwa cha kugwa kwa Clickhouse sichinali chodziwikiratu. Mwina ndi netiweki, mwina ndi makonda a Linux. Inde, zilizonse zomwe mungafune, pakhala zongopeka zokwanira.
Sindinachite lumbiro la wopanga mapulogalamuwo, koma kunali kusaona mtima kusiya anyamata kumbali ina ya mzere - ngakhale atatiimba mlandu pachilichonse. Ndinali wotsimikiza 99% kuti vuto silinali pa zosankha zathu, osati kumbali yathu. Mwayi wa 1% womwe tidasokoneza unali woyaka ndi nkhawa. Koma ziribe kanthu kuti vutolo linali mbali iti, limayenera kukonzedwa. Kusiya makasitomala, mosasamala kanthu kuti ndi ndani, ndi kutayikira koyipa kotereku ndi nkhanza kwambiri.
Tinagwira ntchito patebulo lodyera mpaka XNUMX koloko mβmaΕ΅a. Tinawonjezera zochitika, ikani kusankha, ndipo tinapita kukadzaza mipata. Mukasokoneza deta, umu ndi momwe mumachitira: mumatenga deta yamasiku apitayi ndikuyiyika muzowonongeka.
Pambuyo pa XNUMX koloko mβmaΕ΅a, ine ndi mnzanga tinapita kunyumba kwanga ndi kukaitanitsa mowa kumsika wa mowa. Ndinali nditakhala ndi laputopu ndi mavuto a Clickhouse, mnzanga amandiuza chinachake. Zotsatira zake, patatha ola limodzi adakhumudwa kuti ndikugwira ntchito komanso osamwa mowa naye, ndipo adachoka. Classic - Ndinali bwenzi la Devops.
Pofika 6 koloko m'mawa, ndinapanganso tebulo, ndipo deta inayamba kusefukira. Chilichonse chinagwira ntchito popanda kutayika kulikonse.
Ndiye zinali zovuta. Aliyense anadzudzula mnzake chifukwa cha kutayika kwa data. Ngati cholakwika chatsopano chikadachitika, ndikutsimikiza kuti pakadakhala kuwomberana
M'nkhondo izi, tinayamba kumvetsetsa - kampaniyo inkaganiza kuti ndife anyamata omwe amagwira ntchito ndi deta ndikuwunika momwe matebulo amapangidwira. Adasokoneza ma admin ndi ogulitsa. Ndipo anabwera kudzatifunsa zosiyana ndi ma admin.
Chodandaula chawo chachikulu ndikuti - gehena, munali ndi udindo pazosunga zobwezeretsera ndipo simunachite bwino, mudapitilira kuwononga deta. Ndipo zonsezi ndi ma rewinding mphasa.
Ndinkafuna chilungamo. Ndinakumba makalata ndikuyika zithunzi za aliyense, pomwe Leonid ndi mphamvu zake zonse amawakakamiza kuti apange zosunga zobwezeretsera zomwe zidapangidwa. Malo awo operekera chithandizo adatenga mbali yathu nditatha kuyimbira foni. Pambuyo pake Lenya adavomereza kulakwa kwake.
Mβmalo mwake, mkulu wa kampaniyo sanafune kuimba mlandu anthu ake. Zithunzi ndi mawu zinalibe kanthu pa iye. Iye ankakhulupirira kuti popeza ndife akatswiri pano, tiyenera kutsimikizira aliyense ndi kuumirira pa chisankho chathu. Mwachiwonekere, ntchito yathu inali kuphunzitsa Lenya, komanso, kumulambalala, yemwe adasankhidwa kukhala woyang'anira polojekiti, kuti apite ku chinthu chachikulu ndikutsanulira kukayikira kwathu konse pa lingaliro la zosunga zobwezeretsera kwa iye.
Machezawo adadzadza ndi chidani, mwaukali wobisika komanso wosabisika. Sindinadziwe choti ndichite. Chilichonse chayima. Ndiyeno adandilangiza njira yosavuta - kulemba uthenga waumwini kwa woyang'anira ndikukonzekera msonkhano naye. Vasya, anthu m'moyo weniweni safulumira monga momwe amachitira pocheza. Abwana anayankha ku uthenga wanga: bwerani, palibe funso.
Unali msonkhano wowopsa kwambiri pantchito yanga. Wothandizira wanga kuchokera kwa kasitomala - STO - sanapeze nthawi. Ndinapita ku msonkhano ndi abwana ndi Lena.
Mobwerezabwereza ndinabwereza zokambirana zathu zomwe zingatheke m'mutu mwanga. Ndinakwanitsa kufika molawirira kwambiri, padakali theka la ola. Ndinayamba kuchita mantha, ndinasuta ndudu za 10. Ndinamvetsa, ndizo - ndikusuta ndekha. Sindingathe kuwatsimikizira. Ndipo adalowa mu elevator.
Pamene ankadzuka, anamenya choyatsira mwamphamvu kwambiri moti chinathyoka.
Zotsatira zake, Lenya sanali pamsonkhanowo. Ndipo tinali kukambirana kwambiri za chirichonse ndi bwana! Sergei anandiuza za ululu wake. Sanafune "Clickhouse" - adafuna "kufunsa mafunso."
Sindinawone mbuzi, koma munthu wabwino, wodandaula ndi bizinesi yake, womizidwa ndi ntchito 24/7. Macheza nthawi zambiri amatikoka anthu oipa, onyoza ndi opusa. Koma m'moyo awa ndi anthu ngati inu.
Sergei sanafune ma devops angapo kuti abwereke. Vuto lomwe anali nalo linali lalikulu kwambiri.
Ndinanena kuti nditha kuthetsa mavuto ake - ndi ntchito yosiyana kotheratu, ndipo ndili ndi mnzanga yemwe amamugwirira ntchito. Tikadadziwa kuyambira pachiyambi kuti ndi mgwirizano wawo, tikadapewa zambiri. Kwachedwa, koma tidazindikira kuti vuto lili mu kasamalidwe kolakwika ka data, osati pazomangamanga.
Tinagwirana chanza, adakweza malipiro athu kawiri ndi theka, koma malinga ndi momwe ndingatengere chisokonezo chonse ndi deta yawo ndi Clickhouse ndekha. Mu elevator, ndidalumikizana ndi munthu yemweyo wa DI Max ndikumulumikiza kuti agwire ntchito. Zinali zofunikira kufosholo tsango lonse.
Panali zinyalala zambiri mu ntchito yotengedwa. Kuyambira ndi "zosunga zobwezeretsera" zomwe zatchulidwa. Zinapezeka kuti gulu lomweli la "zosunga zobwezeretsera" silinadzipatula. Iwo anayesa zonse pa izo, nthawi zina ngakhale kuziyika izo mu kupanga.
Madivelopa athu m'nyumba apanga zoyika zawo zama data. Anagwira ntchito motere: adagwirizanitsa mafayilo, adayendetsa script ndikugwirizanitsa deta mu tebulo. Koma vuto lalikulu linali lakuti chiwerengero chachikulu cha deta chinavomerezedwa pa pempho limodzi losavuta. Pempholi linalowa mu sekondi iliyonse. Zonse chifukwa cha nambala imodzi - kuchuluka kwa tsiku.
Opanga m'nyumba adagwiritsa ntchito chida cha analytics molakwika. Iwo anapita ku grafana ndi kulemba pempho lawo lachifumu. Adakweza data kwa milungu iwiri. Zinakhala graph yokongola. Koma zenizeni, pempho la data linali masekondi 2 aliwonse. Izi zonse zidangowunjikana pamzere chifukwa Clickhouse sanachitepo kanthu. Apa ndi pamene chifukwa chachikulu chinabisidwa. Palibe chomwe chinagwira ntchito ku Grafana, zopempha zidayima pamzere, ndipo deta yakale, yosafunika inali ikufika nthawi zonse.
Tinakonzanso gululo, ndikuyikanso. Opanga m'nyumba adalembanso "insert" yawo, ndipo idayamba kugawana deta molondola.
Max adachita kafukufuku wazinthu zonse. Iye adalongosola ndondomeko yosinthira ku backend yokwanira. Koma izi sizinagwirizane ndi kampaniyo. Amayembekezera chinsinsi chamatsenga kuchokera kwa Max chomwe chingawalole kuti azigwira ntchito zakale, koma mogwira mtima. Lenya adakali woyang'anira ntchitoyi, ndipo sanaphunzirepo kanthu. Kuchokera pa zonse zomwe zinaperekedwa, adasankhanso njira yake. Monga nthawi zonse, ichi chinali chisankho chosankha kwambiri ... cholimba mtima. Lenya ankakhulupirira kuti kampani yake inali ndi njira yapadera. Yaminga komanso yodzaza ndi madzi oundana.
Ndipotu, ndi pamene tinasiyana - tinachita zomwe tingathe.
Odzaza ndi chidziwitso ndi nzeru kuchokera m'mbiri iyi, tinatsegula bizinesi yathu ndikudzipangira tokha mfundo zingapo. Sitidzayambanso kugwira ntchito mofanana ndi mmene tinkachitira kale.
DJ Max adalumikizana nafe pambuyo pa ntchitoyi, ndipo timagwirabe ntchito limodzi. Mlandu wa Clickhouse unandiphunzitsa momwe ndingayendetsere kafukufuku wazinthu zonse ndisanayambe ntchito. Timamvetsetsa momwe zonse zimagwirira ntchito ndikuvomereza ntchitozo. Ndipo ngati m'mbuyomu titha kuthamangira kukonza zomangamanga, tsopano timachita ntchito yanthawi imodzi, yomwe imatithandiza kumvetsetsa momwe tingagwiritsire ntchito.
Ndipo inde, timapewa ma projekiti omwe ali ndi zida zopanda pake. Ngakhale ndi ndalama zambiri, ngakhale chifukwa cha ubwenzi. Ndizopanda phindu kuyendetsa ntchito zodwala. Kuzindikira zimenezi kunatithandiza kukula. Mwina ntchito yanthawi imodzi yokonza zomanga ndi kukonza mgwirizano, kapena timangowuluka. Kudutsa madzi ena oundana.
PS Ndiye ngati muli ndi mafunso okhudza zomangamanga zanu, .
Tili ndi zowerengera zaulere 2 pamwezi, mwina polojekiti yanu ikhala imodzi mwazo.
Source: www.habr.com