Zomangamanga zolipiritsa za m'badwo watsopano: kusintha ndikusintha kupita ku Tarantool
Chifukwa chiyani kampani ngati MegaFon ikufunika Tarantool pakulipira? Kuchokera kunja zikuwoneka kuti wogulitsa nthawi zambiri amabwera, amabweretsa bokosi lina lalikulu, amalumikiza pulagi mu socket - ndipo ndiye kulipira! Izi zinali choncho, koma tsopano ndi zakale, ndipo ma dinosaur otere atha kale kapena akutha. Poyamba, kulipira ndi njira yoperekera ma invoice - makina owerengera kapena chowerengera. Mu telecoms zamakono izi makina odzichitira okha pa moyo wonse wolumikizana ndi wolembetsa kuyambira kumapeto kwa mgwirizano mpaka kutha, kuphatikizapo kulipira nthawi yeniyeni, kuvomereza malipiro ndi zina zambiri. Kulipira m'makampani a telecom kuli ngati loboti yankhondo - yayikulu, yamphamvu komanso yodzaza ndi zida.
Kodi Tarantool ikukhudzana bwanji ndi izi? Iwo aziyankhula za izo Oleg Ivlev и Andrey Knyazev. Oleg ndiye womanga wamkulu wa kampaniyo MegaFon wodziwa zambiri akugwira ntchito m'makampani akunja, Andrey ndi director of business systems. Kuchokera pa zolembedwa za lipoti lawo pa Msonkhano wa Tarantool 2018 muphunzira chifukwa chake R&D ikufunika m'mabungwe, Tarantool ndi chiyani, momwe kusakhazikika kwakukula kokhazikika komanso kudalirana kwa mayiko kunakhala zofunikira kuti ziwonekere pakampaniyi, za zovuta zaukadaulo, kusintha kwa zomangamanga, ndi momwe ukadaulo wa MegaFon ukufanana ndi Netflix. , Google ndi Amazon.
Ntchito "Unified Billing"
Ntchito yomwe ikufunsidwayo imatchedwa "Malipiro Ogwirizana". Apa ndi pamene Tarantool anasonyeza makhalidwe ake abwino.
Kukula kwa zokolola za zida za Hi-End sikunafanane ndi kukula kwa olembetsa komanso kukula kwa mautumiki; kuwonjezereka kwa chiwerengero cha olembetsa ndi ntchito kumayembekezeredwa chifukwa cha M2M, IoT, ndi mawonekedwe a nthambi. mpaka kuwonongeka kwa nthawi ndi msika. Kampaniyo idaganiza zopanga njira yolumikizirana yamabizinesi yokhala ndi zomangamanga zapadera zapadziko lonse lapansi, m'malo mwa 8 njira zolipirira zamakono.
MegaFon ndi makampani asanu ndi atatu mu imodzi. Mu 2009, kukonzanso kunatha: nthambi ku Russia zonse zidaphatikizidwa kukhala kampani imodzi, MegaFon OJSC (tsopano PJSC). Chifukwa chake, kampaniyo ili ndi machitidwe obweza 8 okhala ndi mayankho awo "mwambo", mawonekedwe anthambi ndi machitidwe osiyanasiyana abungwe, IT ndi malonda.
Chilichonse chinali bwino mpaka tidayamba kupanga chinthu chimodzi chokha cha federal. Apa panabuka zovuta zambiri: kwa ena, mitengo yamitengo imasonkhanitsidwa, kwa ena imachepetsedwa, ndipo kwa ena - kutengera masamu. Pali zikwi zambiri za mphindi zoterozo.
Kukweza molunjika. Ngakhale zida zozizira kwambiri panthawiyo sizinakwaniritse zosowa. Tidagwiritsa ntchito zida za Hewlett-Packard kuchokera pamzere wa Superdome Hi-End, koma sizinakwaniritse zosowa za nthambi ziwiri. Ndinkafuna kukweza kopingasa popanda ndalama zambiri zogwirira ntchito komanso ndalama zazikulu.
Chiyembekezo cha kukula kwa chiwerengero cha olembetsa ndi mautumiki. Alangizi akhala akubweretsa nkhani za IoT ndi M2M kudziko la telecom: nthawi idzafika pamene foni iliyonse ndi chitsulo zidzakhala ndi SIM khadi, ndi ziwiri mufiriji. Lero tili ndi chiwerengero chimodzi cha olembetsa, koma posachedwa padzakhala ena ambiri.
Zovuta zaukadaulo
Zifukwa zinayi zimenezi zinatilimbikitsa kusintha kwambiri. Panali kusankha pakati pa kukweza dongosolo ndi kupanga kuchokera pachiyambi. Tinaganiza kwa nthawi yayitali, kupanga zisankho zazikulu, kusewera ma tender. Zotsatira zake, tinaganiza zopanga kuyambira pachiyambi, ndipo tinatenga zovuta zosangalatsa - zovuta zamakono.
Scalability
Ngati zinali kale, tiyeni tinene, tinene 8 zolipira kwa olembetsa 15 miliyoni, ndipo tsopano zikanayenera kugwira ntchito Olembetsa 100 miliyoni ndi ena - katunduyo ndi dongosolo la kukula kwake.
Takhala ofananizidwa ndi osewera akulu pa intaneti monga Mail.ru kapena Netflix.
Koma kusuntha kwina kowonjezera katundu ndi olembetsa kwabweretsa zovuta kwa ife.
Geography ya dziko lathu lalikulu
Pakati pa Kaliningrad ndi Vladivostok 7500 km ndi 10 nthawi zones. Kuthamanga kwa kuwala kuli ndi malire ndipo pa mtunda woterewu kuchedwa kumakhala kofunikira kale. 150 ms pamakina owoneka bwino amakono ndizovuta kwambiri kulipira zenizeni zenizeni, makamaka monga momwe zilili mu telecom ku Russia. Kuphatikiza apo, muyenera kusintha tsiku limodzi labizinesi, ndipo ndi magawo osiyanasiyana anthawi izi ndizovuta.
Sitimangopereka ntchito zolipirira zolembetsa, tili ndi mitengo yamitengo yovuta, phukusi, ndi zosintha zosiyanasiyana. Sitiyenera kungolola kapena kukana wolembetsa kuti alankhule, koma kumupatsa gawo linalake - kuwerengera mafoni ndi zochita mu nthawi yeniyeni kuti asazindikire.
kulekerera zolakwika
Iyi ndi mbali ina ya centralization.
Ngati tisonkhanitsa olembetsa onse mu dongosolo limodzi, ndiye kuti zochitika zadzidzidzi zilizonse ndi masoka ndizowopsa kwa bizinesi. Choncho, timapanga dongosolo m'njira yoti tithetse mavuto omwe amabwera chifukwa cha ngozi kwa olembetsa onse.
Izi ndi zotsatira za kukana kukula molunjika. Titakwera mozungulira, tidachulukitsa ma seva kuchokera mazana mpaka masauzande. Ayenera kuyang'aniridwa ndi kusinthidwa, kuchirikiza zokha za IT ndi kubwezeretsa dongosolo logawidwa.
Chodabwitsa n'chakuti sitinapeze mawu amodzi pa telecom yapadziko lonse.
Europe yatsika potengera kuchuluka kwa olembetsa ndi kuchuluka, USA - potengera kutsika kwamitengo yake. Tidayang'ana ku China, ndipo tidapeza ku India ndikulemba ganyu akatswiri ochokera ku Vodafone India.
Timapanga dongosolo la Olembetsa 80 miliyoni okhala ndi nkhokwe ya biliyoni imodzi. Umu ndi momwe timachotsera malire amtsogolo. Izi sichifukwa choti tilanda China, koma chifukwa cha kuukira kwa IoT ndi M2M.
Zolemba 300 miliyoni zidakonzedwa munthawi yeniyeni. Ngakhale tili ndi olembetsa 80 miliyoni, timagwira ntchito ndi onse omwe angathe kukhala makasitomala komanso omwe atisiya ngati tikufuna kutolera zobweza. Chifukwa chake, ma voliyumu enieni amakhala okulirapo.
2 biliyoni zochita Ndalama zimasintha tsiku ndi tsiku - izi ndi malipiro, malipiro, mafoni ndi zochitika zina. 200 TB ya data ikusintha mwachangu, sinthani pang'onopang'ono 8PB ya data, ndipo iyi si malo osungira, koma deta yamoyo mumalipilo amodzi. Scale by data center - Ma seva 5 zikwi pamasamba 14.
Technology stack
Pamene tinakonza zomanga ndikuyamba kusonkhanitsa dongosolo, tinaitanitsa matekinoloje osangalatsa komanso apamwamba kwambiri. Chotsatira chake ndi luso laukadaulo lodziwika bwino kwa osewera pa intaneti ndi mabungwe omwe amapanga machitidwe olemetsa kwambiri.
Muluwu ndi wofanana ndi mulu wa osewera ena akuluakulu: Netflix, Twitter, Viber. Zili ndi zigawo 6, koma tikufuna kufupikitsa ndikugwirizanitsa.
Kusinthasintha ndikwabwino, koma m'makampani akuluakulu palibe njira popanda kugwirizana.
Sitisintha Oracle yemweyo kukhala Tarantool. Muzochitika zamakampani akuluakulu, iyi ndi utopia, kapena nkhondo yazaka 5-10 yokhala ndi zotsatira zosadziwika bwino. Koma Cassandra ndi Couchbase atha kusinthidwa mosavuta ndi Tarantool, ndipo ndizomwe tikuyesetsa.
Izi sizikutanthauza kuti machitidwe ena samakwaniritsa zosowa za MegaFon. Mayankho amakono a kukumbukira ndi opindulitsa kwambiri kotero kuti nkhokwe za kampani ndizokwanira. Koma tili ndi chidwi chochita ndi mtsogoleri, osati ndi munthu amene akutsalira, kuphatikizapo kuyesa katundu.
Tarantool imakhudza zosowa za kampani ngakhale pakapita nthawi.
Mtengo wapatali wa magawo TCO. Kuthandizira kwa Couchbase pamavoliyumu a MegaFon kumawononga ndalama zakuthambo, koma ndi Tarantool zinthu ndizosangalatsa kwambiri, ndipo zimafanana ndi magwiridwe antchito.
Chofunika kwambiri kwa ine ndi kulumikizana mwachindunji ndi wopanga. Izi ndi zomwe anyamata aku Tarantool adapereka ziphuphu.
Ngati mubwera kwa wosewera mpira, makamaka yemwe amagwira ntchito ndi kasitomala wa nangula, ndikunena kuti mukufuna database kuti muthe kuchita izi, izi ndi izi, nthawi zambiri amayankha:
- Chabwino, ikani zofunika pansi pa muluwo - tsiku lina, tidzafika kwa iwo.
Ambiri ali ndi mapu amsewu kwa zaka 2-3 zikubwerazi, ndipo ndizosatheka kuphatikizira pamenepo, koma opanga Tarantool amakopa chidwi chawo, osati kuchokera ku MegaFon kokha, ndikusinthira makina awo kwa kasitomala. Ndizozizira ndipo timakonda kwambiri.
Kumene tidagwiritsa ntchito Tarantool
Timagwiritsa ntchito Tarantool pazinthu zingapo. Woyamba ndi woyendetsa ndege, zomwe tidapanga pamakina owongolera adilesi. Panthawi ina ndinkafuna kuti ikhale dongosolo lomwe linali lofanana ndi Yandex.Maps ndi Google Maps, koma zinasintha mosiyana.
Mwachitsanzo, kalozera wa ma adilesi mu mawonekedwe ogulitsa. Pa Oracle, kusaka adilesi yomwe mukufuna kumatenga masekondi 12-13. - manambala osamasuka. Tikasintha kupita ku Tarantool, sinthani Oracle ndi database ina mu kontrakitala, ndikufufuza komweko, timapeza liwiro la 200x! Mzindawu umatuluka pambuyo pa chilembo chachitatu. Tsopano tikusintha mawonekedwe kuti izi zichitike pambuyo pa woyamba. Komabe, liwiro loyankha ndilosiyana kwambiri - ma milliseconds m'malo mwa masekondi.
Microservices mwina ndiye gawo lalikulu la Tarantool ku MegaFon.
Kumene timakonzekera kugwiritsa ntchito Tarantool
Tikayerekeza pulojekiti yathu yolipira bwino ndi mapulogalamu osinthira ku Deutsche Telekom, Svyazcom, Vodafone India, ndi yamphamvu komanso yopanga modabwitsa. Pogwiritsa ntchito ntchitoyi, osati MegaFon yokha ndi mapangidwe ake omwe adasinthidwa, komanso Tarantool-enterprise adawonekera ku Mail.ru, ndi wogulitsa wathu Nexign (omwe kale anali Peter-Service) - BSS Box (njira yolipira mabokosi).
Izi, mwanjira ina, ntchito yakale kwambiri pamsika waku Russia. Tingayerekezere ndi zimene zalongosoledwa m’buku lakuti “Mythical Man-Month” lolembedwa ndi Frederick Brooks. Kenako, m'zaka za m'ma 60, IBM inalemba ganyu anthu 360 kuti apange makina atsopano a OS/5 a mainframes. Tili ndi zochepa - 000, koma zathu zili mu zovala, ndipo poganizira kugwiritsa ntchito gwero lotseguka ndi njira zatsopano, timagwira ntchito bwino.
Pansipa pali madera olipira kapena, kunena mokulira, machitidwe abizinesi. Anthu ochokera kumabizinesi amadziwa bwino CRM. Aliyense ayenera kukhala ndi machitidwe ena: Open API, API Gateway.
Tsegulani API
Tiyeni tione manambala kachiwiri ndi mmene Open API panopa ntchito. Katundu wake ndi 10 zochita pa sekondi iliyonse. Popeza tikukonzekera kukhazikitsa gawo la microservices ndikumanga MegaFon public API, tikuyembekeza kukula kwakukulu mtsogolomu gawoli. Padzakhaladi zochitika za 100.
Sindikudziwa ngati tingayerekeze ndi Mail.ru mu SSO - anyamatawo akuwoneka kuti ali ndi zochitika za 1 pamphindi. Yankho lawo ndi losangalatsa kwambiri kwa ife ndipo tikukonzekera kutengera zomwe akumana nazo - mwachitsanzo, kupanga zosunga zobwezeretsera za SSO pogwiritsa ntchito Tarantool. Tsopano opanga kuchokera ku Mail.ru akutichitira izi.
CRM
CRM ndi omwewo olembetsa a 80 miliyoni omwe tikufuna kuwonjezera ku biliyoni, chifukwa pali kale zolemba za 300 miliyoni zomwe zimaphatikizapo mbiri ya zaka zitatu. Tikuyembekezera ntchito zatsopano komanso pano kukula ndi ntchito zolumikizidwa. Uwu ndi mpira umene udzakula, chifukwa padzakhala mautumiki ambiri. Chifukwa chake, tifunika nkhani; sitikufuna kupunthwa pa izi.
Kudzilipira palokha popereka ma invoice, kugwira ntchito ndi maakaunti amakasitomala omwe amalandilidwa kusinthidwa kukhala malo osiyana. Kupititsa patsogolo ntchito, Applied domain Architecture Architecture Design.
Zina zonse ndi mayankho amabizinesi. M'malo osungira mafoni - 2 biliyoni patsiku, 60 biliyoni pamwezi. Nthawi zina muyenera kuwawerenga mwezi umodzi, ndipo ndi bwino msanga. Kuyang'anira ndalama - izi ndizofanana ndi 300 miliyoni zomwe zikukula ndikukula nthawi zonse: olembetsa nthawi zambiri amathamanga pakati pa ogwira ntchito, akuwonjezera gawo ili.
Chigawo cha telecom chochuluka cha mauthenga a m'manja ndi kulipira pa intaneti. Awa ndi machitidwe omwe amakulolani kuyimba kapena kuyimba foni, kupanga zisankho mu nthawi yeniyeni. Apa katunduyo ndi 30 transactions pamphindi, koma poganizira kukula kwa kusamutsa deta, tikukonzekera. 250 zochita, ndipo chifukwa chake tili ndi chidwi kwambiri ndi Tarantool.
Chithunzi chapitachi ndi madambwe omwe tigwiritsa ntchito Tarantool. CRM palokha, ndithudi, ndi yotakata ndipo tidzaigwiritsa ntchito pachimake chokha.
Sitidalira kwambiri ogulitsa, tikusintha maziko a BSS, kotero tili ndi fayilo imodzi ya kasitomala kunja kwa bokosi. Koma tikufuna kukulitsa. Chifukwa chake, timatenga njira yosiyana pang'ono - kupanga cache mkati mwa machitidwe.
Mwanjira iyi pali kulunzanitsa kochepa - dongosolo limodzi limayang'anira posungira komanso gwero lalikulu la master.
Njirayi ikugwirizana bwino ndi njira ya Tarantool ndi chigoba cha transaction, pamene magawo okhawo okhudzana ndi zosintha, ndiye kuti, kusintha kwa deta, kumasinthidwa. Zina zonse zitha kusungidwa kwina. Palibe nyanja yayikulu ya data, cache yapadziko lonse lapansi yosayendetsedwa. Cache amapangidwira dongosolo, kapena zinthu, kapena makasitomala, kapena kuti moyo ukhale wosavuta kukonza. Pamene wolembetsa akuyimba ndikukhumudwa ndi ubwino wa ntchito yanu, mukufuna kupereka chithandizo chabwino.
Yankho lathu: kupanga kaundula wogawidwa wa mapulogalamu pa Tarantool - gulu logawidwa ndi geo. Pachithunzichi, awa ndi malo atatu osinthira deta - awiri pamaso pa Urals, wina kupyola ma Urals, ndipo timagawira zopempha zonse pakati pa malowa.
Netflix, yomwe tsopano imatengedwa kuti ndi m'modzi mwa atsogoleri mu IT, inali ndi malo amodzi okha mpaka 2012. Madzulo a Khrisimasi ya Katolika, Disembala 24, malo osungira data awa adatsika. Ogwiritsa ntchito ku Canada ndi USA adasiyidwa opanda makanema omwe amakonda, adakhumudwa kwambiri ndikulemba za izi pamasamba ochezera. Netflix tsopano ili ndi ma data atatu pagombe lakumadzulo chakum'mawa ndi imodzi kumadzulo kwa Europe.
Poyamba tikumanga yankho logawidwa ndi geo - kulolerana kolakwa ndikofunikira kwa ife.
Ndiye tili ndi gulu, koma bwanji RPO = 0 ndi RTO = 0? Yankho lake ndi losavuta, malingana ndi mutu.
Chofunika ndi chiyani pamapulogalamu? Magawo Awiri: Kuponya Basket KU kupanga chisankho chogula, ndi POPEZA. Gawo la DO mu telecom nthawi zambiri limatchedwa kuyitanitsa kapena kulamula kukambirana. Mu telecom, izi zitha kukhala zovuta kwambiri kuposa m'sitolo yapaintaneti, chifukwa komwe kasitomala ayenera kutumizidwa, kuperekedwa zosankha 5, ndipo zonsezi zimachitika kwakanthawi, koma dengu ladzaza. Panthawiyi, kulephera kumatheka, koma sizowopsya, chifukwa zimachitika molumikizana moyang'aniridwa ndi anthu.
Ngati malo a data a Moscow alephera mwadzidzidzi, ndiye kuti mwangosintha kupita kumalo ena a data, tidzapitiriza kugwira ntchito. Mwachidziwitso, chinthu chimodzi chikhoza kutayika m'ngolo, koma mukuwona, onjezeraninso ngolo ndikupitiriza kugwira ntchito. Pankhaniyi, RTO = 0.
Panthawi yomweyi, pali njira yachiwiri: pamene tidadina "kutumiza", tikufuna kuti deta isatayike. Kuyambira nthawi ino, automation imayamba kugwira ntchito - iyi ndi RPO = 0. Pogwiritsa ntchito njira ziwiri zosiyanazi, nthawi imodzi zikhoza kukhala gulu logawidwa ndi geo ndi mbuye wina wosinthika, nthawi ina mtundu wina wa quorum record. Zitsanzo zimatha kusiyana, koma timathetsa vutoli.
Kupitilira apo, pokhala ndi kaundula wogawidwa wa mapulogalamu, titha kukulitsanso zonse - kukhala ndi otumiza ambiri ndi opha omwe amapeza zolembetsa izi.
Cassandra ndi Tarantool pamodzi
Pali vuto lina - "chiwonetsero cha miyeso". Nayi nkhani yosangalatsa yogwiritsa ntchito limodzi Cassandra ndi Tarantool.
Timagwiritsa ntchito Cassandra chifukwa mafoni mabiliyoni a 2 patsiku si malire, ndipo padzakhala zambiri. Otsatsa amakonda kukongoletsa kuchuluka kwa magalimoto ndi magwero; Zambiri zikuwonekera pamasamba ochezera, mwachitsanzo. Zonse zimawonjezera nkhani.
Timamasuka ndi Cassandra, koma ali ndi vuto limodzi - si bwino kuwerenga. Chilichonse chili bwino pa kujambula, 30 pamphindi si vuto - vuto lowerenga.
Chifukwa chake, mutu wokhala ndi posungira udawonekera, ndipo nthawi yomweyo tidathetsa vuto ili: pali nkhani yakale yachikale pomwe zida zosinthira kuchokera pamalipiro apaintaneti zimabwera m'mafayilo omwe timatsitsa ku Cassandra. Tidalimbana ndi vuto la kutsitsa kodalirika kwa mafayilowa, ngakhale kugwiritsa ntchito upangiri wa IBM woyang'anira kusamutsa mafayilo - pali mayankho omwe amayendetsa kusamutsa mafayilo moyenera, pogwiritsa ntchito protocol ya UDP, mwachitsanzo, osati TCP. Izi ndizabwino, koma zikadali mphindi, ndipo sitinazinyamule zonse, wogwiritsa ntchito pamalo oimbira foni sangathe kuyankha kasitomala zomwe zidamuchitikira - tiyenera kudikirira.
Kuti izi zisachitike, ife timagwiritsa ntchito parallel functional reserve. Tikatumiza chochitika kudzera ku Kafka kupita ku Tarantool, kuwerengeranso ma aggregates munthawi yeniyeni, mwachitsanzo, lero, timapeza. ndalama zotsalira, yomwe imatha kusamutsa miyeso pa liwiro lililonse, mwachitsanzo, 100 zikwi zogulitsa pamphindikati ndi masekondi 2 omwewo.
Cholinga chake ndi chakuti mutatha kuyimba foni, mkati mwa masekondi a 2 mu akaunti yanu yaumwini sipadzakhala ndalama zomwe zasinthidwa, koma zambiri za chifukwa chake zinasintha.
Pomaliza
Izi zinali zitsanzo za kugwiritsa ntchito Tarantool. Tidakonda kwambiri kutseguka kwa Mail.ru ndi kufunitsitsa kwawo kuganizira milandu yosiyanasiyana.
Ndizovuta kale kwa alangizi ochokera ku BCG kapena McKinsey, Accenture kapena IBM kutidabwitsa ndi china chatsopano - zambiri zomwe amapereka, zomwe tachita kale, tazichita, kapena tikukonzekera kuchita. Ndikuganiza kuti Tarantool itenga malo ake oyenera patekinoloje yathu ndipo idzalowa m'malo mwaukadaulo wambiri womwe ulipo. Tili mu gawo lachitukuko cha polojekitiyi.
Lipoti la Oleg ndi Andrey ndi limodzi mwa opambana pa Msonkhano wa Tarantool chaka chatha, ndipo pa June 17 Oleg Ivlev adzalankhula pa Msonkhano wa T+ 2019 ndi lipoti "Chifukwa chiyani Tarantool mu Enterprise". Alexander Deulin adzaperekanso ulaliki kuchokera ku MegaFon "Tarantool Caches and Replication from Oracle". Tiyeni tiwone zomwe zasintha, ndi mapulani ati omwe akhazikitsidwa. Lowani - msonkhanowu ndi waulere, zomwe muyenera kuchita ndi lowani. Zonse malipoti adalandiridwa ndipo pulogalamu ya msonkhano yapangidwa: milandu yatsopano, zatsopano pogwiritsa ntchito Tarantool, zomangamanga, bizinesi, maphunziro ndi ma microservices.