Kusukela ngonyaka odlule, inkampani yethu yaqala ukuhlela ama-hackathon. Umncintiswano wokuqala onjalo waba yimpumelelo kakhulu, sabhala ngawo ku . I-hackathon yesibili yenzeka ngoFebhuwari 2019 futhi ayizange ibe yimpumelelo. Mayelana nezinhloso zokubamba lesi sakamuva kungekudala umhleli.
Abahlanganyeli banikezwe umsebenzi othakaselekayo onenkululeko ephelele ekukhetheni isitaki sobuchwepheshe ukuze sisetshenziswe. Bekudingekile ukuthi kusetshenziswe inkundla yokuthatha izinqumo ukuze kusetshenziswe kahle imisebenzi yokufaka amaphuzu yekhasimende engasebenza ngokugeleza okusheshayo kwezinhlelo zokusebenza, imelane nemithwalo esindayo, futhi uhlelo ngokwalo lwalungakala kalula.
Umsebenzi awuyona into encane futhi ungaxazululwa ngezindlela eziningi, njengoba sasiqiniseka ngesikhathi sokuboniswa kwezethulo zokugcina zamaphrojekthi wabahlanganyeli. Kwakukhona amaqembu angu-6 abantu abangu-5 ku-hackathon, bonke ababambiqhaza babenamaphrojekthi amahle, kodwa inkundla yethu yaba ngokuncintisana kakhulu. Sinephrojekthi ethakazelisa kakhulu, engingathanda ukukhuluma ngayo kulesi sihloko.
Isixazululo sethu inkundla esekelwe ekwakhiweni kwe-Serverless ngaphakathi kwe-Kubernetes, okunciphisa isikhathi esisithathayo ukuletha izici ezintsha ekukhiqizeni. Ivumela abahlaziyi ukuthi babhale ikhodi endaweni ebalungele futhi bayisebenzise ekukhiqizeni ngaphandle kokuhlanganyela konjiniyela nonjiniyela.
Yini ukushaya amagoli
I-Tinkoff.ru, njengezinkampani eziningi zanamuhla, inamagoli amakhasimende. Ukuthola amaphuzu kuwuhlelo lokuhlola ikhasimende olusekelwe ezindleleni zezibalo zokuhlaziya idatha.
Isibonelo, iklayenti liphendukela kithi ngesicelo sokuliboleka, noma livule i-akhawunti yosomabhizinisi ngamunye nathi. Uma sihlela ukumnikeza imali ebolekiwe, khona-ke kudingeka sihlole i-solvency yakhe, futhi uma i-akhawunti ingusomabhizinisi ngamunye, kufanele siqiniseke ukuthi iklayenti ngeke liqhube ukuthengiselana okukhohlisayo.
Isisekelo sokwenza izinqumo ezinjalo amamodeli ezibalo ahlaziya kokubili idatha evela kuhlelo lokusebenza ngokwalo kanye nedatha evela kwisitoreji sethu. Ngokungeziwe ekunikeni amaphuzu, izindlela zezibalo ezifanayo zingasetshenziswa futhi enkonzweni yokukhiqiza izincomo ngazinye zemikhiqizo emisha yamakhasimende ethu.
Indlela yokuhlola okunjalo ingamukela izinhlobonhlobo zedatha yokufaka. Futhi ngesikhathi esithile singakwazi ukwengeza ipharamitha entsha kokokufaka, okusekelwe emiphumeleni yokuhlaziywa kwedatha yomlando, kuzokwandisa izinga lokuguqulwa lokusebenzisa isevisi.
Siphethe ingcebo yedatha mayelana nobudlelwano bamakhasimende, futhi umthamo walolu lwazi ukhula njalo. Ukuze uthole amaphuzu kusebenze, ukucutshungulwa kwedatha nakho kudinga imithetho (noma amamodeli ezibalo) akuvumela ukuthi unqume ngokushesha ukuthi ubani ozogunyaza isicelo, ukuthi ubani ozokwenqaba, nokuthi ubani ozonikeza umbhangqwana ngemikhiqizo eyengeziwe, uhlola intshisekelo yabo engaba khona.
Ngomsebenzi esiwenzayo, sesivele sisebenzisa uhlelo olukhethekile lokuthatha izinqumo , okuyinto, ngokusekelwe emithethweni ebekwe abahlaziyi, ochwepheshe nabathuthukisi, inquma ukuthi ivume noma inqabe umkhiqizo othile webhange kuklayenti.
Ziningi izixazululo esezenziwe ngomumo emakethe, womabili amamodeli wamaphuzu kanye nezinhlelo zokuthatha izinqumo ngokwazo. Sisebenzisa enye yalezi zinhlelo enkampanini yethu. Kodwa ibhizinisi liyakhula, liyahlukahluka, kokubili inani lamakhasimende kanye nenani lemikhiqizo ehlinzekwayo liyanda, futhi kanye nalokhu, kuvela imibono yokuthi ungayithuthukisa kanjani inqubo ekhona yokwenza izinqumo. Ngokuqinisekile abantu abasebenza ngesistimu ekhona banemibono eminingi yokwenza kube lula, okungcono, okulula, kodwa ngezinye izikhathi imibono evela ngaphandle iyasiza. I-New Hackathon yahlelwa ngenhloso yokuqoqa imibono ezwakalayo.
Umsebenzi
I-hackathon yenziwa ngoFebhuwari 23. Abahlanganyeli banikezwe umsebenzi wokulwa: ukuthuthukisa uhlelo lokuthatha izinqumo okufanele luhlangabezane nemibandela eminingi.
Satshelwa ukuthi uhlelo olukhona lusebenza kanjani nokuthi yibuphi ubunzima obuvela phakathi nokusebenza kwalo, kanye nokuthi yiziphi izinjongo zebhizinisi ipulatifomu ethuthukisiwe okufanele ilandele. Uhlelo kumele lube nesikhathi esisheshayo sokuya emakethe sokuthuthukisa imithetho ukuze ikhodi yokusebenza yabahlaziyi ingene ekukhiqizeni ngokushesha okukhulu. Futhi ngokugeleza okungenayo kwezicelo, isikhathi sokwenza izinqumo kufanele sibe sincane. Futhi, uhlelo oluthuthukiswayo kufanele lube namandla okuthengisa ukuze kunikezwe iklayenti ithuba lokuthenga eminye imikhiqizo yenkampani uma igunyazwe yithi futhi inenzalo engaba khona kuklayenti.
Kuyacaca ukuthi akunakwenzeka ukubhala iphrojekthi elungele ukukhishwa ngobusuku obubodwa ezongena ekukhiqizeni, futhi kunzima kakhulu ukumboza lonke uhlelo, ngakho-ke sacelwa ukuba sisebenzise okungenani ingxenye yayo. Kwasungulwa inani lezidingo okufanele i-prototype yanelise. Kwakungenzeka ukuzama kokubili ukumboza zonke izidingo ngokuphelele, nokusebenza ngokuningiliziwe ezigabeni ngazinye zesikhulumi esakhiwayo.
Ngokuqondene nobuchwepheshe, bonke ababambiqhaza banikezwa inkululeko ephelele yokuzikhethela. Bekungenzeka ukusebenzisa noma yimiphi imiqondo nobuchwepheshe: Ukusakazwa kwedatha, ukufunda ngomshini, ukuthola imicimbi, idatha enkulu nokunye.
Isixazululo sethu
Ngemuva kokucabanga kancane, sinqume ukuthi isisombululo se-FaaS sizoba silungele ukuqedela umsebenzi.
Kulesi sixazululo, bekudingeka ukuthi kutholwe uhlaka olufanele lwe-Serverless ukuze kusetshenziswe imithetho yohlelo lokuthatha izinqumo oluthuthukiswayo. Njengoba u-Tinkoff esebenzisa i-Kubernetes ngenkuthalo ekuphathweni kwengqalasizinda, sibheke izixazululo ezimbalwa esenziwe ngomumo ezisekelwe kukho; ngizokutshela kabanzi ngakho ngokuhamba kwesikhathi.
Ukuthola isixazululo esisebenza kahle kakhulu, sibheke umkhiqizo othuthukiswayo ngeso labasebenzisi bawo. Abasebenzisi abakhulu besistimu yethu bangabahlaziyi abahilelekile ekuthuthukisweni kwemithetho. Imithetho kufanele isetshenziswe kuseva, noma, njengakithi, isetshenziswe efwini, ukuze kuthathwe izinqumo ezilandelayo. Ngokombono womhlaziyi, ukuhamba komsebenzi kubukeka kanje:
- Umhlaziyi ubhala iskripthi, umthetho, noma imodeli ye-ML esuselwe kudatha evela ku-warehouse. Njengengxenye ye-hackathon, sinqume ukusebenzisa i-Mongodb, kodwa ukukhetha uhlelo lokugcina idatha akubalulekile lapha.
- Ngemva kokuhlola imithetho ethuthukisiwe kudatha yomlando, umhlaziyi ulayisha ikhodi yakhe kuphaneli yomqondisi.
- Ukuze uqinisekise inguqulo, yonke ikhodi izoya kumakhosombe e-Git.
- Ngephaneli yomqondisi kuzokwazi ukusebenzisa ikhodi efwini njengemojuli ehlukile esebenzayo ye-Serverless.
Idatha yokuqala evela kumakhasimende kufanele idlule kusevisi ekhethekile Yokucebisa eklanyelwe ukucebisa isicelo sokuqala ngedatha evela endaweni yokugcina impahla. Bekubalulekile ukusebenzisa le sevisi ngendlela yokuthi izosebenza nenqolobane eyodwa (lapho umhlaziyi athatha kuyo idatha lapho esungula imithetho) ukuze kugcinwe ukwakheka kwedatha okuhlangene.
Ngisho nangaphambi kwe-hackathon, sinqume ngohlaka lwe-Serverless esizolusebenzisa. Namuhla kunobuchwepheshe obuningi emakethe obusebenzisa le ndlela. Izixazululo ezidume kakhulu ngaphakathi kwesakhiwo se-Kubernetes yi-Fission, i-Open FaaS ne-Kubeless. Kukhona ngisho .
Ngemva kokukala zonke izinzuzo nezingozi, sakhetha . Lolu hlaka lwe-Serverless kulula ukuluphatha futhi luhlangabezana nezidingo zomsebenzi.
Ukuze usebenze nge-Fission, udinga ukuqonda imiqondo emibili eyisisekelo: umsebenzi nendawo. Umsebenzi ucezu lwekhodi olubhalwe ngolunye lwezilimi lapho kukhona indawo ye-Fission. ihlanganisa iPython, JS, Go, JVM nezinye izilimi eziningi ezidumile nobuchwepheshe.
I-Fission iphinde ikwazi ukwenza imisebenzi ehlukaniswe ngamafayela amaningana, apakishwe ngaphambilini afakwa kungobo yomlando. Ukusebenza kwe-Fission kuqoqo le-Kubernetes kuqinisekiswa ngama-pods akhethekile, alawulwa uhlaka ngokwalo. Ukuze uhlanganyele nama-cluster pods, umsebenzi ngamunye kufanele unikezwe umzila wawo, futhi ongadlula kuwo amapharamitha we-GET noma ucele indikimba esimweni sesicelo sokuthunyelwe.
Ngenxa yalokho, sihlele ukuthola isisombululo esizovumela abahlaziyi ukuthi bakhiphe imibhalo yemithetho ethuthukisiwe ngaphandle kokuhlanganyela konjiniyela nonjiniyela. Indlela echaziwe iphinde iqede isidingo sokuthi abathuthukisi babhale kabusha ikhodi yomhlaziyi ngolunye ulimi. Isibonelo, ohlelweni lwamanje lokuthatha izinqumo esilusebenzisayo, kufanele sibhale imithetho ngobuchwepheshe obukhethekile nezilimi, ububanzi bawo bulinganiselwe kakhulu, futhi kukhona nokuncika okuqinile kuseva yesicelo, njengoba yonke imithetho yasebhange esalungiswa. zitshalwa endaweni eyodwa. Ngenxa yalokho, ukuze kusetshenziswe imithetho emisha kuyadingeka ukukhulula lonke uhlelo.
Esixazululweni sethu esihlongozwayo, asikho isidingo sokukhulula imithetho; ikhodi ingafakwa kalula ngokuchofoza inkinobho. Futhi, ukuphathwa kwengqalasizinda ku-Kubernetes kukuvumela ukuthi ungacabangi ngomthwalo nokukala; izinkinga ezinjalo zixazululwa ngaphandle kwebhokisi. Futhi ukusetshenziswa kwenqolobane yedatha eyodwa kuqeda isidingo sokuqhathanisa idatha yesikhathi sangempela nedatha yomlando, okwenza umsebenzi womhlaziyi ube lula.
Esikutholile
Njengoba sifike ku-hackathon nesixazululo esenziwe ngomumo (emaphusheni ethu), okwakudingeka sikwenze ukuguqula yonke imicabango yethu ibe yimigqa yekhodi.
Isihluthulelo sempumelelo kunoma iyiphi i-hackathon ukulungiselela kanye nohlelo olubhalwe kahle. Ngakho-ke, into yokuqala esiyenzile ukunquma ukuthi yimaphi amamojula ukwakheka kwesistimu yethu okuzohlanganisa nokuthi yiziphi ubuchwepheshe esizobusebenzisa.
I-architecture yephrojekthi yethu yayimi kanje:
Lo mdwebo ubonisa amaphuzu amabili okungenela, umhlaziyi (umsebenzisi oyinhloko wesistimu yethu) kanye neklayenti.
Inqubo yomsebenzi ihlelwe kanje. Umhlaziyi uthuthukisa umsebenzi womthetho kanye nomsebenzi wokucebisa idatha wemodeli yakhe, ugcina ikhodi yakhe endaweni yokugcina ye-Git, futhi ukhiphe imodeli yakhe efwini ngohlelo lokusebenza lomlawuli. Ake sicabangele ukuthi umsebenzi othunyelwe uzobizwa kanjani futhi senze izinqumo ngezicelo ezingenayo ezivela kumakhasimende:
- Iklayenti ligcwalisa ifomu kuwebhusayithi bese lithumela isicelo salo kusilawuli. Isicelo okumele kuthathwe kuso isinqumo siza kokufakwayo kwesistimu futhi sirekhodwa kusizindalwazi ngesimo saso sangempela.
- Okulandelayo, isicelo esingahluziwe sithunyelwa ukuze sicebise, uma kunesidingo. Ungakwazi ukwengeza isicelo sokuqala ngedatha kokubili evela kumasevisi angaphandle kanye nesitoreji. Umbuzo owumphumela ocetshisiwe nawo ugcinwa kusizindalwazi.
- Umsebenzi womhlaziyi wethulwa, othatha umbuzo othuthukisiwe njengokufakwayo futhi ukhiqize isisombululo, esibuye sibhalwe kusitoreji.
Sinqume ukusebenzisa i-MongoDB njengesitoreji kusistimu yethu ngenxa yokugcinwa kwedatha okugxile kumadokhumenti ngendlela yamadokhumenti e-JSON, njengoba izinsiza zokucebisa, okuhlanganisa nesicelo sangempela, zihlanganise yonke idatha ngezilawuli ze-REST.
Ngakho-ke, sibe namahora angu-XNUMX okusebenzisa inkundla. Sabalalise izindima ngempumelelo; ilungu ngalinye leqembu lalinomkhakha walo wokuzibophezela kuphrojekthi yethu:
- Amaphaneli okuphatha angaphambili omsebenzi womhlaziyi, ayengadawuniloda ngawo imithetho ohlelweni lokulawula inguqulo yemibhalo ebhaliwe, akhethe izinketho zokucebisa idatha yokufaka futhi ahlele imibhalo yemithetho ku-inthanethi.
- I-backend admin, efaka i-REST API yangaphambili nokuhlanganiswa ne-VCS.
- Ukusetha ingqalasizinda ku-Google Cloud nokuthuthukisa isevisi yokucebisa idatha yomthombo.
- Imojula yokuhlanganisa uhlelo lokusebenza lomlawuli nohlaka lwe-Serverless ukuze kusetshenziswe imithetho elandelayo.
- Imibhalo yemithetho yokuhlola ukusebenza kwayo yonke isistimu nokuhlanganiswa kokuhlaziya kuzinhlelo zokusebenza ezingenayo (izinqumo ezenziwe) ukuze kuboniswe okokugcina.
Ake siqale ngokuhleleka.
Indawo yethu engaphambili yayibhalwe nge-Angular 7 kusetshenziswa i-UI Kit yasebhange. Inguqulo yokugcina yephaneli yomqondisi ibukeke kanje:
Njengoba bekunesikhathi esincane, sizame ukwenza umsebenzi obalulekile kuphela. Ukuze kusetshenziswe umsebenzi kuqoqo le-Kubernetes, bekudingeka ukuthi kukhethwe umcimbi (isevisi lapho umthetho okudingeka usetshenziswe khona emafini) kanye nekhodi yomsebenzi esebenzisa ingqondo yokwenza izinqumo. Ekusetshenzisweni ngakunye komthetho wesevisi ekhethiwe, sibhale ilogu yalo mcimbi. Kuphaneli yomqondisi ungabona amalogi ayo yonke imicimbi.
Yonke ikhodi yokusebenza yayigcinwe endaweni yokugcina ye-Git ekude, nayo kwadingeka ukuthi isethwe kuphaneli yomqondisi. Ukuze wenze inguqulo yekhodi, yonke imisebenzi igcinwe emagatsheni ahlukene enqolobane. Iphaneli yokulawula iphinde inikeze amandla okwenza izinguquko emibhalweni ebhaliwe, ukuze ngaphambi kokuthumela umsebenzi ekukhiqizeni, awukwazi ukuhlola kuphela ikhodi ebhaliwe, kodwa futhi wenze izinguquko ezidingekayo.
Ngaphezu kwemisebenzi yemithetho, siphinde sasebenzisa ikhono lokucebisa kancane kancane idatha yomthombo sisebenzisa imisebenzi Yokucebisa, ikhodi yayo okwakuyimibhalo lapho kwakungenzeka ukuya endaweni yokugcina idatha, shayela izinsizakalo zezinkampani zangaphandle futhi wenze izibalo zokuqala. . Ukuze sibonise isisombululo sethu, sibale uphawu lwe-zodiac lweklayenti elishiye isicelo futhi sanquma u-opharetha walo weselula lisebenzisa isevisi yenkampani yangaphandle ye-REST.
Ingemuva lesiteji labhalwa nge-Java futhi lasetshenziswa njengohlelo lokusebenza lwe-Spring Boot. Ekuqaleni sasihlele ukusebenzisa i-Postgres ukugcina idatha yomqondisi, kodwa, njengengxenye ye-hackathon, sanquma ukuzikhawulela ku-H2 elula ukuze songe isikhathi. Ngasemuva, ukuhlanganiswa ne-Bitbucket kwasetshenziswa ukuze kuhumushwe imisebenzi yokucebisa imibuzo kanye nemibhalo yemithetho. Ukuze sihlanganiswe namakhosombe e-Git akude, sisebenzise , okuwuhlobo lokugoqa phezu kwemiyalo ye-CLI, ekuvumela ukuthi wenze noma yimiphi imiyalo ye-git usebenzisa isixhumi esibonakalayo sesoftware. Ngakho-ke sasinezindawo zokugcina ezimbili ezihlukene zemisebenzi yokucebisa nemithetho, futhi yonke imibhalo yahlukaniswa yaba izinkomba. Nge-UI kube nokwenzeka ukukhetha ukuzinikela kwakamuva kwesikripthi segatsha lendawo yokugcina izinto. Lapho wenza izinguquko kukhodi ngephaneli yomqondisi, izibophezelo zekhodi eshintshiwe zidalwe kumakhosombe akude.
Ukuze sisebenzise umbono wethu, sasidinga ingqalasizinda efanelekile. Sinqume ukusebenzisa iqoqo lethu le-Kubernetes emafini. Ukukhetha kwethu bekuyi-Google Cloud Platform. Uhlaka lwe-Fission serverless lufakwe kuqoqo le-Kubernetes, esilisebenzise ku-Gcloud. Ekuqaleni, isevisi yokucebisa idatha yomthombo yasetshenziswa njengohlelo lokusebenza lwe-Java oluhlukile olugoqwe nge-Pod ngaphakathi kweqoqo le-k8s. Kodwa ngemva kokuboniswa kokuqala kwephrojekthi yethu phakathi ne-hackathon, sanconywa ukuthi senze isevisi Yokucebisa ibe nezimo ukuze sinikeze ithuba lokukhetha indlela yokucebisa idatha eluhlaza yezinhlelo zokusebenza ezingenayo. Futhi sasingenakho ukukhetha kodwa ukwenza isevisi yokucebisa futhi i-Serverless.
Ukuze sisebenze ne-Fission, sasebenzisa i-Fission CLI, okumele ifakwe phezu kwe-Kubernetes CLI. Ukufaka imisebenzi kuqoqo le-k8s kulula kakhulu; udinga nje ukwabela umzila wangaphakathi kanye nokungena emsebenzini ukuze uvumele ithrafikhi engenayo uma ukufinyelela ngaphandle kweqoqo kuyadingeka. Ukukhipha umsebenzi owodwa ngokuvamile akuthathi ngaphezu kwamasekhondi ayi-10.
Ukwethulwa kokugcina kwephrojekthi nokufingqa
Ukukhombisa ukuthi isistimu yethu isebenza kanjani, sibeke ifomu elilula kuseva ekude lapho ungathumela khona isicelo somunye wemikhiqizo yebhange. Ukuze ucele, bekufanele ufake ama-initials akho, usuku lokuzalwa kanye nenombolo yocingo.
Idatha evela efomini leklayenti yaya kusilawuli, esathumela kanyekanye izicelo zayo yonke imithetho etholakalayo, esesicebise ngaphambili idatha ngokwemibandela eshiwo, futhi sayilondoloza endaweni yokugcina evamile. Sekukonke, sikhiphe imisebenzi emithathu eyenza izinqumo kuzinhlelo zokusebenza ezingenayo kanye namasevisi angu-4 okunothisa idatha. Ngemva kokufaka isicelo, iklayenti lithole isinqumo sethu:
Ngaphezu kokwenqaba noma ukuvunyelwa, iklayenti liphinde lathola uhlu lweminye imikhiqizo, izicelo esizithumele ngokufana. Yile ndlela esibonise ngayo amathuba okuthengiswa okuphambene endaweni yesikhulumi sethu.
Kube nesamba semikhiqizo yasebhange engu-3 etholakalayo:
- Ikhredithi.
- I-Toy
- I-Mortgage.
Phakathi nomboniso, sikhiphe imisebenzi elungisiwe kanye nemibhalo yokucebisa yesevisi ngayinye.
Umthetho ngamunye wawudinga isethi yawo yedatha yokufaka. Ngakho-ke, ukuze sigunyaze i-mortgage, sibale uphawu lwe-zodiac yeklayenti futhi saxhuma lokhu nengqondo yekhalenda lenyanga. Ukuze sigunyaze ithoyizi, sihlole ukuthi iklayenti selifinyelele iminyaka yobudala, futhi ukuze sikhiphe imali ebolekiwe, sithumele isicelo kusevisi evulekile yangaphandle ukuze sinqume u-opharetha weselula, kwase kwenziwa isinqumo ngakho.
Sizamile ukwenza umboniso wethu uhehe futhi uhlanganyele, wonke umuntu okhona angaya efomini lethu ahlole ukutholakala kwezinsizakalo zethu eziqanjiwe kubo. Futhi ekupheleni kwesethulo, sibonise izibalo zezicelo ezitholiwe, ezibonisa ukuthi bangaki abantu abasebenzisa inkonzo yethu, inani lokugunyazwa, nokwenqatshwa.
Ukuze siqoqe izibalo ku-inthanethi, siphinde sasebenzisa ithuluzi le-BI lomthombo ovulekile futhi wasijikijela endaweni yethu yokugcina. I-Metabase ikuvumela ukuthi wakhe izikrini ezinezibalo kudatha esithakaselayo; udinga nje ukubhalisa ukuxhumana kusizindalwazi, khetha amatafula (kithi, ukuqoqwa kwedatha, njengoba sasebenzisa i-MongoDB), futhi ucacise izinkambu esizithandayo. .
Ngenxa yalokho, sithole i-prototype enhle yenkundla yokwenza izinqumo, futhi phakathi nomboniso, umlaleli ngamunye wayengazihlolela mathupha ukusebenza kwayo. Isixazululo esithakazelisayo, i-prototype eqediwe kanye nomboniso ophumelelayo wasivumela ukuba siwine, naphezu kokuncintisana okuqinile kwamanye amaqembu. Ngiqinisekile ukuthi i-athikili ethokozisayo ingabhalwa kuphrojekthi yeqembu ngalinye.
Source: www.habr.com