Indlela esiqokelele ngayo idatha kumaphulo entengiso kwiisayithi ze-intanethi (indlela enameva eya kwimveliso)

Kubonakala ngathi icandelo lentengiso ye-intanethi kufuneka libe phambili ngokwetekhnoloji kunye ne-automation kangangoko kunokwenzeka. Kakade ke, ngenxa yokuba iingxilimbela ezinjalo kunye neengcali kwintsimi yazo njengeYandex, Mail.Ru, Google kunye ne-Facebook zisebenza apho. Kodwa, njengoko kwavela, akukho mda kwimfezeko kwaye kuhlala kukho into yokwenza ngokuzenzekelayo.

Indlela esiqokelele ngayo idatha kumaphulo entengiso kwiisayithi ze-intanethi (indlela enameva eya kwimveliso)
Umthombo

Iqela loNxibelelwano Dentsu Aegis Network Russia ngoyena mdlali mkhulu kwimarike yentengiso yedijithali kwaye utyala imali ngokukhutheleyo kubuchwephesha, ezama ukukhulisa nokwenza iinkqubo zayo zoshishino. Enye yeengxaki ezingasonjululwanga kwiimarike zentengiso ye-intanethi ibe ngumsebenzi wokuqokelela izibalo kwiiphulo zentengiso ezivela kwiiplatifti ezahlukeneyo ze-Intanethi. Isisombululo sale ngxaki ekugqibeleni saphumela ekudalweni kwemveliso D1.Idijithali (funda njengeDiVan), uphuhliso esifuna ukuthetha ngalo.

Kutheni?

1. Ngethuba lokuqala kweprojekthi, kwakungekho nenye imveliso esele ilungile kwimarike eyasombulula ingxaki yokuzenzekelayo ukuqokelela izibalo kwiikhankaso zentengiso. Oku kuthetha ukuba akukho mntu ngaphandle kwethu uya kuhlangabezana neemfuno zethu.

Iinkonzo ezifana ne-Improvado, i-Roistat, i-Supermetrics, i-SegmentStream inikezela ngokudityaniswa kunye namaqonga, amanethiwekhi oluntu kunye ne-Google Analitycs, kwaye yenza ukuba kube lula ukwakha iidashbhodi zokuhlalutya ukuhlalutya okufanelekileyo kunye nokulawula imikhankaso yentengiso. Ngaphambi kokuba siqalise ukuphuhlisa imveliso yethu, sizame ukusebenzisa ezinye zezi nkqubo ukuqokelela idatha kwiisayithi, kodwa, ngelishwa, azikwazanga ukusombulula iingxaki zethu.

Ingxaki enkulu kukuba iimveliso ezivavanyiweyo zixhomekeke kwimithombo yedatha, ukubonisa izibalo zokubeka ngesayithi, kwaye azizange zibonelele ngokukwazi ukudibanisa izibalo kwimikhankaso yentengiso. Le ndlela ayizange isivumele ukuba sibone izibalo ezivela kwiindawo ezahlukeneyo kwindawo enye kwaye sihlalutye imeko yephulo ngokubanzi.

Enye into kukuba kwizigaba zokuqala iimveliso zijoliswe kwiimarike zaseNtshona kwaye azizange zixhase ukudityaniswa neziza zaseRashiya. Kwaye kwezo ndawo apho ukuhlanganiswa kwaphunyezwa khona, zonke iimetriki eziyimfuneko azizange zihlale zikhutshelwa iinkcukacha ezaneleyo, kwaye ukudibanisa kwakungasoloko kukulungele kwaye kucacile, ngakumbi xa kwakuyimfuneko ukufumana into engekho kwi-interface yenkqubo.
Ngokubanzi, sigqibe kwelokuba singaziqhelani neemveliso zomntu wesithathu, kodwa saqala ukuphuhlisa ezethu...

2. Imarike yentengiso ye-intanethi ikhula unyaka nonyaka, kwaye ngo-2018, ngokubhekiselele kuhlahlo lwabiwo-mali lwentengiso, idlule kwimarike yentengiso yeTV ngokwesiko. Ngoko kukho isikali.

3. Ngokungafaniyo nentengiso yentengiso ye-TV, apho ukuthengiswa kweentengiso zentengiso kujongwe, kukho uninzi lwabanini bentengiso yoluhlu lweesayizi ezahlukeneyo ezisebenza kwi-Intanethi kunye neeakhawunti zabo zentengiso. Ekubeni umkhankaso wokukhangisa, njengomthetho, uqhuba kwiindawo ezininzi ngexesha elinye, ukuqonda imeko yephulo lokukhangisa, kuyimfuneko ukuqokelela iingxelo ezivela kuzo zonke iindawo kwaye zidibanise kwingxelo enye enkulu eya kubonisa umfanekiso wonke. Oku kuthetha ukuba kukho amandla okwenza ngcono.

4. Kwakubonakala ngathi abanini bempahla yentengiso kwi-Intanethi sele benayo isiseko sokuqokelela izibalo kunye nokuzibonisa kwiiakhawunti zentengiso, kwaye baya kukwazi ukubonelela nge-API yale datha. Oku kuthetha ukuba kunokwenzeka ngokobugcisa ukuyiphumeza. Masithi ngoko nangoko ukuba akuzange kube lula.

Ngokubanzi, zonke izinto ezifunekayo zokuphunyezwa kweprojekthi zazicacile kuthi, kwaye sabaleka ukuzisa iprojekthi ebomini...

Isicwangciso esikhulu

Ukuqala, senze umbono wenkqubo efanelekileyo:

  • Imikhankaso yentengiso evela kwi-1C yenkqubo yequmrhu kufuneka ilayishwe ngokuzenzekelayo kuyo ngamagama abo, amaxesha, uhlahlo lwabiwo-mali kunye nokubekwa kwiiplatifti ezahlukeneyo.
  • Kwindawo nganye yokubekwa ngaphakathi kwephulo lentengiso, zonke iinkcukacha-manani ezinokubakho kufuneka zikhutshelwe ngokuzenzekelayo kwiindawo ezibekwa kuzo, njengenani lemibono, ukucofa, iimbono, njl.
  • Amanye amaphulo eentengiso alandelwa kusetyenziswa iliso lomntu wesithathu ngokubizwa ngokuba ziinkqubo zentengiso ezifana ne-Adriver, i-Weborama, i-DCM, njl. Kukho imitha ye-Intanethi yoshishino eRashiya - inkampani yeMediascope. Ngokwesicwangciso sethu, idatha evela ekubekweni kweliso ngokuzimeleyo kunye neshishini kufuneka kwakhona ilayishwe ngokuzenzekelayo kumaphulo entengiso ahambelanayo.
  • Uninzi lwemikhankaso yentengiso kwi-Intanethi ijolise kwizenzo ezithile ekujoliswe kuzo (ukuthenga, ukufowuna, ukubhalisela uvavanyo lokuqhuba, njl. njl.), ezilandelwa kusetyenziswa iGoogle Analytics, kunye nezibalo ezikwabalulekile ekuqondeni ubume bephulo kwaye kufuneka zilayishwe kwisixhobo sethu.

Into yokuqala enzima kakhulu

Ngokuzibophelela kwethu kwimigaqo eguquguqukayo yophuhliso lwesoftware (i-agile, zonke izinto), sagqiba ekubeni siqale siphuhlise i-MVP kwaye emva koko siye kwinjongo ekujoliswe kuyo ngokuphindaphindiweyo.
Sagqiba ekubeni sakhe i-MVP ngokusekelwe kwimveliso yethu I-DANBo (iBhodi yeNethiwekhi yeDentsu Aegis), esisisicelo sewebhu esinolwazi oluphangaleleyo kumaphulo entengiso yabathengi bethu.

Kwi-MVP, iprojekthi yenziwe lula kangangoko kunokwenzeka malunga nokuphunyezwa. Sikhethe uluhlu olulinganiselweyo lwamaqonga okudibanisa. Ezi yayiziiqonga eziphambili, ezifana neYandex.Direct, Yandex.Display, RB.Mail, MyTarget, Adwords, DBM, VK, FB, kunye neenkqubo eziphambili zokubhengeza i-Adriver kunye ne-Weborama.

Ukufikelela kwizibalo kwiisayithi nge-API, sisebenzise iakhawunti enye. Umphathi weqela labaxumi owayefuna ukusebenzisa uqokelelo oluzenzekelayo lweenkcukacha-manani kwiphulo lentengiso kwafuneka aqale agunyazise ukufikelela kumaphulo entengiso ayimfuneko kwiziza kwiakhawunti yeqonga.

Okulandelayo ngumsebenzisi wenkqubo DANBo kwafuneka kufakwe ifayile yefomati ethile kwinkqubo ye-Excel, equlethe lonke ulwazi malunga nokubekwa (iphulo lentengiso, iqonga, ifomathi, ixesha lokubeka, izalathisi ezicwangcisiweyo, uhlahlo lwabiwo-mali, njl.njl.) kunye nabachongi bamaphulo entengiso ahambelanayo iisayithi kunye nezinto zokubala kwiinkqubo zokubhengeza.

Yayijongeka, ngokungafihlisiyo, isoyikeka:

Indlela esiqokelele ngayo idatha kumaphulo entengiso kwiisayithi ze-intanethi (indlela enameva eya kwimveliso)

Idatha ekhutshelweyo yagcinwa kuvimba weenkcukacha, kwaye emva koko iinkonzo ezahlukeneyo ziqokelele izichongi zephulo kwiindawo ezisuka kuzo kwaye zikhutshelwe izibalo kuzo.

Kwisayithi nganye, i-window ehlukeneyo inkonzo yabhalwa, eyathi kanye ngosuku yahamba phantsi kwe-akhawunti yenkonzo enye kwi-API yesayithi kunye nezibalo ezikhutshelweyo kwii-ID zephulo ezichaziweyo. Kwenzeka into efanayo nakwiinkqubo zokubhengeza.

Idatha ekhutshelweyo iboniswe kwi-interface ngendlela yedeshibhodi encinci yesiko:

Indlela esiqokelele ngayo idatha kumaphulo entengiso kwiisayithi ze-intanethi (indlela enameva eya kwimveliso)

Ngokungalindelekanga kuthi, i-MVP yaqala ukusebenza kwaye yaqala ukukhuphela izibalo zangoku kwimikhankaso yentengiso kwi-Intanethi. Siphumeze inkqubo kubathengi abaninzi, kodwa xa sizama ukulinganisa, sadibana neengxaki ezinzulu:

  • Ingxaki ephambili yayibubunzima bokulungiselela idatha yokulayisha kwisistim. Kwakhona, idatha yokubeka kwafuneka iguqulelwe kwifomathi engqongqo phambi kokulayisha. Kwakuyimfuneko ukubandakanya izichongi zequmrhu ezivela kwiindawo ezahlukeneyo kwifayile yokukhuphela. Sijongene nenyaniso yokuba kunzima kakhulu kubasebenzisi abangaqeqeshwanga ngokobugcisa ukuba bachaze ukuba bangazifumana phi ezi zichongi kwisayithi kunye nalapho kufuneka zifakwe khona kwifayile. Xa kuqwalaselwa inani labasebenzi kumasebe abaqhuba amaphulo kwiziza kunye nengeniso, oku kubangele inkxaso enkulu kwicala lethu, nto leyo esingayithandanga kwaphela.
  • Enye ingxaki yayikukuba ayizizo zonke iiplatifti zentengiso ezineendlela zokunikezela ukufikelela kumaphulo entengiso kwezinye iiakhawunti. Kodwa nokuba ibikhona indlela yokuthumela abathunywa, ayingabo bonke abathengisi ababekulungele ukunika ukufikelela kumaphulo abo kwiiakhawunti zomntu wesithathu.
  • Umba obalulekileyo yaba ngumsindo oye wavusa phakathi kwabasebenzisi yinto yokuba zonke izalathisi ezicwangcisiweyo kunye neenkcukacha zokubeka esele zingenile kwinkqubo yethu yocwangciso-mali ye-1C, kufuneka ziphinde zingene DANBo.

Oku kusinike ingcamango yokuba umthombo oyintloko wolwazi malunga nokubekwa kufuneka ube yinkqubo yethu ye-1C, apho yonke idatha ifakwe ngokuchanekileyo nangexesha (inqaku apha kukuba ii-invoyisi zenziwe ngokusekelwe kwidatha ye-1C, ngoko ke ukungena ngokuchanekileyo kwedatha kwi-1C. yinto ephambili kuye wonke umntu we-KPI). Le yindlela eyavela ngayo ingcamango entsha yenkqubo...

Umxholo

Into yokuqala esigqibe ukuyenza kukwahlula inkqubo yokuqokelela izibalo kwimikhankaso yentengiso kwi-Intanethi ibe yimveliso eyahlukileyo - D1.Idijithali.

Kwingqikelelo entsha, sigqibe kwelokuba silayishe D1.Idijithali ulwazi malunga namaphulo entengiso kunye nokubekwa ngaphakathi kwawo ukusuka ku-1C, kwaye emva koko utsale amanani kwiisayithi kunye neenkqubo ze-AdServing ukuya kwezi ndawo. Oku bekufanele ukuba kube lula kakhulu ubomi kubasebenzisi (kwaye, njengesiqhelo, yongeza umsebenzi ongaphezulu kubaphuhlisi) kunye nokunciphisa inani lenkxaso.

Ingxaki yokuqala esiye sadibana nayo yayiyeyendalo yombutho kwaye yayinxulumene nento yokuba asikwazanga ukufumana isitshixo okanye uphawu esinokuthelekisa ngalo amaqumrhu asuka kwiinkqubo ezahlukeneyo namaphulo kunye nokubekwa ukusuka ku-1C. Inyani kukuba inkqubo kwinkampani yethu yenzelwe ngendlela yokuba iikhankaso zentengiso zingenwe kwiinkqubo ezahlukeneyo ngabantu abahlukeneyo (abacwangcisi beendaba, ukuthenga, njl.).

Ukuyicombulula le ngxaki, kuye kwafuneka siyile isitshixo se-hashe esikhethekileyo, i-DANBoID, esiya kudibanisa amaqumrhu kwiinkqubo ezahlukeneyo kunye, kwaye sinokuchongwa ngokulula nangokukhethekileyo kwiiseti zedatha ezikhutshelweyo. Esi sichongi senziwa kwinkqubo yangaphakathi ye-1C yokubekwa komntu ngamnye kwaye ikhutshelwa kumaphulo, iindawo zokubeka kunye nezinto zokubala kuzo zonke iisayithi nakuzo zonke iinkqubo ze-AdServing. Ukuphumeza inkqubo yokubeka i-DANBoID kuzo zonke iindawo ezibekwe kuzo kuthathe ixesha, kodwa sikwazile ukuyenza :)

Emva koko safumanisa ukuba akuzona zonke iisayithi ezine-API yokuqokelela ngokuzenzekelayo izibalo, kwaye kwanabo bane-API, ayibuyisi yonke idatha efunekayo.

Ngeli nqanaba, sagqiba ekubeni sinciphise kakhulu uluhlu lwamaqonga okudibanisa kunye nokugxila kwiiplatifomu eziphambili ezibandakanyekayo kuninzi lwamaphulo okukhangisa. Olu luhlu lubandakanya bonke abadlali abakhulu kwiimarike zentengiso (iGoogle, Yandex, Mail.ru), iinethiwekhi zentlalo (VK, Facebook, Twitter), iinkqubo ezinkulu ze-AdServing kunye ne-analytics (DCM, Adriver, Weborama, Google Analytics) kunye namanye amaqonga.

Uninzi lweendawo esizikhethileyo zine-API ebonelela ngeemetrics esizidingayo. Kwiimeko apho bekungekho API okanye ingenayo idatha efunekayo, sasebenzisa iingxelo ezithunyelwa yonke imihla kwi-imeyile yeofisi yethu ukulayisha idatha (kwezinye iinkqubo kunokwenzeka ukuqwalasela iingxelo ezinjalo, kwezinye savumelana ngokuphuhliswa kwe iingxelo ezinjalo kuthi).

Xa sihlalutya idatha esuka kwiindawo ezahlukeneyo, sifumanise ukuba ulawulo lwamaqumrhu alufani kwiinkqubo ezahlukeneyo. Ngaphezu koko, ulwazi kufuneka lukhutshelwe kwiinkcukacha ezahlukeneyo kwiinkqubo ezahlukeneyo.

Ukusombulula le ngxaki, i-subDANBoID concept yaphuhliswa. Umbono we-SubDANBoID ulula kakhulu, siphawula eyona nto iphambili yephulo kwisiza nge-DANBoID eyenziweyo, kwaye silayisha onke amaziko akhiweyo anezinto ezichonga indawo ezizodwa kunye nefom ye-SubDANBoID ngokomgaqo we-DANBoID + isichongi senqanaba lokuqala. iqumrhu elifakwe kwindlwane + isazisi senqanaba lesibini elifakwe kwindlwane +... Le ndlela yasivumela ukuba sidibanise amaphulo entengiso kwiinkqubo ezahlukeneyo kwaye sikhuphele iinkcukacha-manani kuzo.

Kwaye kwafuneka ukuba sisombulule ingxaki yokufikelela kumaphulo kumaqonga ahlukeneyo. Njengoko sibhale ngasentla, indlela yokunikezela ukufikelela kwiphulo kwi-akhawunti yobugcisa eyahlukileyo ayisoloko isebenza. Ke ngoko, kuye kwafuneka siphuhlise isiseko sogunyaziso oluzenzekelayo nge-OAuth sisebenzisa amathokheni kunye neendlela zokuhlaziya ezi tokens.

Kamva kwinqaku siza kuzama ukuchaza ngokubanzi i-architecture yesisombululo kunye neenkcukacha zobugcisa bokuphunyezwa.

Uyilo lwesisombululo 1.0

Xa siqala ukuphunyezwa kwemveliso entsha, saqonda ukuba ngokukhawuleza sifuna ukubonelela ngamathuba okudibanisa iisayithi ezintsha, ngoko ke sagqiba ekubeni silandele umendo we-microservice architecture.

Xa siqulunqa i-architecture, sahlula iziqhagamshelo kuzo zonke iinkqubo zangaphandle - i-1C, iiplatifomu zentengiso kunye neenkqubo zokukhangisa - kwiinkonzo ezahlukeneyo.
Ingcamango ephambili kukuba zonke izixhumi kwiisayithi zine-API efanayo kwaye zi-adapter ezizisa i-API yesayithi kwi-interface elula kuthi.

Embindini wemveliso yethu sisicelo sewebhu, esiyi-monolith eyenzelwe ngendlela enokuthi idibanise ngokulula kwiinkonzo. Esi sicelo sinoxanduva lokucubungula idatha ekhutshelweyo, ukudibanisa izibalo ezivela kwiinkqubo ezahlukeneyo kunye nokuzinikezela kubasebenzisi benkqubo.

Ukunxibelelana phakathi kweziqhagamshelo kunye nesicelo sewebhu, kwafuneka senze inkonzo eyongezelelweyo, esiyibiza ngokuba yi-Connector Proxy. Yenza imisebenzi yoFundo lweNkonzo kunye noMcwangcisi woMsebenzi. Le nkonzo iqhuba imisebenzi yokuqokelela idatha kwisinxibelelanisi ngasinye ngobusuku. Ukubhala umaleko wenkonzo kwakulula kunokudibanisa umthengisi womyalezo, kwaye kuthi kwakubalulekile ukufumana umphumo ngokukhawuleza.

Ukulula kunye nesantya sophuhliso, siphinde sagqiba ekubeni zonke iinkonzo ziya kuba yiWeb APIs. Oku kwenza ukuba kube lula ukudibanisa ngokukhawuleza ubungqina bobungqina kunye nokuqinisekisa ukuba uyilo lonke luyasebenza.

Indlela esiqokelele ngayo idatha kumaphulo entengiso kwiisayithi ze-intanethi (indlela enameva eya kwimveliso)

Umsebenzi owahlukileyo, endaweni entsonkothileyo yayikukuseka ukufikelela kokuqokelela idatha kwiiakhawunti ezahlukeneyo, ezithi, njengoko sigqibe kwelokuba, kufuneka zenziwe ngabasebenzisi ngokusebenzisa ujongano lwewebhu. Iqulethwe ngamanyathelo amabini ahlukeneyo: okokuqala, umsebenzisi wongeza ithokheni yokufikelela kwi-akhawunti nge-OAuth, kwaye emva koko uqwalasele ukuqokelelwa kwedatha kumxhasi kwi-akhawunti ethile. Ukufumana ithokheni nge-OAuth kuyimfuneko kuba, njengoko sele sibhalile, akusoloko kunokwenzeka ukunika imvume yokufikelela kwiakhawunti efunwayo kwisiza.

Ukudala indlela yehlabathi jikelele yokukhetha i-akhawunti kwiisayithi, kuye kwafuneka songeze indlela kwi-API yoqhagamshelo ebuyisela i-JSON Schema, enikezelwa kwifomu kusetyenziswa icandelo le-JSONEditor elilungisiweyo. Ngale ndlela, abasebenzisi baye bakwazi ukukhetha ii-akhawunti abanokukhuphela kuzo idatha.

Ukuthobela imida yesicelo ekhoyo kwiisayithi, sidibanisa izicelo zokuseta ngaphakathi kwithokheni enye, kodwa sinokuqhuba amathokheni ahlukeneyo ngokufanayo.

Sakhetha i-MongoDB njengendawo yokugcina idatha elayishiweyo kuzo zombini isicelo sewebhu kunye nezixhumi, ezisivumele ukuba singakhathazeki kakhulu malunga nesakhiwo sedatha kumanqanaba okuqala ophuhliso, xa imodeli yesicelo itshintsha yonke imihla.

Kungekudala safumanisa ukuba ayizizo zonke iinkcukacha ezihambelana kakuhle kwi-MongoDB kwaye, umzekelo, kulungele ukugcina izibalo zemihla ngemihla kwisiseko sobudlelwane. Ngoko ke, kubadibanisi abanobume bedatha bufaneleke ngakumbi kwisiseko sedatha yobudlelwane, siqale ukusebenzisa i-PostgreSQL okanye i-MS SQL Server njengokugcinwa.

Uyilo olukhethiweyo kunye nobuchwepheshe busivumela ukuba sakhe kwaye siqalise imveliso ye-D1.Digital ngokukhawuleza. Ngaphezulu kweminyaka emibini yophuhliso lwemveliso, siphuhlise i-23 izixhumanisi kwiisayithi, safumana amava axabisekileyo okusebenza kunye ne-APIs yomntu wesithathu, safunda ukuphepha imigibe yeendawo ezahlukeneyo, apho ngamnye wayenazo, igalelo ekuphuhlisweni kwe-API ubuncinane be-3. iisayithi, zikhuphele ngokuzenzekelayo ulwazi malunga namaphulo angama-15 kunye nokubekwa okungaphezulu kwe-000, iqokelele iimpendulo ezininzi kubasebenzisi malunga nokusebenza kwemveliso kwaye yakwazi ukutshintsha inkqubo ephambili yemveliso amaxesha amaninzi, ngokusekelwe kule ngxelo.

Uyilo lwesisombululo 2.0

Iminyaka emibini idlulile ukususela ekuqaleni kophuhliso D1.Idijithali. Ukunyuka okuthe gqolo komthwalo kwinkqubo kunye nokuvela kwemithombo yedatha emitsha ngokuthe ngcembe iveze iingxaki kuyilo lwesisombululo esikhoyo.

Ingxaki yokuqala inxulumene nesixa sedatha ekhutshelwe kwiindawo. Sasijongene nenyaniso yokuba ukuqokelela kunye nokuhlaziya yonke idatha efunekayo kwiindawo ezinkulu zaqala ukuthatha ixesha elininzi. Umzekelo, ukuqokelela idatha kwi-AdRiver adserving system, esithi ngayo silandele iinkcukacha-manani kwiindawo ezininzi zokubekwa, kuthatha malunga neeyure ezili-12.

Ukuyicombulula le ngxaki, saqala ukusebenzisa zonke iintlobo zeengxelo ukukhuphela idatha kwiisayithi, sizama ukuphuhlisa i-API yazo kunye neendawo ukuze isantya sokusebenza kwayo sihlangabezane neemfuno zethu, kwaye sihambisane nokukhuphela idatha kangangoko kunokwenzeka.

Enye ingxaki inxulumene nokusetyenzwa kwedatha ekhutshelweyo. Ngoku, xa izibalo zokubeka ezintsha zifika, inkqubo yezigaba ezininzi zokubala kwakhona i-metrics iqaliswe, equka ukulayisha idatha ekrwada, ukubala i-aggregated metrics kwisayithi nganye, ukuthelekisa idatha esuka kwimithombo eyahlukeneyo kunye nomnye, kunye nokubala isishwankathelo seemetrics zephulo. Oku kubangela umthwalo omninzi kwisicelo sewebhu esenza zonke izibalo. Amaxesha amaninzi, ngexesha lenkqubo yokubala kwakhona, isicelo sichithe yonke imemori kwi-server, malunga ne-10-15 GB, eyayinefuthe elibi kakhulu kumsebenzi wabasebenzisi kunye nenkqubo.

Iingxaki ezichongiweyo kunye nezicwangciso ezinqwenelekayo zophuhliso oluthe kratya lwemveliso zasikhokelela kwisidingo sokuphinda siqwalasele ulwakhiwo lwesicelo.

Saqala ngee connectors.
Siye saqaphela ukuba zonke iziqhagamshelo zisebenza ngokwemodeli efanayo, ngoko ke sakha isakhelo sombhobho apho ukwenza isidibaniso kufuneka ucwangcise kuphela ingqiqo yamanyathelo, okuseleyo kwaba jikelele. Ukuba umdibaniso ufuna ukuphuculwa, ngoko sidlulisela ngokukhawuleza kwisakhelo esitsha ngexesha elifanayo njengoko ikhonkco iphuculwa.

Kwangelo xesha, saqala ukuthumela iziqhagamshelo eDocker naseKubernetes.
Sicebe ukufudukela eKubernetes ixesha elide, sizama useto lweCI/CD, kodwa saqala ukuhamba kuphela xa isinxibelelanisi esinye, ngenxa yempazamo, saqala ukutya ngaphezulu kwe-20 GB yememori kumncedisi, ngokubulala ezinye iinkqubo. . Ngexesha lophando, isinxibelelanisi safuduselwa kwiqela le-Kubernetes, apho lahlala khona, nasemva kokuba impazamo ilungisiwe.

Ngokukhawuleza saqonda ukuba i-Kubernetes yayilungile, kwaye kwiinyanga ezintandathu sadlulisela iziqhagamshelo ezi-7 kunye ne-Connectors Proxy, edla ezona zixhobo zininzi, kwiqela lemveliso.

Ukulandela izihlanganisi, sigqibe ekubeni sitshintshe ulwakhiwo lwesicelo sonke.
Ingxaki ephambili yayikukuba idatha ivela kwizixhumi ukuya kwiiproksi kwiibhetshi ezinkulu, kwaye emva koko ibethe i-DANBoID kwaye ithunyelwe kwisicelo sewebhu esisembindini sokusebenza. Ngenxa yenani elikhulu leemetrics zokubalwa kwakhona, kukho umthwalo omkhulu kwisicelo.

Kukwangqineke kunzima kakhulu ukubeka esweni ubume boqokelelo lwedatha yemisebenzi kunye nokuxela iimpazamo ezenzeka ngaphakathi kwiziqhagamshelo kwisicelo esisembindini sewebhu ukuze abasebenzisi babone okwenzekayo kwaye kutheni idatha ingaqokelelwa.

Ukusombulula ezi ngxaki, siphuhlise i-architecture 2.0.

Umahluko omkhulu phakathi kwenguqu entsha yezakhiwo kukuba endaweni yeWeb API, sisebenzisa iRabbitMQ kunye nelayibrari yeMassTransit ukutshintshiselana ngemiyalezo phakathi kweenkonzo. Ukwenza oku, kuye kwafuneka ukuba siphinde sibhale ngokupheleleyo i-Proxy ye-Connectors, siyenze i-Connectors Hub. Igama latshintshwa ngenxa yokuba indima ephambili yenkonzo ayisekho ekudluliseleni izicelo kwizixhumanisi kunye nomva, kodwa ekulawuleni ukuqokelelwa kweemethrikhi ezivela kwizihlanganisi.

Ukususela kwisicelo sewebhu esiphakathi, sahlula ulwazi malunga nokubekwa kunye neenkcukacha-manani ukusuka kwiindawo ukuya kwiinkonzo ezihlukeneyo, ezenza kube lula ukulahla ukubala kwakhona okungadingekile kunye nokugcina kuphela izibalo ezibaliweyo kunye nezibalo ezihlanganisiweyo kwinqanaba lokubeka. Siphinde sabhala kwaye salungisa ingqiqo yokubala izibalo ezisisiseko ngokusekelwe kwidatha ekrwada.

Kwangaxeshanye, sifuduka zonke iinkonzo kunye nezicelo kwi-Docker kunye ne-Kubernetes ukwenza isisombululo sibe lula ukukala kwaye silungele ukulawula.

Indlela esiqokelele ngayo idatha kumaphulo entengiso kwiisayithi ze-intanethi (indlela enameva eya kwimveliso)

Siphi ngoku

Ubungqina be-architecture ye-2.0 yemveliso D1.Idijithali ukulungele kwaye usebenza kwindawo yovavanyo kunye neseti elinganiselweyo yezihlanganisi. Konke okuseleyo kukubhala kwakhona ezinye izixhumanisi ze-20 kwiqonga elitsha, ukuvavanya ukuba idatha ilayishwe ngokuchanekileyo kwaye zonke iimetriki zibalwa ngokuchanekileyo, kwaye zikhuphe yonke idizayini kwimveliso.

Enyanisweni, le nkqubo iya kwenzeka ngokuthe ngcembe kwaye kuya kufuneka sishiye ukuhambelana nomva kunye nee-API ezindala ukugcina yonke into isebenza.

Izicwangciso zethu zangoku zibandakanya uphuhliso lweziqhagamshelo ezintsha, ukudityaniswa neenkqubo ezintsha kunye nokongeza iimetriki ezongezelelweyo kwiseti yedatha ekhutshelweyo kwiindawo eziqhagamshelweyo kunye neenkqubo zokwazisa.

Sikwaceba ukudlulisela zonke izicelo, kubandakanywa nesicelo sewebhu esiphakathi, kwiDocker naseKubernetes. Idityaniswe noyilo olutsha, oku kuya kwenza lula kakhulu ukusasazwa, ukubeka iliso kunye nolawulo lwezibonelelo ezisetyenzisiweyo.

Olunye uluvo kukulinga ngokhetho lwesiseko sedatha yokugcina amanani, okwangoku agcinwe kwiMongoDB. Sele sidlulisele izihlanganisi ezininzi kuluhlu lwedatha ye-SQL, kodwa apho umahluko uphantse ungabonakali, kwaye izibalo ezidityanisiweyo ngemini, ezinokuthi zicelwe ixesha elingenasizathu, ingeniso inokuba yingozi kakhulu.

Ngokubanzi, izicwangciso zinkulu, masiqhubeke :)

Ababhali benqaku leR&D Dentsu Aegis Network Russia: Georgy Ostapenko (shmiigaa, Mikhail Kotsik (hitexx)

umthombo: www.habr.com

Yongeza izimvo