Yuav ua li cas peb sau cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm los ntawm cov vev xaib online (txoj kev thorny rau cov khoom lag luam)

Nws zoo nkaus li hais tias thaj chaw ntawm kev tshaj tawm hauv online yuav tsum ua raws li thev naus laus zis thiab automated li sai tau. Tau kawg, vim tias cov neeg loj thiab cov kws tshaj lij hauv lawv txoj haujlwm xws li Yandex, Mail.Ru, Google thiab Facebook ua haujlwm nyob ntawd. Tab sis, raws li nws tau muab tawm, tsis muaj kev txwv rau kev ua tiav thiab muaj ib txwm muaj ib yam dab tsi rau automate.

Yuav ua li cas peb sau cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm los ntawm cov vev xaib online (txoj kev thorny rau cov khoom lag luam)
Tau qhov twg los

Kev sib txuas lus pab pawg Dentsu Aegis Network Russia yog tus neeg ua si loj tshaj plaws hauv kev lag luam digital advertising thiab nquag nqis peev hauv thev naus laus zis, sim ua kom zoo dua thiab ua kom nws cov txheej txheem ua lag luam. Ib qho ntawm cov teeb meem tsis daws teeb meem ntawm kev lag luam online tshaj tawm tau dhau los ua txoj haujlwm ntawm kev sau cov txheeb cais ntawm cov phiaj xwm tshaj tawm los ntawm ntau lub vev xaib hauv Internet. Txoj kev daws teeb meem no thaum kawg ua rau kev tsim cov khoom lag luam D1.Digital (nyeem raws li DiVan), kev txhim kho uas peb xav tham txog.

Vim li cas?

1. Thaum lub sijhawm pib ntawm qhov project, tsis muaj ib qho kev npaj ua tiav ntawm cov khoom lag luam uas daws qhov teeb meem ntawm automating sau cov txheeb cais ntawm cov phiaj xwm kev tshaj tawm. Qhov no txhais tau hais tias tsis muaj leej twg tsuas yog peb tus kheej yuav txaus siab rau peb cov kev xav tau.

Cov kev pabcuam xws li Improvado, Roistat, Supermetrics, SegmentStream muab kev koom ua ke nrog cov platforms, social networks thiab Google Analitycs, thiab tseem ua rau nws muaj peev xwm los tsim cov kev ntsuam xyuas dashboards kom yooj yim tsom xam thiab tswj kev tshaj tawm kev tshaj tawm. Ua ntej peb pib tsim peb cov khoom, peb tau sim siv qee lub tshuab los sau cov ntaub ntawv los ntawm cov chaw, tab sis, hmoov tsis, lawv tsis tuaj yeem daws peb cov teeb meem.

Qhov teeb meem tseem ceeb yog tias cov khoom lag luam sim tau ua raws li cov ntaub ntawv, tso tawm cov txheeb cais los ntawm qhov chaw, thiab tsis muaj peev xwm los sau cov txheeb cais ntawm cov phiaj xwm tshaj tawm. Txoj hauv kev no tsis tau tso cai rau peb pom kev txheeb cais los ntawm cov chaw sib txawv hauv ib qho chaw thiab txheeb xyuas lub xeev ntawm kev sib tw tag nrho.

Lwm qhov tseem ceeb yog tias thaum pib cov khoom lag luam tau tsom mus rau Western kev lag luam thiab tsis txhawb kev koom ua ke nrog cov chaw hauv Lavxias. Thiab rau cov chaw uas kev koom ua ke tau ua tiav, tag nrho cov kev ntsuas tsim nyog tsis tas yuav rub tawm nrog cov ntsiab lus txaus, thiab kev sib koom ua ke tsis yog ib txwm yooj yim thiab pob tshab, tshwj xeeb tshaj yog thaum nws tsim nyog kom tau txais qee yam tsis nyob hauv qhov system interface.
Feem ntau, peb txiav txim siab tsis hloov mus rau cov khoom thib peb, tab sis pib tsim peb tus kheej ...

2. Kev lag luam tshaj tawm hauv online tau loj hlob los ntawm ib xyoos mus rau ib xyoos, thiab hauv 2018, hais txog kev tshaj tawm nyiaj txiag, nws tau dhau los ntawm kev lag luam tshaj tawm hauv TV tshaj plaws. Yog li ntawd muaj ib tug scale.

3. Tsis zoo li TV tshaj tawm kev lag luam, qhov twg kev muag khoom ntawm kev tshaj tawm kev lag luam yog monopolized, muaj ntau tus tswv ntawm kev tshaj tawm cov khoom muag ntawm ntau qhov ntau thiab tsawg ua haujlwm hauv Is Taws Nem nrog lawv tus kheej cov nyiaj tshaj tawm. Txij li thaum kev tshaj tawm kev tshaj tawm, raws li txoj cai, khiav ntawm ntau qhov chaw ib zaug, kom nkag siab txog lub xeev ntawm kev tshaj tawm kev tshaj tawm, nws yog qhov yuav tsum tau sau cov ntawv ceeb toom los ntawm txhua qhov chaw thiab muab tso rau hauv ib daim ntawv qhia loj uas yuav qhia tag nrho cov duab. Qhov no txhais tau tias muaj peev xwm rau optimization.

4. Nws zoo li peb cov tswv ntawm cov khoom lag luam tshaj tawm hauv Is Taws Nem twb muaj cov txheej txheem rau kev sau cov txheeb cais thiab nthuav tawm hauv cov nyiaj tshaj tawm, thiab lawv yuav muaj peev xwm muab API rau cov ntaub ntawv no. Qhov no txhais tau hais tias nws yog technically ua tau los siv nws. Cia hais tam sim ntawd nws tig tawm tsis yooj yim li.

Nyob rau hauv dav dav, tag nrho cov prerequisites rau qhov kev siv ntawm qhov project yog pom tseeb rau peb, thiab peb tau khiav mus coj qhov project mus rau lub neej ...

Kev npaj loj

Yuav pib nrog, peb tsim ib lub zeem muag ntawm ib tug zoo tagnrho system:

  • Kev tshaj tawm cov phiaj xwm los ntawm 1C cov neeg koom tes yuav tsum tau muab tso rau hauv nws nrog lawv cov npe, lub sijhawm, pob nyiaj siv thiab kev tso kawm ntawm ntau lub platform.
  • Rau txhua qhov chaw nyob hauv kev tshaj tawm kev tshaj tawm, txhua qhov kev txheeb xyuas tau yuav tsum tau rub tawm los ntawm cov chaw uas qhov chaw muab tso rau, xws li tus naj npawb ntawm impressions, clicks, views, thiab lwm yam.
  • Qee qhov kev tshaj tawm kev tshaj tawm tau taug qab siv kev saib xyuas thib peb los ntawm kev hu ua adserving systems xws li Adriver, Weborama, DCM, thiab lwm yam. Kuj tseem muaj kev lag luam hauv Internet hauv Russia - lub tuam txhab Mediascope. Raws li peb txoj kev npaj, cov ntaub ntawv los ntawm kev ywj pheej thiab kev saib xyuas kev lag luam yuav tsum tau muab tso rau hauv cov kev sib tw tshaj tawm.
  • Feem ntau cov phiaj xwm tshaj tawm hauv Is Taws Nem yog tsom rau qee lub hom phiaj ua haujlwm (m yuav, hu, sau npe rau kev sim tsav, thiab lwm yam), uas tau taug qab siv Google Analytics, thiab cov txheeb cais uas tseem ceeb rau kev nkag siab txog cov xwm txheej ntawm kev sib tw thiab yuav tsum tau loaded rau hauv peb lub cuab tam.

Thawj damn yog lumpy

Muab peb txoj kev cog lus rau cov hauv paus ntsiab lus hloov pauv ntawm kev txhim kho software (agile, txhua yam), peb txiav txim siab ua ntej tsim MVP thiab tom qab ntawd txav mus rau lub hom phiaj xav rov ua dua.
Peb txiav txim siab los tsim MVP raws li peb cov khoom DANBo (Dentsu Aegis Network Board), uas yog daim ntawv thov lub vev xaib nrog cov ntaub ntawv dav dav ntawm peb cov neeg siv khoom tshaj tawm kev tshaj tawm.

Rau MVP, qhov project tau simplified ntau npaum li qhov ua tau raws li kev siv. Peb tau xaiv cov npe txwv ntawm lub platform rau kev koom ua ke. Cov no yog cov platforms loj, xws li Yandex.Direct, Yandex.Display, RB.Mail, MyTarget, Adwords, DBM, VK, FB, thiab lub ntsiab adserving systems Adriver thiab Weborama.

Txhawm rau nkag mus rau cov txheeb cais ntawm qhov chaw ntawm API, peb siv ib tus account. Tus neeg saib xyuas pab pawg neeg uas xav siv kev sau tsis siv neeg ntawm kev txheeb cais ntawm kev tshaj tawm kev tshaj tawm yuav tsum xub tso cai nkag mus rau qhov tsim nyog tshaj tawm cov phiaj xwm ntawm cov chaw mus rau lub platform account.

Tom ntej no yog tus neeg siv qhov system DANBo yuav tsum tau xa cov ntaub ntawv ntawm ib hom ntawv rau hauv Excel, uas muaj tag nrho cov ntaub ntawv hais txog qhov chaw tso kawm (kev tshaj tawm phiaj xwm, platform, hom, lub sijhawm tso kawm, cov cim qhia, pob nyiaj siv, thiab lwm yam) thiab cov cim ntawm cov kev tshaj tawm kev tshaj tawm ntawm cov sites thiab counters hauv adserving systems.

Nws ntsia, frankly, txaus ntshai:

Yuav ua li cas peb sau cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm los ntawm cov vev xaib online (txoj kev thorny rau cov khoom lag luam)

Cov ntaub ntawv rub tawm tau raug khaws cia rau hauv cov ntaub ntawv, thiab tom qab ntawd cov kev pabcuam cais tau sau cov cim kev sib tw ntawm cov chaw los ntawm lawv thiab rub tawm cov txheeb cais ntawm lawv.

Rau txhua qhov chaw, ib qho kev pabcuam windows sib cais tau sau tseg, uas ib hnub ib zaug mus rau hauv ib tus as-qhauj pabcuam hauv lub vev xaib API thiab rub tawm cov txheeb cais rau cov phiaj xwm ID. Tib yam tshwm sim nrog adserving systems.

Cov ntaub ntawv rub tawm tau tshwm sim ntawm qhov interface hauv daim ntawv me me dashboard:

Yuav ua li cas peb sau cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm los ntawm cov vev xaib online (txoj kev thorny rau cov khoom lag luam)

Kev npaj txhij txog rau peb, MVP pib ua haujlwm thiab pib rub tawm cov txheeb cais tam sim no ntawm kev tshaj tawm kev tshaj tawm hauv Is Taws Nem. Peb siv cov txheej txheem rau ntau tus neeg siv khoom, tab sis thaum sim ntsuas, peb ntsib teeb meem loj:

  • Qhov teeb meem tseem ceeb yog qhov nyuaj ntawm kev npaj cov ntaub ntawv rau kev thauj khoom rau hauv qhov system. Tsis tas li ntawd, cov ntaub ntawv tso kawm yuav tsum tau hloov mus rau ib hom ntawv ruaj khov ua ntej thauj khoom. Nws yog ib qho tsim nyog kom suav nrog cov neeg txheeb xyuas los ntawm ntau qhov chaw hauv cov ntaub ntawv rub tawm. Peb tau ntsib nrog qhov tseeb tias nws yog qhov nyuaj heev rau cov neeg siv tsis muaj kev cob qhia los piav qhia qhov twg yuav nrhiav tau cov cim no ntawm lub xaib thiab qhov twg hauv cov ntaub ntawv lawv xav tau nkag mus. Xav txog tus naj npawb ntawm cov neeg ua haujlwm hauv lub tuam tsev khiav haujlwm ntawm qhov chaw thiab kev hloov pauv, qhov no ua rau muaj kev txhawb nqa ntau ntawm peb sab, uas peb tsis txaus siab kiag li.
  • Lwm qhov teeb meem yog tias tsis yog txhua lub platform tshaj tawm muaj cov txheej txheem rau kev tso cai nkag mus rau kev tshaj tawm cov phiaj xwm rau lwm tus account. Tab sis txawm tias muaj cov txheej txheem delegation, tsis yog txhua tus neeg tshaj tawm tau txaus siab tso cai nkag mus rau lawv cov phiaj xwm rau cov nyiaj thib peb.
  • Ib qho tseem ceeb yog qhov kev npau taws uas tau tshwm sim los ntawm cov neeg siv los ntawm qhov tseeb tias tag nrho cov phiaj xwm qhia thiab cov ntsiab lus ntawm qhov chaw uas lawv tau nkag mus rau hauv peb 1C accounting system, lawv yuav tsum rov nkag mus rau hauv. DANBo.

Qhov no tau muab peb lub tswv yim tias cov ntaub ntawv tseem ceeb ntawm kev tso npe yuav tsum yog peb qhov system 1C, uas txhua cov ntaub ntawv nkag mus kom raug thiab raws sijhawm (lub ntsiab lus ntawm no yog cov ntawv xa nyiaj tau tsim los ntawm 1C cov ntaub ntawv, yog li kev nkag ntawm cov ntaub ntawv mus rau 1C. yog qhov tseem ceeb rau txhua tus KPI). Qhov no yog li cas lub tswv yim tshiab ntawm qhov system tau tshwm sim ...

tswvyim

Thawj qhov uas peb tau txiav txim siab ua yog cais cov txheej txheem rau kev sau cov txheeb cais ntawm kev tshaj tawm kev tshaj tawm hauv Is Taws Nem rau hauv cov khoom sib cais - D1.Digital.

Nyob rau hauv lub tswv yim tshiab, peb txiav txim siab mus thauj mus rau hauv D1.Digital cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm thiab qhov chaw nyob hauv lawv los ntawm 1C, thiab tom qab ntawd rub cov txheeb cais los ntawm cov chaw thiab AdServing systems rau cov chaw no. Qhov no yuav tsum ua kom yooj yim lub neej rau cov neeg siv (thiab, raws li ib txwm, ntxiv ua haujlwm ntxiv rau cov neeg tsim khoom) thiab txo cov nyiaj them yug.

Thawj qhov teeb meem peb tau ntsib yog ntawm lub koom haum xwm txheej thiab muaj feem cuam tshuam nrog qhov tseeb tias peb nrhiav tsis tau ib qho tseem ceeb lossis kos npe los ntawm qhov uas peb tuaj yeem sib piv cov koom haum los ntawm ntau lub tshuab nrog kev sib tw thiab qhov chaw los ntawm 1C. Qhov tseeb yog tias cov txheej txheem hauv peb lub tuam txhab tau tsim nyob rau hauv xws li kev tshaj tawm cov phiaj xwm tau nkag mus rau hauv cov txheej txheem sib txawv los ntawm cov neeg sib txawv (cov phiaj xwm xov xwm, kev yuav khoom, thiab lwm yam).

Txhawm rau daws qhov teeb meem no, peb yuav tsum tsim kom muaj tus yuam sij hashed tshwj xeeb, DANBoID, uas yuav txuas cov koom haum hauv cov tshuab sib txawv ua ke, thiab qhov ntawd tuaj yeem yooj yim yooj yim thiab cim tshwj xeeb hauv cov ntaub ntawv rub tawm. Tus cim no yog tsim nyob rau hauv 1C system sab hauv rau txhua qhov kev tso kawm thiab raug xa mus rau cov phiaj xwm, qhov chaw thiab cov txee rau txhua qhov chaw thiab hauv txhua qhov AdServing systems. Kev ua raws li kev coj ua ntawm kev tso DANBoID hauv txhua qhov chaw tau siv qee lub sijhawm, tab sis peb tau ua tiav :)

Tom qab ntawd peb pom tias tsis yog txhua qhov chaw muaj API rau kev khaws cov txheeb cais, thiab txawm tias cov uas muaj API, nws tsis rov qab tag nrho cov ntaub ntawv tsim nyog.

Nyob rau theem no, peb tau txiav txim siab txo qis cov npe ntawm cov platforms rau kev sib koom ua ke thiab tsom mus rau lub ntsiab platforms uas koom nrog feem ntau ntawm cov phiaj xwm tshaj tawm. Cov npe no suav nrog txhua tus players loj tshaj plaws hauv kev lag luam tshaj tawm (Google, Yandex, Mail.ru), kev sib tham (VK, Facebook, Twitter), loj AdServing thiab analytics systems (DCM, Adriver, Weborama, Google Analytics) thiab lwm yam platforms.

Feem ntau ntawm cov chaw peb xaiv muaj API uas muab cov kev ntsuas peb xav tau. Nyob rau hauv rooj plaub uas tsis muaj API lossis nws tsis muaj cov ntaub ntawv tsim nyog, peb siv cov ntaub ntawv xa tawm txhua hnub rau peb lub chaw ua haujlwm email los thauj cov ntaub ntawv (hauv qee lub tshuab nws tuaj yeem teeb tsa cov ntaub ntawv no, hauv lwm qhov peb tau pom zoo rau kev tsim cov ntawv ceeb toom no. rau peb).

Thaum txheeb xyuas cov ntaub ntawv los ntawm cov chaw sib txawv, peb pom tias cov hierarchy ntawm cov chaw tsis zoo ib yam hauv cov tshuab sib txawv. Ntxiv mus, cov ntaub ntawv yuav tsum tau downloaded nyob rau hauv sib txawv kom meej los ntawm txawv systems.

Txhawm rau daws qhov teeb meem no, lub tswv yim SubDANBoID tau tsim. Lub tswv yim ntawm SubDANBoID yog qhov yooj yim heev, peb khij lub luag haujlwm tseem ceeb ntawm kev sib tw ntawm lub xaib nrog cov tsim DANBoID, thiab peb muab tag nrho cov koom haum sib koom ua ke nrog cov cim tshwj xeeb ntawm qhov chaw thiab daim ntawv SubDANBoID raws li DANBoID txoj cai + tus lej ntawm thawj qib nested entity + identifier of the second level nested entity +... Qhov kev qhia no tso cai rau peb los txuas cov phiaj xwm tshaj tawm hauv cov tshuab sib txawv thiab rub tawm cov ntaub ntawv ntxaws ntxaws ntawm lawv.

Peb kuj yuav tsum tau daws qhov teeb meem ntawm kev nkag mus rau kev sib tw ntawm ntau lub platform. Raws li peb tau sau saum toj no, cov txheej txheem ntawm delegating nkag mus rau ib qho kev sib tw mus rau ib qho kev sib cais account tsis yog ib txwm siv tau. Yog li ntawd, peb yuav tsum tsim kom muaj kev tsim kho vaj tse rau kev tso cai tsis siv neeg los ntawm OAuth siv tokens thiab cov txheej txheem rau kev hloov kho cov tokens.

Tom qab hauv tsab xov xwm peb yuav sim piav qhia ntau ntxiv txog cov qauv kev daws teeb meem thiab cov ntsiab lus ntawm kev siv.

Kev daws teeb meem architecture 1.0

Thaum pib qhov kev siv ntawm cov khoom tshiab, peb nkag siab tias tam sim ntawd peb xav tau los muab kev sib txuas ntawm cov chaw tshiab, yog li peb txiav txim siab ua raws li txoj hauv kev ntawm microservice architecture.

Thaum tsim cov qauv tsim, peb tau sib cais cov khoom sib txuas rau txhua lub tshuab sab nraud - 1C, kev tshaj tawm platforms thiab adserving systems - rau hauv cov kev pabcuam cais.
Lub tswv yim tseem ceeb yog tias txhua qhov txuas mus rau qhov chaw muaj tib API thiab yog cov adapters uas coj lub xaib API rau qhov kev sib txuas yooj yim rau peb.

Nyob rau hauv nruab nrab ntawm peb cov khoom yog ib tug web daim ntawv thov, uas yog ib tug monolith uas yog tsim nyob rau hauv xws li ib txoj kev uas nws yuav yooj yim disassembled rau hauv cov kev pab cuam. Daim ntawv thov no yog lub luag haujlwm rau kev ua cov ntaub ntawv rub tawm, sib sau cov txheeb cais los ntawm cov tshuab sib txawv thiab nthuav qhia rau cov neeg siv khoom.

Txhawm rau sib txuas lus ntawm cov khoom sib txuas thiab daim ntawv thov web, peb yuav tsum tsim ib qho kev pabcuam ntxiv, uas peb hu ua Connector Proxy. Nws ua haujlwm ntawm Service Discovery thiab Task Scheduler. Qhov kev pabcuam no khiav haujlwm sau cov ntaub ntawv rau txhua tus txuas txhua hmo. Kev sau cov txheej txheem kev pabcuam tau yooj yim dua li kev sib txuas lus tus broker, thiab rau peb nws yog qhov tseem ceeb kom tau txais cov txiaj ntsig sai li sai tau.

Rau qhov yooj yim thiab ceev ntawm txoj kev loj hlob, peb kuj tau txiav txim siab tias txhua qhov kev pabcuam yuav yog Web APIs. Qhov no ua rau nws tuaj yeem sib sau ua pov thawj ntawm lub tswv yim sai thiab xyuas kom meej tias tag nrho cov qauv tsim ua haujlwm.

Yuav ua li cas peb sau cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm los ntawm cov vev xaib online (txoj kev thorny rau cov khoom lag luam)

Ib qho kev sib cais, kev ua haujlwm nyuaj yog teeb tsa kev nkag mus sau cov ntaub ntawv los ntawm cov nyiaj sib txawv, uas, raws li peb tau txiav txim siab, yuav tsum tau ua los ntawm cov neeg siv los ntawm lub vev xaib interface. Nws muaj ob kauj ruam cais: ua ntej, tus neeg siv ntxiv lub token nkag mus rau hauv tus as khauj ntawm OAuth, thiab tom qab ntawd teeb tsa cov ntaub ntawv sau rau tus neeg siv khoom los ntawm ib tus account tshwj xeeb. Tau txais lub token ntawm OAuth yog qhov tsim nyog vim tias, raws li peb tau sau lawm, nws tsis yog ib txwm muaj peev xwm xa mus rau tus lej xav tau ntawm lub xaib.

Txhawm rau tsim cov txheej txheem thoob ntiaj teb rau kev xaiv tus as-qhauj los ntawm cov chaw, peb yuav tsum tau ntxiv ib txoj hauv kev rau cov khoom sib txuas API uas xa rov qab JSON Schema, uas tau muab tso rau hauv ib daim ntawv uas siv cov JSONEditor hloov kho. Txoj kev no, cov neeg siv tau tuaj yeem xaiv cov nyiaj los ntawm cov ntaub ntawv rub tawm.

Txhawm rau ua raws li qhov kev thov txwv uas muaj nyob rau ntawm qhov chaw, peb muab cov lus thov rau kev teeb tsa hauv ib lub token, tab sis peb tuaj yeem ua cov tokens sib txawv hauv qhov sib npaug.

Peb xaiv MongoDB ua qhov chaw khaws cia rau cov ntaub ntawv thauj khoom rau ob lub vev xaib thov thiab cov khoom sib txuas, uas tso cai rau peb tsis txhob txhawj xeeb ntau dhau ntawm cov qauv ntaub ntawv thaum pib ntawm kev txhim kho, thaum cov khoom qauv ntawm daim ntawv thov hloov pauv txhua hnub.

Tsis ntev peb pom tias tsis yog txhua cov ntaub ntawv haum zoo hauv MongoDB thiab, piv txwv li, nws yooj yim dua los khaws cov txheeb cais txhua hnub hauv cov ntaub ntawv sib raug zoo. Yog li ntawd, rau cov connectors uas cov ntaub ntawv qauv yog tsim nyog rau ib tug relational database, peb pib siv PostgreSQL los yog MS SQL Server li cia.

Cov kev xaiv architecture thiab thev naus laus zis tau tso cai rau peb tsim thiab tso tawm D1.Digital cov khoom lag luam sai. Tshaj li ob xyoos ntawm kev tsim cov khoom lag luam, peb tau tsim 23 qhov sib txuas rau qhov chaw, tau txais txiaj ntsig zoo ntawm kev ua haujlwm nrog APIs thib peb, kawm kom tsis txhob muaj kev cuam tshuam ntawm cov chaw sib txawv, uas txhua tus muaj lawv tus kheej, pab txhawb rau kev txhim kho API ntawm tsawg kawg 3. cov chaw, cia li rub tawm cov ntaub ntawv ntawm yuav luag 15 qhov kev sib tw thiab ntau dua 000 qhov chaw, tau sau ntau cov lus tawm tswv yim los ntawm cov neeg siv khoom ntawm cov khoom lag luam thiab tswj kom hloov cov txheej txheem tseem ceeb ntawm cov khoom ob peb zaug, raws li cov lus qhia no.

Kev daws teeb meem architecture 2.0

Ob xyoos dhau los txij thaum pib ntawm txoj kev loj hlob D1.Digital. Qhov tsis tu ncua ntawm kev thauj khoom ntawm qhov system thiab qhov tshwm sim ntawm ntau thiab ntau cov ntaub ntawv tshiab tau maj mam nthuav tawm cov teeb meem hauv cov kev daws teeb meem uas twb muaj lawm.

Thawj qhov teeb meem yog hais txog tus nqi ntawm cov ntaub ntawv rub tawm los ntawm cov chaw. Peb tau ntsib nrog qhov tseeb tias kev sau thiab hloov kho tag nrho cov ntaub ntawv tsim nyog los ntawm cov chaw loj tshaj plaws pib siv sijhawm ntau dhau. Piv txwv li, sau cov ntaub ntawv los ntawm AdRiver adserving system, uas peb taug qab cov txheeb cais rau feem ntau qhov chaw, yuav siv sijhawm li 12 teev.

Txhawm rau daws qhov teeb meem no, peb tau pib siv txhua yam kev tshaj tawm los rub tawm cov ntaub ntawv los ntawm cov chaw, peb tab tom sim tsim lawv API ua ke nrog cov chaw kom ceev nws txoj haujlwm ua tau raws li peb cov kev xav tau, thiab sib piv cov ntaub ntawv rub tawm kom ntau li ntau tau.

Lwm qhov teeb meem cuam tshuam txog kev ua cov ntaub ntawv rub tawm. Tam sim no, thaum cov ntawv txheeb cais tshiab tuaj txog, ntau theem txheej txheem ntawm kev ntsuas cov ntsuas rov qab tau pib, uas suav nrog kev thauj cov ntaub ntawv nyoos, suav cov metrics sib sau rau txhua qhov chaw, sib piv cov ntaub ntawv los ntawm ntau qhov chaw sib txawv, thiab suav cov ntsiab lus ntsuas rau kev sib tw. Qhov no ua rau muaj kev thauj khoom ntau ntawm daim ntawv thov web uas ua txhua qhov kev suav. Ob peb zaug, thaum lub sijhawm rov suav cov txheej txheem, daim ntawv thov siv tag nrho cov cim xeeb ntawm tus neeg rau zaub mov, txog 10-15 GB, uas muaj qhov cuam tshuam loj tshaj plaws rau cov neeg siv ua haujlwm nrog lub kaw lus.

Cov teeb meem tau txheeb xyuas thiab cov phiaj xwm xav tau rau kev txhim kho ntxiv ntawm cov khoom coj peb mus rau qhov yuav tsum tau rov xav txog cov ntawv thov architecture.

Peb pib nrog connectors.
Peb pom tias txhua qhov txuas txuas ua haujlwm raws li tus qauv qub, yog li peb tau tsim cov txheej txheem kav dej uas tsim kom muaj qhov sib txuas koj tsuas yog yuav tsum tau ua qhov kev xav ntawm cov kauj ruam, tus so yog universal. Yog tias qee qhov kev sib txuas yuav tsum tau txhim kho, ces peb tam sim ntawd hloov nws mus rau lub moj khaum tshiab nyob rau tib lub sijhawm thaum lub connector tau txhim kho.

Tib lub sijhawm, peb pib xa cov khoom sib txuas rau Docker thiab Kubernetes.
Peb npaj txav mus rau Kubernetes ntev heev, sim nrog CI / CD teeb tsa, tab sis pib txav tsuas yog thaum ib qho txuas, vim muaj qhov yuam kev, pib noj ntau dua 20 GB ntawm lub cim xeeb ntawm lub server, xyaum tua lwm cov txheej txheem. . Thaum lub sij hawm kev tshawb nrhiav, tus connector tau tsiv mus rau Kubernetes pawg, qhov twg thaum kawg nws tseem nyob, txawm tias tom qab qhov yuam kev raug kho.

Heev sai heev peb pom tau hais tias Kubernetes yooj yim, thiab nyob rau hauv rau lub hlis peb pauv 7 connectors thiab Connectors Proxy, uas siv cov khoom siv ntau tshaj, mus rau pawg ntau lawm.

Ua raws li cov connectors, peb txiav txim siab los hloov cov architecture ntawm tus so ntawm daim ntawv thov.
Qhov teeb meem tseem ceeb yog cov ntaub ntawv los ntawm cov khoom sib txuas rau cov neeg sawv cev hauv cov khoom loj, thiab tom qab ntawd ntaus DANBoID thiab raug xa mus rau lub vev xaib hauv nruab nrab rau kev ua haujlwm. Vim muaj coob tus metrics recalculations, muaj ib tug loj load ntawm daim ntawv thov.

Nws kuj tau ua pov thawj nyuaj heev los saib xyuas cov xwm txheej ntawm tus kheej cov ntaub ntawv sau cov haujlwm thiab tshaj tawm cov teeb meem tshwm sim hauv cov txuas mus rau lub vev xaib hauv nruab nrab kom cov neeg siv tuaj yeem pom tias muaj dab tsi tshwm sim thiab vim li cas cov ntaub ntawv tsis raug sau.

Txhawm rau daws cov teeb meem no, peb tsim architecture 2.0.

Qhov sib txawv tseem ceeb ntawm cov qauv tshiab ntawm architecture yog tias tsis yog Web API, peb siv RabbitMQ thiab MassTransit lub tsev qiv ntawv los pauv cov lus ntawm cov kev pabcuam. Ua li no, peb yuav tsum yuav luag tag rov sau Connectors Proxy, ua nws Connectors Hub. Lub npe tau hloov pauv vim lub luag haujlwm tseem ceeb ntawm cov kev pabcuam tsis yog nyob rau hauv kev thov xa mus rau cov khoom sib txuas thiab rov qab, tab sis hauv kev tswj hwm kev sau cov metrics los ntawm cov khoom sib txuas.

Los ntawm lub hauv paus web daim ntawv thov, peb cais cov ntaub ntawv hais txog qhov chaw thiab kev txheeb cais los ntawm cov chaw mus rau hauv cov kev pabcuam cais, uas ua rau nws muaj peev xwm tshem tawm cov kev suav rov qab uas tsis tsim nyog thiab khaws cia tsuas yog suav thiab suav sau cov txheeb cais ntawm qib kev tso kawm. Peb kuj rov sau dua thiab ua kom zoo dua cov logic rau kev suav cov txheeb cais raws li cov ntaub ntawv nyoos.

Nyob rau tib lub sijhawm, peb tab tom tsiv txhua qhov kev pabcuam thiab cov ntawv thov mus rau Docker thiab Kubernetes kom cov kev daws teeb meem yooj yim dua thiab yooj yim dua los tswj.

Yuav ua li cas peb sau cov ntaub ntawv ntawm kev tshaj tawm kev tshaj tawm los ntawm cov vev xaib online (txoj kev thorny rau cov khoom lag luam)

Tam sim no peb nyob qhov twg

Cov ntaub ntawv pov thawj-ntawm- tswvyim architecture 2.0 khoom D1.Digital npaj thiab ua hauj lwm nyob rau hauv ib qho kev xeem ib puag ncig nrog ib tug txwv set ntawm connectors. Txhua yam uas tau ua yog rov sau dua lwm 20 txuas rau lub platform tshiab, sim tias cov ntaub ntawv raug thauj khoom kom raug thiab tag nrho cov kev ntsuas raug suav raug raug, thiab yob tawm tag nrho cov qauv tsim tawm.

Qhov tseeb, cov txheej txheem no yuav tshwm sim maj mam thiab peb yuav tsum tawm rov qab sib raug zoo nrog APIs qub kom txhua yam ua haujlwm.

Peb cov phiaj xwm tam sim no suav nrog kev txhim kho cov khoom sib txuas tshiab, kev koom ua ke nrog cov tshuab tshiab thiab ntxiv cov kev ntsuas ntxiv rau cov txheej txheem ntawm cov ntaub ntawv rub tawm los ntawm cov chaw sib txuas thiab cov khoom siv txhawb nqa.

Peb kuj npaj yuav hloov txhua daim ntawv thov, suav nrog lub vev xaib hauv nruab nrab, mus rau Docker thiab Kubernetes. Ua ke nrog cov txheej txheem tshiab, qhov no yuav ua kom yooj yim rau kev xa tawm, saib xyuas thiab tswj cov khoom siv siv.

Lwm lub tswv yim yog sim nrog kev xaiv ntawm cov ntaub ntawv khaws cia cov txheeb cais, uas tam sim no khaws cia hauv MongoDB. Peb twb tau xa ob peb qhov txuas tshiab rau SQL databases, tab sis qhov sib txawv yog yuav luag tsis pom, thiab rau cov txheeb cais los ntawm hnub, uas tuaj yeem thov rau lub sijhawm tsis txaus ntseeg, qhov nce tuaj yeem loj heev.

Feem ntau, cov phiaj xwm yog grandiose, cia peb mus rau :)

Cov neeg sau ntawv ntawm tsab xov xwm R & D Dentsu Aegis Network Russia: Georgy Ostapenko (shmigaa ua), Mikhail Kotsik (hitexx ua)

Tau qhov twg los: www.hab.com

Ntxiv ib saib