Kupanga malo osungira ndi ntchito yayitali komanso yayikulu.
Zambiri m'moyo wa polojekiti zimatengera momwe chitsanzo cha chinthu ndi maziko amaganiziridwa poyambira.
Njira yovomerezeka yodziwika bwino yakhala ndipo imakhalabe mitundu yosiyanasiyana yophatikizira nyenyezi ndi mawonekedwe achitatu. Monga lamulo, malinga ndi mfundo: deta yoyamba - 3NF, mawonetsero - nyenyezi. Njirayi, yoyesedwa nthawi komanso yothandizidwa ndi kafukufuku wambiri, ndiyo yoyamba (ndipo nthawi zina yokhayo) yomwe imabwera m'maganizo mwa katswiri wodziwa za DWH pamene akuganiza za momwe malo owerengera ayenera kuwoneka.
Kumbali ina, bizinesi mwazonse komanso zofunikira zamakasitomala zimasintha mwachangu, ndipo deta imakonda kukula "mozama" komanso "m'lifupi". Ndipo apa ndipamene choyipa chachikulu cha nyenyezi chikuwonekera - chochepa kusinthasintha.
Ndipo ngati m'moyo wanu wabata komanso wosangalatsa ngati wopanga DWH mwadzidzidzi:
- ntchitoyo idawuka "kuchita china chake mwachangu, ndiyeno tiwona";
- pulojekiti yomwe ikukula mofulumira idawonekera, ndi kugwirizana kwa magwero atsopano ndi kukonzanso chitsanzo cha bizinesi kamodzi pa sabata;
- kasitomala wawonekera yemwe sadziwa momwe dongosololi liyenera kukhalira komanso momwe liyenera kugwirira ntchito, koma ali wokonzeka kuyesa ndikusintha mosalekeza zotsatira zomwe akufuna pomwe akuyandikira nthawi zonse;
- Woyangβanira ntchitoyo anakamba nkhani yabwino yakuti: βTsopano tili ndi changu!β
Kapena ngati mukungofuna kudziwa momwe mungamangire malo osungiramo - kulandiridwa ku odulidwa!
Kodi "kusinthasintha" kumatanthauza chiyani?
Choyamba, tiyeni tifotokoze zomwe dongosolo liyenera kukhala nalo kuti lizitchedwa "flexible".
Payokha, ndikofunikira kutchula kuti zomwe zafotokozedwazo ziyenera kugwirizana kwambiri ndi dongosolo, si ku ndondomeko chitukuko chake. Chifukwa chake, ngati mukufuna kuwerenga za Agile ngati njira yachitukuko, ndibwino kuti muwerenge zolemba zina. Mwachitsanzo, komweko, pa HabrΓ©, pali zinthu zambiri zosangalatsa (monga ΠΈ , ndi ).
Izi sizikutanthauza kuti ndondomeko yachitukuko ndi dongosolo la malo osungiramo deta ndizosagwirizana. Ponseponse, ziyenera kukhala zophweka kwambiri kupanga chosungira cha Agile cha zomangamanga zakale. Komabe, m'kuchita, nthawi zambiri pamakhala zosankha ndi chitukuko cha Agile cha DWH yachikale molingana ndi Kimbal ndi DataVault - malinga ndi Waterfall, kusiyana ndi zochitika zosangalatsa za kusinthasintha kwa mitundu iwiri ya polojekiti imodzi.
Ndiye, ndi kuthekera kotani komwe kuyenera kukhala kosungirako kosinthika? Pali mfundo zitatu apa:
- Kutumiza koyambirira komanso kutembenuka mwachangu - izi zikutanthauza kuti zotsatira za bizinesi yoyamba (mwachitsanzo, malipoti oyambirira) ziyenera kupezedwa mwamsanga, ndiko kuti, ngakhale dongosolo lonse lisanapangidwe ndi kukhazikitsidwa. Komanso, kukonzanso kulikonse kotsatira kuyeneranso kutenga nthawi yochepa momwe kungathekere.
- Kubwerezabwereza - izi zikutanthauza kuti kusintha kulikonse kotsatira sikuyenera kukhudza magwiridwe antchito omwe akugwira kale ntchito. Ndi nthawi iyi yomwe nthawi zambiri imakhala yowopsa kwambiri pama projekiti akuluakulu - posachedwa, zinthu zapayekha zimayamba kupeza maulumikizidwe ambiri kotero kuti zimakhala zosavuta kubwereza mfundozo mukope pafupi kuposa kuwonjezera gawo patebulo lomwe lilipo. Ndipo ngati mungadabwe kuti kusanthula momwe zinthu zikuyendera pazida zomwe zilipo zitha kutenga nthawi yochulukirapo kuposa zomwe zasintha, mwina simunagwirepo ntchito ndi malo osungiramo zinthu zazikulu zamabanki kapena matelefoni.
- Kusinthasintha nthawi zonse ndikusintha zofunikira zamabizinesi - Mapangidwe a chinthu chonsecho ayenera kupangidwa osati kungoganizira za kukula komwe kungatheke, koma ndikuyembekeza kuti njira yomwe ikukulirakulirako sikungayerekeze ngakhale pakupanga.
Ndipo inde, kukwaniritsa zofunikira zonsezi mu dongosolo limodzi ndizotheka (zowona, nthawi zina komanso kusungitsa kwina).
Pansipa ndiwona njira ziwiri zodziwika bwino zamapangidwe osungira ma data - Nangula chitsanzo ΠΈ Data Vault. Zotsalira m'mabokosi ndi njira zabwino kwambiri monga, mwachitsanzo, EAV, 6NF (mu mawonekedwe ake enieni) ndi chirichonse chokhudzana ndi mayankho a NoSQL - osati chifukwa chakuti iwo ali oipitsitsa, ndipo ngakhale chifukwa nkhaniyi ingawopsyeze kupeza. voliyumu ya wamba wamba. Kungoti zonsezi zikugwirizana ndi mayankho a kalasi yosiyana pang'ono - mwina njira zomwe mungagwiritse ntchito pazinthu zinazake, mosasamala kanthu za kamangidwe ka polojekiti yanu (monga EAV), kapena ma paradigms ena osungira zidziwitso padziko lonse lapansi (monga ma graph database). ndi zosankha zina NoSQL).
Mavuto a njira ya "classical" ndi mayankho awo munjira zosinthika
Pogwiritsa ntchito njira ya "classic" ndikutanthauza nyenyezi yabwino yakale (mosasamala kanthu za kukhazikitsidwa kwapadera kwa zigawo zapansi, mulole otsatira Kimball, Inmon ndi CDM andikhululukire).
1. Kukhazikika kwamphamvu kwa kulumikizana
Chitsanzochi chimachokera pa kugawanitsa bwino kwa deta Dimension ΠΈ mfundo. Ndipo izi, mwatsoka, ndizomveka - pambuyo pake, kusanthula deta muzochitika zambiri kumatsikira pakuwunika zizindikiro zina (zowona) m'magawo ena (miyeso).
Pankhaniyi, kugwirizana pakati pa zinthu kumakhazikitsidwa mwa mawonekedwe a maubwenzi pakati pa matebulo pogwiritsa ntchito kiyi yachilendo. Izi zikuwoneka mwachilengedwe, koma nthawi yomweyo zimabweretsa kuchepa koyamba kwa kusinthasintha - tanthauzo okhwima la cardinality kugwirizana.
Izi zikutanthauza kuti pagawo la mapangidwe a tebulo, muyenera kudziwa molondola pagulu lililonse lazinthu zofananira ngati zingagwirizane ndi zambiri, kapena 1 mpaka zambiri, ndi "njira iti". Izi zimatsimikizira mwachindunji kuti ndi tebulo liti lomwe lidzakhala ndi kiyi yoyamba ndi yomwe idzakhale ndi kiyi yakunja. Kusintha kaganizidwe kameneka pamene zofunikira zatsopano zilandiridwa kungapangitse kukonzanso maziko.
Mwachitsanzo, popanga chinthu cha "chiphaso cha ndalama", inu, kudalira malumbiro a dipatimenti yogulitsa malonda, munaika mwayi wochitapo kanthu. kukwezedwa kumodzi pamacheke angapo (koma osati mosemphanitsa):
Ndipo patapita nthawi, ogwira nawo ntchito adayambitsa njira yatsopano yotsatsira yomwe angachitepo chimodzimodzi zokwezedwa zingapo nthawi imodzi. Ndipo tsopano muyenera kusintha matebulo polekanitsa ubale kukhala chinthu chosiyana.
(Zinthu zonse zotengedwa momwe cheke chokwezera chikuphatikizidwa tsopano ziyenera kukonzedwanso).
Maubwenzi mu Data Vault ndi Anchor Model
Kupewa izi kudakhala kophweka: simuyenera kudalira dipatimenti yogulitsa kuti muchite izi. kugwirizana onse poyamba kusungidwa mu matebulo osiyana ndikuchikonza ngati zambiri mpaka zambiri.
Njira iyi idaperekedwa Dan Linstedt monga gawo la paradigm Data Vault ndi kuthandizidwa kwathunthu Lars RΓΆnnbΓ€ck Π² Anchor Model.
Zotsatira zake, timapeza gawo loyamba lapadera la njira zosinthika:
Maubwenzi apakati pa zinthu sasungidwa m'mabungwe a makolo, koma ndi mtundu wosiyana wa chinthu.
Π Data Vault Matebulo olumikizira otere amatchedwa Lumikizanindi Anchor Model - chimango. Poyang'ana koyamba, iwo ali ofanana kwambiri, ngakhale kuti kusiyana kwawo sikutha ndi dzina (lomwe lidzakambidwa pansipa). Muzomangamanga zonse ziwiri, matebulo olumikizira amatha kulumikizana chiwerengero chilichonse cha mabungwe (osati kwenikweni 2).
Kubwerezabwereza uku, poyang'ana koyamba, kumapereka kusinthasintha kwakukulu pakusintha. Mapangidwe oterowo amakhala ololera osati kusintha kokha kwa kardinali wa maulalo omwe alipo, komanso kuwonjezera zatsopano - ngati tsopano cheke chili ndi ulalo kwa wosunga ndalama yemwe adadutsamo, mawonekedwe a ulalo woterowo adzangowonjezera. kukhala chowonjezera pa matebulo omwe alipo popanda kukhudza zinthu ndi njira zomwe zilipo.
2. Kubwereza deta
Vuto lachiwiri lomwe lathetsedwa ndi zomangamanga zosinthika silikuwonekeratu ndipo ndi lobadwa poyamba. Miyezo yamtundu wa SCD2 (pang'onopang'ono kusintha miyeso ya mtundu wachiwiri), ngakhale osati iwo okha.
M'nyumba yosungiramo zinthu zakale, kukula kwake kumakhala ndi tebulo lomwe limakhala ndi kiyi yolowera (monga PK) ndi makiyi abizinesi ndi mawonekedwe osiyanasiyana.
Ngati mulingo umathandizira kumasulira, malire ovomerezeka amawonjezedwa kugawo lokhazikika, ndipo mitundu ingapo imawonekera m'nkhokwe pamzere umodzi wa gwero (imodzi pakusintha kulikonse kwa mawonekedwe).
Ngati mulingo uli ndi gawo limodzi losinthidwa pafupipafupi, kuchuluka kwa mitundu yotere kumakhala kochititsa chidwi (ngakhale zotsalazo sizinasinthidwe kapena sizisintha), ndipo ngati pali zambiri, kuchuluka kwamitundu kumatha kukula mokulirapo kuchokera ku chiwerengero chawo. Kukula kumeneku kumatha kutenga malo ambiri a disk, ngakhale zambiri zomwe zimasunga zimangokhala zobwerezabwereza za mizere yosasinthika kuchokera pamizere ina.
Nthawi yomweyo, imagwiritsidwanso ntchito nthawi zambiri denormalizing - zina zimasungidwa mwadala ngati mtengo, osati ngati ulalo wa bukhu lofotokozera kapena gawo lina. Njirayi imafulumizitsa kupeza deta, kuchepetsa chiwerengero cha majowina pamene mukupeza gawo.
Kawirikawiri izi zimabweretsa zomwezo zimasungidwa nthawi imodzi m'malo angapo. Mwachitsanzo, zambiri za dera lomwe mukukhala ndi gulu la kasitomala zitha kusungidwa nthawi imodzi mumiyeso ya "Client" ndi "Purchase", "Delivery" ndi "Call Center Calls", komanso mu "Client - Client Manager". β link table.
Nthawi zambiri, zomwe tafotokozazi zimagwira ntchito pamiyeso yokhazikika (yosasinthidwa), koma m'matembenuzidwe amatha kukhala ndi sikelo yosiyana: mawonekedwe a chinthu chatsopano (makamaka m'mbuyo) amangotsogolera osati kungosintha kwazinthu zonse zogwirizana. matebulo, koma kukuwonekera kwazinthu zatsopano zofananira - pamene Table 1 imagwiritsidwa ntchito pomanga Table 2, ndipo Table 2 imagwiritsidwa ntchito pomanga Table 3, etc. Ngakhale ngati palibe lingaliro limodzi la Table 1 lomwe likukhudzidwa pakumanga Table 3 (ndi zina za Table 2 zopezedwa kuchokera kuzinthu zina zikukhudzidwa), kumasulira kumeneku kudzatsogolera kumutu wowonjezera, komanso pamlingo wokulirapo mpaka wowonjezera. zomasulira mu Table 3. zomwe ziribe kanthu kochita nazo konse, ndi kupitirira pansi pa unyolo.
3. Kuvuta kopanda mzere wa rework
Panthawi imodzimodziyo, sitolo iliyonse yatsopano yomangidwa pamaziko a ina imawonjezera chiwerengero cha malo omwe deta "ikhoza "kusiyana" pamene kusintha kwa ETL. Izi, zimabweretsa kuwonjezeka kwa zovuta (ndi nthawi) ya kukonzanso kotsatira.
Ngati zomwe zili pamwambazi zikufotokozera machitidwe omwe ali ndi njira zosinthidwa za ETL, mutha kukhala paradigm yotere - muyenera kuwonetsetsa kuti zosintha zatsopano zapangidwa molondola pazinthu zonse zogwirizana. Ngati kukonzanso kumachitika pafupipafupi, mwayi "wosowa" maulumikizidwe angapo mwangozi umawonjezeka kwambiri.
Ngati, kuwonjezera, tiganizira kuti ETL "yosinthidwa" ndiyovuta kwambiri kuposa "yosasinthidwa", zimakhala zovuta kupewa zolakwika mukamakonzanso malo onsewa.
Kusunga zinthu ndi mawonekedwe mu Data Vault ndi Anchor Model
Njira yomwe alemba olemba ma flexible architecture atha kupangidwa motere:
Ndikofunikira kulekanitsa zomwe zikusintha kuchokera ku zomwe zimakhalabe zomwezo. Ndiko kuti, sungani makiyi mosiyana ndi mawonekedwe.
Komabe, munthu sayenera kusokoneza osasinthidwa chikhalidwe ndi zosasinthika: choyamba sichisunga mbiri ya kusintha kwake, koma ikhoza kusintha (mwachitsanzo, pokonza zolakwika zolowetsa kapena kulandira deta yatsopano); yachiwiri sichimasintha.
Mawonedwe amasiyana pa zomwe kwenikweni zitha kuonedwa ngati zosasinthika mu Data Vault ndi Anchor Model.
Kuchokera pamalingaliro omanga Data Vault, akhoza kuonedwa ngati wosasintha makiyi onse - zachilengedwe (TIN ya bungwe, kachidindo kazinthu mumayendedwe oyambira, ndi zina) ndi surrogate. Pankhaniyi, makhalidwe otsala akhoza kugawidwa m'magulu malinga ndi gwero ndi / kapena pafupipafupi kusintha ndi Sungani tebulo lapadera la gulu lirilonse ndi mitundu yodziyimira payokha.
Mu paradigm Anchor Model zimaganiziridwa zosasinthika chinsinsi chokhachokha zenizeni. Zina zonse (kuphatikiza makiyi achilengedwe) ndi nkhani yapadera chabe yazikhalidwe zake. Kumeneko zikhumbo zonse ndizodziyimira pawokha mwa kusakhazikika, kotero pa chikhalidwe chilichonse a osiyana tebulo.
Π Data Vault matebulo omwe ali ndi makiyi azinthu amatchedwa Hubami. Ma Hubs nthawi zonse amakhala ndi magawo okhazikika:
- Natural Entity Keys
- surrogate key
- Lumikizani ku gwero
- Lembani nthawi yowonjezera
Zolemba mu Hubs osasintha ndipo alibe zomasulira. Kunja, ma hubs ndi ofanana kwambiri ndi matebulo amtundu wa ID-mapu omwe amagwiritsidwa ntchito m'makina ena kuti apange olowa, komabe, tikulimbikitsidwa kugwiritsa ntchito hashi kuchokera pagulu la makiyi abizinesi ngati surrogates mu Data Vault. Njirayi imathandizira kutsitsa maubwenzi ndi zikhalidwe kuchokera ku magwero (palibe chifukwa cholowa m'malo kuti mutenge wina, ingowerengerani hashi ya kiyi yachilengedwe), koma imatha kuyambitsa zovuta zina (zokhudzana, mwachitsanzo, kugundana, milandu komanso kusasindikiza. zilembo zamakiyi a zingwe, ndi zina .p.), chifukwa chake sichivomerezedwa.
Makhalidwe ena onse amasungidwa mu matebulo apadera otchedwa Masatilaiti. Malo amodzi amatha kukhala ndi ma satellite angapo omwe amasunga mawonekedwe osiyanasiyana.
Kugawidwa kwa makhalidwe pakati pa ma satellites kumachitika molingana ndi mfundo kusintha kwa mgwirizano - mu satellite imodzi zomwe sizinasinthidwe zimatha kusungidwa (mwachitsanzo, tsiku lobadwa ndi SNILS kwa munthu), kwina - zomwe sizisintha kawirikawiri (mwachitsanzo, dzina lomaliza ndi nambala ya pasipoti), lachitatu - zosintha pafupipafupi. (mwachitsanzo, adilesi yotumizira, gulu, tsiku lomaliza, ndi zina). Pankhaniyi, kumasulira kumachitika pamlingo wa ma satelayiti, osati gulu lonse, chifukwa chake ndikofunikira kugawa mawonekedwe kuti mphambano ya matembenuzidwe mkati mwa satellite imodzi ikhale yochepa (yomwe imachepetsa kuchuluka kwa matembenuzidwe osungidwa. ).
Komanso, kukhathamiritsa njira yotsitsa deta, zopezeka kuchokera kuzinthu zosiyanasiyana nthawi zambiri zimaphatikizidwa mu satellite.
Ma satellite amalumikizana ndi Hub kudzera kiyi yakunja (zomwe zimagwirizana ndi 1-to-ambiri cardinality). Izi zikutanthauza kuti mikhalidwe ingapo (mwachitsanzo, manambala amafoni angapo a kasitomala m'modzi) amathandizidwa ndi zomangamanga "zosasintha".
Π Anchor Model matebulo amene amasunga makiyi amatchedwa Nangula. Ndipo amasunga:
- Makiyi olowera okha
- Lumikizani ku gwero
- Lembani nthawi yowonjezera
Makiyi achilengedwe kuchokera pakuwona kwa Model Anchor amaganiziridwa wamba makhalidwe. Njira imeneyi ingaoneke ngati yovuta kumvetsa, koma imapereka mwayi wodziwa chinthucho.
Mwachitsanzo, ngati deta yokhudzana ndi bungwe lomwelo ingabwere kuchokera ku machitidwe osiyanasiyana, omwe amagwiritsa ntchito kiyi yakeyake. Mu Data Vault, izi zitha kupangitsa kuti pakhale zovuta zamitundu ingapo (imodzi pa gwero + mtundu wolumikizana), pomwe mumtundu wa Anchor, kiyi yachilengedwe ya gwero lililonse imagwera mumtundu wake ndipo imatha kugwiritsidwa ntchito potsitsa mosadalira. ena onse.
Koma palinso mfundo imodzi yobisika apa: ngati mawonekedwe a machitidwe osiyanasiyana aphatikizidwa m'gulu limodzi, mwina pali zina. malamulo a "gluing", zomwe dongosololi liyenera kumvetsetsa kuti zolembedwa zochokera kuzinthu zosiyanasiyana zimagwirizana ndi chochitika chimodzi cha bungwe.
Π Data Vault malamulo awa mosakayikira adzatsimikizira mapangidwe "Surrogate hub" ya master entity ndipo osati mwanjira iliyonse kukhudza Ma Hub omwe amasunga makiyi achilengedwe ndi mawonekedwe awo oyamba. Ngati nthawi ina malamulo ophatikizana asintha (kapena mawonekedwe omwe amachitidwawo asinthidwa), zidzakhala zokwanira kukonzanso malo olowera.
Π Nangula chitsanzo chinthu choterocho chikhoza kusungidwamo nangula yekhayo. Izi zikutanthauza kuti zikhumbo zonse, mosasamala kanthu kuti zimachokera kuti, zidzamangidwa kwa wotsatira yemweyo. Kulekanitsa zolemba zophatikizidwa molakwika ndipo, kawirikawiri, kuyang'anira kufunika kophatikizana mu dongosolo loterolo kungakhale kovuta kwambiri, makamaka ngati malamulowo ndi ovuta kwambiri ndipo amasintha kawirikawiri, ndipo khalidwe lomwelo lingapezeke kuchokera kuzinthu zosiyanasiyana (ngakhale kuti ndizovuta kwambiri. zotheka, popeza mtundu uliwonse wamakhalidwe umasunga ulalo kugwero lake).
Mulimonsemo, ngati dongosolo lanu likuyenera kugwiritsa ntchito ntchitoyi kuchotsera, kuphatikiza zolemba ndi zinthu zina za MDM, m'pofunika kulabadira kwambiri mbali za kusunga makiyi achilengedwe mu njira agile. Ndizotheka kuti mapangidwe a bulkier Data Vault adzakhala otetezeka mwadzidzidzi pakuphatikiza zolakwika.
Anchor model imaperekanso mtundu wina wa chinthu wotchedwa mfundo ndizopadera mtundu wowonongeka wa nangula, yomwe ingakhale ndi khalidwe limodzi lokha. Ma nodewa akuyenera kugwiritsidwa ntchito kusunga akalozera osabisala (mwachitsanzo, jenda, ukwati, gulu la makasitomala, ndi zina zotero). Mosiyana ndi Nangula, mfundo alibe ma tebulo ogwirizana nawo, ndipo mawonekedwe ake okha (dzina) amasungidwa patebulo limodzi ndi kiyi. Ma Node amalumikizidwa ku Anchors ndi matebulo omangirira (Tie) momwemonso Anchors amalumikizidwa wina ndi mnzake.
Palibe malingaliro omveka bwino okhudza kugwiritsa ntchito Node. Mwachitsanzo, , amene amalimbikitsa kugwiritsa ntchito Anchor Model ku Russia, amakhulupirira (osati mopanda nzeru) kuti palibe buku limodzi lofotokozera lomwe linganene motsimikiza kuti nthawi zonse adzakhala static ndi single-level, choncho ndi bwino kugwiritsa ntchito nthawi yomweyo Anchor zonse.
Kusiyana kwina kofunikira pakati pa Data Vault ndi mtundu wa Anchor ndiko kupezeka zizindikiro za mgwirizano:
Π Data Vault Maulalo ndi zinthu zofanana ndi ma Hubs, ndipo amatha kukhala nawo makhalidwe ake. The Nangula chitsanzo Maulalo amagwiritsidwa ntchito kokha kulumikiza Nangula ndi sangakhale ndi makhalidwe awoawo. Kusiyanaku kumabweretsa njira zosiyanasiyana zowonetsera mfundo, zomwe zidzakambidwenso.
Zosungirako zenizeni
Izi zisanachitike, tinkakambirana makamaka za kuyeza zitsanzo. Zoona zake sizikumveka bwino.
Π Data Vault chinthu wamba kusunga mfundo ndi Lumikizani, m'ma satelayiti ake zizindikiro zenizeni zimawonjezedwa.
Njirayi ikuwoneka yodabwitsa. Zimapereka mwayi wosavuta kuzizindikiro zomwe zawunikidwa ndipo nthawi zambiri zimakhala zofanana ndi tebulo lodziwika bwino (zizindikiro zokha zomwe zimasungidwa osati patebulo lokha, koma mu "oyandikana nawo"). Koma palinso misampha: chimodzi mwazosintha zamtunduwu - kukulitsa chinsinsi - kumafunikira. kuwonjezera kiyi yatsopano yakunja ku Link. Ndipo izi, "zimaswa" modularity ndikupangitsa kufunika kosintha zinthu zina.
Π Nangula chitsanzo Kulumikizana sikungakhale ndi zikhumbo zake, kotero njira iyi siigwira ntchito - zikhumbo zonse ndi zizindikiro ziyenera kugwirizana ndi nangula wina. Mapeto ake ndi osavuta - Mfundo iliyonse imafunikiranso nangula wake. Kwa zina zomwe tazolowera kuziwona ngati zowona, izi zitha kuwoneka mwachilengedwe - mwachitsanzo, kugula kumatha kuchepetsedwa kukhala chinthu "kuyitanitsa" kapena "chiphaso", kuyendera tsamba ku gawo, ndi zina zambiri. Koma palinso mfundo zomwe sizili zophweka kupeza "chinthu chonyamulira" chachilengedwe - mwachitsanzo, zotsalira za katundu m'nyumba zosungiramo katundu kumayambiriro kwa tsiku lililonse.
Chifukwa chake, zovuta zokhala ndi ma modularity pakukulitsa kiyi mu mtundu wa Anchor sizimatuluka (ndikokwanira kungowonjezera Ubale Watsopano ku Nangula wofananira), koma kupanga chitsanzo kuti muwonetse zowona sikumveka bwino; Nangula "zopanga" zitha kuwoneka. zomwe zikuwonetsa mtundu wabizinesi m'njira yosadziwika bwino.
Momwe kusinthasintha kumatheka
Chotsatira chomangidwa muzochitika zonsezi chili ndi kwambiri matebulokuposa muyeso wachikhalidwe. Koma zikhoza kutenga malo ochepa kwambiri a disk ndi seti yofanana ya zosinthidwa monga momwe zimakhalira kale. Mwachilengedwe, palibe zamatsenga pano - zonse ndi za normalization. Pogawira zikhalidwe pa Satellite (mu Data Vault) kapena matebulo paokha (Anchor Model), timachepetsa (kapena kuchotseratu) kubwereza kwa zikhalidwe zina posintha zina.
chifukwa Data Vault zopindula zidzadalira kugawidwa kwa makhalidwe pakati pa Satellite, ndi kwa Nangula chitsanzo - pafupifupi molingana mwachindunji ndi kuchuluka kwa mitundu pa chinthu chilichonse choyezera.
Komabe, kupulumutsa malo ndikofunikira, koma osati chachikulu, mwayi wosungirako padera. Pamodzi ndi kusungirako kosiyana kwa maubwenzi, njira iyi imapanga sitolo kapangidwe ka modular. Izi zikutanthauza kuti kuwonjezera zomwe aliyense payekha komanso magawo atsopano amtundu wotere amawonekera superstructure pa gulu la zinthu zomwe zilipo popanda kuzisintha. Ndipo izi ndizomwe zimapangitsa kuti njira zomwe zafotokozedwazo zikhale zosinthika.
Izi zikufanananso ndi kusintha kuchokera ku kupanga zidutswa kupita ku kupanga zochuluka - ngati mwachikhalidwe tebulo lililonse lachitsanzo ndi lapadera ndipo limafunikira chidwi chapadera, ndiye kuti munjira zosinthika ndi kale "gawo" lokhazikika. Kumbali imodzi, pali matebulo ochulukirapo, ndipo njira zotsitsa ndi kubweza deta ziyenera kuwoneka zovuta kwambiri. Kumbali ina, iwo amakhala wamba. Zomwe zikutanthauza kuti pakhoza kukhala makina opangidwa ndi metadata. Funso lakuti "tidzayiyika bwanji?", Yankho lomwe lingathe kutenga gawo lalikulu la ntchito yokonza zokonza, tsopano silili lofunika (komanso funso lokhudza kusintha kwachitsanzo pazochitika zogwirira ntchito. ).
Izi sizikutanthauza kuti openda sakufunika m'dongosolo loterolo - wina akufunikabe kuti agwiritse ntchito zinthu zomwe zili ndi zikhumbo ndikudziwa komwe anganyamulire zonse. Koma kuchuluka kwa ntchito, komanso mwayi ndi mtengo wa zolakwika, zimachepetsedwa kwambiri. Ponseponse pakuwunika komanso pakupanga ETL, yomwe gawo lalikulu limatha kuchepetsedwa kukhala metadata yosintha.
Mbali yakuda
Zonse zomwe zili pamwambazi zimapangitsa njira zonse ziwiri kukhala zosinthika, zamakono komanso zoyenera kukonzanso kambirimbiri. Zoonadi, palinso "mbiya mu mafuta", zomwe ndikuganiza kuti mukhoza kuziganizira kale.
Kuwonongeka kwa data, komwe kumayambitsa kusinthika kwa zomangamanga zosinthika, kumabweretsa kuchuluka kwa matebulo ndipo, motero, pamwamba kujowina posankha. Kuti mungopeza mawonekedwe onse amtundu, mu sitolo yachikale kusankha imodzi ndikokwanira, koma zomangamanga zosinthika zidzafuna mndandanda wonse wa majowina. Komanso, ngati zonsezi zikugwirizana ndi malipoti zitha kulembedwa pasadakhale, ndiye kuti akatswiri omwe amazolowera kulemba SQL pamanja adzavutika kawiri.
Pali mfundo zingapo zomwe zimapangitsa izi kukhala zosavuta:
Pogwira ntchito ndi miyeso yayikulu, mawonekedwe ake onse sagwiritsidwa ntchito nthawi imodzi. Izi zikutanthauza kuti pakhoza kukhala zolumikizana zochepa kuposa momwe zimawonekera poyang'ana koyamba. Data Vault imathanso kuganizira kuchuluka kwa kugawana komwe kumayembekezeredwa pogawira ma satellite. Nthawi yomweyo, ma Hub kapena Anchors omwe amafunikira makamaka popanga ndi kupanga ma surrogates potsitsa ndipo sagwiritsidwa ntchito kawirikawiri pamafunso (izi ndizoona makamaka kwa Anchors).
Malumikizidwe onse ndi makiyi. Kuphatikiza apo, njira yosungiramo zambiri "yopanikizidwa" imachepetsa kuchuluka kwa matebulo ojambulira pomwe ikufunika (mwachitsanzo, posefa ndi mtengo wake). Izi zitha kupangitsa kuti sampuli kuchokera pankhokwe yokhazikika yokhala ndi zolumikizira zambiri zitha kukhala mwachangu kuposa kusanthula gawo limodzi lolemera ndi mitundu yambiri pamzere uliwonse.
Mwachitsanzo, apa Nkhaniyi ili ndi mayeso ofananiza atsatanetsatane a momwe Anchor amagwirira ntchito ndi chitsanzo kuchokera patebulo limodzi.
Zambiri zimatengera injini. Mapulatifomu ambiri amakono ali ndi njira zolumikizirana mkati. Mwachitsanzo, MS SQL ndi Oracle "akhoza kudumpha" kujowina kumatebulo ngati deta yawo sikugwiritsidwa ntchito paliponse kupatula zojowina zina ndipo sizikhudza kusankha komaliza (kuchotsa tebulo/kujowina), ndi MPP Vertica. , yatsimikizira kuti ndi injini yabwino kwambiri ya Anchor Model, kutengera kukhathamiritsa kwapamanja kwa dongosolo lamafunso. Kumbali ina, kusunga Chitsanzo cha Anchor, mwachitsanzo, pa Click House, yomwe ili ndi chithandizo chochepa cholumikizira, sichikuwoneka ngati lingaliro labwino kwambiri.
Kuonjezera apo, kwa zomangamanga zonse zilipo mayendedwe apadera, kupangitsa kuti kupezeka kwa data kukhale kosavuta (zonse kuchokera pamachitidwe a mafunso komanso kwa ogwiritsa ntchito kumapeto). Mwachitsanzo, Matebulo a Point-In-Time mu Data Vault kapena ntchito yapadera tebulo mu chitsanzo cha Anchor.
Chiwerengero
Chofunikira chachikulu cha zomangamanga zomwe zimaganiziridwa kuti ndi zosinthika ndikusintha kwa "mapangidwe" awo.
Ndi katundu uyu amene amalola:
- Pambuyo pokonzekera koyambirira kokhudzana ndi kutumizidwa kwa metadata ndikulemba ma algorithms oyambira a ETL, mwamsanga perekani kasitomala ndi zotsatira zoyamba m'njira ya malipoti angapo okhala ndi data kuchokera kuzinthu zochepa chabe. Sikoyenera kuganiza mozama (ngakhale pamlingo wapamwamba) mtundu wonse wa chinthu.
- Mtundu wa data ukhoza kuyamba kugwira ntchito (ndi kukhala wothandiza) ndi zinthu 2-3 zokha, ndiyeno kukula pang'onopang'ono (zokhudza chitsanzo cha Anchor Nikolai Kufananiza bwino ndi mycelium).
- Zosintha zambiri, kuphatikiza kukulitsa gawo la phunziroli ndikuwonjezera magwero atsopano sichimakhudza magwiridwe antchito omwe alipo ndipo sizimayika pachiwopsezo chophwanya chinthu chomwe chikugwira ntchito kale.
- Chifukwa chowola kukhala zinthu wamba, njira za ETL pamakina oterowo zimawoneka chimodzimodzi, zolemba zawo zimadzipereka ku algorithmization ndipo, pamapeto pake, zochita zokha.
Mtengo wa kusinthasintha uku ndi machitidwe. Izi sizikutanthauza kuti n'zosatheka kukwaniritsa ntchito zovomerezeka pa zitsanzo zoterezi. Nthawi zambiri, mungafunike kulimbikira komanso chidwi kwambiri kuti mukwaniritse ma metric omwe mukufuna.
mapulogalamu
Mitundu yamagulu Data Vault
Zambiri za Data Vault:
Mitundu yamagulu Anchor Model
Zambiri za Anchor Model:
Gome lachidule lomwe lili ndi mawonekedwe ofananira komanso kusiyana kwa njira zomwe zimaganiziridwa:
Source: www.habr.com