I-ProHoster > Π‘Π»ΠΎΠ³ > Ukuphatha > Ikhwalithi yedatha ku-warehouse

Ikhwalithi yedatha ku-warehouse

Izinga ledatha endaweni yokugcina impahla liyisidingo esibalulekile sokuthola ulwazi olubalulekile. Ikhwalithi ephansi iholela ekuphenduleni okungalungile kweketango ngokuhamba kwesikhathi.
Okokuqala, ukuthembela olwazini olunikeziwe kuyalahleka. Abantu sebeqala ukusebenzisa izinhlelo zokusebenza zeBusiness Intelligence kancane; amandla ezicelo ahlala engafunwanga.
Ngenxa yalokho, ukutshalwa kwezimali okwengeziwe kuphrojekthi yokuhlaziya kubuzwa.

Isibopho sekhwalithi yedatha

Isici esihlobene nokuthuthukisa ikhwalithi yedatha sibaluleke kakhulu kumaphrojekthi we-BI. Kodwa-ke, akulona ilungelo lochwepheshe bezobuchwepheshe kuphela.
Ikhwalithi yedatha nayo ithonywa yizici ezinjengokuthi

Isiko lebhizinisi

  • Ingabe abasebenzi ngokwabo banesithakazelo ekukhiqizeni izinga elihle?
  • Uma kungenjalo, kungani kungenjalo? Kungase kube nokungqubuzana kwezintshisekelo.
  • Mhlawumbe kunemithetho yezinkampani enquma ukuthi ubani ophethe ikhwalithi?

Izinqubo

  • Iyiphi idatha edalekayo ekugcineni kwala maketango?
  • Mhlawumbe izinhlelo zokusebenza zihlelwe ngendlela yokuthi udinga "ukusonta" ukuze ubonise lokhu noma leso simo empeleni.
  • Ingabe amasistimu okusebenza ayakwenza ukuqinisekiswa kwedatha nokubuyisana ngokwawo?

Wonke umuntu enhlanganweni unesibopho ngekhwalithi yedatha kumasistimu wokubika.

Incazelo nencazelo

Ikhwalithi wukwaneliseka okuqinisekisiwe kokulindelwe ngamakhasimende.

Kodwa ikhwalithi yedatha ayinayo incazelo. Ihlala ibonisa umongo wokusetshenziswa. Indawo yokugcina idatha kanye nesistimu ye-BI kusebenzela izinjongo ezihlukile kunesistimu yokusebenza okuvela kuyo idatha.

Isibonelo, kusistimu yokusebenza, isici sekhasimende singase sibe inkambu ozikhethela yona. Endaweni yokugcina, lesi sici singasetshenziswa njengobukhulu futhi ukugcwaliswa kwaso kuyadingeka. Okuphinde kwethule isidingo sokugcwalisa amanani azenzakalelayo.

Izidingo zokugcinwa kwedatha zihlala zishintsha futhi ngokuvamile ziphakeme kunalezo zamasistimu okusebenza. Kodwa futhi kungase kube ngenye indlela nxazonke, lapho singekho isidingo sokugcina ulwazi oluningiliziwe olusuka ohlelweni lokusebenza endaweni yokugcina.

Ukwenza ikhwalithi yedatha ilinganiseke, izindinganiso zayo kufanele zichazwe. Abantu abasebenzisa ulwazi nezibalo zomsebenzi wabo kumele babambe iqhaza enqubweni yokuchaza. Umphumela walokhu kubandakanyeka kungase kube umthetho, okulandela ukuthi umuntu angasho shazi etafuleni ukuthi kukhona iphutha noma cha. Lesi simiso kufanele sifomethwe njengesikripthi/ikhodi yokuqinisekisa okulandelayo.

Ukuthuthukisa ikhwalithi yedatha

Akunakwenzeka ukuhlanza nokulungisa wonke amaphutha okucatshangelwa phakathi nenqubo yokulayisha idatha endaweni yokugcina impahla. Ikhwalithi yedatha enhle ingafinyelelwa kuphela ngokubambisana okuseduze phakathi kwabo bonke ababambiqhaza. Abantu abafaka idatha kumasistimu okusebenza kudingeka bafunde ukuthi yiziphi izenzo eziholela emaphutheni.

Ikhwalithi yedatha iyinqubo. Ngeshwa, izinhlangano eziningi azinalo isu lokuthuthukisa okuqhubekayo. Abaningi banomkhawulo ekugcineni idatha kuphela futhi abasebenzisi amandla aphelele wezinhlelo zokuhlaziya. Ngokuvamile, lapho kuthuthukiswa izindawo zokugcina idatha, i-70-80% yesabelomali isetshenziselwa ukusebenzisa ukuhlanganiswa kwedatha. Inqubo yokuqapha nokwenza ngcono ihlala ingaphelele, uma kunjalo.

Amathuluzi

Ukusetshenziswa kwamathuluzi esofthiwe kungasiza ohlelweni lokuzenzakalela ukuthuthukiswa kwekhwalithi yedatha nokuqapha. Isibonelo, bangakwazi ngokugcwele ukuqinisekiswa kobuchwepheshe bezakhiwo zokugcina: ifomethi yenkambu, ukuba khona kwamanani azenzakalelayo, ukuhambisana namagama ezinkambu zethebula.

Kungase kube nzima kakhulu ukuhlola okuqukethwe. Njengoba izidingo zesitoreji zishintsha, incazelo yedatha nayo ingase ishintshe. Ithuluzi ngokwalo lingaba iphrojekthi enkulu edinga ukwesekwa.

Ithiphu

Imininingo egciniwe yobudlelwano, lapho izitolo ziklanywa khona, zinekhono elimangalisayo lokudala ukubuka. Angasetshenziswa ukuhlola ngokushesha idatha uma wazi imininingwane yokuqukethwe. Icala ngalinye lokuthola iphutha noma inkinga kudatha lingarekhodwa ngendlela yombuzo wesizindalwazi.

Ngale ndlela, kuzokwakhiwa isisekelo solwazi ngokuqukethwe. Yiqiniso, izicelo ezinjalo kufanele zisheshe. Ukubuka ngokuvamile kudinga isikhathi esincane somuntu ukuze sigcinwe kunamathuluzi asekelwe etafuleni. Ukubuka kuhlala kulungele ukubonisa umphumela wokuhlolwa.
Esimeni semibiko ebalulekile, ukubuka kungase kuqukathe ikholomu nomamukeli. Kunengqondo ukusebenzisa amathuluzi afanayo e-BI ukubika ngesimo sekhwalithi yedatha endaweni yokugcina impahla.

Isibonelo:

Umbuzo ububhalelwe isizindalwazi se-Oracle. Kulesi sibonelo, izivivinyo zibuyisela inani lenombolo elingatolikwa njengokufunwa kwalo. Amanani we-T_MIN kanye ne-T_MAX angasetshenziswa ukulungisa ileveli ye-alamu. Inkambu ye-REPORT yake yasetshenziswa njengomlayezo kumkhiqizo wezohwebo we-ETL owawungazi ukuthi uthunyelwa kanjani kahle ama-imeyili, ngakho-ke i-rpad β€œiwudondolo”.

Endabeni yetafula elikhulu, ungakwazi ukwengeza, isibonelo, KANYE ROWNUM <= 10, i.e. uma kukhona amaphutha angu-10, lokhu kwanele ukubangela i-alamu.

CREATE OR REPLACE VIEW V_QC_DIM_PRODUCT_01 AS
SELECT
  CASE WHEN OUTPUT>=T_MIN AND OUTPUT<=T_MAX
  THEN 'OK' ELSE 'ERROR' END AS RESULT,
  DESCRIPTION,
  TABLE_NAME, 
  OUTPUT, 
  T_MIN,
  T_MAX,
  rpad(DESCRIPTION,60,' ') || rpad(OUTPUT,8,' ') || rpad(T_MIN,8,' ') || rpad(T_MAX,8,' ') AS REPORT
FROM (-- Test itself
  SELECT
    'DIM_PRODUCT' AS TABLE_NAME,
    'Count of blanks' AS DESCRIPTION,
    COUNT(*) AS OUTPUT,
    0 AS T_MIN,
    10 AS T_MAX
  FROM DIM_PRODUCT
  WHERE DIM_PRODUCT_ID != -1 -- not default value
  AND ATTRIBUTE IS NULL ); -- count blanks

Ukushicilelwa kusebenzisa izinto ezivela encwadini
Ronald Bachmann, uDkt. UGuido Kemper
I-Raus aus der BI-Falle
Wie Business Intelligence zum Erfolg wird

Source: www.habr.com

Engeza amazwana