Umgangatho wedatha kwindawo yokugcina impahla

Umgangatho wedatha kwindawo yokugcina iimpahla uyimfuneko ebalulekileyo yokufumana ulwazi oluxabisekileyo. Umgangatho ophantsi ukhokelela kwimpendulo yekhonkco elibi ekuhambeni kwexesha.
Okokuqala, ukuthembela kwinkcazelo enikiweyo kuyalahleka. Abantu baqala ukusebenzisa izicelo zobuNhloli boShishino ngaphantsi; amandla ezicelo ahlala engafunwa.
Ngenxa yoko, utyalo-mali olongezelelweyo kwiprojekthi yohlalutyo lubizwa ngokuba ngumbuzo.

Uxanduva lomgangatho wedatha

Umba onxulumene nokuphucula umgangatho wedatha ubaluleke kakhulu kwiiprojekthi ze-BI. Nangona kunjalo, ayilolungelo leengcali zobugcisa kuphela.
Umgangatho wedatha ukwaphenjelelwa yimiba efana ne

inkcubeko Corporate

  • Ngaba abasebenzi ngokwabo banomdla wokuvelisa umgangatho olungileyo?
  • Ukuba akunjalo, kutheni kungenjalo? Kusenokubakho ukungqubana kwemidla.
  • Mhlawumbi kukho imigaqo yequmrhu emisela ukuba ngubani ojongene nomgangatho?

Iinkqubo

  • Yeyiphi idatha eyenziweyo ekupheleni kwala matyathanga?
  • Mhlawumbi iinkqubo zokusebenza ziqwalaselwe ngendlela yokuba kufuneka "ujike" ukubonakalisa oku okanye loo meko ngokwenene.
  • Ngaba iinkqubo zokusebenza zenza ukuqinisekiswa kwedatha kunye noxolelaniso ngokwazo?

Wonke umntu kumbutho unoxanduva lomgangatho wedatha kwiinkqubo zokunika ingxelo.

Ingcaciso nentsingiselo

Umgangatho kukwaneliseka okuqinisekisiweyo kokulindelwe ngumthengi.

Kodwa umgangatho wedatha awuqulathanga ngcaciso. Ihlala ibonisa umxholo wokusetyenziswa. Indawo yokugcina idatha kunye nenkqubo ye-BI isebenza ngeenjongo ezahlukeneyo kunenkqubo yokusebenza apho idatha ifunyenwe khona.

Ngokomzekelo, kwinkqubo yokusebenza, uphawu lomthengi lunokuba yintsimi yokuzikhethela. Kwindawo yokugcina, olu phawu lunokusetyenziswa njengomlinganiselo kwaye ukuzaliswa kwayo kuyafuneka. Nto leyo, ngokulandelelana, yazisa imfuno yokuzalisa amaxabiso angagqibekanga.

Iimfuno zokugcina idatha zihlala zitshintsha kwaye zihlala ziphezulu kunezo zeenkqubo zokusebenza. Kodwa inokuba ngenye indlela ngeenxa zonke, xa kungekho mfuneko yokugcina ulwazi olucacileyo kwinkqubo yokusebenza kwindawo yokugcina.

Ukwenza umgangatho wedatha ulinganiseke, imigangatho yayo kufuneka ichazwe. Abantu abasebenzisa ulwazi kunye namanani omsebenzi wabo kufuneka babandakanyeke kwinkqubo yenkcazo. Isiphumo solu thatho-nxaxheba sinokuba ngumgaqo, emva kokuba umntu unokuxelela ngokujonga etafileni ukuba kukho impazamo okanye ayikho. Lo mgaqo mawufomathwe njengeskripthi/ikhowudi yokuqinisekisa okulandelayo.

Ukuphucula umgangatho wedatha

Akunakwenzeka ukucoca kunye nokulungisa zonke iimpazamo ezicingelwayo ngexesha lenkqubo yokulayisha idatha kwindawo yokugcina impahla. Umgangatho olungileyo wedatha unokufezekiswa kuphela ngokusebenzisana ngokusondeleyo phakathi kwabo bonke abathathi-nxaxheba. Abantu abafaka idatha kwiinkqubo zokusebenza kufuneka bafunde ukuba zeziphi izenzo ezikhokelela kwiimpazamo.

Umgangatho wedatha yinkqubo. Ngelishwa, imibutho emininzi ayinaso isicwangciso sokuphucula okuqhubekayo. Abaninzi banciphisa kuphela ukugcina idatha kwaye bangasebenzisi amandla apheleleyo eenkqubo zokuhlalutya. Ngokuqhelekileyo, xa kuphuhliswa iindawo zokugcina idatha, i-70-80% yohlahlo lwabiwo-mali isetyenziselwa ukuphumeza ukuhlanganiswa kwedatha. Inkqubo yokubeka iliso nokuphucula ihleli ingagqitywanga, ukuba kunjalo.

Zixhobo

Ukusetyenziswa kwezixhobo zesoftware kunokunceda kwinkqubo yokuphucula umgangatho wedatha ngokuzenzekelayo kunye nokubeka iliso. Ngokomzekelo, banokwenza ngokuzenzekelayo ukuqinisekiswa kobugcisa bezakhiwo zokugcina: ifomathi yentsimi, ubukho bexabiso elingagqibekanga, ukuthotyelwa kwamagama entsimi yetafile.

Kunokuba nzima ngakumbi ukujonga umxholo. Njengoko iimfuno zokugcina zitshintsha, ukuchazwa kwedatha kunokutshintsha. Isixhobo ngokwaso sinokuba yiprojekthi enkulu efuna inkxaso.

Icebiso

Oovimba beenkcukacha zobudlelwane, apho iivenkile ziyilwe ngokuqhelekileyo, zinekhono elimangalisayo lokudala iimbono. Zingasetyenziselwa ukujonga ngokukhawuleza idatha ukuba uyazi izinto ezithile zomxholo. Imeko nganye yokufumana impazamo okanye ingxaki kwidatha ingabhalwa ngendlela yombuzo wesiseko sedatha.

Ngale ndlela, isiseko solwazi malunga nomxholo siya kwenziwa. Kakade ke, izicelo ezinjalo zimele zikhawuleze. Iimboniselo zifuna ixesha elingaphantsi lomntu ukugcina kunezixhobo ezisekwe kwitafile. Umbono uhlala ulungele ukubonisa umphumo wovavanyo.
Kwimeko yeengxelo ezibalulekileyo, umbono unokuquka ikholamu kunye nommkeli. Kunengqiqo ukusebenzisa izixhobo ze-BI ezifanayo ukunika ingxelo malunga nomgangatho wedatha kwindawo yokugcina impahla.

Umzekelo:

Umbuzo wawubhalelwe i-database ye-Oracle. Kulo mzekelo, iimvavanyo zibuyisela ixabiso lamanani elinokutolikwa njengoko lifunwayo. Amaxabiso e-T_MIN kunye ne-T_MAX angasetyenziselwa ukunyenyisa inqanaba le-alam. Intsimi ye-REPORT yayisetyenziswe njengomyalezo kwimveliso ye-ETL yorhwebo eyayingayazi indlela yokuthumela i-imeyile ngokufanelekileyo, ngoko i-rpad "yi-crutch".

Kwimeko yetafile enkulu, unokongeza, umzekelo, KUNYE ROWNUM <= 10, i.e. ukuba kukho iimpazamo ezili-10, ke oku kwanele ukwenza i-alamu.

CREATE OR REPLACE VIEW V_QC_DIM_PRODUCT_01 AS
SELECT
  CASE WHEN OUTPUT>=T_MIN AND OUTPUT<=T_MAX
  THEN 'OK' ELSE 'ERROR' END AS RESULT,
  DESCRIPTION,
  TABLE_NAME, 
  OUTPUT, 
  T_MIN,
  T_MAX,
  rpad(DESCRIPTION,60,' ') || rpad(OUTPUT,8,' ') || rpad(T_MIN,8,' ') || rpad(T_MAX,8,' ') AS REPORT
FROM (-- Test itself
  SELECT
    'DIM_PRODUCT' AS TABLE_NAME,
    'Count of blanks' AS DESCRIPTION,
    COUNT(*) AS OUTPUT,
    0 AS T_MIN,
    10 AS T_MAX
  FROM DIM_PRODUCT
  WHERE DIM_PRODUCT_ID != -1 -- not default value
  AND ATTRIBUTE IS NULL ); -- count blanks

Olu papasho lusebenzisa izinto ezikule ncwadi
URonald Bachmann, uGqr. UGuido Kemper
Raus aus der BI-Falle
Wie Business Intelligence zum Erfolg wird


umthombo: www.habr.com

Yongeza izimvo