Njengoba wazi, i-SAP inikeza uhla olugcwele lwesofthiwe kokubili ukugcina idatha yokuthengiselana kanye nokucubungula le datha ekuhlaziyeni nasekubikeni izinhlelo. Ikakhulukazi, iplatifomu ye-SAP Business Warehouse (SAP BW) iyikhithi yamathuluzi yokugcina nokuhlaziya idatha ngamakhono obuchwepheshe abanzi. Kuzo zonke izinzuzo zayo zenhloso, uhlelo lwe-SAP BW lune-drawback eyodwa ebalulekile. Lokhu kuyizindleko eziphezulu zokugcina nokucubungula idatha, ikakhulukazi uma usebenzisa i-SAP BW esekelwe efwini ku-Hana.
Kuthiwani uma uqala ukusebenzisa okunye okungeyona i-SAP futhi okungcono umkhiqizo we-OpenSource njengesitoreji? Thina kwaX5 Retail Group sikhethe iGreenPlum. Lokhu, yiqiniso, kuxazulula inkinga yezindleko, kodwa ngesikhathi esifanayo, izinkinga ziphakama ngokushesha ezixazululwe cishe ngokuzenzakalelayo lapho usebenzisa i-SAP BW.
Ikakhulukazi, indlela yokubuyisela idatha kusuka kuzinhlelo zomthombo, okuyizixazululo eziningi ze-SAP?
I-HR Metrics kwakuyiphrojekthi yokuqala lapho kwakudingeka khona ukuxazulula le nkinga. Umgomo wethu bekuwukwakha inqolobane yedatha ye-HR futhi sakhe imibiko yokuhlaziya endaweni yokusebenza nabasebenzi. Kulesi simo, umthombo oyinhloko wedatha yi-SAP HCM transactional system, lapho bonke abasebenzi, imisebenzi yenhlangano kanye neholo yenziwa khona.
Ukukhishwa kwedatha
Ku-SAP BW kukhona ama-data extractors ajwayelekile wezinhlelo ze-SAP. Lawa ma-extractors angaqoqa ngokuzenzakalelayo idatha edingekayo, aqaphe ubuqotho bayo, futhi anqume ushintsho lwama-deltas. Nansi, isibonelo, umthombo wedatha ojwayelekile wezibaluli zesisebenzi 0EMPLOYEE_ATTR:
Umphumela wokukhipha idatha kuyo yesisebenzi esisodwa:
Uma kunesidingo, i-extractor enjalo ingashintshwa ukuze ihambisane nezidingo zakho noma i-extractor yakho ingadalwa.
Umbono wokuqala owavela kwaba ukuthi kungenzeka ziphinde zisetshenziswe. Ngeshwa, lokhu kwaba umsebenzi ongenakwenzeka. Iningi le-logic lisetshenziswa ohlangothini lwe-SAP BW, futhi kwakungenakwenzeka ukuhlukanisa ngokungenabuhlungu i-extractor emthonjeni ku-SAP BW.
Kwaba sobala ukuthi kuzodingeka sithuthukise indlela yethu yokukhipha idatha ezinhlelweni ze-SAP.
Isakhiwo sokulondoloza idatha ku-SAP HCM
Ukuze siqonde izimfuneko zendlela enjalo, sidinga kuqala ukunquma ukuthi iyiphi idatha esiyidingayo.
Idatha eminingi ku-SAP HCM igcinwa kumathebula e-SQL ayisicaba. Ngokusekelwe kule datha, izicelo ze-SAP zibona ngeso lengqondo izakhiwo zenhlangano, abasebenzi kanye nolunye ulwazi lwe-HR kumsebenzisi. Isibonelo, yile ndlela uhlaka lwenhlangano olubukeka ngayo ku-SAP HCM:
Ngokomzimba, isihlahla esinjalo sigcinwa kumatafula amabili - ezintweni ze-hrp1000 naku-hrp1001 ukuxhumana phakathi kwalezi zinto.
Izinto “Umnyango 1” kanye “Nehhovisi 1”:
Ubudlelwano phakathi kwezinto:
Kungaba nenani elikhulu lazo zombili izinhlobo zezinto kanye nezinhlobo zokuxhuma phakathi kwazo. Kukhona kokubili ukuxhumana okujwayelekile phakathi kwezinto kanye nalezo ezenzelwe izidingo zakho ezithile. Isibonelo, ubudlelwano obujwayelekile be-B012 phakathi kweyunithi yenhlangano kanye nesikhundla esigcwele bubonisa inhloko yomnyango.
Isibonisi somphathi ku-SAP:
Isitoreji kuthebula lesizindalwazi:
Idatha yesisebenzi igcinwa ku-pa* amathebula. Isibonelo, idatha yemicimbi yabasebenzi yesisebenzi igcinwa kuthebula elithi pa0000
Sinqume ukuthi iGreenPlum izothatha idatha "eluhlaza", i.e. vele uwakopishe ematafuleni e-SAP. Futhi ngokuqondile ku-GreenPlum zizocutshungulwa futhi ziguqulwe zibe izinto ezibonakalayo (isibonelo, uMnyango noma Isisebenzi) kanye namamethrikhi (isibonelo, isilinganiso sokubalwa kwekhanda).
Cishe amathebula angama-70 achazwa, idatha okufanele idluliselwe ku-GreenPlum. Ngemva kwalokho saqala ukwenza indlela yokudlulisa le datha.
I-SAP inikeza inani elikhulu kakhulu lezindlela zokuhlanganisa. Kodwa indlela elula ukuthi ukufinyelela okuqondile kusizindalwazi akuvunyelwe ngenxa yemikhawulo yamalayisensi. Ngakho, konke ukugeleza kokuhlanganiswa kufanele kusetshenziswe ezingeni leseva yohlelo lokusebenza.
Inkinga elandelayo kwaba ukuntuleka kwedatha mayelana namarekhodi asusiwe ku-database ye-SAP. Uma ususa irowu kusizindalwazi, liyasuswa ngokoqobo. Labo. ukwakhiwa kwe-delta yoshintsho ngokusekelwe esikhathini soshintsho kwakungenakwenzeka.
Yiqiniso, i-SAP HCM inezindlela zokurekhoda izinguquko zedatha. Isibonelo, ekudluliseleni okulandelayo ezinhlelweni zomamukeli, kunezinkomba zoshintsho ezirekhoda noma yiziphi izinguquko futhi ngesisekelo lapho kwakhiwa khona i-Idoc (into yokudluliselwa kumasistimu angaphandle).
Isibonelo se-IDoc sokushintsha i-infotype 0302 yesisebenzi esinenombolo yabasebenzi 1251445:
Noma ukugcina amalogi ezinguquko zedatha kuthebula le-DBTABLOG.
Isibonelo selogi yokususa irekhodi ngokhiye othi QK53216375 kuthebula le-hrp1000:
Kodwa lezi zindlela azitholakali kuyo yonke idatha edingekayo, futhi ukucubungula kwazo ezingeni leseva yohlelo lokusebenza kungadla izinsiza eziningi. Ngakho-ke, ukunika amandla kakhulu ukungena kuwo wonke amathebula adingekayo kungaholela ekulimaleni okubonakalayo kokusebenza kwesistimu.
Inkinga enkulu elandelayo bekungamathebula ahlanganisiwe. Isilinganiso sesikhathi kanye nedatha yokuhola enguqulweni ye-RDBMS ye-SAP HCM igcinwa njengesethi yamathebula anengqondo yesisebenzi ngasinye esibalweni ngasinye. Lawa mathebula anengqondo agcinwa njengedatha kanambambili kuthebula pcl2.
I-Payroll Cluster:
Idatha evela kumathebula ahlanganisiwe ayikwazi ukubhekwa njengomyalo we-SQL, kodwa idinga ukusetshenziswa kwama-SAP HCM macros noma amamojula omsebenzi akhethekile. Ngokuvumelana nalokho, ijubane lokufunda lamatafula anjalo lizoba liphansi kakhulu. Ngakolunye uhlangothi, amaqoqo anjalo agcina idatha edingekayo kanye kuphela ngenyanga - iholo lokugcina kanye nokulinganisa isikhathi. Ngakho isivinini kuleli cala asibucayi kangako.
Ukuhlola izinketho zokwenza i-delta yezinguquko zedatha, sinqume ukucabangela inketho yokulayisha ngokugcwele. Inketho yokudlulisa ama-gigabytes wedatha engashintshiwe phakathi kwamasistimu nsuku zonke ingase ingabonakali kahle. Kodwa-ke, futhi inezinzuzo eziningi - asikho isidingo sokusebenzisa kokubili i-delta ohlangothini lomthombo futhi usebenzise ukushumeka kwale delta ohlangothini lomamukeli. Ngokufanelekile, izindleko nesikhathi sokuqalisa siyancishiswa, futhi ukwethembeka kokuhlanganiswa kuyanda. Ngesikhathi esifanayo, kwanqunywa ukuthi cishe zonke izinguquko ku-SAP HR zenzeka phakathi nezinyanga ezintathu ngaphambi kosuku lwamanje. Ngakho-ke, kunqunywe ukukhetha ukulanda okugcwele kwansuku zonke kwedatha evela kwa-SAP HR N izinyanga ngaphambi kwedethi yamanje kanye nokukhipha okugcwele kwanyanga zonke. Ipharamitha engu-N incike kuthebula elithile
futhi isukela ku-1 kuye ku-15.
Uhlelo olulandelayo lwahlongozwa ukuze kukhishwe idatha:
Uhlelo lwangaphandle lukhiqiza isicelo bese lisithumela ku-SAP HCM, lapho lesi sicelo sihlolelwa ukuphelela kwedatha nezimvume zokufinyelela amathebula. Uma isheke siphumelele, i-SAP HCM iqhuba uhlelo oluqoqa idatha edingekayo futhi luyidlulisele kusixazululo sokuhlanganiswa kwe-Fuse. I-Fuse inquma isihloko esidingekayo e-Kafka futhi idlulisela idatha lapho. Okulandelayo, idatha evela e-Kafka idluliselwa ku-Stage Area GP.
Kulolu chungechunge, sinesithakazelo endabeni yokukhipha idatha ku-SAP HCM. Ake sikubheke kabanzi.
Umdwebo wokusebenzisana we-SAP HCM-FUSE.
Uhlelo lwangaphandle lunquma isikhathi sesicelo sokugcina esiyimpumelelo ku-SAP.
Inqubo ingaqaliswa isibali sikhathi noma omunye umcimbi, okuhlanganisa ukubeka isikhathi sokuvala ukuze ulinde impendulo ngedatha evela ku-SAP futhi uqale isicelo sokuphinda. Bese ikhiqiza isicelo se-delta bese isithumela kwa-SAP.
Idatha yesicelo ithunyelwa emzimbeni ngefomethi ye-json.
Indlela http: THUMELA.
Isicelo esiyisibonelo:
Isevisi ye-SAP iqapha isicelo sokuphelela, ukuhambisana nesakhiwo samanje se-SAP, kanye nokutholakala kwemvume yokufinyelela etafuleni eliceliwe.
Esimeni samaphutha, isevisi ibuyisela impendulo enekhodi nencazelo efanele. Uma ukulawula kuphumelela, kudala inqubo yangemuva ukuze kukhiqizwe isampula, kukhiqize futhi kubuyisele ngokuvumelanisa i-id yeseshini ehlukile.
Uma kwenzeka iphutha, isistimu yangaphandle iliqopha kulogi. Uma kunempendulo eyimpumelelo, idlulisela i-id yeseshini kanye negama lethebula isicelo esenzelwe lona.
Uhlelo lwangaphandle lubhalisa iseshini yamanje njengevuliwe. Uma kukhona amanye amaseshini aleli thebula, avalwa ngesixwayiso esilogwe.
Umsebenzi wangemuva we-SAP ukhiqiza ikhesa ngokusekelwe kumingcele ecacisiwe kanye nephakethe ledatha losayizi oshiwo. Usayizi weqoqo inombolo enkulu yamarekhodi inqubo efundwa kusizindalwazi. Ngokuzenzakalelayo, kucatshangwa ukuthi ilingana no-2000. Uma kunamarekhodi amaningi kusampula yedathabhesi kunosayizi wepakethe esetshenzisiwe, ngemva kokudlulisa iphakethe lokuqala, ibhulokhi elilandelayo liyakhiwa nge-offset ehambisanayo kanye nenombolo yephakethe ye-incremented. Izinombolo zinyuswa ngo-1 futhi zithunyelwa ngokulandelana ngokuqinile.
Okulandelayo, i-SAP idlulisa iphakethe njengokufaka kusevisi yewebhu yesistimu yangaphandle. Futhi isistimu yenza izilawuli ephaketheni elingenayo. Iseshini ene-id eyamukelwe kufanele ibhaliswe ohlelweni futhi kufanele ibe sesimweni esivulekile. Uma inombolo yephakheji > 1, isistimu kufanele irekhode ukwamukela okuyimpumelelo kwephakheji yangaphambilini (package_id-1).
Uma ukulawula kuphumelele, isistimu yangaphandle iyancozulula futhi ilondoloze idatha yethebula.
Ukwengeza, uma ifulegi lokugcina likhona kuphakheji futhi ukwenziwa kwe-serial kube yimpumelelo, imojula yokuhlanganisa iyaziswa mayelana nokuqedwa ngempumelelo kokucubungula iseshini futhi imojuli ibuyekeza isimo seseshini.
Esimeni sephutha lokulawula/lokudlulisa, iphutha liyangena futhi amaphakethe ale seshini azonqatshwa isistimu yangaphandle.
Ngokufanayo, esimweni esiphambene, lapho uhlelo lwangaphandle lubuyisela iphutha, luyangena futhi ukudluliswa kwephakethe kuyama.
Ukuze ucele idatha ohlangothini lwe-SAP HСM, isevisi yokuhlanganisa yaqaliswa. Le nkonzo isetshenziswa ngohlaka lwe-ICF (SAP Internet Communication Framework - ). Ikuvumela ukuthi ubuze idatha kusuka ohlelweni lwe-SAP HCM usebenzisa amatafula athile. Lapho udala isicelo sedatha, kungenzeka ukucacisa uhlu lwezinkambu ezithile kanye nemingcele yokuhlunga ukuze uthole idatha edingekayo. Ngesikhathi esifanayo, ukuqaliswa kwesevisi akusho noma iyiphi i-logic yebhizinisi. Ama-algorithms okubala i-delta, amapharamitha wemibuzo, ukuqapha ubuqotho, njll. nawo asetshenziswa ohlangothini lwesistimu yangaphandle.
Lo mshini ikuvumela ukuthi uqoqe futhi udlulise yonke idatha edingekayo ngamahora ambalwa. Lesi sivinini siseduze nokwamukeleka, ngakho-ke sibheka lesi sixazululo njengesikhashana, okwenza kube nokwenzeka ukugcwalisa isidingo sethuluzi lokukhipha kuphrojekthi.
Esithombeni esiqondiwe, ukuxazulula inkinga yokukhishwa kwedatha, izinketho zokusebenzisa izinhlelo ze-CDC ezifana ne-Oracle Golden Gate noma amathuluzi e-ETL afana ne-SAP DS ayahlolwa.
Source: www.habr.com