Talu mai le 1999, mo le tautuaina o le ofisa i tua, ua faʻaaogaina e le matou faletupe le BISKVIT faʻapipiʻiina faiga faʻapipiʻi i luga o le Progress OpenEdge platform, lea e faʻaaogaina lautele i le lalolagi atoa, e aofia ai le vaega tau tupe. O le faatinoga o lenei DBMS e mafai ai ona e faitau e oo atu i le miliona pe sili atu faamaumauga i le sekone i le tasi database (DB). O la matou Alualu i Luma OpenEdge auaunaga e uiga i le 1,5 miliona tupe teu a le tagata lava ia ma e tusa ma le 22,2 miliona konekarate mo oloa faʻamalosi (nogatupe taʻavale ma mokesi), ma e nafa foʻi ma faʻamautu uma ma le pule faʻatonu (Central Bank) ma le SWIFT.
I le faʻaaogaina o le Alualu i Luma OpenEdge, sa matou feagai ma le manaʻoga e faʻaogaina ma le Oracle DBMS. I le taimi muamua, o le fusi lea o le faʻamaufaʻailoga lea o matou atinaʻe - seʻia oʻo ina matou faʻapipiʻi ma faʻapipiʻi le Pro2 CDC - o se oloa Alualu i Luma e mafai ai ona e auina saʻo mai faʻamatalaga mai le Progress DBMS i le Oracle DBMS, luga o le initaneti. I lenei pou o le a matou faʻamatalaina auʻiliʻili, faʻatasi ai ma faʻalavelave uma, pe faʻafefea ona faʻauo lelei i le va o OpenEdge ma Oracle.
Na fa'afefea ona tupu: fa'apipi'i fa'amaumauga ile QCD e ala ile fa'asoa faila
Muamua, o nisi mea moni e uiga ia tatou atinaʻe. Ole numera o tagata faʻaoga faʻaogaina o le database e tusa ma le 15 afe. O le tele o faʻamaumauga faʻatau uma, e aofia ai le kopi ma le faʻatali, e 600 TB, o le tele faʻamaumauga o le 16,5 TB. I le taimi lava e tasi, o faʻamaumauga o loʻo faʻatumuina pea lava pea: i le tausaga talu ai naʻo ia, e tusa ma le 120 TB o faʻamaumauga aoga ua faʻaopoopoina. O le faiga e faʻamalosia e 150 pito i luma sapalai i luga o le x86 platform. O faʻamaumauga o loʻo talimalo i luga ole 21 IBM platform servers.
O faiga pito i luma, faiga fa'atupe autu eseese ma 'au'aunaga fa'atupe o lo'o tu'ufa'atasia ma le OpenEdge Progress (BISCUIT IBS) e ala i le pasi Sonic ESB. O le tu'uina atu o fa'amaumauga i le QCD e fa'atatau ile fa'afesuiaiga o faila. Seʻia oʻo i se taimi patino, o lenei fofo e lua ni faʻafitauli tetele i le taimi e tasi - maualalo le faʻatinoina o le tuʻuina atu o faʻamatalaga i totonu o se fale teu oloa faʻamaumauga (CDW) ma se taimi umi mo le faʻatinoina o faʻamaumauga (reconciliation) ma isi faiga.
O le mea lea, na amata ai ona matou suʻeina se meafaigaluega e mafai ona faʻavaveina nei faiga. O le fofo i faʻafitauli uma e lua o le oloa fou a le Progress OpenEdge - Pro2 CDC (Suiga Faʻamaumauga Faʻamaumauga). O lea la, tatou amata.
Fa'apipi'i le Progress OpenEdge ma le Pro2Oracle
Ina ia faʻatautaia le Pro2 Oracle i luga o le komepiuta Windows a le pule, ua lava le faʻapipiʻiina o le Progress OpenEdge Developer Kit Classroom Edition, lea e mafai ona e leai se totogi. Fa'atonuga fa'apipi'i OpenEdge:
DLC: C:ProgressOpenEdge
WRK: C:OpenEdgeWRK
O faiga ETL e mana'omia ai Laisene Alualu i Luma OpenEdge version 11.7+ - e ta'ua ole OE DataServer mo Oracle ma le 4GL Development System. O nei laisene e aofia ai ma le Pro2. Mo le faʻaogaina atoatoa o le DataServer mo Oracle faʻatasi ai ma se faʻamaumauga mamao a Oracle, faʻapipiʻi Full Oracle Client.
I luga o le Oracle server e te manaʻomia e faʻapipiʻi Oracle Database 12+, fatuina se faʻamaumauga gaogao ma faʻaopoopo se tagata faʻaoga (tatou valaʻau ia te ia cdc).
Ina ia faʻapipiʻi le Pro2Oracle, download le tufatufaina lata mai mai le nofoaga autu o le download. Tatala le fa'amaumauga i totonu o se lisi C:Pro2 (Ina ia faʻapipiʻi le Pro2 i luga o Unix, o loʻo faʻaaogaina le tufatufaina tutusa ma faʻaoga tutusa mataupu faavae).
Fausia se cdc replication database
Fa'amaumauga fa'amaumauga cdc (repl) Pro2 e faʻaaogaina e teu ai faʻamatalaga faʻatulagaina, e aofia ai le faʻasologa o faʻafanua, igoa o faʻamaumauga faʻapipiʻi ma a latou laulau. O lo'o iai fo'i se fa'asologa o fa'asologa, e aofia ai fa'amatalaga e uiga i le mea moni o se laina laulau i totonu o fa'amaumauga fa'amaumauga ua suia. O faʻamatalaga mai le faʻasologa o faʻasologa o loʻo faʻaaogaina e faiga ETL e iloa ai laina e manaʻomia ona kopiina i Oracle mai le faʻamaumauga autu.
O lo'o matou faia se fa'amaumauga tu'ufa'atasi cdc.
Taualumaga mo le fausiaina o se fa'amaumauga
- I luga o le database server matou te fatuina se lisi mo le cdc database - mo se faʻataʻitaʻiga, i luga o le server /fa'amaumauga/cdc/.
- Fausia se dummy mo le cdc database: kopi le $DLC/cdc avanoa
- Fa'ataga le lagolago mo faila tetele: proutil cdc -C EnableLargeFiles
- Matou te saunia se tusitusiga mo le amataina o le cdc database. E tatau ona tutusa fa'amaufa'ailoga amata ma fa'amaufa'ailoga amata o le fa'amaumauga tu'ufa'atasi.
- Matou te amataina le cdc database.
- Faʻafesoʻotaʻi i le cdc database ma uta le Pro2 schema mai le faila cdc.df, lea e aofia ai ma le Pro2.
- Matou te fatuina tagata faʻaoga nei i le cdc database:
pro2adm - mo le faʻafesoʻotaʻi mai le vaega o le pulega Pro2;
pro2etl - mo le faʻafesoʻotaʻi faiga ETL (ReplBatch);
pro2cdc - mo le fesoʻotaʻi o faiga CDC (CDCBatch);
Fa'aagaoioia OpenEdge Suiga Fa'amaumauga Pu'eina
Se'i o tatou ki le masini CDC lava ia, faatasi ai ma le fesoasoani o fa'amaumauga o le a toe fa'afo'i atu i se vaega fa'atekonolosi fa'aopoopo. I faʻamaumauga faʻamaumauga taʻitasi a le Alualu i Luma OpenEdge, e tatau ona e faʻaopoopoina nofoaga eseese e teu ai mea o le a faʻaluaina ai faʻamatalaga faʻamatalaga, ma faʻagaoioia le masini lava ia e faʻaaoga ai le poloaiga. proutil.
Fa'ata'ita'iga faiga mo le bisquit database
- Kopi mai le lisi C:Pro2db faila cdcadd.st i le bisquit source database directory.
- Matou te faʻamatalaina i totonu cdcadd.st lapopoa tumau mo itulagi "ReplCDCArea" и "ReplCDCArea_IDX". E mafai ona e fa'aopoopo ni nofoaga fou e teu ai i luga ole laiga: prostrct addonline bisquit cdcadd.st
- Fa'agaoioia OpenEdge CDC:
proutil bisquit -C enablecdc area "ReplCDCArea" indexarea "ReplCDCArea_IDX" - O tagata fa'aoga nei e tatau ona faia i totonu o fa'amaumauga fa'amaumauga e fa'ailoa ai faiga fa'agasolo:
a. pro2adm - mo le faʻafesoʻotaʻi mai le Pro2 pulega vaega.
e. pro2etl - mo fesoʻotaʻiga ETL faiga (ReplBatch).
i. pro2cdc – mo feso'ota'iga faiga CDC (CDCBatch).
Fausiaina o se Fa'amaumauga mo le DataServer mo Oracle
Le isi, matou te manaʻomia le fatuina o se faʻamaumauga a le Schema Holder i luga o le 'auʻaunaga lea o le a toe faʻaaogaina ai faʻamaumauga mai le DBMS Alualu i Luma i le Oracle DBMS. DataServer Schema Holder o se fa'amatalaga avanoa o le Progress OpenEdge e aunoa ma tagata fa'aoga po'o fa'amaumauga o talosaga, o lo'o iai se fa'afanua o feso'ota'iga i le va o laulau fa'apogai ma laulau Oracle fafo.
Ole fa'amaumauga ole Schema Holder mo le Alualu i Luma OpenEdge DataServer mo Oracle mo Pro2 e tatau ona tu'u i luga ole fa'aumau ole faagasologa o le ETL e faia eseese mo lala ta'itasi;
Auala e fai ai se Schema Holder
- Tatala le tufatufaina o le Pro2 i totonu o se lisi /pro2
- Fausia ma alu i le lisi /pro2/dbsh
- Fausia se fa'amaumauga a le Schema Holder e fa'aaoga ai le fa'atonuga kopi le $DLC/bisquitsh gaogao
- Faia o le liuaina bisquitsh i totonu o le faʻailoga manaʻomia - mo se faʻataʻitaʻiga, i le UTF-8 pe afai o faʻamaumauga a Oracle o loʻo i ai UTF-8 encoding: proutil bisquitsh -C convchar liliu UTF-8
- A maeʻa ona fatuina se faʻamaumauga gaogao bisquitsh fa'afeso'ota'i i le faiga fa'aoga tasi: pro bisquitsh
- Se'i o tatou i le Fa'amatalaga Lomifefiloi: Meafaigaluega -> Faʻamatalaga Faʻamatalaga -> DataServer -> ORACLE Utilities -> Fausia Faʻamaumauga Faʻamaumauga
- Fa'alauiloa le Fa'amau Fuafuaga
- Faʻatulagaina le Oracle DataServer broker:
a. Amata AdminServer.
proadsv -amata
e. Amata o le Oracle DataServer broker
oraman -name orabroker1 -amata
Fa'atulaga le vaega fa'afoe ma le fa'asologa o faiga
I le faʻaaogaina o le Pro2 administrative panel, Pro2 parameters e faʻapipiʻiina, e aofia ai le faʻatulagaina o le faʻasologa o le faʻasologa ma le faʻatupuina o faiga ETL (Processor Library), polokalame faʻatasi muamua (Bulk-Copy Processor), faʻasologa o faʻasologa ma faiga faʻavae CDC OpenEdge. O lo'o iai fo'i meafaigaluega muamua mo le mata'ituina ma le fa'afoeina o faiga ETL ma CDC. Muamua, matou te setiina faila faila.
Faʻafefea ona faʻapipiʻi faila faila
- Alu i le lisi C:Pro2bpreplScripts
- Tatala le faila mo le teuteuina replProc.pf
- Fa'aopoopo fa'amaufa'ailoga feso'ota'iga i le cdc replication database:
# Fa'amatalaga Fa'amatalaga
-db cdc -ld repl -H <igoa'i fa'amaumauga autu> -S <fa'amatalaga tau fa'atau oloa cdc>
-U pro2admin -P <password> - Faaopoopo i replProc.pf feso'ota'iga tapula'a i puna'oa fa'amaumauga ma Schema Holder i foliga o faila fa'amau. Ole igoa ole faila fa'amaufa'ailoga e tatau ona fetaui ma le igoa ole fa'amaumauga fa'apogai o lo'o feso'ota'i.
# Faʻafesoʻotaʻi i punaʻoa faʻatusa uma BISQUIT
-pf bpreplscriptsbisquit.pf - Faaopoopo i replProc.pf tapula'a mo le fa'afeso'ota'i ile Schema Holder.
#Target Pro DB Schema Holder
-db bisquitsh -ld bisquitsh
-H <ETL process hostname>
-S <biskuitsh broker port>
-db bisquitsql
-ld bisquitsql
-dt TUALA
-S 5162 -H <igoa talimalo o le tagata fai pisinisi>
-DataService orabroker1 - Fa'asaoina le faila fa'amau replProc.pf
- O le isi, e tatau ona e fatuina ma tatala mo le faʻasaʻoina o faila faila mo faʻamaumauga faʻamaumauga taʻitasi i totonu o le lisi C:Pro2bpreplScripts: bisquit.pf. O faila pf ta'itasi o lo'o i ai ta'iala mo le fa'afeso'ota'i i fa'amaumauga fa'atatau, mo se fa'ata'ita'iga:
-db bisquit -ld bisquit -H <namename> -S <broker port>
-U pro2admin -P <password>
Ina ia fetuutuunai ala pupuu Windows, e tatau ona e alu i le lisi C:Pro2bpreplScripts ma fa'asa'o le ala 'upu "Pro2 - Administration". Ina ia faia lenei mea, tatala meatotino o le ala pupuu ma le laina Amata i totonu fa'ailoa le lisi fa'apipi'i Pro2. E tatau ona faia se gaioiga faapena mo le "Pro2 - Editor" ma le "RunBulkLoader" ala pupuu.
Fa'atonu Fa'atonu a le Pro2: Fa'autaina o le Fa'asologa Muamua
Sei o tatou fa'alauiloa le fa'amafanafanaga.
Alu i le "DB Map".
Ina ia faʻafesoʻotaʻi faʻamaumauga i le Pro2 - Pulega, alu i le laupepa DB Faafanua. Fa'aopoopo le fa'afanua o fa'amaumauga fa'amaumauga - Tagata Fuafuaga - Oracle.
Alu i le tab Mapi. Lisi Source Database Ona o le faaletonu, ua filifilia le fa'amaumauga muamua o puna'oa feso'ota'i. I le itu taumatau o le lisi e tatau ona i ai se tusitusiga Fa'amaumauga uma e Feso'ota'i - o faʻamaumauga filifilia e fesoʻotaʻi. I lalo i le agavale e tatau ona e va'ai i se lisi o laulau Alualu i Luma mai bisquit. I le itu taumatau o se lisi o laulau mai le database Oracle.
Fausia SQL schemas ma database i Oracle
Ina ia faia se fa'asologa o fa'afanua, e tatau ona e fa'atupu muamua Fuafuaga SQL i Oracle. I le Pro2 Administration matou te faʻatinoina le mea lisi Meafaigaluega -> Fausia Code -> Fuafuaga Fuafuaga, ona i totonu o le pusa talanoaga Filifili Faʻamaumauga filifili se tasi pe sili atu fa'amaumauga fa'amaumauga ma fa'agaoioi i le itu taumatau.
Kiliki OK ma filifili le lisi e teu ai le SQL schemas.
Ona sosoo ai lea ma le faia o le faavae. E mafai ona faia lenei mea, mo se faʻataʻitaʻiga, e ala i Oracle SQL Atinaʻe. Ina ia faia lenei mea, matou te faʻafesoʻotaʻi i le database Oracle ma faʻapipiʻi le schema mo le faʻaopoopoina o laulau. A maeʻa ona suia le tuʻufaʻatasia o laulau Oracle, e manaʻomia le faʻafouina o le SQL schemas i le Schema Holder.
A maeʻa le download, alu ese mai le bisquitsh database ma tatala le Pro2 administrative panel. O laulau mai le Oracle database e tatau ona faʻaalia i luga o le Mapping tab i le itu taumatau.
Fa'afanua laulau
Ina ia fatuina se faʻafanua faʻasologa, i le Pro2 pulega vaega, alu i le faʻafanua faʻafanua ma filifili le faʻamatalaga faʻamatalaga. Kiliki i luga o Map Tables, filifili Filifili Suiga i le agavale o laulau e tatau ona toe faia i Oracle, faʻagasolo i le itu taumatau ma faʻamaonia le filifiliga. O le a otometi lava ona faia se faafanua mo laulau ua filifilia. Matou te toe faia le gaioiga e fai ai se faʻasologa o faʻafanua mo isi faʻamaumauga faʻamaumauga.
Fausiaina o le Pro2 Replication Processor Library ma le Bulk-Copy Processor Programs
O le Replication Processor Library ua mamanuina mo faiga faʻapipiʻi aganuʻu (ETLs) e faʻatautaia le faʻasologa o le Pro2 replication ma tulei suiga i le database Oracle. E otometi lava ona fa'apolopolo polokalame fa'akomupiuta fa'akomupiuta i le fa'atonuga pe a mae'a augatupulaga bprepl/repl_proc (PROC_DIRECTORY parakalafa). Ina ia fa'atupuina le faletusi fa'akomupiuta, alu i le Meafaigaluega -> Fausia Code -> Faletusi Faʻatonu. A maeʻa le faʻatupuina, o le a faʻaalia polokalame i le lisi bprepl/repl_proc.
O polokalame Bulk Load Processor e fa'aogaina e fa'amaopoopo ai fa'amaumauga o le Alualu i luma ma le fa'amaumauga ole Oracle e fa'atatau i le gagana polokalame o le Alualu i Luma ABL (4GL). Ina ia fa'atupuina, alu i le mea fa'aitu Meafaigaluega -> Fa'atupu Fa'ailoga -> Fa'agaio'iga Kopi Fa'atele. I totonu o le Select Database dialog box, filifili faʻamaumauga autu, faʻanofo i le itu taumatau o le faamalama ma kiliki OK. A maeʻa le faʻatupuina, o le a faʻaalia polokalame i le lisi bpreplrepl_mproc.
Fa'atuina faiga toe faia i le Pro2
O le vaevaeina o laulau i seti o lo'o tu'uina atu e se isi fa'asologa o filo e fa'aleleia ai le fa'atinoga ma le lelei ole Pro2 Oracle. Ona o le faaletonu, o feso'ota'iga uma na faia i le fa'asologa o fa'afanua mo laulau fa'afouga fou e feso'ota'i ma le numera numera 1. E fautuaina e va'ava'ai laulau i filo eseese.
O faʻamatalaga e uiga i le tulaga o faʻasologa o filo o loʻo faʻaalia i luga o le Pro2 Administration screen i le Monitor tab i le Replication Status section. O se faʻamatalaga auʻiliʻili o tau faʻamaufaʻailoga e mafai ona maua i le Pro2 pepa (directory C:Pro2Docs).
Fausia ma fa'agaoioia faiga fa'avae CDC
O faiga fa'avae o se seti o tulafono mo le OpenEdge CDC engine e mata'ituina suiga i laulau. I le taimi o le tusitusi, Pro2 naʻo le lagolagoina o faiga faʻavae CDC ma le tulaga 0, o lona uiga, naʻo le mea moni e mataʻituina suiga o faamaumauga.
Ina ia fatuina se faiga faʻavae CDC, i luga o le vaega o le pulega, alu i le Mapping tab, filifili le faʻamatalaga faʻamaumauga ma kiliki i le Add/Remove Policies button. I le faamalama Filifili Suiga e matala, filifili i le itu agavale ma agai i le taumatau laulau e te manaʻomia e fatu ai pe tape ai se faiga faʻavae CDC.
Ina ia faʻagaoioia, toe tatala le Mapping tab, filifili le faʻamaumauga autu ma kiliki i luga o le ki (I) Fa'agaoioia Faiga Fa'avae. Filifili ma agai i le itu taumatau o le laulau tulafono e tatau ona faʻagaoioia, kiliki OK. A mae'a ona makaina i le lanu meamata. I le faʻaaogaina (I) Fa'agaoioia Faiga Fa'avae E mafai fo'i ona e fa'ate'aina faiga fa'avae CDC. O fefaʻatauaiga uma e faia i luga ole laiga.
A mae'a ona fa'agaoioia le faiga fa'avae CDC, fa'amatalaga e uiga i fa'amaumauga ua suia e teu i le nofoaga e teu ai "ReplCDCArea" e tusa ai ma faʻamaumauga faʻamaumauga. O nei faʻamatalaga o le a faʻatautaia e ala i se faiga faʻapitoa CDCBatch, lea e faʻavae i luga oi latou o le a fatuina ai faʻamatalaga i le Pro2 replication queue i le database cdc (repl).
O le mea lea, e lua a matou laina mo le toe faia. O le laʻasaga muamua o le CDCBatch: mai le faʻamaumauga faʻamaumauga, o faʻamaumauga muamua e alu i le nofoaga tutotonu o le CDC. O le laasaga lona lua o le taimi e faʻafeiloaʻi ai faʻamaumauga mai le CDC database i Oracle. O se vaega lea o le fausaga o loʻo iai nei ma le oloa lava ia - e oʻo mai i le taimi nei e leʻi mafai e le au atiaʻe ona faʻavaeina faʻasologa saʻo.
Tulaga muamua
A maeʻa ona faʻatagaina le CDC masini ma faʻatutuina le Pro2 replication server, e manaʻomia le amataina o le faʻasologa muamua. Poloaiga fa'atasi muamua:
/pro2/bprepl/Script/replLoad.sh bisquit table-name
A mae'a le fa'amaopoopoina muamua, e mafai ona amata fa'agasolo fa'asologa.
Amataina o faiga toe faia
Ina ia amata faiga toe faia e te mana'omia le fa'atinoina o se tusitusiga replbatch.sh. Aʻo leʻi amataina, ia mautinoa o loʻo i ai faʻamaumauga replbatch mo filo uma - replbatch1, replbatch2, ma isi. Afai o mea uma, tatala le laina faʻatonu (mo se faʻataʻitaʻiga, proenv), alu i le lisi /bprepl/scripts ma amata le tusitusiga. I totonu o le vaega o le pulega, matou te siakiina o le faagasologa tutusa ua maua le tulaga RUNNING.
Iʻuga
Ina ua maeʻa le faʻatinoga, matou faʻavavevaveina le tuʻuina atu o faʻamatalaga i le fale teu oloa faʻamaumauga. O faʻamatalaga e otometi lava ona oʻo i totonu ole Oracle ile initaneti. E leai se manaʻoga e faʻaumatia le taimi e faʻatautaia ai ni fesili umi e aoina mai faʻamatalaga mai faiga eseese. E le gata i lea, i totonu o lenei fofo e mafai ai e le faiga o le toe faia ona faʻapipiʻi faʻamaumauga, lea e iai foi se aafiaga lelei i le saoasaoa. O le taimi nei o le toe faʻaleleia o le BISKVIT i aso uma ma isi faiga na amata ona alu i le 15-20 minute nai lo le 2-2,5 itula, ma o le toe faʻaleleia atoatoa e tele itula nai lo le lua aso.
puna: www.habr.com