Otu esi eme enyi n'etiti sistemu ụlọ akụ OpenEdge Progress yana Oracle DBMS

Ebe ọ bụ na 1999, na-eje ozi na azụ ụlọ ọrụ, anyị akụ na-eji Integrated ụlọ akụ usoro BISKVIT na Progress OpenEdge ikpo okwu, nke a na-eji n'ụwa nile, gụnyere na ego ngalaba. Ịrụ ọrụ nke DBMS a na-enye gị ohere ịgụ ihe ruru nde ma ọ bụ karịa ndekọ kwa sekọnd n'otu nchekwa data (DB). Ọrụ OpenEdge anyị na-aga n'ihu gbasara nkwụnye ego mmadụ 1,5 na ihe dị ka nde 22,2 maka ngwaahịa na-arụ ọrụ (nbinye ụgbọ ala na mortgages), ma na-ahụ maka mmezi niile na onye na-ahụ maka njikwa (Central Bank) na SWIFT.

Iji Progress OpenEdge, anyị chere mkpa ọ dị ime ka ọ rụọ ọrụ na Oracle DBMS. Na mbido, ngwugwu a bụ ihe mgbochi akụrụngwa anyị - ruo mgbe anyị wụnye ma hazie Pro2 CDC - ngwaahịa ọganihu na-enye gị ohere izipu data sitere na DBMS Ọganihu na Oracle DBMS ozugbo, n'ịntanetị. Na post a, anyị ga-agwa gị n'ụzọ zuru ezu, yana ọnyà niile, otu esi eme enyi nke ọma n'etiti OpenEdge na Oracle.

Otu o siri mee: bulite data na QCD site na nkesa faịlụ

Nke mbụ, ụfọdụ eziokwu gbasara akụrụngwa anyị. Ọnụ ọgụgụ ndị na-arụsi ọrụ ike nke nchekwa data dị ihe dịka 15 puku. Olu nke ọdụ data niile na-arụpụta ihe, gụnyere oyiri na njikere, bụ TB 600, nchekwa data kacha ukwuu bụ 16,5 TB. N'otu oge ahụ, a na-emejupụta ọdụ data mgbe niile: n'ime afọ gara aga naanị, agbakwunyere ihe dị ka TB 120 nke data na-arụpụta ihe. A na-akwado sistemụ ahụ site na sava 150 n'ihu n'elu ikpo okwu x86. A na-akwado ọdụ data ndị a na sava ikpo okwu 21 IBM.

Sistemụ ngwụcha ngwụcha, sistemu isi ụlọ akụ dị iche iche na ọrụ ụlọ akụ jikọtara ya na OpenEdge Progress (BISCUIT IBS) site na bọs Sonic ESB. Ibulite data na QCD na-apụta site na mgbanwe faịlụ. Ruo oge ụfọdụ, ihe ngwọta a nwere nnukwu nsogbu abụọ n'otu oge - arụmọrụ dị ala nke na-ebugo ozi n'ime ụlọ nkwakọba ihe data ụlọ ọrụ (CDW) na ogologo oge maka ịme nzikọrịta data (mmekọrịta) na usoro ndị ọzọ.

Ya mere, anyị malitere ịchọ ngwá ọrụ nwere ike ime ka usoro ndị a dị ngwa. Ihe ngwọta nye nsogbu abụọ a bụ ngwaahịa ọhụrụ Progress OpenEdge - Pro2 CDC (Change Data Capture). Ya mere, ka anyị malite.

Wụnye Progress OpenEdge na Pro2Oracle

Iji mee Pro2 Oracle na kọmpụta Windows nke onye nchịkwa, o zuru ezu ịwụnye Progress OpenEdge Developer Kit Classroom Edition, nke nwere ike ịbụ. скачать n'efu. Akwụkwọ ndekọ nrụnye OpenEdge:

DLC: C: ProgressOpenEdge
WRK: C:OpenEdgeWRK

Usoro ETL chọrọ ụdị ikikere OpenEdge Progress 11.7+ - ya bụ OE DataServer maka Oracle na Sistemụ Mmepe 4GL. Agụnyere ikikere ndị a na Pro2. Maka ịrụ ọrụ zuru oke nke DataServer maka Oracle nwere nchekwa data Oracle dịpụrụ adịpụ, etinyere onye ahịa Oracle zuru oke.

Na sava Oracle ịkwesịrị ịwụnye Oracle Database 12+, mepụta nchekwa data efu wee tinye onye ọrụ (ka anyị kpọọ ya). cdc).

Iji wụnye Pro2Oracle, budata nkesa kachasị ọhụrụ site na ebe nbudata Ngwanrọ Ọganihu. Wepu ihe ndekọ ahụ ka ọ bụrụ ndekọ C: Pro2 (Iji hazie Pro2 na Unix, a na-eji otu nkesa na otu ụkpụrụ nhazi ahụ na-etinye).

Ịmepụta nchekwa data mmụgharị cdc

nchekwa data ngbanwe cdc (repl) A na-eji Pro2 echekwa ozi nhazi, gụnyere maapụ mmegharị, aha ọdụ data emegharịgharị na tebụl ha. O nwekwara ahịrị mkpọgharị, nke nwere ndetu gbasara eziokwu na ahịrị tebụl dị na ebe nchekwa data agbanweela. A na-eji usoro ETL na-eji data sitere n'ahịrị ntugharịgharị iji chọpụta ahịrị ndị achọrọ ka e depụtaghachi ya na Oracle site na ebe nchekwa data isi mmalite.

Anyị na-eke nchekwa data cdc dị iche.

Usoro maka ịmepụta nchekwa data

1. Na sava nchekwa data anyị na-emepụta ndekọ maka nchekwa data cdc - dịka ọmụmaatụ, na ihe nkesa /database/cdc/.
2. Mepụta dummy maka nchekwa data cdc: procopy $DLC/cdc efu
3. Kwado nkwado maka nnukwu faịlụ: proutil cdc -C EnableLargeFiles
4. Anyị na-akwado edemede maka ịmalite nchekwa data cdc. Ntọala mmalite ga-adị ka mmalite mmalite nke nchekwa data emegharịgharịrị.
5. Anyị na-amalite nchekwa data cdc.
6. Jikọọ na cdc nchekwa data wee buo Pro2 schema na faịlụ cdc.df, nke agụnyere na Pro2.
7. Anyị na-ekepụta ndị ọrụ na nchekwa data cdc:

pro2adm - maka ijikọ site na Pro2 nhazi panel;
pro2etl - maka ijikọ usoro ETL (ReplBatch);
pro2cdc - maka ijikọ usoro CDC (CDCBatch);

Na-eme ka Mgbanwe Mgbanwe Data OpenEdge rụọ ọrụ

Ugbu a, ka anyị gbanye usoro CDC n'onwe ya, site n'enyemaka nke data a ga-emegharị na mpaghara teknụzụ ọzọ. Na nchekwa data isi mmalite OpenEdge nke ọ bụla, ịkwesịrị ịgbakwunye ebe nchekwa dị iche iche nke a ga-edegharị data isi mmalite ya, wee rụọ ọrụ n'onwe ya site na iji iwu ahụ. proutil.

Usoro ihe atụ maka nchekwa data bisquit

1. Na-eṅomi site na katalọgụ C: Pro2db faịlụ cdcadd.st gaa na ndekọ ndekọ data isi mmalite bisquit.
2. Anyị na-akọwa na cdcadd.st ofo size ókè maka mpaghara "ReplCDCArea" и "ReplCDCArea_IDX". Ị nwere ike itinye ebe nchekwa ọhụrụ n'ịntanetị: prostrct addonline bisquit cdcadd.st
3. Mee ka OpenEdge CDC rụọ ọrụ:
   proutil bisquit -C ikikecdc mpaghara "ReplCDCArea" indexarea "ReplCDCArea_IDX"
4. Ndị ọrụ ndị a ga-emerịrị na nchekwa data isi mmalite iji chọpụta usoro na-agba ọsọ:
   a. pro2adm - maka ijikọ site na ngalaba nhazi Pro2.
   b. pro2etl - maka ijikọ usoro ETL (ReplBatch).
   c. pro2cdc - maka ijikọ usoro CDC (CDCBatch).

Ịmepụta ihe njide Schema maka DataServer maka Oracle

Na-esote, anyị kwesịrị ịmepụta nchekwa data Schema Holder na ihe nkesa ebe data sitere na DBMS Ọganihu ga-emegharị na Oracle DBMS. DataServer Schema Holder bụ nchekwa data OpenEdge ọganihu efu na-enweghị ndị ọrụ ma ọ bụ data ngwa, nwere maapụ akwụkwọ ozi n'etiti tebụl isi iyi na tebụl Oracle mpụga.

Ebe nchekwa data nke Schema maka Ọganihu OpenEdge DataServer maka Oracle maka Pro2 ga-adịrịrị na sava ETL ka emepụtara ya iche maka alaka ụlọ ọrụ ọ bụla.

Otu esi emepụta ihe njide Schema

1. Wepu nkesa Pro2 ka ọ bụrụ ndekọ /pro2
2. Mepụta wee gaa na ndekọ /pro2/dbsh
3. Jiri iwu a mepụta nchekwa data ejidere Schema detuo $DLC/ bisquitsh efu
4. Na-eme ntụgharị bisquitsh n'ime koodu achọrọ - dịka ọmụmaatụ, na UTF-8 ma ọ bụrụ na ọdụ data Oracle nwere UTF-8: proutil bisquitsh -C convchar tọghatara UTF-8
5. Mgbe ịmepụtara nchekwa data efu bisquitsh jikọọ na ya na ọnọdụ otu onye ọrụ: pro bisquitsh
6. Ka anyị gaa na ọkọwa okwu data: Ngwaọrụ -> Akwụkwọ ọkọwa okwu -> DataServer -> Ọrụ ORACLE -> Mepụta Schema DataServer
7. Ẹkedori Schema Holder
8. Ịtọlite ​​onye na-ere ahịa Oracle DataServer:
   a. Malite AdminServer.
   proadsv - mmalite
   b. Mmalite nke onye na-ere ahịa Oracle DataServer
   oraman - aha orabroker1 -bido

Ịtọlite ​​​​ogwe njikwa na atụmatụ mmegharị

N'iji nhazi nhazi Pro2, a na-ahazi paramita Pro2, gụnyere ịtọlite ​​​​atụmatụ mmegharị na ịmepụta usoro ETL (Ọbá akwụkwọ Processor), mmemme mmekọrịta mbụ (Onwe-Copy Processor), ihe na-akpali akpali na OpenEdge CDC atumatu. Enwekwara ngwaọrụ ndị bụ isi maka nlekota na ijikwa usoro ETL na CDC. Nke mbụ, anyị na-edozi faịlụ paramita.

Otu esi ahazi faịlụ paramita

1. Gaa na katalọgụ C: Pro2bpreplScripts
2. Mepee faịlụ maka ndezi replProc.pf
3. Tinye paramita njikọ na nchekwa data mmụgharị cdc:
   # Ebe nchekwa data megharịa
   -db cdc -ld repl -H <aha isi nchekwa data> -S <ọdụ ụgbọ mmiri cdc ọdụ data>
   -U pro2admin -P <paswọọdụ>
4. gbakwunye na replProc.pf paramita njikọ na ọdụ data isi iyi na Schema Holder n'ụdị faịlụ oke. Aha faịlụ parampat ga-adakọrịrị na aha ebe nchekwa data ejikọrọ.
   # Jikọọ na isi mmalite niile emegharịrị BISQUIT
   -pf bpreplscriptsbisquit.pf
5. gbakwunye na replProc.pf paramita maka ijikọ na njide Schema.
   #Target Pro DB Schema njide
   -db bisquitsh -ld bisquitsh
   -H <ETL usoro nnabata aha>
   -S <biskuitsh ọdụ ụgbọ mmiri>
   -db bisquitsql
   -ld bisquitsql
   -dt ORACLE
   -S 5162 -H <aha nnabata nke onye na-ere ahịa Oracle>
   -DataService orbroker1
6. Chekwaa faịlụ parameters replProc.pf
7. Na-esote, ịkwesịrị ịmepụta na mepee maka idezi faịlụ paramita maka nchekwa data isi iyi ọ bụla ejikọrọ na ndekọ C:Pro2bpreplScripts: bisquit.pf. Faịlụ pf ọ bụla nwere paramita maka ijikọ na nchekwa data kwekọrọ, dịka ọmụmaatụ:
   -db bisquit -ld bisquit -H <aha nnabata> -S <ọdụ ụgbọ mmiri>
   -U pro2admin -P <paswọọdụ>

Iji hazie ụzọ mkpirisi Windows, ịkwesịrị ịga na ndekọ C: Pro2bpreplScripts ma dezie ụzọ mkpirisi "Pro2 - nchịkwa". Iji mee nke a, mepee njirimara nke ụzọ mkpirisi na n'ahịrị Bido n'ime gosi akwụkwọ ndekọ nrụnye Pro2. A ghaghị ime ọrụ yiri nke ahụ maka ụzọ mkpirisi "Pro2 - Editor" na "RunBulkLoader".

Ntọala nchịkwa Pro2: Na-ebunye nhazi mbido

Ka anyị malite console.

Gaa na "DB Map".

Iji jikọta ọdụ data na Pro2 - nchịkwa, gaa na taabụ DB Map. Tinye nkewa nke ọdụ data isi mmalite - Ihe njide Schema - Oracle.

Gaa na taabụ nkewa. Edepụtara Ebe nchekwa data isi mmalite Site na ndabara, ahọpụtara nchekwa data isi mmalite ejikọrọ. N'aka nri nke ndepụta ahụ kwesịrị inwe ihe odide Ejikọrọ ọdụ data niile - ejikọrọ ọdụ data ahọpụtara. N'okpuru aka ekpe ị ga-ahụ ndepụta nke tebụl ọganihu sitere na bisquit. N'aka nri bụ ndepụta tebụl sitere na nchekwa data Oracle.

Ịmepụta atụmatụ SQL na ọdụ data na Oracle

Iji mepụta maapụ mmegharị, ị ga-ebu ụzọ mepụta SQL atụmatụ na Oracle. Na nchịkwa Pro2 anyị na-eme ihe menu Ngwaọrụ -> Mepụta koodu -> Atụmatụ ebumnuche, wee na igbe okwu Họrọ Ebe nchekwa data họrọ otu ma ọ bụ karịa isi iyi ọdụ data wee bugharịa ha n'aka nri.

Pịa OK wee họrọ ndekọ ka ịchekwaa schemas SQL.

Ọzọ anyị na-emepụta isi. Enwere ike ime nke a, dịka ọmụmaatụ, site na Oracle SQL Onye Mmepụta. Iji mee nke a, anyị na-ejikọta na nchekwa data Oracle wee buru atụmatụ maka ịgbakwunye tebụl. Mgbe ịgbanwechara nhazi nke tebụl Oracle, ịkwesịrị imelite atụmatụ SQL na njide Schema.

Mgbe emechara nbudata ahụ nke ọma, pụọ na nchekwa data bisquitsh wee mepee panel nhazi Pro2. Tebụl sitere na nchekwa data Oracle kwesịrị ịpụta na taabụ Mapping n'aka nri.

Tebụl maapụ

Iji mepụta maapụ mmegharịgharị, na ngalaba nhazi Pro2, gaa na taabụ Mapping wee họrọ nchekwa data isi mmalite. Pịa na tebụl Map, họrọ Mgbanwe n'aka ekpe nke tebụl ndị a ga-emegharị na Oracle, bugharịa ha n'aka nri wee kwado nhọrọ ahụ. A ga-emepụta maapụ na-akpaghị aka maka tebụl ahọpụtara. Anyị na-emeghachi ọrụ ahụ iji mepụta maapụ mmegharị maka ọdụ data isi mmalite ndị ọzọ.

Na-amụba Ọbá akwụkwọ Pro2 Replication Processor yana Mmemme Nhazi nke nnukwu

Emebere ọbá akwụkwọ Processor Replication maka usoro mmegharị omenala (ETL) nke na-ahazi kwụ n'ahịrị Pro2 ma na-atụgharị mgbanwe na nchekwa data Oracle. A na-echekwa mmemme ọbá akwụkwọ nrụgharịgharị na-akpaghị aka na ndekọ mgbe ọgbọ gachara bprepl/repl_proc (nha PROC_DIRECTORY). Ka iwepụta ọba akwụkwọ nhazigharị, gaa na Ngwaọrụ -> Mepụta koodu -> Ọbá akwụkwọ nhazi. Mgbe emechara ọgbọ, mmemme ahụ ga-apụta na ndekọ bprepl/repl_proc.

A na-eji mmemme Processor nnukwu ibu iji mekọrịta ọdụ data Ọganihu isi mmalite yana nchekwa data Oracle ebumnuche dabere na asụsụ mmemme Progress ABL (4GL). Iji mepụta ha, gaa na ihe menu Ngwaọrụ -> Mepụta koodu -> Ihe nrụpụta nnukwu nnomi. N'ime igbe okwu Họrọ Database, họrọ ọdụ data isi iyi, bugharịa ha n'akụkụ aka nri nke mpio wee pịa OK. Mgbe emechara ọgbọ, mmemme ga-apụta na ndekọ bpreplrepl_mproc.

Ịtọlite ​​​​usoro mmegharị na Pro2

Ịkewaa tebụl n'ime setịpụ nke eriri mmegharị dị iche na-arụ na-eme ka arụmọrụ na arụmọrụ nke Pro2 Oracle dịkwuo mma. Site na ndabara, njikọ niile emepụtara na map mmegharị maka tebụl mmegharị ọhụrụ na-ejikọta ya na nọmba eri 1. A na-atụ aro ikewapụ tebụl n'ime eriri dị iche iche.

A na-egosipụta ozi gbasara ọkwa nke eriri mmegharị n'ihuenyo nchịkwa Pro2 na taabụ Monitor na ngalaba Ọnọdụ Mmụgharị. Enwere ike ịchọta nkọwa zuru ezu nke ụkpụrụ paramita na akwụkwọ Pro2 (akwụkwọ ndekọ aha C: Pro2Docs).

Mepụta ma rụọ ọrụ amụma CDC

Atumatu bụ usoro iwu maka igwe OpenEdge CDC iji nyochaa mgbanwe na tebụl. N'oge ederede, Pro2 na-akwado naanị amụma CDC na ọkwa 0, ya bụ, naanị eziokwu ka a na-enyocha ndekọ mgbanwe.

Iji mepụta amụma CDC, na panel nhazi, gaa na taabụ Mapping, họrọ ebe nchekwa data wee pịa bọtịnụ Tinye/Wepụ Atumatu. Na mpio Họrọ mgbanwe na-emepe, họrọ n'akụkụ aka ekpe wee gaa n'aka nri tebụl nke ịchọrọ ịmepụta ma ọ bụ hichapụ amụma CDC.

Iji mee ka ọ rụọ ọrụ, mepee taabụ Mapping ọzọ, họrọ nchekwa data isi iyi wee pịa bọtịnụ (N'ime) Mee ka amụma rụọ ọrụ. Họrọ wee gaa n'akụkụ aka nri nke tebụl atumatu ndị achọrọ ịgbalite, pịa OK. Mgbe nke a gasịrị, a na-akara ha na akwụkwọ ndụ akwụkwọ ndụ. Site n'iji (N'ime) Mee ka amụma rụọ ọrụ Ị nwekwara ike gbanyụọ amụma CDC. A na-eme azụmahịa niile n'ịntanetị.

Ka emechara iwu CDC rụọ ọrụ, a na-echekwa ndetu gbasara ndekọ emezigharịrị na mpaghara nchekwa "ReplCDCArea" dị ka isi iyi nchekwa data. A ga-ahazi ndetu ndị a site na usoro pụrụ iche CDCBatch, nke dabere na ha ga-emepụta ndetu na Pro2 replication kwụ n'ahịrị na nchekwa data cdc (repl).

Ya mere, anyị nwere ahịrị abụọ maka mmegharị. Nzọụkwụ mbụ bụ CDCBatch: site na ebe nchekwa data, data na-ebu ụzọ gaa na nchekwa data CDC etiti. Usoro nke abụọ bụ mgbe ebufe data site na nchekwa data CDC gaa na Oracle. Nke a bụ akụkụ nke ụkpụrụ ụlọ dị ugbu a na ngwaahịa n'onwe ya - ruo ugbu a ndị mmepe enwebeghị ike ịmepụta mmegharị ozugbo.

Mmekọrịta izizi

Mgbe ịmechara usoro CDC na ịtọlite ​​​​sava replication Pro2, anyị kwesịrị ịmalite mmekọrịta mbụ. Iwu mmekọrịta izizi:

/pro2/bprepl/Script/replLoad.sh bisquit table-aha

Mgbe emechara mmekọrịta mbụ, enwere ike ịmalite usoro ntugharị.

Mmalite nke usoro mmeghari

Iji malite usoro mmegharị, ịkwesịrị ịme edemede replbatch.sh. Tupu ịmalite, gbaa mbọ hụ na enwere scripts replbatch maka eri niile - replbatch1, replbatch2, wdg. Ọ bụrụ na ihe niile dị, mepee ahịrị iwu (dịka ọmụmaatụ, proenv), gaa na ndekọ /bprepl/scripts ma malite edemede ahụ. Na nchịkwa nchịkwa, anyị na-elele na usoro kwekọrọ enwetala ọnọdụ RUNNING.

Результаты

Mgbe mmejuputa atumatu, anyị mere ngwa ngwa bulite ozi n'ụlọ nkwakọba data ụlọ ọrụ. Data ahụ na-abanye na Oracle na-akpaghị aka. Ọ dịghị mkpa igbubi oge na-agba ọsọ ụfọdụ ajụjụ na-agba ọsọ iji nakọta data sitere na usoro dị iche iche. Tụkwasị na nke a, na ngwọta a, usoro ntụgharị nwere ike ịpịkọta data, nke nwekwara mmetụta dị mma na ọsọ ọsọ. Ugbu a, ngbanwe nke usoro BISKVIT kwa ụbọchị na sistemụ ndị ọzọ malitere iwere 15-20 nkeji kama awa 2-2,5, na ngbanwe zuru oke were ọtụtụ awa kama ụbọchị abụọ.

isi: www.habr.com