{"id":34842,"date":"2019-10-31T22:00:43","date_gmt":"2019-10-31T19:00:43","guid":{"rendered":"https:\/\/prohoster.info\/blog\/ot-ezhednevnyh-avarij-k-stabilnosti-informatica-10-glazami-admina\/"},"modified":"2019-10-31T22:00:43","modified_gmt":"2019-10-31T19:00:43","slug":"ot-ezhednevnyh-avarij-k-stabilnosti-informatica-10-glazami-admina","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/ot-ezhednevnyh-avarij-k-stabilnosti-informatica-10-glazami-admina","title":{"rendered":"Nga fatkeq\u00ebsit\u00eb e p\u00ebrditshme n\u00eb stabilitet: Informatica 10 p\u00ebrmes syve t\u00eb administratorit","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

\"Nga<\/a><\/noindex><\/p>\n

Komponenti ETL i magazinit t\u00eb dh\u00ebnash shpesh mbetet n\u00eb hije t\u00eb magazinit vet\u00eb dhe i jepet m\u00eb pak v\u00ebmendje se sa baz\u00ebs s\u00eb t\u00eb dh\u00ebnave kryesore ose komponent\u00ebve t\u00eb front-end, BI, p\u00ebrgatitjes s\u00eb raporteve. Megjithat\u00eb, nga pik\u00ebpamja e mekanik\u00ebs s\u00eb mbushjes s\u00eb magazin\u00ebs me t\u00eb dh\u00ebna, ETL luan nj\u00eb rol ky\u00e7 dhe k\u00ebrkon jo m\u00eb pak v\u00ebmendje nga administrator\u00ebt sesa komponent\u00ebt e tjer\u00eb. M\u00eb quaj Alexander, tani un\u00eb administratoj ETL-n\u00eb n\u00eb Rostelecom, dhe n\u00eb k\u00ebt\u00eb artikull do t\u00eb p\u00ebrpiqem t\u00eb ndaj pak nga ajo q\u00eb has nj\u00eb administrator i nj\u00eb prej sistemeve ETL m\u00eb t\u00eb njohura n\u00eb nj\u00eb magazin t\u00eb madhe t\u00eb dh\u00ebnash t\u00eb kompanis\u00eb Rostelecom.
\n<\/a><\/noindex>
\nN\u00ebse lexuesit e nderuar jan\u00eb t\u00eb njohur n\u00eb p\u00ebrgjith\u00ebsi me projektin ton\u00eb t\u00eb magazin\u00ebs s\u00eb t\u00eb dh\u00ebnave dhe me produktin Informatica PowerCenter, at\u00ebher\u00eb mund t\u00eb kaloni menj\u00ebher\u00eb n\u00eb seksionin tjet\u00ebr.<\/p>\n

Disa vjet m\u00eb par\u00eb, n\u00eb Rostelecom u krijua dhe filloi t\u00eb realizohet ideja e nj\u00eb magazin\u00ebs s\u00eb centralizuar t\u00eb dh\u00ebnash. Nj\u00eb s\u00ebr\u00eb magazinash, q\u00eb zgjidhnin detyra t\u00eb ve\u00e7anta, ishin krijuar tashm\u00eb, por numri i skenar\u00ebve po rritej, kostot p\u00ebr mb\u00ebshtetje gjithashtu po rriteshin, dhe b\u00ebhej e qart\u00eb se e ardhmja \u00ebsht\u00eb n\u00eb centralizim. Arkitektonikisht, kjo magazin\u00eb p\u00ebrb\u00ebhet nga disa nivele, t\u00eb realizuara n\u00eb Hadoop dhe GreenPlum, bazat ndihm\u00ebse t\u00eb dh\u00ebnash, mekanizmat ETL dhe BI.<\/p>\n

Megjithat\u00eb, p\u00ebr shkak t\u00eb numrit t\u00eb madh t\u00eb burimeve t\u00eb dh\u00ebnash q\u00eb jan\u00eb t\u00eb shp\u00ebrndara gjeografikisht dhe t\u00eb ndryshme, u krijua nj\u00eb mekaniz\u00ebm i ve\u00e7ant\u00eb p\u00ebr eksportimin e t\u00eb dh\u00ebnave, i cili drejtohet nga Informatica. Si rezultat, paketat me t\u00eb dh\u00ebna p\u00ebrfundojn\u00eb n\u00eb zon\u00ebn nd\u00ebrfaq\u00ebsore t\u00eb Hadoop, pas s\u00eb cil\u00ebs fillojn\u00eb proceset e ngarkes\u00ebs s\u00eb t\u00eb dh\u00ebnave n\u00ebp\u00ebr nivelet e magazin\u00ebs, n\u00eb Hadoop dhe GreenPlum, t\u00eb cilat menaxhohen nga mekanizmi i quajtur ETL, i realizuar n\u00eb Informatica. Th\u00ebn\u00eb k\u00ebshtu, sistemi Informatica \u00ebsht\u00eb nj\u00eb nga element\u00ebt kryesor\u00eb q\u00eb sigurojn\u00eb funksionimin e magazin\u00ebs.<\/p>\n

M\u00eb n\u00eb detaje p\u00ebr magazin\u00ebn ton\u00eb do t\u00eb flitet n\u00eb nj\u00eb nga postimet e ardhshme.<\/p>\n

Informatica PowerCenter\/Big Data Management n\u00eb k\u00ebt\u00eb moment konsiderohet si softueri lider n\u00eb fush\u00ebn e mjeteve p\u00ebr integrimin e t\u00eb dh\u00ebnave. Ky \u00ebsht\u00eb nj\u00eb produkt i kompanis\u00eb amerikane Informatica, e cila \u00ebsht\u00eb nj\u00eb nga lojtar\u00ebt m\u00eb t\u00eb fort\u00eb n\u00eb ETL (Extract Transform Load), menaxhimin e cil\u00ebsis\u00eb s\u00eb t\u00eb dh\u00ebnave, MDM (Master Data Management), ILM (Information Lifecycle Management) dhe t\u00eb tjer\u00eb.<\/p>\n

PowerCenter q\u00eb p\u00ebrdorim \u00ebsht\u00eb nj\u00eb server i integruar aplikacionesh Tomcat, n\u00eb t\u00eb cilin operojn\u00eb aplikacionet e Informatica, q\u00eb realizojn\u00eb sh\u00ebrbimet e saj: <\/p>\n

Domen<\/b>, n\u00eb thelb, \u00ebsht\u00eb baza p\u00ebr gjith\u00e7ka tjet\u00ebr, brenda domainit funksionojn\u00eb sh\u00ebrbimet, p\u00ebrdoruesit, komponent\u00ebt e GRID.<\/p>\n

Administrator Console<\/b>, mjeti web p\u00ebr menaxhim dhe monitorim, p\u00ebrve\u00e7 klientit Informatica Developer, \u00ebsht\u00eb mjeti kryesor p\u00ebr t\u00eb nd\u00ebrlidhur me produktin<\/p>\n

MRS, Model Repository Service<\/b>, magazina e metadatat, p\u00ebrfaq\u00ebson nj\u00eb shtres\u00eb midis baz\u00ebs ku metadatat ruhen fizikisht dhe klientit Informatica Developer, ku zhvillohet. Repository-t ruajn\u00eb dhe p\u00ebrshkrimin e t\u00eb dh\u00ebnave, dhe informacionin tjet\u00ebr, p\u00ebrfshir\u00eb p\u00ebr nj\u00eb s\u00ebr\u00eb sh\u00ebrbimesh t\u00eb tjera t\u00eb Informatica, p\u00ebr shembull, orarin e ekzekutimeve t\u00eb detyrave (Schedules) ose t\u00eb dh\u00ebnat e monitorimit, si dhe paramet\u00ebrset e aplikacioneve, q\u00eb ve\u00e7an\u00ebrisht lejojn\u00eb p\u00ebrdorimin e nj\u00eb dhe t\u00eb nj\u00ebjt\u00ebs aplikacion p\u00ebr t\u00eb punuar me burime dhe marr\u00ebs t\u00eb ndrysh\u00ebm t\u00eb t\u00eb dh\u00ebnave.<\/p>\n

DIS, Data Integration Service<\/b>, ky \u00ebsht\u00eb sh\u00ebrbimi ku ndodhin proceset funksionale kryesore, n\u00eb t\u00eb operojn\u00eb aplikacionet dhe ndodhin fillimet e Workflows (p\u00ebrshkrimi i sekuencave t\u00eb mappings dhe nd\u00ebrveprimi i tyre) dhe Mappings (transformime, blloqe ku ndodhin vet\u00eb transformimet, p\u00ebrpunimi i t\u00eb dh\u00ebnave).<\/p>\n

Konfigurimi i GRID<\/b> \u2013 n\u00eb thelb, \u00ebsht\u00eb nj\u00eb variant nd\u00ebrtimi t\u00eb nj\u00eb kompleksi me p\u00ebrdorimin e disa server\u00ebve, kur ngarkesa e lan\u00e7uar nga DIS shp\u00ebrndahet n\u00eb node (dometh\u00ebn\u00eb server\u00ebve q\u00eb b\u00ebjn\u00eb pjes\u00eb n\u00eb domain). N\u00eb k\u00ebt\u00eb rast, p\u00ebrve\u00e7 shp\u00ebrndarjes n\u00eb DIS t\u00eb ngarkes\u00ebs p\u00ebrmes nj\u00eb shtrese shtes\u00eb abstrakte GRID, q\u00eb bashkon disa node, n\u00eb t\u00eb cilin dhe punon DIS n\u00eb vend t\u00eb punuarit n\u00eb nj\u00eb node t\u00eb caktuar, gjithashtu mund t\u00eb krijohen kopje rezerv\u00eb shtes\u00eb t\u00eb MRS. Madje mund t\u00eb realizohet disponueshm\u00ebri e lart\u00eb, kur k\u00ebrkesat e jashtme mund t\u00eb p\u00ebrpunohen p\u00ebrmes node-ve rezerv\u00eb n\u00eb rast t\u00eb d\u00ebshtimit t\u00eb atij kryesor. Nga ky variant nd\u00ebrtimi deri tani kemi hequr dor\u00eb.<\/p>\n

\"Nga
\nInformatica PowerCenter, n\u00eb m\u00ebnyr\u00eb schematike<\/i><\/p>\n

N\u00eb fillimet e pun\u00ebs brenda zinxhirit t\u00eb furnizimit t\u00eb t\u00eb dh\u00ebnave, rregullisht shfaqeshin probleme, disa prej t\u00eb cilave p\u00ebr shkak t\u00eb pun\u00ebs jo t\u00eb q\u00ebndrueshme t\u00eb Informatica n\u00eb at\u00eb moment. Un\u00eb do t\u00eb ndaj disa nga momentet e paharrueshme t\u00eb k\u00ebsaj saga \u2014 mastering Informatica 10.<\/p>\n

\"Nga
\nLogotipas Informatica<\/i><\/p>\n

Fusha e p\u00ebrgjegj\u00ebsis\u00eb son\u00eb p\u00ebrfshin gjithashtu mjedise t\u00eb tjera t\u00eb Informatica, q\u00eb kan\u00eb specifikat e tyre p\u00ebr shkak t\u00eb ngarkesave t\u00eb ndryshme; p\u00ebr momentin, un\u00eb do t\u00eb p\u00ebrmend ve\u00e7an\u00ebrisht si Informatica \u00ebsht\u00eb zhvilluar si komponent ETL i vet\u00eb magazin\u00ebs s\u00eb t\u00eb dh\u00ebnave.<\/p>\n

Si ndodhi kjo<\/h2>\n

\nN\u00eb vitin 2016, kur filluam t\u00eb p\u00ebrgjigjeshim p\u00ebr funksionimin e Informatica, ajo kishte arritur tashm\u00eb versionin 10.0, dhe p\u00ebr koleg\u00ebt me optimiz\u00ebm q\u00eb merrnin vendim p\u00ebr p\u00ebrdorimin e nj\u00eb produkti me versionin m\u00eb t\u00eb vog\u00ebl .0, gjith\u00e7ka dukej e qart\u00eb \u2014 duhej t\u00eb p\u00ebrdorej versioni i ri! Sa i p\u00ebrket burimeve harduerike, gjith\u00e7ka ishte n\u00eb rregull n\u00eb at\u00eb moment.<\/p>\n

Q\u00eb nga pranvera e vitit 2016, menaxhimin e Informatica e kishte nj\u00eb kontraktues, dhe sipas fjal\u00ebve t\u00eb pakic\u00ebs s\u00eb p\u00ebrdoruesve t\u00eb sistemit, \u201cajo punonte disa her\u00eb n\u00eb jav\u00eb\u201d. Duhet t\u00eb sqarojm\u00eb se t\u00eb dh\u00ebnat ishin de-fakto n\u00eb faz\u00ebn PoC, nuk kishte administrator\u00eb n\u00eb ekip dhe sistemi vazhdimisht rr\u00ebzohej p\u00ebr arsye t\u00eb ndryshme, pas s\u00eb cil\u00ebs inxhinieri i kontraktuesit e rihapte at\u00eb.<\/p>\n

N\u00eb vjesht\u00eb, n\u00eb ekip u shfaq\u00ebn tre administrator\u00eb, t\u00eb cil\u00ebt ndan\u00eb mes tyre fushat e p\u00ebrgjegj\u00ebsis\u00eb, dhe filloi t\u00eb nd\u00ebrtohej nj\u00eb pun\u00eb normale p\u00ebr administrimin e sistemeve n\u00eb projekt, duke p\u00ebrfshir\u00eb Informatica. Duhet th\u00ebn\u00eb ve\u00e7mas se ky produkt nuk \u00ebsht\u00eb shum\u00eb i p\u00ebrhapur dhe nuk ka nj\u00eb komunitet t\u00eb gjer\u00eb, n\u00eb t\u00eb cilin mund t\u00eb gjeni p\u00ebrgjigje p\u00ebr \u00e7do pyetje dhe t\u00eb zgjidhni \u00e7do problem. Prandaj, mb\u00ebshtetje teknike e plot\u00eb nga partneri yn\u00eb rus i Informatica ishte shum\u00eb e r\u00ebnd\u00ebsishme, me ndihm\u00ebn e t\u00eb cilit u korrigjua \u00e7do gabim yn\u00eb dhe ato t\u00eb Informatica 10, e cila ishte akoma e re.<\/p>\n

E para q\u00eb duhej t\u00eb b\u00ebnim p\u00ebr zhvilluesit e ekipit ton\u00eb dhe kontraktuesin ishte stabilizimi i funksionimit t\u00eb vet\u00eb Informatica, duke arritur funksionalitetin e konsol\u00ebs s\u00eb administrimit n\u00eb rrjet (Informatica Administrator).<\/p>\n

\"Nga
\nNdonj\u00ebher\u00eb, zhvilluesit e Informatica na kan\u00eb pritur k\u00ebshtu<\/i><\/p>\n

Duke l\u00ebn\u00eb jasht\u00eb procesin e sqarimit t\u00eb arsyeve, arsyeja kryesore e rr\u00ebzimeve ishte skema e nd\u00ebrveprimit t\u00eb softuerit Informatica me baz\u00ebn e t\u00eb dh\u00ebnave t\u00eb depozit\u00ebs, e cila ndodhej n\u00eb nj\u00eb server relativisht t\u00eb larg\u00ebt, nga k\u00ebndv\u00ebshtrimi i peizazhit rrjetor. Kjo shkaktonte vonesa dhe d\u00ebmtonte funksionimin e mekanizmave q\u00eb siguronin kontrollin e gjendjes s\u00eb domain-it t\u00eb Informatica. Pas nj\u00eb optimizimi t\u00eb caktuar t\u00eb baz\u00ebs s\u00eb t\u00eb dh\u00ebnave, nd\u00ebrrimit t\u00eb parametrave t\u00eb Informatica q\u00eb e b\u00ebn\u00eb at\u00eb m\u00eb tolerant ndaj vonesave t\u00eb baz\u00ebs s\u00eb t\u00eb dh\u00ebnave, dhe p\u00ebrfundimisht p\u00ebrdit\u00ebsimit t\u00eb versionit t\u00eb Informatica n\u00eb 10.1 dhe transferimin e baz\u00ebs s\u00eb t\u00eb dh\u00ebnave nga serveri i m\u00ebparsh\u00ebm n\u00eb nj\u00eb server m\u00eb t\u00eb af\u00ebrt me Informatica, problemi humbi r\u00ebnd\u00ebsin\u00eb, dhe q\u00eb nga at\u00ebher\u00eb nuk kemi v\u00ebrejtur r\u00ebnie t\u00eb k\u00ebtij lloji.<\/p>\n

\"Nga
\nNj\u00eb nga p\u00ebrpjekjet p\u00ebr t\u00eb arritur funksionalitetin e Informatica Monitor<\/i><\/p>\n

Situata me konsol\u00ebn e administrimit ishte gjithashtu kritike. Nd\u00ebrsa zhvillimi po vazhdonte aktivisht direkt n\u00eb nj\u00eb mjedis t\u00eb ashtuquajtur produktiv, koleg\u00ebt shpesh kishin nevoj\u00eb t\u00eb analizojn\u00eb funksionimin e mappings, workflow \u201cn\u00eb ecje\u201d. N\u00eb Informatica t\u00eb re, n\u00eb Sh\u00ebrbimin e Integrimit t\u00eb T\u00eb Dh\u00ebnave, nuk ka nj\u00eb mjet t\u00eb ve\u00e7ant\u00eb p\u00ebr monitorimin e till\u00eb, por n\u00eb konsol\u00ebn web t\u00eb administrimit ka lindur nj\u00eb seksion monitorimi (Informatica Administrator Monitor), ku mund t\u00eb v\u00ebrehet funksionimi i aplikacioneve, workflow dhe mappings, ekzekutimet, logjet. Her\u00eb pas here, konsola b\u00ebhej krejt\u00ebsisht e paarritshme, ose informacionet p\u00ebr proceset aktuale n\u00eb DIS ndalonin s\u00eb p\u00ebrdit\u00ebsuari, ose ndodhnin gabime gjat\u00eb ngarkimit t\u00eb faqeve.<\/p>\n

\"Nga
\nZgjedhja e parametrave java p\u00ebr stabilizimin e funksionimit<\/i><\/p>\n

Rregullimi i problemit po p\u00ebrparonte n\u00eb shum\u00eb m\u00ebnyra, eksperimentet p\u00ebr ndryshimin e parametrave ishin duke u zhvilluar, logjet dhe jstack u mbledh\u00ebn, dhe u d\u00ebrguan n\u00eb mb\u00ebshtetje, p\u00ebrve\u00e7 k\u00ebsaj, po zhvillohej k\u00ebrkimi aktiv n\u00eb Google dhe vet\u00ebm po v\u00ebzhgohej.<\/p>\n

Fillimisht u krijua nj\u00eb MRS t\u00eb ve\u00e7ant\u00eb p\u00ebr monitorim, si\u00e7 u v\u00ebrtetua m\u00eb von\u00eb, ky ishte nj\u00eb nga konsumator\u00ebt kryesor\u00eb t\u00eb burimeve n\u00eb mjediset tona, pasi ekzekutimet e mappings ishin shum\u00eb intensive. U nd\u00ebrruan parametrat q\u00eb kishin t\u00eb b\u00ebnin me java heap, dhe nj\u00eb s\u00ebr\u00eb parametrash t\u00eb tjer\u00eb.
\nSi rezultat, deri n\u00eb p\u00ebrdit\u00ebsimin e ardhsh\u00ebm t\u00eb Informatica 10.1.1, funksionimi i konsol\u00ebs dhe monitorit arriti t\u00eb stabilizohet, zhvilluesit filluan t\u00eb punonin m\u00eb efektivisht dhe proceset e rregullta po b\u00ebheshin gjithnj\u00eb e m\u00eb t\u00eb shpeshta.<\/p>\n

Nj\u00eb p\u00ebrvoj\u00eb interesante mund t\u00eb jet\u00eb bashk\u00ebpunimi nd\u00ebrmjet zhvillimit dhe administrat\u00ebs. Pyetja e kuptimit t\u00eb p\u00ebrbashk\u00ebt, si funksionon gjith\u00e7ka, \u00e7far\u00eb \u00ebsht\u00eb e mundur t\u00eb b\u00ebhet dhe \u00e7far\u00eb jo, gjithmon\u00eb \u00ebsht\u00eb e r\u00ebnd\u00ebsishme kur p\u00ebrdoren sisteme t\u00eb komplikuara. Prandaj, mund t\u00eb rekomandohet me besim q\u00eb s\u00eb pari t\u00eb trajnohet ekipi i administrator\u00ebve se si t\u00eb administrojn\u00eb softuerin, dhe ekipi i zhvilluesve se si t\u00eb shkruajn\u00eb kod dhe t\u00eb p\u00ebrshkruajn\u00eb proceset n\u00eb sistem, e m\u00eb pas t\u00eb d\u00ebrgohen t\u00eb par\u00ebt dhe t\u00eb dyt\u00eb p\u00ebr t\u00eb punuar p\u00ebr rezultat. Kjo \u00ebsht\u00eb v\u00ebrtet e r\u00ebnd\u00ebsishme kur koha nuk \u00ebsht\u00eb nj\u00eb burim i pakufizuar. Shum\u00eb probleme mund t\u00eb zgjidhen madje edhe me prov\u00eb dhe gabim, por ndonj\u00ebher\u00eb disa k\u00ebrkojn\u00eb njohuri a priori \u2014 rasti yn\u00eb konfirmon r\u00ebnd\u00ebsin\u00eb e kuptimit t\u00eb k\u00ebsaj aksiome.<\/p>\n

P\u00ebr shembull, kur u p\u00ebrpoq\u00ebm t\u00eb aktivizonim versionimin n\u00eb MRS (si\u00e7 rezultoi, kishte nevoj\u00eb p\u00ebr nj\u00eb version tjet\u00ebr SVN), pas nj\u00eb kohe ne e zbuluam me shqet\u00ebsim se koha e rillogaritjes s\u00eb sistemit ishte rritur n\u00eb disa dhjet\u00ebra minuta. Pas zbulimit t\u00eb shkakut t\u00eb vones\u00ebs s\u00eb nisjes dhe \u00e7aktivizimit t\u00eb versionimit, gj\u00ebrat u b\u00eb p\u00ebrs\u00ebri mir\u00eb.<\/p>\n

Nj\u00eb nga pengesat e dukshme q\u00eb lidhen me Informatica \u00ebsht\u00eb nj\u00eb luft\u00eb epike me rritjen e rrjedhave java. N\u00eb nj\u00eb moment, erdhi koha p\u00ebr t\u00eb klonuar, q\u00eb do t\u00eb thoshte t\u00eb shp\u00ebrndanin proceset e krijuara m\u00eb par\u00eb n\u00eb nj\u00eb num\u00ebr t\u00eb madh sistemesh burimi. Nd\u00ebrsa, rezultoi se jo t\u00eb gjitha proceset n\u00eb 10.1.1 funksiononin mir\u00eb, dhe pas nj\u00eb kohe DIS b\u00ebhej jo funksional. Zbuloheshin dhjet\u00ebra mij\u00ebra rrjedha, numri i t\u00eb cilave rritej ve\u00e7an\u00ebrisht gjat\u00eb procedur\u00ebs s\u00eb shp\u00ebrndarjes s\u00eb aplikacioneve. Her\u00eb pas here duhej t\u00eb b\u00ebhej nj\u00eb rillogaritje disa her\u00eb n\u00eb dit\u00eb p\u00ebr t\u00eb rikthyer funksionalitetin.<\/p>\n

K\u00ebtu, duhet t\u00eb fal\u00ebnderojm\u00eb mb\u00ebshtetjen, problemi u lokalizua dhe u riparua relativisht shpejt me ndihm\u00ebn e EBF (Emergency Bug Fix) \u2013 pas k\u00ebsaj, t\u00eb gjith\u00eb pat\u00ebn ndjenj\u00ebn se mjeti v\u00ebrtet funksionon.<\/p>\n

V\u00ebrtet funksionon!<\/h2>\n

\nN\u00eb momentin kur filluam pun\u00ebn n\u00eb modin e destinuar, Informatica dukej n\u00eb k\u00ebt\u00eb m\u00ebnyr\u00eb. Versioni Informatica 10.1.1HF1 (HF1 \u00ebsht\u00eb HotFix1, grumbullimi vendor nga kompleksi EBF) me EBF t\u00eb instaluara q\u00eb riparonin problemet tona me shkall\u00ebzimin dhe disa t\u00eb tjera, n\u00eb nj\u00eb server nga tre, q\u00eb ishin pjes\u00eb e GRID-it, 20 b\u00ebrthama x86_64 dhe ruajtje n\u00eb nj\u00eb masiv t\u00eb madh dhe t\u00eb ngadalt\u00eb diskesh lokal\u00eb \u2014 kjo konfigurimi i serverit<\/a> p\u00ebr klasterin Hadoop. N\u00eb nj\u00eb server tjet\u00ebr t\u00eb till\u00eb \u2014 DBMS Oracle me t\u00eb cilin punon dhe domeni Informatica dhe mekanizmi menaxhues ETL. T\u00eb gjitha k\u00ebto monitorohen me mjete t\u00eb zakonshme monitorimi, t\u00eb p\u00ebrdorura nga ekipi (Zabbix + Grafana), nga dy an\u00eb \u2014 si Informatica me sh\u00ebrbimet e saj, ashtu edhe proceset q\u00eb po ngarkohen n\u00eb t\u00eb. Tani, dhe performanca dhe stabiliteti i pun\u00ebs, pa marr\u00eb parasysh faktor\u00ebt e jasht\u00ebm, varen nga konfigurimet q\u00eb kufizojn\u00eb ngarkes\u00ebn.<\/p>\n

Ve\u00e7mas mund t\u00eb flasim p\u00ebr GRID. Ambienti u nd\u00ebrtua n\u00eb tre node, me mund\u00ebsi balancimi ngarkese. Megjithat\u00eb, gjat\u00eb testimit u zbulua se p\u00ebr shkak t\u00eb problemeve t\u00eb nd\u00ebrveprimit nd\u00ebrmjet instanceve t\u00eb aplikuara t\u00eb aplikacioneve tona, nj\u00eb konfigurim i till\u00eb nuk punonte ashtu si pritej, dhe p\u00ebrkoh\u00ebsisht u vendos t\u00eb hiqet nga kjo skem\u00eb nd\u00ebrtimi, duke nxjerr\u00eb dy nga tre node nga domeni. Megjithat\u00eb, vet\u00eb skema mbeti e nj\u00ebjt\u00eb, dhe tani \u00ebsht\u00eb pik\u00ebrisht sh\u00ebrbimi GRID, por i reduktuar n\u00eb nj\u00eb node.<\/p>\n

Pik\u00ebrisht tani, mbetet nj\u00eb v\u00ebshtir\u00ebsi q\u00eb lidhet me r\u00ebnien e performanc\u00ebs gjat\u00eb pastrimit t\u00eb rregullt t\u00eb skem\u00ebs s\u00eb monitorit \u2014 gjat\u00eb proceseve q\u00eb ndodhin n\u00eb m\u00ebnyr\u00eb t\u00eb p\u00ebrbashk\u00ebt dhe me pastrimin e aktivizuar, mund t\u00eb ndodhin d\u00ebshtime n\u00eb funksionin e mekanizmit menaxhues ETL. Kjo aktualisht zgjidhet \"me nj\u00eb zgjidhje t\u00eb p\u00ebrkohshme\" \u2014 pastrimi manual i skem\u00ebs s\u00eb monitorit, me humbjen e t\u00eb gjitha t\u00eb dh\u00ebnave t\u00eb saj t\u00eb m\u00ebparshme. Kjo nuk \u00ebsht\u00eb shum\u00eb kritike p\u00ebr produktivitetin, n\u00eb pun\u00ebn e zakonshme, por p\u00ebr momentin po k\u00ebrkohet nj\u00eb zgjidhje normale.<\/p>\n

Nga kjo situat\u00eb del nj\u00eb tjet\u00ebr problem \u2014 ndonj\u00ebher\u00eb ndodhin fillime t\u00eb shum\u00ebfishta t\u00eb mekanizmit ton\u00eb menaxhues.<\/p>\n

\"Nga
\nFillimet e shum\u00ebfishta t\u00eb aplikacionit, q\u00eb \u00e7ojn\u00eb n\u00eb d\u00ebshtimin e mekanizmit<\/i><\/p>\n

Kur aktivizohet sipas nj\u00eb grafiku n\u00eb momentet e ngarkesave t\u00eb m\u00ebdha n\u00eb sistem, ndonj\u00ebher\u00eb ndodhin situata t\u00eb tilla q\u00eb \u00e7ojn\u00eb n\u00eb d\u00ebshtimin e mekanizmit. Akoma problemi po riparohet manualisht, po k\u00ebrkohet nj\u00eb zgjidhje t\u00eb p\u00ebrhershme.<\/p>\n

N\u00eb p\u00ebrgjith\u00ebsi, mund t\u00eb p\u00ebrfundojm\u00eb se kur ka ngarkes\u00eb t\u00eb madhe, \u00ebsht\u00eb shum\u00eb e r\u00ebnd\u00ebsishme t\u00eb sigurohen burime adekuate, p\u00ebrfshir\u00eb burimet harduerike p\u00ebr vet\u00eb Informatica si dhe p\u00ebr depozit\u00ebn e saj t\u00eb DB-s\u00eb, si dhe t\u00eb sigurohen konfigurime optimale p\u00ebr to. P\u00ebr m\u00eb tep\u00ebr, mbetet hapur \u00e7\u00ebshtja se cila skem\u00eb vendosjeje e DB-s\u00eb \u00ebsht\u00eb m\u00eb e mir\u00eb - n\u00eb nj\u00eb host t\u00eb ve\u00e7ant\u00eb, ose n\u00eb t\u00eb nj\u00ebjtin me softuerin Informatica. Nga nj\u00ebra an\u00eb, \u00ebsht\u00eb m\u00eb e lir\u00eb ta mbash n\u00eb nj\u00eb server, dhe kjo eliminon pothuajse mund\u00ebsin\u00eb e problemeve me nd\u00ebrveprimin rrjet, nga ana tjet\u00ebr, ngarkesa nga DB-ja shtohet me ngarkes\u00ebn nga Informatica.<\/p>\n

Si n\u00eb \u00e7do produkt serioz, edhe n\u00eb Informatica ka momente komike.
\nNj\u00eb her\u00eb, duke analizuar nj\u00eb aksident, vura re se n\u00eb logjet MRS, koha e ngjarjeve ishte sh\u00ebnuar \u00e7uditsh\u00ebm.<\/p>\n

\"Nga
\nDualizmi temporal n\u00eb logjet MRS \"sip\u00ebr dizajnit\"<\/i><\/p>\n

Doli se shenjat e koh\u00ebs sh\u00ebnohen n\u00eb formatin 12-or\u00ebsh, pa treguar AM\/PM, dometh\u00ebn\u00eb para mesdit\u00ebs ose pas saj. Madje ishte hapur nj\u00eb k\u00ebrkes\u00eb p\u00ebr k\u00ebt\u00eb \u00e7\u00ebshtje, dhe u mor nj\u00eb p\u00ebrgjigje zyrtare - ishte menduar ashtu, shenjat n\u00eb logun MRS jan\u00eb pik\u00ebrisht n\u00eb k\u00ebt\u00eb format. Pra, ndonj\u00ebher\u00eb mbetet nj\u00eb mister i caktuar rreth koh\u00ebs s\u00eb ndodhis\u00eb s\u00eb ndonj\u00eb ERROR-i...<\/p>\n

T\u00eb d\u00ebshirosh m\u00eb t\u00eb mir\u00ebn<\/h2>\n

\nSot, Informatica \u00ebsht\u00eb nj\u00eb mjet mjaft i q\u00ebndruesh\u00ebm, i p\u00ebrshtatsh\u00ebm p\u00ebr administrator\u00ebt dhe p\u00ebrdoruesit, jasht\u00ebzakonisht i fuqish\u00ebm p\u00ebr mund\u00ebsit\u00eb aktuale dhe potencialin e tij. Ai shum\u00ebfish kalon nevojat tona dhe aktualisht p\u00ebrdoret n\u00eb nj\u00eb projekt n\u00eb m\u00ebnyr\u00eb jo shum\u00eb karakteristike dhe tipike. V\u00ebshtir\u00ebsit\u00eb kan\u00eb t\u00eb b\u00ebjn\u00eb pjes\u00ebrisht me m\u00ebnyr\u00ebn se si funksionojn\u00eb mekanizmat - specifika \u00ebsht\u00eb se n\u00eb nj\u00eb periudh\u00eb t\u00eb shkurt\u00ebr kohore, nj\u00eb num\u00ebr i madh procesesh aktivizohen q\u00eb azhurnojn\u00eb intensivisht parameter\u00ebt dhe punojn\u00eb me depozit\u00ebn e DB-s\u00eb, nd\u00ebrkoh\u00eb q\u00eb burimet harduerike t\u00eb serverit jan\u00eb p\u00ebrdorur krejt\u00ebsisht nga CPU. <\/p>\n

Tani, ne jemi af\u00ebr kalimit n\u00eb Informatica 10.2.1 ose 10.2.2, t\u00eb cilat kan\u00eb rishikuar disa mekanizma t\u00eb brendsh\u00ebm, dhe mb\u00ebshtetja premton eliminimin e disa problemeve q\u00eb kemi aktualisht me performanc\u00ebn dhe funksionimin. Po ashtu, pritet q\u00eb nga pik\u00ebpamja harduerike t\u00eb kemi server\u00eb t\u00eb optimizuar p\u00ebr konfigurimin ton\u00eb, duke marr\u00eb parasysh rezerv\u00ebn p\u00ebr periudh\u00ebn e ardhshme p\u00ebr shkak t\u00eb rritjes dhe zhvillimit t\u00eb depozit\u00ebs.<\/p>\n

Natyrisht, na pret testimi, verifikimi i pajtueshm\u00ebris\u00eb dhe ndoshta nd\u00ebrrime arkitekturore n\u00eb pjes\u00ebn e HA GRID. Zhvillimi brenda Informatica do t\u00eb vazhdoj\u00eb, sepse n\u00eb perspektiv\u00ebn afatshkurt\u00ebr nuk mund t\u00eb vendosim di\u00e7ka n\u00eb vend t\u00eb sistemit.
\nDhe ata q\u00eb do t\u00eb jen\u00eb p\u00ebrgjegj\u00ebs p\u00ebr k\u00ebt\u00eb sistem n\u00eb t\u00eb ardhmen, patjet\u00ebr do t\u00eb arrijn\u00eb ta sjellin at\u00eb n\u00eb nivelet e nevojshme t\u00eb besueshm\u00ebris\u00eb dhe performanc\u00ebs t\u00eb k\u00ebrkuara nga klient\u00ebt.<\/p>\n

Artikulli \u00ebsht\u00eb p\u00ebrgatitur nga ekipi i menaxhimit t\u00eb t\u00eb dh\u00ebnave t\u00eb \"Rostelecom\"<\/i><\/p>\n

\"Nga
\nLogotipi aktual i Informatica<\/i>
\n
Burimi: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

ETL-\u043a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u0430 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 \u0434\u0430\u043d\u043d\u044b\u0445 \u0447\u0430\u0441\u0442\u043e \u043e\u043a\u0430\u0437\u044b\u0432\u0430\u0435\u0442\u0441\u044f \u0432 \u0442\u0435\u043d\u0438 \u0441\u0430\u043c\u043e\u0433\u043e \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 \u0438 \u0435\u0439 \u0443\u0434\u0435\u043b\u044f\u0435\u0442\u0441\u044f \u043c\u0435\u043d\u044c\u0448\u0435 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u044f, \u0447\u0435\u043c \u0433\u043b\u0430\u0432\u043d\u043e\u0439 \u0431\u0430\u0437\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u043b\u0438 \u0444\u0440\u043e\u043d\u0442-\u043a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u0435, BI, \u0444\u043e\u0440\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0438 \u043e\u0442\u0447\u0451\u0442\u043e\u0432. \u041f\u0440\u0438 \u044d\u0442\u043e\u043c \u0441 \u0442\u043e\u0447\u043a\u0438 \u0437\u0440\u0435\u043d\u0438\u044f \u043c\u0435\u0445\u0430\u043d\u0438\u043a\u0438 \u043d\u0430\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 \u0434\u0430\u043d\u043d\u044b\u043c\u0438, ETL \u0438\u0433\u0440\u0430\u0435\u0442 \u043a\u043b\u044e\u0447\u0435\u0432\u0443\u044e \u0440\u043e\u043b\u044c \u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u043d\u0435 \u043c\u0435\u043d\u044c\u0448\u0435 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u044f \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0430\u0442\u043e\u0440\u043e\u0432, \u0447\u0435\u043c \u043e\u0441\u0442\u0430\u043b\u044c\u043d\u044b\u0435 \u043a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u044b. \u041c\u0435\u043d\u044f \u0437\u043e\u0432\u0443\u0442 \u0410\u043b\u0435\u043a\u0441\u0430\u043d\u0434\u0440, \u0441\u0435\u0439\u0447\u0430\u0441 \u044f \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u0443\u044e ETL \u0432 \u0420\u043e\u0441\u0442\u0435\u043b\u0435\u043a\u043e\u043c\u0435, \u0438 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":26234,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-34842","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47 Nga aksidentet e p\u00ebrditshme n\u00eb stabilitet: Informatica 10 p\u00ebrmes syve t\u00eb administratorit | ProHoster","description":"Komponenti ETL i depozit\u00ebs s\u00eb t\u00eb dh\u00ebnave shpesh mbetet n\u00eb hije t\u00eb depozit\u00ebs vet\u00eb dhe i kushtohet m\u00eb pak v\u00ebmendje se nd\u00ebrlidhja kryesore e DB-s\u00eb ose komponent\u00ebt e p\u00ebrpar\u00ebm, BI, formimi i raporteve. Megjithat\u00eb, nga perspektiva mekanike e mbushjes s\u00eb depozit\u00ebs me t\u00eb dh\u00ebna, ETL luan nj\u00eb rol ky\u00e7 dhe k\u00ebrkon pak m\u00eb shum\u00eb v\u00ebmendje nga administrator\u00ebt se komponent\u00ebt e tjer\u00eb. M\u00eb quajn\u00eb Aleksand\u00ebr, tani un\u00eb administroj ETL n\u00eb Rostelecom, dhe","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/ot-ezhednevnyh-avarij-k-stabilnosti-informatica-10-glazami-admina","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u0442 \u0435\u0436\u0435\u0434\u043d\u0435\u0432\u043d\u044b\u0445 \u0430\u0432\u0430\u0440\u0438\u0439 \u043a \u0441\u0442\u0430\u0431\u0438\u043b\u044c\u043d\u043e\u0441\u0442\u0438: Informatica 10 \u0433\u043b\u0430\u0437\u0430\u043c\u0438 \u0430\u0434\u043c\u0438\u043d\u0430 | ProHoster","og:description":"ETL-\u043a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u0430 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 \u0434\u0430\u043d\u043d\u044b\u0445 \u0447\u0430\u0441\u0442\u043e \u043e\u043a\u0430\u0437\u044b\u0432\u0430\u0435\u0442\u0441\u044f \u0432 \u0442\u0435\u043d\u0438 \u0441\u0430\u043c\u043e\u0433\u043e \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 \u0438 \u0435\u0439 \u0443\u0434\u0435\u043b\u044f\u0435\u0442\u0441\u044f \u043c\u0435\u043d\u044c\u0448\u0435 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u044f, \u0447\u0435\u043c \u0433\u043b\u0430\u0432\u043d\u043e\u0439 \u0431\u0430\u0437\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u043b\u0438 \u0444\u0440\u043e\u043d\u0442-\u043a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u0435, BI, \u0444\u043e\u0440\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0438 \u043e\u0442\u0447\u0451\u0442\u043e\u0432. \u041f\u0440\u0438 \u044d\u0442\u043e\u043c \u0441 \u0442\u043e\u0447\u043a\u0438 \u0437\u0440\u0435\u043d\u0438\u044f \u043c\u0435\u0445\u0430\u043d\u0438\u043a\u0438 \u043d\u0430\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 \u0434\u0430\u043d\u043d\u044b\u043c\u0438, ETL \u0438\u0433\u0440\u0430\u0435\u0442 \u043a\u043b\u044e\u0447\u0435\u0432\u0443\u044e \u0440\u043e\u043b\u044c \u0438 \u0442\u0440\u0435\u0431\u0443\u0435\u0442 \u043d\u0435 \u043c\u0435\u043d\u044c\u0448\u0435 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u044f \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0430\u0442\u043e\u0440\u043e\u0432, \u0447\u0435\u043c \u043e\u0441\u0442\u0430\u043b\u044c\u043d\u044b\u0435 \u043a\u043e\u043c\u043f\u043e\u043d\u0435\u043d\u0442\u044b. \u041c\u0435\u043d\u044f \u0437\u043e\u0432\u0443\u0442 \u0410\u043b\u0435\u043a\u0441\u0430\u043d\u0434\u0440, \u0441\u0435\u0439\u0447\u0430\u0441 \u044f \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u0443\u044e ETL \u0432 \u0420\u043e\u0441\u0442\u0435\u043b\u0435\u043a\u043e\u043c\u0435, \u0438","og:url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/ot-ezhednevnyh-avarij-k-stabilnosti-informatica-10-glazami-admina","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:00:43+00:00","article:modified_time":"2019-10-31T19:00:43+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"34842","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-08 21:32:10","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 02:14:05","updated":"2026-02-08 21:32:10","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/34842","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=34842"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/34842\/revisions"}],"predecessor-version":[{"id":158197,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/34842\/revisions\/158197"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media\/26234"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=34842"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=34842"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=34842"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}