{"id":55701,"date":"2020-01-26T00:00:00","date_gmt":"2020-01-25T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh"},"modified":"2020-02-18T14:03:50","modified_gmt":"2020-02-18T11:03:50","slug":"nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh","title":{"rendered":"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Ky \u00ebsht\u00eb nj\u00eb artikull p\u00ebrkthim i artikullit tim n\u00eb medium \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/rock-your-data\/getting-started-with-data-lake-4bb13643f9\">Fillimi me Liqenin e T\u00eb Dh\u00ebnave<\/a><\/noindex>, i cili u b\u00eb mjaft popullor, ndoshta p\u00ebr shkak t\u00eb thjesht\u00ebsis\u00eb s\u00eb tij. Prandaj, vendosa ta shkruaj at\u00eb n\u00eb gjuh\u00ebn shqipe dhe ta pasuroj pak, n\u00eb m\u00ebnyr\u00eb q\u00eb nj\u00eb person i zakonsh\u00ebm, q\u00eb nuk \u00ebsht\u00eb specialist n\u00eb pun\u00ebn me t\u00eb dh\u00ebnat, t\u00eb kuptoj\u00eb se \u00e7far\u00eb \u00ebsht\u00eb nj\u00eb depo e t\u00eb dh\u00ebnave (DW), \u00e7far\u00eb \u00ebsht\u00eb nj\u00eb liqen t\u00eb dh\u00ebnash (Data Lake), dhe si bashk\u00ebjetojn\u00eb ato. <\/p>\n<p>Pse vendosa t\u00eb shkruaj p\u00ebr liqenin e t\u00eb dh\u00ebnave? Kam punuar me t\u00eb dh\u00ebna dhe analitik\u00eb p\u00ebr m\u00eb shum\u00eb se 10 vjet, dhe tani po punoj me t\u00eb dh\u00ebna t\u00eb m\u00ebdha n\u00eb Amazon Alexa AI n\u00eb Cambridge, q\u00eb \u00ebsht\u00eb n\u00eb Boston, p\u00ebrkund\u00ebr faktit q\u00eb jetoj n\u00eb Victoria n\u00eb ishullin Vancouver dhe shpesh q\u00ebndroj n\u00eb Boston, Seattle, dhe Vancouver, dhe ndonj\u00ebher\u00eb madje flas n\u00eb Mosk\u00eb n\u00eb konferenca. Gjithashtu, her\u00eb pas here shkrimi \u00ebsht\u00eb nj\u00eb aktivitet i imi, por zakonisht shkruaj n\u00eb anglisht, dhe kam shkruar tashm\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/www.amazon.com\/Dmitry-Anoshin\/e\/B01A5PVT2M\">disa libra<\/a><\/noindex>, gjithashtu kam nj\u00eb nevoj\u00eb p\u00ebr t\u00eb ndar\u00eb trendet e analitik\u00ebs nga Amerika Veriore, dhe ndonj\u00ebher\u00eb shkruaj n\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/t.me\/rockyourdata\">Telegram<\/a><\/noindex>.<\/p>\n<p>Un\u00eb gjithmon\u00eb kam punuar me depo t\u00eb dh\u00ebnash, dhe q\u00eb nga viti 2015 kam filluar t\u00eb punoj ngusht\u00eb me Amazon Web Services, madje kalova plot\u00ebsisht n\u00eb analiz\u00ebn n\u00eb re (AWS, Azure, GCP). Kam v\u00ebzhguar evolucionin e zgjidhjeve p\u00ebr analiz\u00eb q\u00eb nga viti 2007 dhe vet\u00eb kam punuar p\u00ebr nj\u00eb ofrues depo t\u00eb dh\u00ebnash si Teradata dhe e kam implementuar at\u00eb n\u00eb Sberbank. At\u00ebher\u00eb doli Big Data me Hadoop. T\u00eb gjith\u00eb filluan t\u00eb flasin se epoka e depozita kishte p\u00ebrfunduar dhe tani t\u00eb gjith\u00eb ishin te Hadoop, dhe pastaj filluan t\u00eb flisnin p\u00ebr Data Lake, p\u00ebrs\u00ebri duke th\u00ebn\u00eb se tani p\u00ebrfundimisht depoja e dh\u00ebnash kishte vdekur. Por p\u00ebr fat t\u00eb mir\u00eb (ndoshta p\u00ebr disa t\u00eb pafat q\u00eb fitonin shum\u00eb para duke konfiguruar Hadoop), depa e dh\u00ebnash nuk ka zhdukur. <br \/>\n<noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><br \/>\nN\u00eb k\u00ebt\u00eb artikull do t\u00eb shqyrtojm\u00eb se \u00e7far\u00eb \u00ebsht\u00eb nj\u00eb liqen t\u00eb dh\u00ebnash. Artikulli \u00ebsht\u00eb i destinuar p\u00ebr njer\u00ebz me pak p\u00ebrvoj\u00eb n\u00eb depozit\u00eb t\u00eb dh\u00ebnash ose q\u00eb nuk kan\u00eb fare.<\/p>\n<p><img decoding=\"async\" alt=\"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?\" src=\"\/wp-content\/uploads\/2020\/01\/85b3eda809ce19fc33efb2fad4e93a41.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nN\u00eb imazhin \u00ebsht\u00eb liqeni Bled, nj\u00eb nga liqenet e mia t\u00eb preferuara, ndon\u00ebse kam qen\u00eb vet\u00ebm nj\u00eb her\u00eb atje, por e mbaj mend p\u00ebr gjith\u00eb jet\u00ebn. Por do t\u00eb flasim p\u00ebr nj\u00eb lloj tjet\u00ebr liqeni \u2014 liqenin e t\u00eb dh\u00ebnave. Mund t\u00eb keni d\u00ebgjuar disa her\u00eb p\u00ebr k\u00ebt\u00eb termin, por nj\u00eb p\u00ebrcaktim tjet\u00ebr nuk do t\u00eb d\u00ebmtonte ask\u00ebnd.<\/p>\n<p>S\u00eb pari, ja disa nga p\u00ebrcaktimet m\u00eb popullore t\u00eb Liqenit t\u00eb Dh\u00ebnave:<\/p>\n<blockquote><p>\u00abarkiv i t\u00eb dh\u00ebnash t\u00eb t\u00eb gjitha llojeve t\u00eb t\u00eb dh\u00ebnave t\u00eb pap\u00ebrpunuara, t\u00eb cilat jan\u00eb t\u00eb arritshme p\u00ebr analiz\u00eb nga kushdo n\u00eb organizat\u00eb\u00bb \u2014 Martin Fowler.<\/p><\/blockquote>\n<blockquote><p>\u00abN\u00ebse mendoni se nj\u00eb vitrin\u00eb t\u00eb dh\u00ebnash \u00ebsht\u00eb nj\u00eb shishe uji \u2014 t\u00eb pastruar, t\u00eb paketuar dhe t\u00eb mbushur p\u00ebr p\u00ebrdorim t\u00eb leht\u00eb, at\u00ebher\u00eb nj\u00eb liqen t\u00eb dh\u00ebnash p\u00ebr ne \u00ebsht\u00eb nj\u00eb reservoir i madh me uj\u00eb n\u00eb form\u00ebn e tij natyrale. P\u00ebrdoruesit mund t\u00eb marrin uj\u00eb p\u00ebr vete, t\u00eb zhyt\u00ebn n\u00eb thell\u00ebsi, t\u00eb eksplorojn\u00eb\u00bb \u2014 James Dixon. <\/p><\/blockquote>\n<p> Tani ne me siguri e dim\u00eb se liqeni i t\u00eb dh\u00ebnave ka t\u00eb b\u00ebj\u00eb me analitik\u00ebn, ai na lejon t\u00eb ruajm\u00eb sasi t\u00eb m\u00ebdha t\u00eb dh\u00ebnash n\u00eb form\u00ebn e tyre origjinale dhe kemi qasje t\u00eb nevojshme dhe t\u00eb leht\u00eb n\u00eb t\u00eb dh\u00ebnat.<\/p>\n<p>Un\u00eb shpesh e dua t\u00eb thjeshtoj gj\u00ebrat; n\u00ebse mund t\u00eb shpjegoj nj\u00eb term t\u00eb komplikuar me fjal\u00eb t\u00eb thjeshta, do t\u00eb thot\u00eb se e kam kuptuar si funksionon dhe p\u00ebr \u00e7far\u00eb \u00ebsht\u00eb e nevojshme. Nj\u00eb her\u00eb, duke k\u00ebrkuar n\u00eb iPhone tim n\u00eb galerin\u00eb e fotove, m\u00eb erdhi n\u00eb mendje, kjo \u00ebsht\u00eb pik\u00ebrisht nj\u00eb liqen t\u00eb dh\u00ebnash, madje kam b\u00ebr\u00eb nj\u00eb slide p\u00ebr konferenca:<\/p>\n<p><img decoding=\"async\" alt=\"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?\" src=\"\/wp-content\/uploads\/2020\/01\/1956ddf4091ca00f6d86c33a6780d495.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nE gjitha \u00ebsht\u00eb shum\u00eb e thjesht\u00eb. Ne b\u00ebjm\u00eb nj\u00eb fotografi me telefon, fotografia ruhet n\u00eb telefon dhe mund t\u00eb ruhen n\u00eb iCloud (ruajtje skedari n\u00eb re). Gjithashtu telefoni mbledh meta t\u00eb dh\u00ebna p\u00ebr fotografit\u00eb: \u00e7far\u00eb \u00ebsht\u00eb paraqitur, gjeo-sh\u00ebnimi, koha. Si rezultat, mund t\u00eb p\u00ebrdorim nd\u00ebrfaqen e p\u00ebrshtatshme t\u00eb iPhone-it p\u00ebr t\u00eb gjetur fotografin\u00eb ton\u00eb dhe madje shohim tregues, p\u00ebr shembull, kur k\u00ebrkoj fotografi me fjal\u00ebn zjarr (fire), gjej 3 fotografi me pamjen e nj\u00eb zjarri. P\u00ebr mua, kjo \u00ebsht\u00eb si nj\u00eb mjet Business Intelligence, q\u00eb funksionon shum\u00eb shpejt dhe sakt\u00eb. <\/p>\n<p>Sigurisht, nuk duhet t\u00eb harrojm\u00eb p\u00ebr sigurin\u00eb (autorizimin dhe autentikimin), ndryshe t\u00eb dh\u00ebnat tona mund t\u00eb kalojn\u00eb leht\u00eb n\u00eb akses publik. Ka shum\u00eb lajm\u00eb p\u00ebr korporata t\u00eb m\u00ebdha dhe startup-e, t\u00eb cilat kan\u00eb pasur t\u00eb dh\u00ebnat e tyre n\u00eb akses publik p\u00ebr shkak t\u00eb moskujdesit t\u00eb zhvilluesve dhe mosrespektimit t\u00eb rregullave t\u00eb thjeshta.<\/p>\n<p>Madje nj\u00eb figur\u00eb kaq e thjesht\u00eb, na ndihmon t\u00eb paraqesim se \u00e7far\u00eb \u00ebsht\u00eb nj\u00eb liqen t\u00eb dh\u00ebnash, dallimet e tij nga nj\u00eb depo tradicionale t\u00eb dh\u00ebnash dhe element\u00ebt e tij kryesor\u00eb:<\/p>\n<ol>\n<li><b>Ngarkimi i t\u00eb dh\u00ebnave <\/b>(Ingestion) \u2014 komponenti ky\u00e7 i liqenit t\u00eb t\u00eb dh\u00ebnave. T\u00eb dh\u00ebnat mund t\u00eb hyjn\u00eb n\u00eb ruajtjen e t\u00eb dh\u00ebnave n\u00eb dy m\u00ebnyra \u2014 batch (ngarkimi n\u00eb intervale) dhe streaming (rrjedha e t\u00eb dh\u00ebnave).<\/li>\n<li><b>Ruajtja e skedar\u00ebve<\/b> (Storage) \u2014 komponenti kryesor i Liqenit t\u00eb T\u00eb Dh\u00ebnave. Na nevojitet nj\u00eb ruajtje e shkall\u00ebzueshme leht\u00ebsisht, jasht\u00ebzakonisht e besueshme dhe me kosto t\u00eb ul\u00ebt. P\u00ebr shembull, n\u00eb AWS kjo \u00ebsht\u00eb S3.<\/li>\n<li><b>Katalogu dhe K\u00ebrkimi<\/b> (Catalog and Search) \u2014 p\u00ebr t\u00eb shmangur Bllokimin e T\u00eb Dh\u00ebnave (kur ngrem\u00eb t\u00eb gjitha t\u00eb dh\u00ebnat n\u00eb nj\u00eb vend dhe m\u00eb pas \u00ebsht\u00eb e pamundur t\u00eb punojm\u00eb me to), na nevojitet t\u00eb krijojm\u00eb nj\u00eb shtres\u00eb metadatat p\u00ebr klasifikimin e t\u00eb dh\u00ebnave, n\u00eb m\u00ebnyr\u00eb q\u00eb p\u00ebrdoruesit t\u00eb mund t\u00eb gjejn\u00eb leht\u00ebsisht t\u00eb dh\u00ebnat q\u00eb u nevojiten p\u00ebr analiz\u00eb. P\u00ebr m\u00eb tep\u00ebr, mund t\u00eb p\u00ebrdoren zgjidhje t\u00eb tjera p\u00ebr k\u00ebrkim, si ElasticSearch. K\u00ebrkimi e ndihmon p\u00ebrdoruesin q\u00eb t\u00eb gjej\u00eb t\u00eb dh\u00ebnat e nevojshme p\u00ebrmes nj\u00eb nd\u00ebrfaqeje miq\u00ebsore.<\/li>\n<li><b>P\u00ebrpunimi<\/b> (Process) \u2014 ky hap merret me p\u00ebrpunimin dhe transformimin e t\u00eb dh\u00ebnave. Ne mund t\u00eb transformojm\u00eb t\u00eb dh\u00ebnat, t\u00eb ndryshojm\u00eb strukturat e tyre, t'i pastroni dhe shum\u00eb m\u00eb tep\u00ebr. <\/li>\n<li><b>Siguria<\/b> (Siguria) \u2014 \u00ebsht\u00eb e r\u00ebnd\u00ebsishme t\u00eb investoni koh\u00eb n\u00eb dizajnin e zgjidhjeve t\u00eb siguris\u00eb. P\u00ebr shembull, enkriptimi i t\u00eb dh\u00ebnave gjat\u00eb ruajtjes, p\u00ebrpunimit dhe ngarkimit. \u00cbsht\u00eb e r\u00ebnd\u00ebsishme t\u00eb p\u00ebrdoren metoda autentikimi dhe autorizimi. N\u00eb p\u00ebrfundim, nevojitet nj\u00eb mjet auditimi.<\/li>\n<\/ol>\n<p>\nNga nj\u00eb pik\u00ebpamje praktike, ne mund t\u00eb karakterizojm\u00eb liqenin e t\u00eb dh\u00ebnave me tre atribute:<\/p>\n<ol>\n<li><b>Mblidhni dhe ruani gjith\u00e7ka<\/b> \u2014 liqeni i t\u00eb dh\u00ebnave p\u00ebrmban t\u00eb gjitha t\u00eb dh\u00ebnat, si t\u00eb dh\u00ebna t\u00eb pap\u00ebrpunuara p\u00ebr \u00e7do periudh\u00eb kohe, ashtu edhe t\u00eb dh\u00ebna t\u00eb p\u00ebrpunuara\/t\u00eb pastruara.<\/li>\n<li><b>Analiza e thell\u00eb<\/b> \u2014 liqeni i t\u00eb dh\u00ebnave u lejon p\u00ebrdoruesve t\u00eb eksplorojn\u00eb dhe analizojn\u00eb t\u00eb dh\u00ebnat.<\/li>\n<li><b>Akses fleksib\u00ebl<\/b> \u2014 liqeni i t\u00eb dh\u00ebnave siguron akses fleksib\u00ebl p\u00ebr t\u00eb dh\u00ebna t\u00eb ndryshme dhe p\u00ebr skenar\u00eb t\u00eb ndrysh\u00ebm.<\/li>\n<\/ol>\n<p>\nTani mund t\u00eb flasim p\u00ebr ndarjen midis depozit\u00ebs s\u00eb t\u00eb dh\u00ebnave dhe liqenit t\u00eb t\u00eb dh\u00ebnave. Zakonisht, njer\u00ebzit pyesin:<\/p>\n<ul>\n<li>Por, \u00e7far\u00eb ndodh me depozit\u00ebn e t\u00eb dh\u00ebnave?<\/li>\n<li>A e z\u00ebvend\u00ebsojm\u00eb depozit\u00ebn e t\u00eb dh\u00ebnave me liqenin e t\u00eb dh\u00ebnave apo e zgjedhim at\u00eb?<\/li>\n<li>A \u00ebsht\u00eb e mundur t\u00eb shmangim p\u00ebrdorimin e liqenit t\u00eb t\u00eb dh\u00ebnave?<\/li>\n<\/ul>\n<p>\nN\u00ebse flasim shkurt, nuk ka nj\u00eb p\u00ebrgjigje t\u00eb sakt\u00eb. Gjith\u00e7ka varet nga situata specifike, aft\u00ebsit\u00eb n\u00eb ekip dhe buxheti. P\u00ebr shembull, migrimi i depozit\u00ebs s\u00eb t\u00eb dh\u00ebnave n\u00eb Oracle n\u00eb AWS dhe krijimi i nj\u00eb liqeni t\u00eb dh\u00ebnash nga nj\u00eb kompani n\u00ebnshkruar e Amazon \u2014 Woot \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/aws.amazon.com\/blogs\/big-data\/our-data-lake-story-how-woot-com-built-a-serverless-data-lake-on-aws\/\">Historia jon\u00eb e liqenit t\u00eb t\u00eb dh\u00ebnave: Si Woot.com nd\u00ebrtuar nj\u00eb liqen t\u00eb dh\u00ebnash pa server\u00eb n\u00eb AWS<\/a><\/noindex>. <\/p>\n<p>Nga ana tjet\u00ebr, shpall\u00ebsi Snowflake pretendon se nuk keni m\u00eb nevoj\u00eb t\u00eb mendoni p\u00ebr liqenin e t\u00eb dh\u00ebnave, pasi platforma e tyre t\u00eb dh\u00ebnash (deri n\u00eb vitin 2020, k\u00ebt\u00eb e quanin depo t\u00eb dh\u00ebnash) ju lejon t\u00eb kombinoni dhe liqenin e t\u00eb dh\u00ebnave dhe depozit\u00ebn e t\u00eb dh\u00ebnave. Kam punuar pak me Snowflake dhe \u00ebsht\u00eb v\u00ebrtet nj\u00eb produkt unik q\u00eb mund ta b\u00ebj\u00eb k\u00ebt\u00eb. \u00c7mimi i c\u00ebshtjes, \u00ebsht\u00eb nj\u00eb \u00e7\u00ebshtje tjet\u00ebr.<\/p>\n<p>N\u00eb p\u00ebrfundim, mendimi im personal \u00ebsht\u00eb se na nevojitet ende nj\u00eb depo e dh\u00ebnash si burimi kryesor i t\u00eb dh\u00ebnave p\u00ebr raportimet tona, dhe gjith\u00e7ka q\u00eb nuk p\u00ebrshtatet, e ruajm\u00eb n\u00eb liqenin e t\u00eb dh\u00ebnave. Roli i analiz\u00ebs \u00ebsht\u00eb t\u00eb ofroj\u00eb akses t\u00eb leht\u00eb p\u00ebr biznesin n\u00eb m\u00ebnyr\u00eb q\u00eb t\u00eb b\u00ebj\u00eb vendime. M\u00eb n\u00eb fund, p\u00ebrdoruesit e biznesit punojn\u00eb m\u00eb efektivisht me nj\u00eb depo t\u00eb dh\u00ebnash sesa me nj\u00eb liqen t\u00eb dh\u00ebnash; p\u00ebr shembull n\u00eb Amazon \u2014 kemi Redshift (depot\u00eb analitike t\u00eb t\u00eb dh\u00ebnave) dhe Redshift Spectrum\/Athena (nd\u00ebrfaqja SQL p\u00ebr liqenin e t\u00eb dh\u00ebnave n\u00eb S3 mbi baz\u00ebn e Hive\/Presto). T\u00eb nj\u00ebjt\u00ebn gj\u00eb vlen edhe p\u00ebr depo t\u00eb tjera moderne analitike t\u00eb t\u00eb dh\u00ebnave.<\/p>\n<p>Le t\u00eb shqyrtojm\u00eb arkitektur\u00ebn tipike t\u00eb depoit t\u00eb dh\u00ebnave:<\/p>\n<p><img decoding=\"async\" alt=\"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?\" src=\"\/wp-content\/uploads\/2020\/01\/a2015f7f5e28e8a671699682105e011e.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nKjo \u00ebsht\u00eb nj\u00eb zgjidhje klasike. Kemi sistemet burim, me ndihm\u00ebn e ETL\/ELT kopjojm\u00eb t\u00eb dh\u00ebnat n\u00eb depot\u00eb analitike t\u00eb t\u00eb dh\u00ebnave dhe i lidhim me zgjidhjen e Business Intelligence (e imja e preferuar \u00ebsht\u00eb Tableau, dhe e juaja?). <\/p>\n<p>Kjo zgjidhje ka k\u00ebto disavantazhe:<\/p>\n<ul>\n<li>Operacionet ETL\/ELT k\u00ebrkojn\u00eb koh\u00eb dhe burime.<\/li>\n<li>Si rregull, memoria p\u00ebr ruajtjen e t\u00eb dh\u00ebnave n\u00eb depo analitike t\u00eb t\u00eb dh\u00ebnave nuk \u00ebsht\u00eb e lir\u00eb (p\u00ebr shembull Redshift, BigQuery, Teradata), pasi duhet t\u00eb blejm\u00eb nj\u00eb kluster t\u00eb t\u00ebr\u00eb.<\/li>\n<li>P\u00ebrdoruesit e biznesit kan\u00eb qasje n\u00eb t\u00eb dh\u00ebna t\u00eb pastra dhe shpesh t\u00eb akumuara, por nuk kan\u00eb mund\u00ebsi t\u00eb marrin t\u00eb dh\u00ebna t\u00eb pap\u00ebrpunuara.<\/li>\n<\/ul>\n<p>\nNatyrisht, gjith\u00e7ka varet nga rasti juaj. N\u00ebse nuk keni probleme me ruajtjen e t\u00eb dh\u00ebnave, at\u00ebher\u00eb nuk keni nevoj\u00eb p\u00ebr nj\u00eb liqen t\u00eb dh\u00ebnash. Por kur lindin probleme me munges\u00ebn e hap\u00ebsir\u00ebs, kapacitetit, ose kostoja \u00ebsht\u00eb nj\u00eb faktor ky\u00e7, at\u00ebher\u00eb mund t\u00eb shqyrtoni mund\u00ebsin\u00eb e nj\u00eb liqeni t\u00eb dh\u00ebnash. Pik\u00ebrisht p\u00ebr k\u00ebt\u00eb, liqeni i t\u00eb dh\u00ebnave \u00ebsht\u00eb shum\u00eb popullor. K\u00ebtu \u00ebsht\u00eb nj\u00eb shembull i arkitektur\u00ebs s\u00eb liqenit t\u00eb t\u00eb dh\u00ebnave:<br \/>\n<img decoding=\"async\" alt=\"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?\" src=\"\/wp-content\/uploads\/2020\/01\/c952e2202a6ce2c8d7d91215aa5390cc.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\nDuke p\u00ebrdorur qasjen e liqenit t\u00eb t\u00eb dh\u00ebnave, ne ngarkojm\u00eb t\u00eb dh\u00ebna t\u00eb pap\u00ebrpunuara n\u00eb liqenin ton\u00eb t\u00eb t\u00eb dh\u00ebnave (n\u00eb grup ose n\u00eb rrjedhje), dhe m\u00eb pas i p\u00ebrpunojm\u00eb t\u00eb dh\u00ebnat sipas nevoj\u00ebs. Liqeni i t\u00eb dh\u00ebnave lejon p\u00ebrdoruesit e biznesit t\u00eb krijojn\u00eb transformime t\u00eb tyre t\u00eb t\u00eb dh\u00ebnave (ETL\/ELT) ose t\u00eb analizojn\u00eb t\u00eb dh\u00ebnat n\u00eb zgjidhje t\u00eb Inteligjenc\u00ebs Biznesore (n\u00ebse ka drejtorin e nevojsh\u00ebm).<\/p>\n<blockquote><p>Q\u00ebllimi i \u00e7do zgjidhjeje analitike \u00ebsht\u00eb t\u00eb sh\u00ebrbej\u00eb p\u00ebrdoruesve t\u00eb biznesit. Prandaj, ne duhet gjithmon\u00eb t\u00eb punojm\u00eb sipas k\u00ebrkesave t\u00eb biznesit. (N\u00eb Amazon, kjo \u00ebsht\u00eb nj\u00eb nga parimet \u2014 punimi nga prapa).<\/p><\/blockquote>\n<p> Duke punuar si me ruajtjen e t\u00eb dh\u00ebnave ashtu edhe me liqenin e t\u00eb dh\u00ebnave, ne mund t\u00eb krahasojm\u00eb t\u00eb dyja zgjidhjet:<\/p>\n<p><img decoding=\"async\" alt=\"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?\" src=\"\/wp-content\/uploads\/2020\/01\/07b62ac9838438a0b28caf1b22b2dccd.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nGjetja kryesore q\u00eb mund t\u00eb b\u00ebhet \u00ebsht\u00eb se ruajtja e t\u00eb dh\u00ebnave nuk konkurron me liqenin e t\u00eb dh\u00ebnave, por e plot\u00ebson at\u00eb. Megjithat\u00eb, \u00ebsht\u00eb p\u00ebrgjegj\u00ebsia juaj t\u00eb vendosni se \u00e7far\u00eb \u00ebsht\u00eb m\u00eb e p\u00ebrshtatshme p\u00ebr rastin tuaj. \u00cbsht\u00eb gjithmon\u00eb interesante ta provosh vet\u00eb dhe t\u00eb b\u00ebsh p\u00ebrfundime t\u00eb sakta.<\/p>\n<p>D\u00ebshiroj gjithashtu t\u00eb flas p\u00ebr nj\u00eb nga rastet kur fillova t\u00eb p\u00ebrdor k\u00ebt\u00eb qasje t\u00eb liqenit t\u00eb t\u00eb dh\u00ebnave. Gjith\u00e7ka ishte mjaft e thjesht\u00eb; p\u00ebrpiqesha t\u00eb p\u00ebrdorja nj\u00eb mjet ELT (kishim Matillion ETL) dhe Amazon Redshift, zgjidhja ime funksiononte, por nuk p\u00ebrmbushte k\u00ebrkesat.<\/p>\n<p>M\u00eb nevojitej t\u00eb merrja log-et e web-it, t'i transformoja dhe t'i aggregoja p\u00ebr t\u00eb ofruar t\u00eb dh\u00ebnat p\u00ebr dy raste:<\/p>\n<ol>\n<li>Ekipa e marketingut d\u00ebshironte t\u00eb analizonte aktivitetin e bot\u00ebve p\u00ebr SEO.<\/li>\n<li>IT d\u00ebshiroi t\u00eb shihte metrikat e pun\u00ebs s\u00eb faqeve.<\/li>\n<\/ol>\n<p>\nLog-et ishin shum\u00eb t\u00eb thjeshta. Ja nj\u00eb shembull:<\/p>\n<pre><code class=\"plaintext\">https 2018-07-02T22:23:00.186641Z app\/my-loadbalancer\/50dc6c495c0c9188 \n192.168.131.39:2817 10.0.0.1:80 0.086 0.048 0.037 200 200 0 57 \n&quot;GET https:\/\/www.example.com:443\/ HTTP\/1.1&quot; &quot;curl\/7.46.0&quot; ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 \narn:aws:elasticloadbalancing:us-east-2:123456789012:targetgroup\/my-targets\/73e2d6bc24d8a067\n&quot;Root=1-58337281-1d84f3d73c47ec4e58577259&quot; &quot;www.example.com&quot; &quot;arn:aws:acm:us-east-2:123456789012:certificate\/12345678-1234-1234-1234-123456789012&quot;\n1 2018-07-02T22:22:48.364000Z &quot;authenticate,forward&quot; &quot;-&quot; &quot;-&quot;<\/code><\/pre>\n<p>\nNj\u00eb skedar kishte pesh\u00ebn 1-4 megabajt.<\/p>\n<p>Por ishte nj\u00eb v\u00ebshtir\u00ebsi. Ne kishim 7 domain-e n\u00eb t\u00eb gjith\u00eb bot\u00ebn, dhe n\u00eb nj\u00eb dit\u00eb krijoheshin 7000 skedar\u00eb. Kjo nuk ishte shum\u00eb, vet\u00ebm 50 gigabajt. Por madh\u00ebsia e klasterit ton\u00eb Redshift ishte gjithashtu e vog\u00ebl (4 nodo). Ngarkimi n\u00eb m\u00ebnyr\u00ebn tradicionale t\u00eb nj\u00eb skedari merrte rreth nj\u00eb minut\u00eb. Dometh\u00ebn\u00eb, problemi nuk zgjidhej drejtp\u00ebrdrejt. Dhe ky ishte rasti kur vendosa t\u00eb p\u00ebrdor qasjen e liqenit t\u00eb t\u00eb dh\u00ebnave. Zgjidhja dukej k\u00ebshtu:<\/p>\n<p><img decoding=\"async\" alt=\"Na na duhet li nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb t\u00eb b\u00ebjm\u00eb me deponin\u00eb e t\u00eb dh\u00ebnave?\" src=\"\/wp-content\/uploads\/2020\/01\/21ca33e82da56f83b3deab4c32eb2345.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\n\u00ebsht\u00eb mjaft e thjesht\u00eb (dua t\u00eb theksoj se p\u00ebrpar\u00ebsia e pun\u00ebs n\u00eb cloud \u00ebsht\u00eb thjesht\u00ebsia). Un\u00eb p\u00ebrdora:<\/p>\n<ul>\n<li>AWS Elastic Map Reduce (Hadoop) si burim llogarit\u00ebs <\/li>\n<li>AWS S3 si storage skedar\u00ebsh me mund\u00ebsi p\u00ebr enkriptimin e t\u00eb dh\u00ebnave dhe kufizimin e aksesit<\/li>\n<li>Spark si burim llogarit\u00ebs n\u00eb memorie dhe PySpark p\u00ebr logjik\u00ebn dhe transformimin e t\u00eb dh\u00ebnave<\/li>\n<li>Parquet si rezultati i pun\u00ebs s\u00eb Spark<\/li>\n<li>AWS Glue Crawler si mbledh\u00ebs metadata p\u00ebr t\u00eb dh\u00ebna dhe pjes\u00eb t\u00eb reja<\/li>\n<li>Redshift Spectrum si nd\u00ebrfaqe SQL p\u00ebr liqenin e t\u00eb dh\u00ebnave p\u00ebr p\u00ebrdoruesit ekzistues t\u00eb Redshift<\/li>\n<\/ul>\n<p>\nKlasteri m\u00eb i vog\u00ebl EMR+Spark p\u00ebrpunoi t\u00eb gjith\u00eb partin\u00eb e skedar\u00ebve brenda 30 minutash. Ka edhe raste t\u00eb tjera p\u00ebr AWS, ve\u00e7an\u00ebrisht shum\u00eb q\u00eb lidhen me Alexa, ku ka shum\u00eb t\u00eb dh\u00ebna. <\/p>\n<p>Pak m\u00ebsova nj\u00eb nga disavantazhet e liqenit t\u00eb t\u00eb dh\u00ebnave \u2014 \u00ebsht\u00eb GDPR. Problemi \u00ebsht\u00eb se kur klienti k\u00ebrkon t\u00eb fshihet, dhe t\u00eb dh\u00ebnat ndodhen n\u00eb nj\u00eb nga skedar\u00ebt, ne nuk mund ta p\u00ebrdorim Data Manipulation Language dhe operacionin DELETE si n\u00eb nj\u00eb baz\u00eb t\u00eb dh\u00ebnash.<\/p>\n<p>Shpresoj se ky artikull sqaroi dallimin midis nj\u00eb depozite t\u00eb dh\u00ebnash dhe nj\u00eb liqeni t\u00eb t\u00eb dh\u00ebnave. N\u00ebse ishte interesante, mund t\u00eb p\u00ebrkthej edhe artikujt e mi t\u00eb tjer\u00eb ose artikuj profesionist\u00ebsh q\u00eb lexoj. Gjithashtu, mund t\u00eb flas p\u00ebr zgjidhje me t\u00eb cilat punoj dhe arkitektur\u00ebn e tyre.<br \/>\n<br \/>Burimi: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/485180\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u042d\u0442\u043e \u0441\u0442\u0430\u0442\u044c\u044f \u043f\u0435\u0440\u0435\u0432\u043e\u0434 \u043c\u043e\u0435\u0439 \u0441\u0442\u0430\u0442\u044c\u0438 \u043d\u0430 medium \u2014 Getting Started with Data Lake, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043e\u043a\u0430\u0437\u0430\u043b\u0430\u0441\u044c \u0434\u043e\u0432\u043e\u043b\u044c\u043d\u043e \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0439, \u043d\u0430\u0432\u0435\u0440\u043d\u043e\u0435 \u0438\u0437-\u0437\u0430 \u0441\u0432\u043e\u0435\u0439 \u043f\u0440\u043e\u0441\u0442\u043e\u0442\u044b. \u041f\u043e\u044d\u0442\u043e\u043c\u0443 \u044f \u0440\u0435\u0448\u0438\u043b \u043d\u0430\u043f\u0438\u0441\u0430\u0442\u044c \u0435\u0435 \u043d\u0430 \u0440\u0443\u0441\u0441\u043a\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438 \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u0434\u043e\u043f\u043e\u043b\u043d\u0438\u0442\u044c, \u0447\u0442\u043e\u0431\u044b \u043f\u0440\u043e\u0441\u0442\u043e\u043c\u0443 \u0447\u0435\u043b\u043e\u0432\u0435\u043a\u0443, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043d\u0435 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u0441\u043f\u0435\u0446\u0438\u0430\u043b\u0438\u0441\u0442\u043e\u043c \u043f\u043e \u0440\u0430\u0431\u043e\u0442\u0435 \u0441 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0441\u0442\u0430\u043b\u043e \u043f\u043e\u043d\u044f\u0442\u043d\u043e, \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 (DW), \u0430 \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u043e\u0437\u0435\u0440\u043e \u0434\u0430\u043d\u043d\u044b\u0445 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55701","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.10 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u042d\u0442\u043e \u0441\u0442\u0430\u0442\u044c\u044f \u043f\u0435\u0440\u0435\u0432\u043e\u0434 \u043c\u043e\u0435\u0439 \u0441\u0442\u0430\u0442\u044c\u0438 \u043d\u0430 medium \u2014 Getting Started with Data Lake, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043e\u043a\u0430\u0437\u0430\u043b\u0430\u0441\u044c \u0434\u043e\u0432\u043e\u043b\u044c\u043d\u043e \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0439, \u043d\u0430\u0432\u0435\u0440\u043d\u043e\u0435 \u0438\u0437-\u0437\u0430 \u0441\u0432\u043e\u0435\u0439 \u043f\u0440\u043e\u0441\u0442\u043e\u0442\u044b. \u041f\u043e\u044d\u0442\u043e\u043c\u0443 \u044f \u0440\u0435\u0448\u0438\u043b \u043d\u0430\u043f\u0438\u0441\u0430\u0442\u044c \u0435\u0435 \u043d\u0430 \u0440\u0443\u0441\u0441\u043a\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438 \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u0434\u043e\u043f\u043e\u043b\u043d\u0438\u0442\u044c, \u0447\u0442\u043e\u0431\u044b \u043f\u0440\u043e\u0441\u0442\u043e\u043c\u0443 \u0447\u0435\u043b\u043e\u0432\u0435\u043a\u0443, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043d\u0435 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u0441\u043f\u0435\u0446\u0438\u0430\u043b\u0438\u0441\u0442\u043e\u043c \u043f\u043e \u0440\u0430\u0431\u043e\u0442\u0435 \u0441 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0441\u0442\u0430\u043b\u043e \u043f\u043e\u043d\u044f\u0442\u043d\u043e, \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 (DW), \u0430 \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u043e\u0437\u0435\u0440\u043e \u0434\u0430\u043d\u043d\u044b\u0445\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.10\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041d\u0443\u0436\u043d\u043e \u043b\u0438 \u043d\u0430\u043c \u043e\u0437\u0435\u0440\u043e \u0434\u0430\u043d\u043d\u044b\u0445? \u0410 \u0447\u0442\u043e \u0434\u0435\u043b\u0430\u0442\u044c \u0441 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435\u043c \u0434\u0430\u043d\u043d\u044b\u0445? | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u042d\u0442\u043e \u0441\u0442\u0430\u0442\u044c\u044f \u043f\u0435\u0440\u0435\u0432\u043e\u0434 \u043c\u043e\u0435\u0439 \u0441\u0442\u0430\u0442\u044c\u0438 \u043d\u0430 medium \u2014 Getting Started with Data Lake, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043e\u043a\u0430\u0437\u0430\u043b\u0430\u0441\u044c \u0434\u043e\u0432\u043e\u043b\u044c\u043d\u043e \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0439, \u043d\u0430\u0432\u0435\u0440\u043d\u043e\u0435 \u0438\u0437-\u0437\u0430 \u0441\u0432\u043e\u0435\u0439 \u043f\u0440\u043e\u0441\u0442\u043e\u0442\u044b. \u041f\u043e\u044d\u0442\u043e\u043c\u0443 \u044f \u0440\u0435\u0448\u0438\u043b \u043d\u0430\u043f\u0438\u0441\u0430\u0442\u044c \u0435\u0435 \u043d\u0430 \u0440\u0443\u0441\u0441\u043a\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438 \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u0434\u043e\u043f\u043e\u043b\u043d\u0438\u0442\u044c, \u0447\u0442\u043e\u0431\u044b \u043f\u0440\u043e\u0441\u0442\u043e\u043c\u0443 \u0447\u0435\u043b\u043e\u0432\u0435\u043a\u0443, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043d\u0435 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u0441\u043f\u0435\u0446\u0438\u0430\u043b\u0438\u0441\u0442\u043e\u043c \u043f\u043e \u0440\u0430\u0431\u043e\u0442\u0435 \u0441 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0441\u0442\u0430\u043b\u043e \u043f\u043e\u043d\u044f\u0442\u043d\u043e, \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 (DW), \u0430 \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u043e\u0437\u0435\u0440\u043e \u0434\u0430\u043d\u043d\u044b\u0445\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-25T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:03:50+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Na nevojitet nj\u00eb liqen t\u00eb dh\u00ebnash? \u00c7far\u00eb duhet b\u00ebr\u00eb me depozit\u00ebn e dh\u00ebnave? | ProHoster","description":"Ky artikull \u00ebsht\u00eb nj\u00eb p\u00ebrkthim i artikullit tim n\u00eb medium \u2014 Getting Started with Data Lake, i cili u b\u00eb mjaft popullor, ndoshta p\u00ebr shkak t\u00eb thjesht\u00ebsis\u00eb s\u00eb tij. Prandaj vendosa ta shkruaj n\u00eb gjuh\u00ebn ruse dhe ta zgjeroj pak, n\u00eb m\u00ebnyr\u00eb q\u00eb p\u00ebr personat e zakonsh\u00ebm, t\u00eb cil\u00ebt nuk jan\u00eb specialist\u00eb n\u00eb pun\u00ebn me t\u00eb dh\u00ebna, t\u00eb jet\u00eb e qart\u00eb se \u00e7far\u00eb \u00ebsht\u00eb nj\u00eb depozit\u00eb t\u00eb dh\u00ebnash (DW), dhe \u00e7far\u00eb \u00ebsht\u00eb nj\u00eb liqen t\u00eb dh\u00ebnash.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041d\u0443\u0436\u043d\u043e \u043b\u0438 \u043d\u0430\u043c \u043e\u0437\u0435\u0440\u043e \u0434\u0430\u043d\u043d\u044b\u0445? \u0410 \u0447\u0442\u043e \u0434\u0435\u043b\u0430\u0442\u044c \u0441 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435\u043c \u0434\u0430\u043d\u043d\u044b\u0445? | ProHoster","og:description":"\u042d\u0442\u043e \u0441\u0442\u0430\u0442\u044c\u044f \u043f\u0435\u0440\u0435\u0432\u043e\u0434 \u043c\u043e\u0435\u0439 \u0441\u0442\u0430\u0442\u044c\u0438 \u043d\u0430 medium \u2014 Getting Started with Data Lake, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043e\u043a\u0430\u0437\u0430\u043b\u0430\u0441\u044c \u0434\u043e\u0432\u043e\u043b\u044c\u043d\u043e \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0439, \u043d\u0430\u0432\u0435\u0440\u043d\u043e\u0435 \u0438\u0437-\u0437\u0430 \u0441\u0432\u043e\u0435\u0439 \u043f\u0440\u043e\u0441\u0442\u043e\u0442\u044b. \u041f\u043e\u044d\u0442\u043e\u043c\u0443 \u044f \u0440\u0435\u0448\u0438\u043b \u043d\u0430\u043f\u0438\u0441\u0430\u0442\u044c \u0435\u0435 \u043d\u0430 \u0440\u0443\u0441\u0441\u043a\u043e\u043c \u044f\u0437\u044b\u043a\u0435 \u0438 \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u0434\u043e\u043f\u043e\u043b\u043d\u0438\u0442\u044c, \u0447\u0442\u043e\u0431\u044b \u043f\u0440\u043e\u0441\u0442\u043e\u043c\u0443 \u0447\u0435\u043b\u043e\u0432\u0435\u043a\u0443, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u043d\u0435 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u0441\u043f\u0435\u0446\u0438\u0430\u043b\u0438\u0441\u0442\u043e\u043c \u043f\u043e \u0440\u0430\u0431\u043e\u0442\u0435 \u0441 \u0434\u0430\u043d\u043d\u044b\u043c\u0438 \u0441\u0442\u0430\u043b\u043e \u043f\u043e\u043d\u044f\u0442\u043d\u043e, \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 (DW), \u0430 \u0447\u0442\u043e \u0442\u0430\u043a\u043e\u0435 \u043e\u0437\u0435\u0440\u043e \u0434\u0430\u043d\u043d\u044b\u0445","og:url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/nuzhno-li-nam-ozero-dannyh-a-chto-delat-s-hranilishhem-dannyh","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-25T21:00:00+00:00","article:modified_time":"2020-02-18T11:03:50+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55701","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 19:38:32","updated":"2022-09-27 20:27:01"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/55701","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=55701"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/55701\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=55701"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=55701"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=55701"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}