{"id":55327,"date":"2020-01-18T00:00:00","date_gmt":"2020-01-17T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/samye-vostrebovannye-navyki-v-professii-data-engineer"},"modified":"2020-02-18T14:03:26","modified_gmt":"2020-02-18T11:03:26","slug":"samye-vostrebovannye-navyki-v-professii-data-engineer","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","title":{"rendered":"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e inxhinerit t\u00eb t\u00eb dh\u00ebnave","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Sipas t\u00eb statistikave t\u00eb vitit 2019<\/a><\/noindex>, inxhinieri i t\u00eb dh\u00ebnave aktualisht \u00ebsht\u00eb profesioni me k\u00ebrkes\u00eb m\u00eb t\u00eb lart\u00eb. Inxhinieri i t\u00eb dh\u00ebnave luan nj\u00eb rol kritik n\u00eb organizata - krijon dhe mir\u00ebmban linjat dhe bazat e t\u00eb dh\u00ebnave q\u00eb p\u00ebrdoren p\u00ebr procesimin, transformimin dhe ruajtjen e t\u00eb dh\u00ebnave. Cilat jan\u00eb aft\u00ebsit\u00eb m\u00eb t\u00eb r\u00ebnd\u00ebsishme q\u00eb k\u00ebrkohen prej k\u00ebsaj profesioni? A ndryshon lista nga ajo q\u00eb k\u00ebrkohet nga data scientist? Do t\u00eb m\u00ebsoni p\u00ebr t\u00eb gjitha k\u00ebto nga artikulli im.<\/p>\n

Kam analizuar ofertat e pun\u00ebs p\u00ebr pozitat e inxhinier\u00ebve t\u00eb t\u00eb dh\u00ebnave ashtu si\u00e7 jan\u00eb n\u00eb janar t\u00eb vitit 2020, p\u00ebr t\u00eb kuptuar se cilat aft\u00ebsi n\u00eb fush\u00ebn e teknologjis\u00eb jan\u00eb m\u00eb t\u00eb njohura. Pastaj kam krahasuar rezultatet me statistikat p\u00ebr ofertat e pun\u00ebs p\u00ebr pozitat e data scientist - k\u00ebshtu u zbulua disa dallime interesante.<\/p>\n

Pa u zgjatur shum\u00eb, ja dhjet\u00eb teknologji q\u00eb p\u00ebrmenden m\u00eb shpesh n\u00eb tekstet e ofertave t\u00eb pun\u00ebs:<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

P\u00ebrmendjet e teknologjive n\u00eb ofertat p\u00ebr pozitat e inxhinier\u00ebve t\u00eb t\u00eb dh\u00ebnave n\u00eb vitin 2020<\/i><\/p>\n

Le t\u00eb hedhim nj\u00eb v\u00ebshtrim.
\n<\/a><\/noindex><\/p>\n

Detyrat e inxhinierit t\u00eb t\u00eb dh\u00ebnave<\/h4>\n

\nAktualisht, puna q\u00eb kryejn\u00eb inxhinier\u00ebt e t\u00eb dh\u00ebnave ka nj\u00eb r\u00ebnd\u00ebsi t\u00eb madhe p\u00ebr organizatat \u2013 k\u00ebta njer\u00ebz jan\u00eb p\u00ebrgjegj\u00ebs p\u00ebr ruajtjen e informacionit dhe p\u00ebr ta sjell\u00eb at\u00eb n\u00eb nj\u00eb form\u00eb q\u00eb stafi i tjer\u00eb mund ta p\u00ebrdor\u00eb. Inxhinier\u00ebt e t\u00eb dh\u00ebnave nd\u00ebrtrojn\u00eb pipelines p\u00ebr t\u00eb siguruar marrjen e t\u00eb dh\u00ebnave, n\u00eb m\u00ebnyr\u00eb t\u00eb vazhdueshme ose n\u00eb paketa, nga burime t\u00eb shumta. M\u00eb pas, k\u00ebto pipeline kryejn\u00eb operacione t\u00eb ekstraktimit, transformimit dhe ngarkimit (ndryshe ETL), duke e b\u00ebr\u00eb informacionin m\u00eb t\u00eb p\u00ebrshtatsh\u00ebm p\u00ebr p\u00ebrdorim t\u00eb m\u00ebtejsh\u00ebm. Pas k\u00ebsaj, t\u00eb dh\u00ebnat u dor\u00ebzohen analist\u00ebve dhe shkenc\u00ebtar\u00ebve t\u00eb t\u00eb dh\u00ebnave p\u00ebr nj\u00eb p\u00ebrpunim m\u00eb t\u00eb thell\u00eb. N\u00eb fund, t\u00eb dh\u00ebnat mbyllin udh\u00ebtimin e tyre n\u00eb panellet informative, n\u00eb raporte dhe n\u00eb modele p\u00ebr machine learning.<\/p>\n

Kisha k\u00ebrkuar informacion q\u00eb do t\u00eb lejonte t\u00eb arrija n\u00eb p\u00ebrfundimin se cilat teknologji jan\u00eb m\u00eb k\u00ebrkuar n\u00eb pun\u00ebn e inxhinier\u00ebve t\u00eb t\u00eb dh\u00ebnave aktualisht.<\/p>\n

Metodat<\/h4>\n

\nKisha mbledhur informacion nga tri webfaqe p\u00ebr k\u00ebrkimin e pun\u00ebs \u2014 SimplyHired<\/a><\/noindex>, Indeed<\/a><\/noindex> dhe Monster<\/a><\/noindex> dhe kisha par\u00eb se cilat fjal\u00eb ky\u00e7e shfaqen n\u00eb lidhje me 'data engineer' n\u00eb tekstet e ofertave t\u00eb pun\u00ebs, t\u00eb dedikuara p\u00ebr banor\u00ebt e Shteteve t\u00eb Bashkuara. P\u00ebr k\u00ebt\u00eb detyr\u00eb, un\u00eb kam p\u00ebrdorur dy biblioteka Python \u2014 Requests<\/a><\/noindex> dhe Beautiful Soup<\/a><\/noindex>. N\u00eb grupin e fjal\u00ebve ky\u00e7e kam p\u00ebrfshir\u00eb ata q\u00eb ishin n\u00eb list\u00ebn e m\u00ebparshme p\u00ebr analiz\u00ebn e vendeve t\u00eb pun\u00ebs p\u00ebr pozitat e shkenc\u00ebtarit t\u00eb t\u00eb dh\u00ebnave, si dhe ata q\u00eb kam p\u00ebrzgjedhur manualisht duke lexuar shpalljet p\u00ebr inxhinier\u00ebt e t\u00eb dh\u00ebnave. LinkedIn nuk ishte nj\u00eb nga burimet, pasi m\u00eb ndaluan aty pas p\u00ebrpjekjes s\u00eb kaluar p\u00ebr t\u00eb mbledhur t\u00eb dh\u00ebna.<\/p>\n

P\u00ebr \u00e7do fjal\u00eb ky\u00e7e, kam num\u00ebruar p\u00ebrqindjen e shfaqjeve nga numri total i teksteve n\u00eb secilin nga faqet e internetit ve\u00e7mas, dhe pastaj kam llogaritur mesataren nga tre burimet.<\/p>\n

Rezultatet<\/h4>\n

\nM\u00eb posht\u00eb jan\u00eb tridhjet\u00eb terma teknik\u00eb n\u00eb fush\u00ebn e inxhinieris\u00eb s\u00eb t\u00eb dh\u00ebnave me treguesit m\u00eb t\u00eb lart\u00eb n\u00eb t\u00eb tri faqet e vendeve t\u00eb pun\u00ebs.<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

Ja, k\u00ebto jan\u00eb t\u00eb nj\u00ebjtat shifra, por t\u00eb paraqitura n\u00eb form\u00ebn e nj\u00eb tabele:<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

Le t\u00eb shkojm\u00eb p\u00ebr radh\u00eb.<\/p>\n

P\u00ebrmbledhje e rezultateve<\/b><\/p>\n

Si SQL ashtu edhe Python shfaqen n\u00eb m\u00eb shum\u00eb se dy t\u00eb tretat e vendeve t\u00eb pun\u00ebs t\u00eb shqyrtuara. Pik\u00ebrisht k\u00ebto dy teknologji ka kuptim t\u00eb studiohen fillimisht. Python<\/a><\/noindex> \u2013 nj\u00eb gjuh\u00eb programuese shum\u00eb e njohur, e p\u00ebrdorur p\u00ebr pun\u00ebn me t\u00eb dh\u00ebna, krijimin e uebfaqeve dhe shkruan skenar\u00eb. SQL<\/a><\/noindex> q\u00eb do t\u00eb thot\u00eb Gjuh\u00eb e K\u00ebrkimeve t\u00eb Strukturuara (SQL); ajo p\u00ebrfaq\u00ebson nj\u00eb standard t\u00eb zbatuar nga nj\u00eb grup gjuh\u00ebsh dhe p\u00ebrdoret p\u00ebr t\u00eb nxjerr\u00eb t\u00eb dh\u00ebna nga bazat e t\u00eb dh\u00ebnave relacionale. Ajo ka lindur nj\u00eb koh\u00eb t\u00eb gjat\u00eb dhe ka treguar q\u00eb \u00ebsht\u00eb shum\u00eb e q\u00ebndrueshme.<\/p>\n

P\u00ebrdoret p\u00ebr Spark n\u00eb rreth gjysm\u00ebn e ofertave t\u00eb pun\u00ebs. Apache Spark<\/a><\/noindex> \u00ebsht\u00eb nj\u00eb \"motor analitik i integruar p\u00ebr p\u00ebrpunimin e t\u00eb dh\u00ebnave t\u00eb m\u00ebdha me module t\u00eb p\u00ebrfshira p\u00ebr transmetim, SQL, m\u00ebsim makinerie dhe p\u00ebrpunim grafik\". Ai \u00ebsht\u00eb ve\u00e7an\u00ebrisht popullor p\u00ebr ata q\u00eb punojn\u00eb me baza t\u00eb dh\u00ebnash t\u00eb m\u00ebdha.<\/p>\n

AWS p\u00ebrmendet n\u00eb rreth 45% t\u00eb teksteve t\u00eb ofertave t\u00eb pun\u00ebs. Ky \u00ebsht\u00eb nj\u00eb platform\u00eb e p\u00ebrpunimit n\u00eb re e prodhimit t\u00eb Amazon; ajo zot\u00ebron pjes\u00ebn m\u00eb t\u00eb madhe t\u00eb tregut midis t\u00eb gjitha platformave t\u00eb tjera n\u00eb re.
\nM\u00eb pas ndjekin Java dhe Hadoop \u2013 pak m\u00eb shum\u00eb se 40% p\u00ebr secilin. Java<\/a><\/noindex> \u00ebsht\u00eb nj\u00eb gjuh\u00eb e gjer\u00eb e p\u00ebrdorur, e provuar n\u00eb betej\u00eb, q\u00eb n\u00eb anket\u00ebn e zhvilluesve n\u00eb Stack Overflow n\u00eb vitin 2019<\/a><\/noindex> zuri i dhjet\u00eb n\u00eb mesin e gjuh\u00ebve q\u00eb shkaktojn\u00eb tmerr te programuesit. N\u00eb kontrast me t\u00eb, Python doli i dyti si gjuh\u00eb m\u00eb e dashur. Gjuha Java kontrollohet nga Oracle, dhe gjith\u00e7ka q\u00eb duhet t\u00eb dini p\u00ebr t\u00eb mund t\u00eb kuptohet nga ky screenshot i faqes zyrtare nga janari 2020.<\/p>\n

\"Aft\u00ebsit\u00eb
\n
\nSi t\u00eb kisha b\u00ebr\u00eb nj\u00eb udh\u00ebtim me makin\u00eb n\u00eb koh\u00eb<\/i>
\nApache Hadoop<\/a><\/noindex> p\u00ebrdor modelin e softuerit MapReduce me klaster\u00eb server\u00ebsh p\u00ebr t\u00eb dh\u00ebna t\u00eb m\u00ebdha. Tani kjo model po braktiset gjithnj\u00eb e m\u00eb shpesh.<\/p>\n

Pastaj shohim Hive, Scala, Kafka dhe NoSQL \u2013 secila nga k\u00ebto teknologji p\u00ebrmendet n\u00eb nj\u00eb t\u00eb kat\u00ebrt\u00ebn e aktiviteteve t\u00eb pun\u00ebs t\u00eb paraqitura. Apache Hive \u00ebsht\u00eb nj\u00eb program-arkiv q\u00eb \"thjeshton leximin, shkrimin dhe menaxhimin e grupeve t\u00eb m\u00ebdha t\u00eb t\u00eb dh\u00ebnave q\u00eb ndodhen n\u00eb depo t\u00eb shp\u00ebrndara, duke p\u00ebrdorur SQL\". Scala<\/a><\/noindex> \u2013 nj\u00eb gjuh\u00eb programimi q\u00eb p\u00ebrdoret aktivisht n\u00eb pun\u00ebn me t\u00eb dh\u00ebna t\u00eb m\u00ebdha. N\u00eb ve\u00e7anti, Spark u zhvillua n\u00eb Scala. N\u00eb renditjen e p\u00ebrmendur m\u00eb par\u00eb, Scala z\u00eb vendin e nj\u00ebmb\u00ebdhjet\u00eb. Apache Kafka<\/a><\/noindex> \u2013 nj\u00eb platform\u00eb e shp\u00ebrndar\u00eb p\u00ebr p\u00ebrpunimin e mesazheve n\u00eb rrjedh\u00eb. Shum\u00eb popullore si nj\u00eb mjet p\u00ebr transmetimin e t\u00eb dh\u00ebnave.<\/p>\n

Baza t\u00eb dh\u00ebnash NoSQL<\/a><\/noindex> p\u00ebrballen me SQL. Ato dallohet p\u00ebr faktin se nuk jan\u00eb relacional, nuk jan\u00eb t\u00eb strukturuar dhe kan\u00eb skalabilitet horizontal. NoSQL ka fituar disa popullaritet, megjithat\u00eb, entuziazmi i tepruar p\u00ebr k\u00ebt\u00eb qasje, deri n\u00eb profeci se do t\u00eb z\u00ebvend\u00ebsoj\u00eb SQL si paradigma dominuese e ruajtjes, duket se ka mbetur pas.<\/p>\n

Krahasimi me terminologjin\u00eb n\u00eb shpalljet e pun\u00ebs p\u00ebr data scientist<\/h4>\n

\nJa tridhjet\u00eb terma teknologjik\u00eb m\u00eb t\u00eb zakonsh\u00ebm nga pun\u00ebdh\u00ebn\u00ebsit n\u00eb fush\u00ebn e data science. Ky list\u00eb u mor n\u00eb t\u00eb nj\u00ebjt\u00ebn m\u00ebnyr\u00eb q\u00eb e p\u00ebrshkrova m\u00eb lart p\u00ebr inxhinierin\u00eb e t\u00eb dh\u00ebnave.<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

P\u00ebrmendjet e teknologjive n\u00eb shpalljet p\u00ebr pozita data scientist n\u00eb vitin 2020<\/i><\/p>\n

N\u00eb terma t\u00eb p\u00ebrgjithsh\u00ebm, n\u00eb krahasim me grupin e shqyrtuar m\u00eb par\u00eb, ka m\u00eb shum\u00eb shpallje pun\u00ebsh me 28% (12,013 p\u00ebr m\u00eb shum\u00eb 9,396). Le t\u00eb shohim se cilat teknologji shfaqen m\u00eb rrall\u00eb n\u00eb shpalljet p\u00ebr data scientists sesa p\u00ebr data engineers.<\/p>\n

M\u00eb t\u00eb popullarizuara n\u00eb inxhinierin\u00eb e t\u00eb dh\u00ebnave<\/b><\/p>\n

N\u00eb grafikun m\u00eb posht\u00eb jan\u00eb fjal\u00eb ky\u00e7e me nj\u00eb ndryshim mesatar n\u00eb vlera m\u00eb shum\u00eb se 10% ose m\u00eb pak se -10%.<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

Dallimet m\u00eb t\u00eb m\u00ebdha n\u00eb frekuenc\u00ebn e fjal\u00ebve ky\u00e7e mes data engineer dhe data scientist<\/i><\/p>\n

Rritja m\u00eb e dukshme \u00ebsht\u00eb te AWS: n\u00eb inxhinierin\u00eb e t\u00eb dh\u00ebnave ajo shfaqet 25% m\u00eb shpesh se n\u00eb shkenc\u00ebn e t\u00eb dh\u00ebnave (p\u00ebrkat\u00ebsisht rreth 45% dhe 20% e totalit t\u00eb vendeve t\u00eb pun\u00ebs). Diferenca \u00ebsht\u00eb e ndjeshme!<\/p>\n

K\u00ebto jan\u00eb t\u00eb nj\u00ebjtat t\u00eb dh\u00ebna n\u00eb nj\u00eb prezantim pak ndryshe \u2013 n\u00eb grafik, rezultatet p\u00ebr nj\u00eb fjal\u00eb ky\u00e7e t\u00eb nj\u00ebjt\u00eb n\u00eb vendet e pun\u00ebs p\u00ebr inxhinier t\u00eb t\u00eb dh\u00ebnave dhe shkenc\u00ebtar t\u00eb t\u00eb dh\u00ebnave jan\u00eb renditur ngjitur.<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

Dallimet m\u00eb t\u00eb m\u00ebdha n\u00eb frekuenc\u00ebn e fjal\u00ebve ky\u00e7e mes data engineer dhe data scientist<\/i><\/p>\n

Rritja e dyt\u00eb m\u00eb e madhe \u00ebsht\u00eb te Spark \u2013 inxhinieri i t\u00eb dh\u00ebnave shpesh duhet t\u00eb punoj\u00eb me t\u00eb dh\u00ebna t\u00eb m\u00ebdha. Kafka<\/a><\/noindex> po ashtu ka sh\u00ebnuar rritje prej 20%, pra pothuajse kat\u00ebr her\u00eb m\u00eb shum\u00eb se sa rezultati p\u00ebr vendet e pun\u00ebs shkenc\u00ebtar t\u00eb t\u00eb dh\u00ebnave. Transferimi i t\u00eb dh\u00ebnave \u00ebsht\u00eb nj\u00eb nga p\u00ebrgjegj\u00ebsit\u00eb kryesore t\u00eb inxhinierit t\u00eb t\u00eb dh\u00ebnave. N\u00eb fund, numri i p\u00ebrmendjeve rezultoi t\u00eb ishte 15% m\u00eb shum\u00eb n\u00eb fush\u00ebn e inxhinieris\u00eb s\u00eb t\u00eb dh\u00ebnave p\u00ebr Java, NoSQL, Redshift, SQL dhe Hadoop.<\/p>\n

M\u00eb pak t\u00eb njohura n\u00eb inxhinierin\u00eb e t\u00eb dh\u00ebnave<\/b><\/p>\n

Tani le t\u00eb shohim se cilat teknologji jan\u00eb m\u00eb pak t\u00eb njohura n\u00eb vendet e pun\u00ebs p\u00ebr inxhinier t\u00eb t\u00eb dh\u00ebnave.
\nR\u00ebnia m\u00eb e theksuar n\u00eb krahasim me fush\u00ebn e shkenc\u00ebs s\u00eb t\u00eb dh\u00ebnave ndodhi te R<\/a><\/noindex>: atje ajo figuroi n\u00eb rreth 56% t\u00eb vendeve t\u00eb pun\u00ebs, k\u00ebtu \u2013 vet\u00ebm n\u00eb 17%. I habitsh\u00ebm. R \u00ebsht\u00eb nj\u00eb gjuh\u00eb programimi q\u00eb \u00ebsht\u00eb e njohur midis shkenc\u00ebtar\u00ebve dhe statistikaneve, si dhe z\u00eb vendin e tet\u00eb n\u00eb renditjen e gjuh\u00ebve t\u00eb tmerrshme.<\/p>\n

SAS<\/a><\/noindex> ndodhet gjithashtu n\u00eb ofertat e pun\u00ebs p\u00ebr pozitat e inxhinier\u00ebve t\u00eb t\u00eb dh\u00ebnave n\u00eb m\u00ebnyr\u00eb t\u00eb dukshme m\u00eb rrall\u00eb \u2013 diferenca \u00ebsht\u00eb 14%. SAS \u00ebsht\u00eb nj\u00eb gjuh\u00eb e patentuar, e cila \u00ebsht\u00eb krijuar p\u00ebr pun\u00eb me statistika dhe t\u00eb dh\u00ebna. Nj\u00eb pik\u00eb interesant: n\u00eb p\u00ebrputhje me rezultatet e hulumtimit tim mbi ofertat e pun\u00ebs p\u00ebr shkenc\u00ebtar\u00ebt e t\u00eb dh\u00ebnave<\/a><\/noindex>, s\u00eb fundmi ajo ka humbur shum\u00eb pozita \u2013 m\u00eb shum\u00eb se \u00e7do teknologji tjet\u00ebr.<\/p>\n

T\u00eb k\u00ebrkuara dhe n\u00eb inxhinierin\u00eb e t\u00eb dh\u00ebnave, ashtu si n\u00eb shkenc\u00ebn e t\u00eb dh\u00ebnave<\/b><\/p>\n

Duhet t\u00eb theksohet se tet\u00eb nga dhjet\u00eb pozita kryesore n\u00eb t\u00eb dyja grupet p\u00ebrputhen. SQL, Python, Spark, AWS, Java, Hadoop, Hive dhe Scala jan\u00eb n\u00eb dhjet\u00ebshe si p\u00ebr sektorin e inxhinieris\u00eb s\u00eb t\u00eb dh\u00ebnave ashtu edhe p\u00ebr shkenc\u00ebn e t\u00eb dh\u00ebnave. N\u00eb grafik\u00ebn m\u00eb posht\u00eb mund t\u00eb shihni pes\u00eb mb\u00ebshtetje m\u00eb t\u00eb njohura t\u00eb teknologjis\u00eb nga pun\u00ebdh\u00ebn\u00ebsit e inxhinier\u00ebve t\u00eb t\u00eb dh\u00ebnave, nd\u00ebrsa pran\u00eb \u2013 treguesin e tyre p\u00ebr ofertat e pun\u00ebs p\u00ebr shkenc\u00ebtar\u00ebt e t\u00eb dh\u00ebnave.<\/p>\n

\"Aft\u00ebsit\u00eb<\/p>\n

R rekomandimet<\/h4>\n

\nN\u00ebse d\u00ebshironi t\u00eb merremi me inxhinierin\u00eb e t\u00eb dh\u00ebnave, do t'ju sugjeroja t\u00eb njihni k\u00ebto teknologji \u2013 po i rendis\u00eb ato sipas rendit t\u00eb p\u00ebraf\u00ebrt t\u00eb r\u00ebnd\u00ebsis\u00eb.<\/p>\n

M\u00ebsoni SQL. Ju inkurajoj konkretisht p\u00ebr PostgreSQL, sepse ka kod t\u00eb hapur, popullaritet t\u00eb madh n\u00eb komunitet dhe ndodhet n\u00eb nj\u00eb faz\u00eb rritjeje. Si t\u00eb p\u00ebrdorni gjuh\u00ebn, mund t\u00eb m\u00ebsoni nga libri My Memorable SQL \u2013 versioni pilot i saj \u00ebsht\u00eb i disponuesh\u00ebm. k\u00ebtu<\/a><\/noindex>.<\/p>\n

M\u00ebsoni Python-in, jo domosdoshm\u00ebrisht n\u00eb nj\u00eb nivel t\u00eb avancuar. Libri My Memorable Python \u00ebsht\u00eb pik\u00ebrisht p\u00ebr fillestar\u00ebt. Mund ta blini n\u00eb Amazon<\/a><\/noindex>, nj\u00eb kopje elektronike ose fizike, sipas zgjedhjes suaj, ose ta shkarkoni n\u00eb formatin pdf ose epub n\u00eb k\u00ebt\u00eb faqe<\/a><\/noindex>.<\/p>\n

Pasi t\u00eb njiheni me Python-in, kaloni te pandas \u2013 biblioteka Python q\u00eb p\u00ebrdoret p\u00ebr pastrimin dhe p\u00ebrpunimin e t\u00eb dh\u00ebnave. N\u00ebse synoni t\u00eb punoni n\u00eb nj\u00eb kompani ku k\u00ebrkohet njohuri p\u00ebr Python (dhe shumica e tyre e k\u00ebrkon k\u00ebt\u00eb), mund t\u00eb jeni t\u00eb sigurt se njohuria p\u00ebr pandas do t\u00eb supozohet si standart. Un\u00eb po p\u00ebrfundoj nj\u00eb udh\u00ebzues hyr\u00ebs p\u00ebr pun\u00ebn me pandas \u2013 mund t\u00eb aboni<\/a><\/noindex>, p\u00ebr t\u00eb mos humbur momentin e daljes.<\/p>\n

M\u00ebsoni AWS. N\u00ebse d\u00ebshironi t\u00eb b\u00ebheni inxhinier t\u00eb t\u00eb dh\u00ebnave, pa nj\u00eb platform\u00eb cloud n\u00eb dor\u00eb nuk e kaloni dot, dhe AWS \u00ebsht\u00eb m\u00eb e njohura prej tyre. Kur un\u00eb studoja Linux Academy<\/a><\/noindex>, ndihmuan shum\u00eb kur studioja inxhinierin\u00eb e t\u00eb dh\u00ebnave n\u00eb Google Cloud<\/a><\/noindex>, mendoj se do t\u00eb ken\u00eb materiale t\u00eb mira edhe p\u00ebr AWS.<\/p>\n

N\u00ebse keni kaluar t\u00eb gjith\u00eb k\u00ebt\u00eb list\u00eb dhe d\u00ebshironi t\u00eb rriteni n\u00eb syt\u00eb e pun\u00ebdh\u00ebn\u00ebsve si inxhinier t\u00eb dh\u00ebnash, sugjeroj t\u00eb shtoni Apache Spark p\u00ebr pun\u00ebn me t\u00eb dh\u00ebna t\u00eb m\u00ebdha. Edhe pse k\u00ebrkimi im p\u00ebr njoftime pune n\u00eb fush\u00ebn e t\u00eb dh\u00ebnave ka treguar nj\u00eb r\u00ebnie t\u00eb interesit, p\u00ebr inxhinier\u00ebt e dh\u00ebnave ai ende shfaqet n\u00eb pothuajse \u00e7do t\u00eb dyt\u00eb njoftim.<\/p>\n

N\u00eb fund<\/h4>\n

\nShpresoj q\u00eb ky p\u00ebrmbledhje i teknologjive m\u00eb t\u00eb k\u00ebrkuara p\u00ebr inxhinier\u00ebt e dh\u00ebnave t'ju ket\u00eb dukur i dobish\u00ebm. N\u00ebse jeni t\u00eb interesuar se si kurrizhen pun\u00ebt p\u00ebr analist\u00ebt, lexoni nj\u00eb artikull tjet\u00ebr timin<\/a><\/noindex>. Supe-r suksese n\u00eb inxhinierin\u00eb tuaj!
\n
Burimi: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55327","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e inxhinierit t\u00eb t\u00eb dh\u00ebnave | ProHoster","description":"Sipas statistikave t\u00eb vitit 2019, inxhinier\u00ebt e t\u00eb dh\u00ebnave aktualisht jan\u00eb profesioni me rritjen m\u00eb t\u00eb shpejt\u00eb t\u00eb k\u00ebrkes\u00ebs. Inxhinieri i t\u00eb dh\u00ebnave luan nj\u00eb rol kritik n\u00eb organizat\u00eb \u2013 krijon dhe mb\u00ebshtet n\u00eb gjendje pune linjat dhe bazat e t\u00eb dh\u00ebnave q\u00eb p\u00ebrdoren p\u00ebr p\u00ebrpunimin, transformimin dhe ruajtjen e t\u00eb dh\u00ebnave. Cilat aft\u00ebsi duhet t\u00eb ken\u00eb k\u00ebta profesionist\u00eb n\u00eb radh\u00eb t\u00eb par\u00eb? Ndryshon","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster","og:description":"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f","og:url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-17T21:00:00+00:00","article:modified_time":"2020-02-18T11:03:26+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55327","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 13:45:53","updated":"2022-09-30 07:37:35"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/55327","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=55327"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/55327\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=55327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=55327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=55327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}