{"id":55327,"date":"2020-01-18T00:00:00","date_gmt":"2020-01-17T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/samye-vostrebovannye-navyki-v-professii-data-engineer"},"modified":"2020-02-18T14:03:26","modified_gmt":"2020-02-18T11:03:26","slug":"samye-vostrebovannye-navyki-v-professii-data-engineer","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","title":{"rendered":"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Sipas <noindex><a rel=\"nofollow\" href=\"https:\/\/insights.dice.com\/2019\/06\/04\/data-engineer-remains-top-demand-job\/\">sipas statistikave t\u00eb vitit 2019<\/a><\/noindex>, data engineer aktualisht \u00ebsht\u00eb profesioni, k\u00ebrkesa p\u00ebr t\u00eb cilin po rritet m\u00eb shpejt se p\u00ebr \u00e7do profesion tjet\u00ebr. Data engineer luan nj\u00eb rol kritikisht t\u00eb r\u00ebnd\u00ebsish\u00ebm n\u00eb organizat\u00eb: krijon dhe mban funksionale pipeline-et dhe bazat e t\u00eb dh\u00ebnave q\u00eb p\u00ebrdoren p\u00ebr p\u00ebrpunimin, transformimin dhe ruajtjen e t\u00eb dh\u00ebnave. Cilat aft\u00ebsi u duhen m\u00eb shum\u00eb p\u00ebrfaq\u00ebsuesve t\u00eb k\u00ebtij profesioni? A ndryshon kjo list\u00eb nga ajo q\u00eb k\u00ebrkohet nga data scientists? P\u00ebr t\u00eb gjitha k\u00ebto do t\u00eb m\u00ebsoni n\u00eb artikullin tim.<\/p>\n<p>Kam analizuar shpalljet e pun\u00ebs p\u00ebr pozicionin data engineer n\u00eb form\u00ebn n\u00eb t\u00eb cil\u00ebn paraqiteshin n\u00eb janar 2020, p\u00ebr t\u00eb kuptuar se cilat aft\u00ebsi teknologjike jan\u00eb m\u00eb t\u00eb k\u00ebrkuarat. M\u00eb pas i krahasova rezultatet me statistikat e shpalljeve p\u00ebr pozicionin data scientist, dhe dol\u00ebn n\u00eb pah disa dallime interesante.<\/p>\n<p>Pa hyr\u00eb n\u00eb nj\u00eb hyrje t\u00eb gjat\u00eb, ja dhjet\u00eb teknologjit\u00eb q\u00eb p\u00ebrmenden m\u00eb shpesh n\u00eb shpalljet e pun\u00ebs:<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/91e7df1321d88a3076a5239b66a446d6.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>P\u00ebrmendjet e teknologjive n\u00eb shpalljet p\u00ebr pozicionin e data engineer n\u00eb vitin 2020<\/i><\/p>\n<p>Le t\u00eb merremi me k\u00ebt\u00eb.<br \/>\n<noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<h4>P\u00ebrgjegj\u00ebsit\u00eb e data engineer<\/h4>\n<p>\nSot, puna q\u00eb b\u00ebjn\u00eb data engineers ka nj\u00eb r\u00ebnd\u00ebsi t\u00eb jasht\u00ebzakonshme p\u00ebr organizatat: jan\u00eb pik\u00ebrisht k\u00ebta specialist\u00eb q\u00eb p\u00ebrgjigjen p\u00ebr ruajtjen e informacionit dhe e p\u00ebrgatisin at\u00eb n\u00eb nj\u00eb form\u00eb t\u00eb till\u00eb q\u00eb punonj\u00ebsit e tjer\u00eb t\u00eb mund t\u00eb punojn\u00eb me t\u00eb. Data engineers nd\u00ebrtojn\u00eb pipeline-e p\u00ebr t\u00eb organizuar marrjen e t\u00eb dh\u00ebnave, si n\u00eb rrjedh\u00eb ashtu edhe n\u00eb paketa, nga nj\u00eb s\u00ebr\u00eb burimesh. M\u00eb pas, k\u00ebto pipeline-e kryejn\u00eb operacione nxjerrjeje, transformimi dhe ngarkimi (me fjal\u00eb t\u00eb tjera, procese ETL), duke i b\u00ebr\u00eb t\u00eb dh\u00ebnat m\u00eb t\u00eb p\u00ebrshtatshme p\u00ebr p\u00ebrdorim t\u00eb m\u00ebtejsh\u00ebm. Pas k\u00ebsaj, t\u00eb dh\u00ebnat u kalohen analist\u00ebve dhe data scientists p\u00ebr p\u00ebrpunim m\u00eb t\u00eb thelluar. N\u00eb fund, t\u00eb dh\u00ebnat e p\u00ebrfundojn\u00eb udh\u00ebtimin e tyre n\u00eb panele informative, raporte dhe modele t\u00eb machine learning.<\/p>\n<p>K\u00ebrkova informacion q\u00eb do t\u00eb m\u00eb lejonte t\u00eb nxirrja nj\u00eb p\u00ebrfundim se cilat teknologji jan\u00eb aktualisht m\u00eb t\u00eb k\u00ebrkuarat n\u00eb pun\u00ebn e nj\u00eb data engineer.<\/p>\n<h4>Metodat<\/h4>\n<p>\nMblodha informacion nga tre faqe interneti p\u00ebr k\u00ebrkim pune \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/www.simplyhired.com\/\">SimplyHired<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/www.indeed.com\/\">Indeed<\/a><\/noindex> dhe <noindex><a rel=\"nofollow\" href=\"https:\/\/www.monster.com\/\">Monster<\/a><\/noindex> dhe analizova se cilat fjal\u00eb ky\u00e7e shfaqen s\u00eb bashku me \u201cdata engineer\u201d n\u00eb tekstet e shpalljeve t\u00eb pun\u00ebs t\u00eb destinuara p\u00ebr banor\u00ebt e SHBA-s\u00eb. P\u00ebr k\u00ebt\u00eb detyr\u00eb p\u00ebrdora dy biblioteka Python \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/requests.readthedocs.io\/en\/master\/\">Requests<\/a><\/noindex> dhe <noindex><a rel=\"nofollow\" href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/bs4\/doc\/\">Beautiful Soup<\/a><\/noindex>N\u00eb grupin e fjal\u00ebve ky\u00e7e p\u00ebrfshiva si ato q\u00eb ishin n\u00eb list\u00ebn e m\u00ebparshme p\u00ebr analiz\u00ebn e vendeve t\u00eb pun\u00ebs p\u00ebr pozicionin data scientist, ashtu edhe ato q\u00eb i p\u00ebrzgjodha manualisht duke lexuar shpalljet e pun\u00ebs p\u00ebr data engineers. LinkedIn nuk u p\u00ebrfshi te burimet, sepse aty m\u00eb bllokuan pas p\u00ebrpjekjes sime t\u00eb m\u00ebparshme p\u00ebr t\u00eb mbledhur t\u00eb dh\u00ebna.<\/p>\n<p>P\u00ebr secil\u00ebn fjal\u00eb ky\u00e7e llogarita p\u00ebrqindjen e paraqitjeve ndaj numrit total t\u00eb teksteve ve\u00e7mas p\u00ebr secilin sajt, dhe m\u00eb pas nxora vler\u00ebn mesatare p\u00ebr t\u00eb tre burimet.<\/p>\n<h4>Rezultatet<\/h4>\n<p>\nM\u00eb posht\u00eb jan\u00eb paraqitur tridhjet\u00eb terma teknik\u00eb nga fusha e data engineering me rezultatet m\u00eb t\u00eb larta n\u00eb t\u00eb tre sajtet e pun\u00ebsimit.<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/a46401973d369dace7f53c890172af8c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Dhe ja t\u00eb nj\u00ebjtat shifra, por t\u00eb paraqitura n\u00eb form\u00eb tabele:<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/c29e2861806b0761bc5b1be6eb46ec5d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Le t\u2019i marrim me radh\u00eb.<\/p>\n<p><b>P\u00ebrmbledhje e rezultateve<\/b><\/p>\n<p>Si SQL, ashtu edhe Python p\u00ebrmenden n\u00eb m\u00eb shum\u00eb se dy t\u00eb tretat e vendeve t\u00eb pun\u00ebs t\u00eb analizuara. Pik\u00ebrisht k\u00ebto dy teknologji ka kuptim t\u00eb m\u00ebsohen s\u00eb pari. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.python.org\/\">Python<\/a><\/noindex> \u2013 \u00ebsht\u00eb nj\u00eb gjuh\u00eb programimi shum\u00eb popullore, q\u00eb p\u00ebrdoret p\u00ebr pun\u00eb me t\u00eb dh\u00ebnat, krijimin e faqeve web dhe shkrimin e skripteve. <noindex><a rel=\"nofollow\" href=\"https:\/\/ru.wikipedia.org\/wiki\/SQL\">SQL<\/a><\/noindex> shkurtohet nga Structured Query Language (gjuha e pyetjeve t\u00eb strukturuara); ai n\u00ebnkupton nj\u00eb standard t\u00eb zbatuar nga nj\u00eb grup gjuh\u00ebsh dhe p\u00ebrdoret p\u00ebr nxjerrjen e t\u00eb dh\u00ebnave nga bazat relacionale. \u00cbsht\u00eb shfaqur prej koh\u00ebsh dhe ka d\u00ebshmuar q\u00ebndrueshm\u00ebri t\u00eb lart\u00eb.<\/p>\n<p>P\u00ebr Spark flitet n\u00eb rreth gjysm\u00ebn e vendeve t\u00eb pun\u00ebs. <noindex><a rel=\"nofollow\" href=\"https:\/\/spark.apache.org\/\">Apache Spark<\/a><\/noindex> \u2013 \u00ebsht\u00eb nj\u00eb \u00abmotor analitik i unifikuar p\u00ebr p\u00ebrpunimin e t\u00eb dh\u00ebnave t\u00eb m\u00ebdha me module t\u00eb integruara p\u00ebr transmetim rrjedh\u00ebs, SQL, machine learning dhe p\u00ebrpunim grafik\u00ebsh\u00bb. Ai \u00ebsht\u00eb ve\u00e7an\u00ebrisht i popullarizuar te ata q\u00eb punojn\u00eb me baza t\u00eb dh\u00ebnash me p\u00ebrmasa t\u00eb m\u00ebdha.<\/p>\n<p>AWS shfaqet n\u00eb rreth 45% t\u00eb teksteve t\u00eb vendeve t\u00eb pun\u00ebs. Kjo \u00ebsht\u00eb nj\u00eb platform\u00eb cloud computing e Amazon; ajo mban pjes\u00ebn m\u00eb t\u00eb madhe t\u00eb tregut mes t\u00eb gjitha platformave cloud.<br \/>\nPas tyre vijn\u00eb Java dhe Hadoop \u2013 pak m\u00eb shum\u00eb se 40% secili. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.java.com\/en\/\">Java<\/a><\/noindex> \u2013 nj\u00eb gjuh\u00eb shum\u00eb e p\u00ebrhapur dhe e sprovuar n\u00eb praktik\u00eb, e cila n\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/insights.stackoverflow.com\/survey\/2019#most-loved-dreaded-and-wanted\">anket\u00ebn e zhvilluesve t\u00eb Stack Overflow p\u00ebr vitin 2019<\/a><\/noindex> u rendit n\u00eb vendin e dhjet\u00eb mes gjuh\u00ebve q\u00eb u shkaktojn\u00eb programuesve m\u00eb shum\u00eb tmerr. N\u00eb t\u00eb kund\u00ebrt, Python doli i dyti mes gjuh\u00ebve m\u00eb t\u00eb dashura. Java menaxhohet nga Oracle, dhe gjith\u00e7ka q\u00eb duhet t\u00eb dini p\u00ebr t\u00eb mund t\u00eb kuptohet nga kjo pamje e faqes zyrtare nga janari i vitit 2020.<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/ed119ff8bac06c9d25b996d6be7f32dd.jpg\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\n<i>Sikur b\u00ebra nj\u00eb xhiro me makin\u00eb kohe<\/i><br \/>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/\">Apache Hadoop<\/a><\/noindex> p\u00ebrdor modelin softuerik MapReduce me klaster\u00eb server\u00ebsh p\u00ebr big data. Tani kjo qasje po braktiset gjithnj\u00eb e m\u00eb shpesh.<\/p>\n<p>M\u00eb tej shohim Hive, Scala, Kafka dhe NoSQL \u2014 secila prej k\u00ebtyre teknologjive p\u00ebrmendet n\u00eb nj\u00eb t\u00eb kat\u00ebrt\u00ebn e vendeve t\u00eb lira t\u00eb paraqitura. Apache Hive \u00ebsht\u00eb nj\u00eb sistem ruajtjeje t\u00eb dh\u00ebnash q\u00eb \u201ce thjeshton leximin, shkrimin dhe menaxhimin e grupeve t\u00eb m\u00ebdha t\u00eb t\u00eb dh\u00ebnave t\u00eb vendosura n\u00eb depo t\u00eb shp\u00ebrndara, me ndihm\u00ebn e SQL\u201d. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.scala-lang.org\/\">Scala<\/a><\/noindex> \u2013 gjuh\u00eb programimi q\u00eb p\u00ebrdoret gjer\u00ebsisht n\u00eb pun\u00ebn me big data. N\u00eb ve\u00e7anti, Spark \u00ebsht\u00eb krijuar n\u00eb Scala. N\u00eb renditjen e p\u00ebrmendur m\u00eb her\u00ebt t\u00eb gjuh\u00ebve q\u00eb ngjallin frik\u00eb, Scala renditet n\u00eb vendin e nj\u00ebmb\u00ebdhjet\u00eb. <noindex><a rel=\"nofollow\" href=\"https:\/\/kafka.apache.org\/intro\">Apache Kafka<\/a><\/noindex> \u2013 platform\u00eb e shp\u00ebrndar\u00eb p\u00ebr p\u00ebrpunimin e mesazheve n\u00eb rrjedh\u00eb. \u00cbsht\u00eb shum\u00eb e njohur si mjet p\u00ebr transmetimin e t\u00eb dh\u00ebnave n\u00eb rrjedh\u00eb.<\/p>\n<p><noindex><a rel=\"nofollow\" href=\"https:\/\/www.mongodb.com\/scale\/nosql-vs-relational-databases\">Bazat e t\u00eb dh\u00ebnave NoSQL<\/a><\/noindex> pozicionohen si alternativ\u00eb ndaj SQL. Ato dallohen sepse nuk jan\u00eb relacionale, nuk jan\u00eb t\u00eb strukturuara dhe ofrojn\u00eb shkall\u00ebzim horizontal. NoSQL ka fituar nj\u00ebfar\u00eb popullariteti, megjithat\u00eb entuziazmi i tepruar p\u00ebr k\u00ebt\u00eb qasje, deri edhe te parashikimet se do ta z\u00ebvend\u00ebsonte SQL si paradigm\u00ebn dominuese t\u00eb ruajtjes, duket se tashm\u00eb i p\u00ebrket s\u00eb kaluar\u00ebs.<\/p>\n<h4>Krahasimi me termat n\u00eb vendet e lira p\u00ebr data scientist<\/h4>\n<p>\nK\u00ebta jan\u00eb tridhjet\u00eb termat teknologjik\u00eb m\u00eb t\u00eb p\u00ebrhapur te pun\u00ebdh\u00ebn\u00ebsit n\u00eb fush\u00ebn e data science. K\u00ebt\u00eb list\u00eb e p\u00ebrftova n\u00eb t\u00eb nj\u00ebjt\u00ebn m\u00ebnyr\u00eb q\u00eb p\u00ebrshkrova m\u00eb sip\u00ebr p\u00ebr data engineering.<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/d200159a3b56d0ceae1031b0b8d31e3b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>P\u00ebrmendjet e teknologjive n\u00eb vendet e lira p\u00ebr pozicionin data scientist n\u00eb vitin 2020<\/i><\/p>\n<p>N\u00ebse flasim p\u00ebr numrin total, krahasuar me grupin e shqyrtuar m\u00eb her\u00ebt, vende t\u00eb lira kishte 28% m\u00eb shum\u00eb (12 013 kundrejt 9396). Le t\u00eb shohim cilat teknologji shfaqen m\u00eb rrall\u00eb n\u00eb vendet e lira p\u00ebr data scientist sesa p\u00ebr data engineer.<\/p>\n<p><b>M\u00eb t\u00eb njohura n\u00eb data engineering<\/b><\/p>\n<p>Grafiku m\u00eb posht\u00eb tregon fjal\u00ebt ky\u00e7e me diferenc\u00eb mesatare n\u00eb vlera m\u00eb t\u00eb madhe se 10% ose m\u00eb t\u00eb vog\u00ebl se -10%.<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/97fa2dca4ba7d4b821d4a8cea0e59214.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Dallimet m\u00eb t\u00eb m\u00ebdha n\u00eb shpesht\u00ebsin\u00eb e fjal\u00ebve ky\u00e7e te data engineer dhe data scientist<\/i><\/p>\n<p>Rritjen m\u00eb t\u00eb madhe e tregon AWS: n\u00eb data engineering ai shfaqet 25% m\u00eb shpesh sesa n\u00eb data science (p\u00ebraf\u00ebrsisht 45% dhe 20% e numrit total t\u00eb vendeve t\u00eb lira, p\u00ebrkat\u00ebsisht). Nj\u00eb diferenc\u00eb e ndjeshme!<\/p>\n<p>Ja t\u00eb nj\u00ebjtat t\u00eb dh\u00ebna n\u00eb nj\u00eb paraqitje paksa ndryshe \u2014 n\u00eb grafik, rezultatet p\u00ebr t\u00eb nj\u00ebjt\u00ebn fjal\u00eb ky\u00e7e n\u00eb vendet e lira p\u00ebr pozicionet data engineer dhe data scientist jan\u00eb vendosur krah p\u00ebr krah.<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/1d71d42a17475f7c80cf6c1ff5d525af.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Dallimet m\u00eb t\u00eb m\u00ebdha n\u00eb shpesht\u00ebsin\u00eb e fjal\u00ebve ky\u00e7e te data engineer dhe data scientist<\/i><\/p>\n<p>Rritjen tjet\u00ebr m\u00eb t\u00eb madhe e vura re te Spark \u2013 nj\u00eb data engineer shpesh duhet t\u00eb punoj\u00eb me t\u00eb dh\u00ebna n\u00eb shkall\u00eb t\u00eb madhe. <noindex><a rel=\"nofollow\" href=\"https:\/\/kafka.apache.org\/\">Kafka<\/a><\/noindex> gjithashtu u rrit me 20%, pra pothuajse kat\u00ebr her\u00eb m\u00eb shum\u00eb krahasuar me rezultatin n\u00eb ofertat e pun\u00ebs p\u00ebr data scientist. Transferimi i t\u00eb dh\u00ebnave \u00ebsht\u00eb nj\u00eb nga p\u00ebrgjegj\u00ebsit\u00eb kryesore t\u00eb nj\u00eb data engineer. S\u00eb fundi, numri i p\u00ebrmendjeve doli 15% m\u00eb i lart\u00eb n\u00eb data engineering p\u00ebr Java, NoSQL, Redshift, SQL dhe Hadoop.<\/p>\n<p><b>M\u00eb pak t\u00eb njohura n\u00eb data engineering<\/b><\/p>\n<p>Tani le t\u00eb shohim cilat teknologji jan\u00eb m\u00eb pak t\u00eb njohura n\u00eb ofertat e pun\u00ebs p\u00ebr data engineer. <br \/>\nR\u00ebnia m\u00eb e fort\u00eb krahasuar me fush\u00ebn e data science u vu re te <noindex><a rel=\"nofollow\" href=\"https:\/\/www.r-project.org\/about.html\">R<\/a><\/noindex>: atje ai p\u00ebrmendej n\u00eb rreth 56% t\u00eb ofertave t\u00eb pun\u00ebs, nd\u00ebrsa k\u00ebtu vet\u00ebm n\u00eb 17%. Mbres\u00ebl\u00ebn\u00ebse. R \u00ebsht\u00eb nj\u00eb gjuh\u00eb programimi e preferuar nga studiuesit dhe statistikien\u00ebt, si dhe mban vendin e tet\u00eb n\u00eb renditjen e gjuh\u00ebve m\u00eb t\u00eb frikshme.<\/p>\n<p><noindex><a rel=\"nofollow\" href=\"https:\/\/www.sas.com\/en_us\/home.html\">SAS<\/a><\/noindex> gjithashtu shfaqet duksh\u00ebm m\u00eb rrall\u00eb n\u00eb ofertat e pun\u00ebs p\u00ebr pozicionin data engineer \u2013 diferenca \u00ebsht\u00eb 14%. SAS \u00ebsht\u00eb nj\u00eb gjuh\u00eb pron\u00ebsore e krijuar p\u00ebr pun\u00eb me statistik\u00eb dhe t\u00eb dh\u00ebna. Nj\u00eb detaj interesant: duke gjykuar nga rezultatet e <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/the-most-in-demand-tech-skills-for-data-scientists-d716d10c191d\">studimit tim mbi ofertat e pun\u00ebs p\u00ebr data scientists<\/a><\/noindex>, koh\u00ebt e fundit ai ka humbur shum\u00eb terren \u2013 m\u00eb shum\u00eb se \u00e7do teknologji tjet\u00ebr.<\/p>\n<p><b>T\u00eb k\u00ebrkuara si n\u00eb data engineering, ashtu edhe n\u00eb data science<\/b><\/p>\n<p>Duhet theksuar se tet\u00eb nga dhjet\u00eb pozicionet e para n\u00eb t\u00eb dy grupet p\u00ebrputhen. SQL, Python, Spark, AWS, Java, Hadoop, Hive dhe Scala hyn\u00eb n\u00eb dhjet\u00ebshen kryesore si p\u00ebr industrin\u00eb e data engineering, ashtu edhe p\u00ebr data science. N\u00eb grafikun m\u00eb posht\u00eb mund t\u00eb shihni pes\u00ebmb\u00ebdhjet\u00eb teknologjit\u00eb m\u00eb t\u00eb k\u00ebrkuara nga pun\u00ebdh\u00ebn\u00ebsit p\u00ebr data engineers, dhe pran\u00eb tyre treguesin p\u00ebr ofertat e pun\u00ebs p\u00ebr data scienctists.<\/p>\n<p><img decoding=\"async\" alt=\"Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer\" src=\"\/wp-content\/uploads\/2020\/01\/f2d36a492fd9dc8801d7541aa6cfb691.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<h4>Rekomandime<\/h4>\n<p>\nN\u00ebse doni t\u00eb merreni me data engineering, do t\u2019ju k\u00ebshilloja t\u00eb zot\u00ebroni teknologjit\u00eb e m\u00ebposhtme \u2013 po i rendis sipas prioritetit t\u00eb p\u00ebraf\u00ebrt.<\/p>\n<p>M\u00ebsoni SQL. Un\u00eb do t\u2019ju rekomandoja pik\u00ebrisht PostgreSQL, sepse \u00ebsht\u00eb open-source, ka popullaritet t\u00eb madh n\u00eb komunitet dhe \u00ebsht\u00eb n\u00eb faz\u00eb rritjeje. Si t\u00eb p\u00ebrdorni gjuh\u00ebn mund ta m\u00ebsoni nga libri My Memorable SQL \u2013 versioni i tij pilot \u00ebsht\u00eb i disponuesh\u00ebm <noindex><a rel=\"nofollow\" href=\"https:\/\/memorablesql.com\/\">k\u00ebtu<\/a><\/noindex>.<\/p>\n<p>P\u00ebrvet\u00ebsoni Python, edhe n\u00ebse jo n\u00eb nivelin m\u00eb t\u00eb avancuar. Libri My Memorable Python \u00ebsht\u00eb menduar pik\u00ebrisht p\u00ebr fillestar\u00ebt. Mund ta blini n\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/www.amazon.com\/Memorable-Python-Learn-Faster-ebook\/dp\/B07ZXJKKSN\/\">Amazon<\/a><\/noindex>, n\u00eb kopje elektronike ose fizike, sipas zgjedhjes suaj, ose ta shkarkoni n\u00eb format pdf ose epub <noindex><a rel=\"nofollow\" href=\"https:\/\/memorablepython.com\/\">n\u00eb k\u00ebt\u00eb faqe<\/a><\/noindex>.<\/p>\n<p>Sapo t\u00eb njiheni me Python, kaloni te pandas \u2014 nj\u00eb bibliotek\u00eb e Python q\u00eb p\u00ebrdoret p\u00ebr pastrimin dhe p\u00ebrpunimin e t\u00eb dh\u00ebnave. N\u00ebse synoni t\u00eb punoni n\u00eb nj\u00eb kompani ku k\u00ebrkohet aft\u00ebsia p\u00ebr t\u00eb shkruar n\u00eb Python (dhe shumica jan\u00eb t\u00eb tilla), mund t\u00eb jeni t\u00eb sigurt se njohja e pandas do t\u00eb merret si e mir\u00ebqen\u00eb. Tani po p\u00ebrfundoj nj\u00eb udh\u00ebzues hyr\u00ebs p\u00ebr pun\u00ebn me pandas \u2014 mund t\u00eb <noindex><a rel=\"nofollow\" href=\"https:\/\/dataawesome.com\/\">abonoheni<\/a><\/noindex>, q\u00eb t\u00eb mos humbisni publikimin.<\/p>\n<p>M\u00ebsoni AWS. N\u00ebse doni t\u00eb b\u00ebheni data engineer, nuk b\u00ebhet pa nj\u00eb platform\u00eb cloud n\u00eb arsenalin tuaj, dhe AWS \u00ebsht\u00eb m\u00eb e popullarizuara prej tyre. Mua m\u00eb ndihmuan shum\u00eb kurset e <noindex><a rel=\"nofollow\" href=\"https:\/\/linuxacademy.com\/\">Linux Academy<\/a><\/noindex>, kur po studioja <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/10-days-to-become-a-google-cloud-certified-professional-data-engineer-fdb6c401f8e0\">data engineering n\u00eb Google Cloud<\/a><\/noindex>, mendoj se kan\u00eb materiale t\u00eb mira edhe p\u00ebr AWS.<\/p>\n<p>N\u00ebse e keni p\u00ebrvet\u00ebsuar tashm\u00eb gjith\u00eb k\u00ebt\u00eb list\u00eb dhe d\u00ebshironi t\u00eb rriteni edhe m\u00eb shum\u00eb n\u00eb syt\u00eb e pun\u00ebdh\u00ebn\u00ebsve si data engineer, ju sugjeroj t\u00eb shtoni Apache Spark p\u00ebr pun\u00ebn me big data. Edhe pse studimi im p\u00ebr vendet e lira n\u00eb data science tregoi nj\u00eb r\u00ebnie t\u00eb interesit, p\u00ebr data engineer ai ende shfaqet pothuajse n\u00eb \u00e7do vend t\u00eb dyt\u00eb pune.<\/p>\n<h4>N\u00eb fund<\/h4>\n<p>\nShpresoj q\u00eb ky p\u00ebrmbledhje e teknologjive m\u00eb t\u00eb k\u00ebrkuara p\u00ebr data engineer t\u2019ju ket\u00eb qen\u00eb i dobish\u00ebm. N\u00ebse ju intereson si paraqitet situata n\u00eb vendet e lira t\u00eb pun\u00ebs p\u00ebr analist\u00ebt, lexoni <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/most-in-demand-tech-skills-for-data-analysts-26d4ea4450f8\">artikullin tim tjet\u00ebr<\/a><\/noindex>. Ju uroj suksese n\u00eb inxhinieri!<br \/>\n<br \/>Burimi: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/digital-ecosystems\/blog\/484120\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55327","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.2 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.2\" \/>\n\t\t<meta property=\"og:locale\" content=\"sq_AL\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-17T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:03:26+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Aft\u00ebsit\u00eb m\u00eb t\u00eb k\u00ebrkuara n\u00eb profesionin e data engineer | ProHoster","description":"Sipas statistikave t\u00eb vitit 2019, data engineer aktualisht \u00ebsht\u00eb nj\u00eb profesion shum\u00eb i k\u00ebrkuar.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster","og:description":"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430.","og:url":"https:\/\/prohoster.info\/sq\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-17T21:00:00+00:00","article:modified_time":"2020-02-18T11:03:26+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55327","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 13:45:53","updated":"2022-09-30 07:37:35","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/55327","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=55327"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/55327\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=55327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=55327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=55327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}