{"id":55327,"date":"2020-01-18T00:00:00","date_gmt":"2020-01-17T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/samye-vostrebovannye-navyki-v-professii-data-engineer"},"modified":"2020-02-18T14:03:26","modified_gmt":"2020-02-18T11:03:26","slug":"samye-vostrebovannye-navyki-v-professii-data-engineer","status":"publish","type":"post","link":"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","title":{"rendered":"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Saska\u0146\u0101 ar <noindex><a rel=\"nofollow\" href=\"https:\/\/insights.dice.com\/2019\/06\/04\/data-engineer-remains-top-demand-job\/\">2019. gada statistika<\/a><\/noindex>, datu in\u017eenieris \u0161obr\u012bd ir profesija, kuras piepras\u012bjums aug strauj\u0101k par cit\u0101m. Datu in\u017eenieris sp\u0113l\u0113 kritiski svar\u012bgu lomu organiz\u0101cij\u0101s \u2013 vi\u0146\u0161 izveido un uztur datu caurules un datu b\u0101zes, kas tiek izmantotas datu apstr\u0101dei, transform\u0113\u0161anai un glab\u0101\u0161anai. K\u0101di ir galvenie pras\u012bbas, kas nepiecie\u0161amas \u0161\u012bs profesijas p\u0101rst\u0101vjiem? Vai saraksts at\u0161\u0137iras no t\u0101, kas nepiecie\u0161ams datu zin\u0101tniekiem? Par to visu j\u016bs uzzin\u0101siet no manas raksta.<\/p>\n<p>Es analiz\u0113ju datu in\u017eeniera darba sludin\u0101jumus t\u0101d\u0101 form\u0101t\u0101, k\u0101d\u0101 tie bija 2020. gada janv\u0101r\u012b, lai saprastu, k\u0101das tehnolo\u0123iju prasmes ir vispopul\u0101r\u0101k\u0101s. P\u0113c tam es sal\u012bdzin\u0101ju ieg\u016btos rezult\u0101tus ar datu zin\u0101tnieka darbavietu statistiku \u2013 \u0161aj\u0101 proces\u0101 atkl\u0101j\u0101s da\u017ei interesanti at\u0161\u0137ir\u012bbas.<\/p>\n<p>Iepaz\u012bsimies bez gar\u0101m ievad\u0101m \u2013 \u0161eit ir desmit tehnolo\u0123ijas, kas visbie\u017e\u0101k tiek min\u0113tas darba sludin\u0101jumos:<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/91e7df1321d88a3076a5239b66a446d6.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Tehnolo\u0123iju piemin\u0113jumi datu in\u017eeniera darbaviet\u0101s 2020. gad\u0101<\/i><\/p>\n<p>S\u0101ksim izprast.<br \/>\n<noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<h4>Datu in\u017eeniera pien\u0101kumi<\/h4>\n<p>\nPa\u0161reiz\u0113j\u0101 br\u012bdi datu in\u017eenieru veikt\u0101 darba noz\u012bme ir milz\u012bga organiz\u0101cij\u0101m \u2013 tie\u0161i \u0161ie cilv\u0113ki ir atbild\u012bgi par inform\u0101cijas glab\u0101\u0161anu un t\u0101s transform\u0101ciju t\u0101d\u0101 form\u0101, lai citi darbinieki var\u0113tu ar to str\u0101d\u0101t. Datu in\u017eenieri izveido datu caurules, lai ieg\u016btu datus no da\u017e\u0101diem avotiem, gan pl\u016bsm\u0101s, gan pakotn\u0113s. P\u0113c tam caurules veic datu ieg\u016b\u0161anas, transform\u0113\u0161anas un iel\u0101d\u0113\u0161anas (citiem v\u0101rdiem sakot, ETL proces\u0101) oper\u0101cijas, padarot datus piem\u0113rot\u0101kus t\u0101l\u0101kai izmanto\u0161anai. P\u0113c tam dati tiek nodoti anal\u012bti\u0137iem un datu zin\u0101tniekiem dzi\u013c\u0101kai apstr\u0101dei. Visbeidzot, dati pabeidz savu ce\u013cojumu inform\u0101cijas pane\u013cos, zi\u0146ojumos un ma\u0161\u012bnm\u0101c\u012b\u0161an\u0101s mode\u013cos.<\/p>\n<p>Es mekl\u0113ju inform\u0101ciju, kas \u013cautu secin\u0101t, k\u0101das tehnolo\u0123ijas \u0161obr\u012bd ir vispiepras\u012bt\u0101k\u0101s datu in\u017eeniera darb\u0101.<\/p>\n<h4>Metodes<\/h4>\n<p>\nEs apkopoju inform\u0101ciju no trim darba mekl\u0113\u0161anas vietn\u0113m \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/www.simplyhired.com\/\">SimplyHired<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/www.indeed.com\/\">Indeed<\/a><\/noindex> un <noindex><a rel=\"nofollow\" href=\"https:\/\/www.monster.com\/\">Monster<\/a><\/noindex> un skat\u012bjos, k\u0101di atsl\u0113gv\u0101rdi bie\u017ei sastopami kop\u0101 ar \u201edatu in\u017eenieris\u201d darba sludin\u0101jumos, kas paredz\u0113ti ASV iedz\u012bvot\u0101jiem. \u0160im uzdevumam es izmantoju divas Python bibliot\u0113kas \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/requests.readthedocs.io\/en\/master\/\">Requests<\/a><\/noindex> un <noindex><a rel=\"nofollow\" href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/bs4\/doc\/\">Beautiful Soup<\/a><\/noindex>. Es ietveru atsl\u0113gv\u0101rdus, kas ietilpst iepriek\u0161\u0113j\u0101 sarakst\u0101 par datu zin\u0101tnieku vakanc\u0113m, k\u0101 ar\u012b tos, kurus es izv\u0113l\u0113jos pats, lasot pied\u0101v\u0101jumus par darbu datu in\u017eenieriem. LinkedIn netika iek\u013cauts avotu sarakst\u0101, jo mani tur blo\u0137\u0113ja p\u0113c iepriek\u0161\u0113j\u0101s datu v\u0101k\u0161anas m\u0113\u0123in\u0101juma.<\/p>\n<p>Katram atsl\u0113gv\u0101rdam es apr\u0113\u0137in\u0101ju procentu\u0101lo da\u013cu no kop\u0113j\u0101 tekstu skaita katr\u0101 no vietn\u0113m atsevi\u0161\u0137i, un p\u0113c tam apr\u0113\u0137in\u0101ju vid\u0113jo v\u0113rt\u012bbu tr\u012bs avotiem.<\/p>\n<h4>Rezult\u0101ti<\/h4>\n<p>\nZem\u0101k ir sniegti tr\u012bsdesmit tehniskie termini datu in\u017eenierijas jom\u0101 ar visaugst\u0101kajiem r\u0101d\u012bt\u0101jiem vis\u0101s trij\u0101s darba vakance\u0161u vietn\u0113s.<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/a46401973d369dace7f53c890172af8c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>\u0160eit ir tie pa\u0161i dati, bet att\u0113loti tabulas veid\u0101:<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/c29e2861806b0761bc5b1be6eb46ec5d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>S\u0101ksim pa\u0161i k\u0101rt\u012bb\u0101.<\/p>\n<p><b>Rezult\u0101tu apskats<\/b><\/p>\n<p>Gan SQL, gan Python par\u0101d\u0101s vair\u0101k nek\u0101 div\u0101s tre\u0161da\u013c\u0101s apskat\u012bto vakances. Tie\u0161i \u0161\u012bs divas tehnolo\u0123ijas ir j\u0101m\u0101c\u0101s vispirms. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.python.org\/\">Python<\/a><\/noindex> \u2013 \u013coti popul\u0101ra programm\u0113\u0161anas valoda, kas tiek izmantota datu apstr\u0101d\u0113, t\u012bmek\u013ca viet\u0146u izveid\u0113 un skriptu rakst\u012b\u0161an\u0101. <noindex><a rel=\"nofollow\" href=\"https:\/\/ru.wikipedia.org\/wiki\/SQL\">SQL<\/a><\/noindex> izsaka Structured Query Language (struktur\u0113to vaic\u0101jumu valoda); t\u0101 nor\u0101da uz standartu, ko realiz\u0113 valodu grupa, un tiek izmantota datu ieg\u016b\u0161anai no rel\u0101ciju datub\u0101z\u0113m. T\u0101 ir par\u0101d\u012bjusies jau sen un ir pier\u0101d\u012bjusi sevi ar augstu iztur\u012bbu.<\/p>\n<p>Par Spark run\u0101 apm\u0113ram pus\u0113 vakanci. <noindex><a rel=\"nofollow\" href=\"https:\/\/spark.apache.org\/\">Apache Spark<\/a><\/noindex> \u2013 ir 'apvienotais anal\u012btiskais dzin\u0113js lielu datu apstr\u0101dei ar ieb\u016bv\u0113tiem modu\u013ciem straum\u0113\u0161anai, SQL, ma\u0161\u012bnm\u0101c\u012b\u0161an\u0101s un grafu apstr\u0101dei'. Tas ir \u012bpa\u0161i popul\u0101rs starp tiem, kas str\u0101d\u0101 ar lielu apjomu datu b\u0101z\u0113m.<\/p>\n<p>AWS par\u0101d\u0101s apm\u0113ram 45% vakances tekstos. T\u0101 ir Amazon ra\u017eota m\u0101ko\u0146datoru platforma; tai ir visliel\u0101k\u0101 tirgus da\u013ca starp vis\u0101m m\u0101ko\u0146platform\u0101m.<br \/>\nSekojot Java un Hadoop \u2013 nedaudz vair\u0101k par 40% katram. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.java.com\/en\/\">Java<\/a><\/noindex> \u2013 pla\u0161i izplat\u012bta, c\u012b\u0146\u0101 p\u0101rbaud\u012bta valoda, kas <noindex><a rel=\"nofollow\" href=\"https:\/\/insights.stackoverflow.com\/survey\/2019#most-loved-dreaded-and-wanted\">tika desmitaj\u0101 viet\u0101 2019. gada Stack Overflow izstr\u0101d\u0101t\u0101ju aptauj\u0101<\/a><\/noindex> attiec\u012bb\u0101 uz valod\u0101m, kas rada programm\u0113t\u0101jiem \u0161ausmas. Pret\u0113ji tam, Python izr\u0101d\u012bj\u0101s otrais vism\u012bl\u0113t\u0101kais valoda. Java valodu vada Oracle, un visu, kas par to nepiecie\u0161ams zin\u0101t, var saprast no \u0161\u012b ekr\u0101nuz\u0146\u0113muma no ofici\u0101l\u0101s lapas 2020. gada janv\u0101r\u012b.<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/ed119ff8bac06c9d25b996d6be7f32dd.jpg\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\n<i>K\u0101 b\u016btu ce\u013cojot cauri laikam<\/i><br \/>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/\">Apache Hadoop<\/a><\/noindex> izmanto programmat\u016bras modeli MapReduce ar serveru klasteriem lieliem datiem. Tagad no \u0161\u012b mode\u013ca arvien bie\u017e\u0101k atsak\u0101s.<\/p>\n<p>T\u0101l\u0101k m\u0113s redzam Hive, Scala, Kafka un NoSQL \u2013 katra no \u0161\u012bm tehnolo\u0123ij\u0101m tiek piemin\u0113ta ceturtda\u013c\u0101 no iesniegtaj\u0101m vakanc\u0113m. Apache Hive \u2013 tas ir datu kr\u0101tuves programma, kas \"atvieglo lielu datu kopu las\u012b\u0161anu, rakst\u012b\u0161anu un p\u0101rvald\u012bbu, kas atrodas sadal\u012bt\u0101s kr\u0101tuv\u0113s, izmantojot SQL\". <noindex><a rel=\"nofollow\" href=\"https:\/\/www.scala-lang.org\/\">Scala<\/a><\/noindex> \u2013 programm\u0113\u0161anas valoda, ko akt\u012bvi izmanto, str\u0101d\u0101jot ar lieliem datiem. \u012apa\u0161i uz Scala tika rad\u012bts Spark. Iepriek\u0161 min\u0113taj\u0101 sarakst\u0101 par bied\u0113jo\u0161\u0101m programm\u0113\u0161anas valod\u0101m Scala ie\u0146em vienpadsmito vietu. <noindex><a rel=\"nofollow\" href=\"https:\/\/kafka.apache.org\/intro\">Apache Kafka<\/a><\/noindex> \u2013 sadal\u012bta platforma pl\u016bsto\u0161u zi\u0146ojumu apstr\u0101dei. \u013boti popul\u0101ra k\u0101 datu pl\u016bsmas r\u012bks.<\/p>\n<p><noindex><a rel=\"nofollow\" href=\"https:\/\/www.mongodb.com\/scale\/nosql-vs-relational-databases\">NoSQL datub\u0101zes<\/a><\/noindex> nost\u0101dina sevi pret\u012b SQL. Tie at\u0161\u0137iras ar to, ka nav rel\u0101ciju, nav struktur\u0113ti un pied\u0101v\u0101 horizont\u0101lu m\u0113rogojam\u012bbu. NoSQL ieguvis zin\u0101mu popularit\u0101ti, tom\u0113r aps\u0113st\u012bba ar \u0161o pieeju, l\u012bdz pat pravietojumiem, ka tas aizvietos SQL k\u0101 domin\u0113jo\u0161o uzglab\u0101\u0161anas paradigmu, \u0161\u0137iet, jau ir pag\u0101tn\u0113.<\/p>\n<h4>sal\u012bdzin\u0101jums ar terminolo\u0123iju vakanc\u0113s datu zin\u0101tnieka lomai<\/h4>\n<p>\n\u0160eit ir tr\u012bsdesmit tehnolo\u0123iskie termini, visbie\u017e\u0101k sastopami darba dev\u0113ju piepras\u012bjum\u0101 datu zin\u0101tn\u0113. \u0160o sarakstu es ieguvu t\u0101d\u0101 pa\u0161\u0101 veid\u0101, k\u0101 aprakst\u012bts iepriek\u0161 datu in\u017eenierij\u0101.<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/d200159a3b56d0ceae1031b0b8d31e3b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Tehnolo\u0123iju piemin\u0113\u0161ana vakanc\u0113s datu zin\u0101tnieka amatam 2020. gad\u0101<\/i><\/p>\n<p>Run\u0101jot par kop\u0113jo skaitu, sal\u012bdzinot ar iepriek\u0161 apskat\u012bto pied\u0101v\u0101jumu, vakance bija vair\u0101k par 28% (12 013 pret 9396). Apskat\u012bsim, kuras tehnolo\u0123ijas ir sastopamas vakanc\u0113s datu zin\u0101tniekiem ret\u0101k nek\u0101 datu in\u017eenieriem.<\/p>\n<p><b>Popul\u0101r\u0101kas datu in\u017eenierij\u0101<\/b><\/p>\n<p>T\u0101l\u0101k redzamaj\u0101 diagramm\u0101 ir par\u0101d\u012bti atsl\u0113gv\u0101rdi ar vid\u0113jo starp\u012bbu v\u0113rt\u012bb\u0101s, kas ir liel\u0101ka par 10% vai maz\u0101ka par -10%.<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/97fa2dca4ba7d4b821d4a8cea0e59214.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Visliel\u0101k\u0101s at\u0161\u0137ir\u012bbas atsl\u0113gv\u0101rdu bie\u017eum\u0101 datu in\u017eeniera un datu zin\u0101tnieka lom\u0101m<\/i><\/p>\n<p>Vissevi\u0161\u0137\u0101k\u0101 izaugsme tiek konstat\u0113ta AWS: datu in\u017eenierij\u0101 tas par\u0101d\u0101s par 25% bie\u017e\u0101k nek\u0101 datu zin\u0101tn\u0113 (aptuveni 45% un 20% no kop\u0113j\u0101 vakance skaita attiec\u012bgi). Starp\u012bba ir iev\u0113rojama!<\/p>\n<p>\u0160ie pa\u0161i dati nedaudz at\u0161\u0137ir\u012bg\u0101 veid\u0101 \u2013 diagramm\u0101 rezult\u0101ti vienam un tam pa\u0161am atsl\u0113gv\u0101rdam vakanc\u0113s datu in\u017eeniera un datu zin\u0101tnieka lom\u0101m novietoti blakus.<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/1d71d42a17475f7c80cf6c1ff5d525af.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Visliel\u0101k\u0101s at\u0161\u0137ir\u012bbas atsl\u0113gv\u0101rdu bie\u017eum\u0101 datu in\u017eeniera un datu zin\u0101tnieka lom\u0101m<\/i><\/p>\n<p>N\u0101kamais liel\u0101kais pieaugums ir nov\u0113rots Spark \u2013 datu in\u017eenieriem bie\u017ei j\u0101str\u0101d\u0101 ar lieliem datiem. <noindex><a rel=\"nofollow\" href=\"https:\/\/kafka.apache.org\/\">Kafka<\/a><\/noindex> ar\u012b pieauga par 20%, tas ir, gandr\u012bz \u010detras reizes sal\u012bdzin\u0101jum\u0101 ar datu zin\u0101tnieku vakanc\u0113m. Datu nodo\u0161ana ir viena no galvenaj\u0101m datu in\u017eeniera atbild\u012bb\u0101m. Visbeidzot, min\u0113jumu skaits datu in\u017eenierijas jom\u0101 Java, NoSQL, Redshift, SQL un Hadoop bija par 15% liel\u0101ks.<\/p>\n<p><b>Maz\u0101k popul\u0101ras datu in\u017eenierij\u0101<\/b><\/p>\n<p>Tagad apl\u016bkosim, kuras tehnolo\u0123ijas ir maz\u0101k popul\u0101ras datu in\u017eenieru vakanc\u0113s. <br \/>\nVisliel\u0101kais kritums sal\u012bdzin\u0101jum\u0101 ar datu zin\u0101tnes jomu bija <noindex><a rel=\"nofollow\" href=\"https:\/\/www.r-project.org\/about.html\">R<\/a><\/noindex>: \u0161eit tas par\u0101d\u012bj\u0101s aptuveni 56% vakanc\u0113s, bet \u0161eit \u2013 tikai 17%. Iespaid\u012bgi. R ir programm\u0113\u0161anas valoda, ko lieto zin\u0101tnieki un statisti\u0137i, k\u0101 ar\u012b ie\u0146em astoto vietu \u0161ausm\u012bgo valodu rang\u0101.<\/p>\n<p><noindex><a rel=\"nofollow\" href=\"https:\/\/www.sas.com\/en_us\/home.html\">SAS<\/a><\/noindex> ar\u012b ret\u0101k sastopams datu in\u017eeniera vakanc\u0113s \u2013 at\u0161\u0137ir\u012bba ir 14%. SAS ir patent\u0113ta valoda, kas paredz\u0113ta statistikas un datu apstr\u0101dei. Interesants moments: p\u0113c man\u0101 p\u0113t\u012bjum\u0101 <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/the-most-in-demand-tech-skills-for-data-scientists-d716d10c191d\">mani p\u0113t\u012bjumi par datu zin\u0101tnieku vakanc\u0113m<\/a><\/noindex>, p\u0113d\u0113j\u0101 laik\u0101 t\u0101 ir iev\u0113rojami zaud\u0113jusi poz\u012bcijas \u2013 vair\u0101k nek\u0101 jebkura cita tehnolo\u0123ija.<\/p>\n<p><b>Piepras\u012btas gan datu in\u017eenierij\u0101, gan datu zin\u0101tn\u0113<\/b><\/p>\n<p>J\u0101atz\u012bm\u0113, ka asto\u0146as no desmit pirmaj\u0101m poz\u012bcij\u0101m abos kopumos sakr\u012bt. SQL, Python, Spark, AWS, Java, Hadoop, Hive un Scala iek\u013c\u0101v\u0101s desmitniek\u0101 gan datu in\u017eenierijas, gan datu zin\u0101tnes jom\u0101. Zem\u0101k eso\u0161aj\u0101 grafik\u0101 j\u016bs varat redz\u0113t piecpadsmit popul\u0101r\u0101k\u0101s tehnolo\u0123ijas datu in\u017eenieru darba dev\u0113jiem, blakus \u2013 to r\u0101d\u012bt\u0101js datu zin\u0101tnieku vakanc\u0113s.<\/p>\n<p><img decoding=\"async\" alt=\"Vispiepras\u012bt\u0101kas prasmes datu in\u017eeniera profesij\u0101.\" src=\"\/wp-content\/uploads\/2020\/01\/f2d36a492fd9dc8801d7541aa6cfb691.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<h4>Ieteikumi<\/h4>\n<p>\nJa v\u0113laties nodarboties ar datu in\u017eenieriju, es ieteiktu apg\u016bt \u0161\u0101das tehnolo\u0123ijas \u2013 es t\u0101s uzskait\u012b\u0161u apm\u0113ram priorit\u0101tes sec\u012bb\u0101.<\/p>\n<p>Apg\u016bstiet SQL. Es ieteiktu tie\u0161i PostgreSQL, jo tai ir atv\u0113rt\u0101 koda, liela popularit\u0101te kopien\u0101 un t\u0101 ir izaugsmes f\u0101z\u0113. K\u0101 izmantot valodu, var uzzin\u0101t gr\u0101mat\u0101 My Memorable SQL \u2013 t\u0101s pilotversija ir pieejama <noindex><a rel=\"nofollow\" href=\"https:\/\/memorablesql.com\/\">\u0161eit<\/a><\/noindex>.<\/p>\n<p>Apg\u016bstiet Python, pat ne pa\u0161\u0101 gr\u016bt\u0101kaj\u0101 l\u012bmen\u012b. Gr\u0101mata My Memorable Python ir tie\u0161i dom\u0101ta ies\u0101c\u0113jiem. To var nopirkt <noindex><a rel=\"nofollow\" href=\"https:\/\/www.amazon.com\/Memorable-Python-Learn-Faster-ebook\/dp\/B07ZXJKKSN\/\">Amazon<\/a><\/noindex>, elektronisko kopiju vai fizisko, p\u0113c j\u016bsu izv\u0113les, vai lejupiel\u0101d\u0113t pdf vai epub form\u0101t\u0101 <noindex><a rel=\"nofollow\" href=\"https:\/\/memorablepython.com\/\">\u0161aj\u0101 vietn\u0113<\/a><\/noindex>.<\/p>\n<p>Kad esat iepazinu\u0161ies ar Python, p\u0101rejiet uz pandas \u2013 Python bibliot\u0113ku, kas tiek izmantota datu t\u012br\u012b\u0161anai un apstr\u0101dei. Ja pl\u0101nojat str\u0101d\u0101t uz\u0146\u0113mum\u0101, kur\u0101 tiek pras\u012btas programm\u0113\u0161anas prasmes Python (un t\u0101di ir liel\u0101k\u0101 da\u013ca), varat b\u016bt p\u0101rliecin\u0101ti, ka zin\u0101\u0161anas par pandas tiek pie\u0146emts k\u0101 pa\u0161saprotams. Es \u0161obr\u012bd pabeidzu ievada ce\u013cvedi darbam ar pandas \u2013 varat <noindex><a rel=\"nofollow\" href=\"https:\/\/dataawesome.com\/\">pieteikties<\/a><\/noindex>, lai nepalaistu gar\u0101m br\u012bdi, kad tas tiks public\u0113ts.<\/p>\n<p>Apg\u016bstiet AWS. Ja v\u0113laties k\u013c\u016bt par datu in\u017eenieri, jums b\u016bs nepiecie\u0161ama m\u0101ko\u0146u platforma, un AWS ir vispopul\u0101r\u0101k\u0101 no t\u0101m. Man \u013coti pal\u012bdz\u0113ja kursi <noindex><a rel=\"nofollow\" href=\"https:\/\/linuxacademy.com\/\">Linux Academy<\/a><\/noindex>, kad es m\u0101c\u012bjos <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/10-days-to-become-a-google-cloud-certified-professional-data-engineer-fdb6c401f8e0\">datu in\u017eenierij\u0101 Google Cloud<\/a><\/noindex>, dom\u0101ju, ka ar\u012b par AWS var atrast labus materi\u0101lus.<\/p>\n<p>Ja jau esat apguvis visu \u0161o sarakstu un v\u0113laties v\u0113l vair\u0101k pacelt savu v\u0113rt\u012bbu ac\u012bs darba dev\u0113jiem k\u0101 datu in\u017eenieris, iesaku pievienot Apache Spark darbam ar lieliem datiem. Lai gan mana p\u0113t\u012bjuma rezult\u0101ti par datu zin\u0101tnes vakanc\u0113m par\u0101d\u012bja intere\u0161u samazin\u0101\u0161anos, datu in\u017eenieru jom\u0101 t\u0101s tom\u0113r par\u0101d\u0101s gandr\u012bz katr\u0101 otraj\u0101 vakanc\u0113.<\/p>\n<h4>Visbeidzot<\/h4>\n<p>\nCeru, ka \u0161is p\u0101rskats par vispiepras\u012bt\u0101kaj\u0101m tehnolo\u0123ij\u0101m datu in\u017eenieriem bija jums noder\u012bgs. Ja j\u016bs interes\u0113, k\u0101 izskat\u0101s kuras anal\u012bti\u0137us vakances, izlasiet <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/most-in-demand-tech-skills-for-data-analysts-26d4ea4450f8\">citu manu rakstu<\/a><\/noindex>. Veiksm\u012bgu in\u017eenieriju!<br \/>\n<br \/>Avots: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/digital-ecosystems\/blog\/484120\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55327","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.4 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.4\" \/>\n\t\t<meta property=\"og:locale\" content=\"lv_LV\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-17T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:03:26+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Vispiepras\u012bt\u0101k\u0101s prasmes datu in\u017eeniera profesij\u0101 | ProHoster","description":"Saska\u0146\u0101 ar 2019. gada statistiku, datu in\u017eenieris pa\u0161laik ir profesija, uz kuru ir piepras\u012bjums.","canonical_url":"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"lv_LV","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster","og:description":"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430.","og:url":"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-17T21:00:00+00:00","article:modified_time":"2020-02-18T11:03:26+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55327","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 13:45:53","updated":"2022-09-30 07:37:35","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/posts\/55327","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/comments?post=55327"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/posts\/55327\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/media?parent=55327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/categories?post=55327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/tags?post=55327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}