{"id":55327,"date":"2020-01-18T00:00:00","date_gmt":"2020-01-17T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/samye-vostrebovannye-navyki-v-professii-data-engineer"},"modified":"2020-02-18T14:03:26","modified_gmt":"2020-02-18T11:03:26","slug":"samye-vostrebovannye-navyki-v-professii-data-engineer","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","title":{"rendered":"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Vastavalt <noindex><a rel=\"nofollow\" href=\"https:\/\/insights.dice.com\/2019\/06\/04\/data-engineer-remains-top-demand-job\/\">2019. aasta statistikast<\/a><\/noindex>, andmekinineer on hetkel amet, mille j\u00e4rele on n\u00f5udlus kiireimalt kasvav. Andmekinineer m\u00e4ngib organisatsioonides kriitilist rolli \u2013 loob ja hooldab t\u00f6\u00f6tingimustes andmeharusid ja -baase, mida kasutatakse andmete t\u00f6\u00f6tlemiseks, transformeerimiseks ja salvestamiseks. Milliseid oskusi on selle ametiga tegelevatel inimestel eelk\u00f5ige vaja? Erineb see nimekirjast, mis on vajalik andmete teadlaste puhul? K\u00f5ik selle kohta saad teada minu artiklist.<\/p>\n<p>Anal\u00fc\u00fcsisin andmekinineeri ametikohtade kuulutusi jaanuaris 2020, et v\u00e4lja selgitada, millised tehnoloogilised oskused on k\u00f5ige populaarsemad. Seej\u00e4rel v\u00f5rdlesin saadud tulemusi andmete teadlaste ametikohtade statistikaga \u2013 selgusid m\u00f5ned huvitavad erinevused.<\/p>\n<p>L\u00e4hme ilma pikemate eess\u00f5nadeta otse asja juurde \u2013 siin on k\u00fcmme k\u00f5ige sagedamini mainitud tehnoloogiat ametikohtade kuulutustes:<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/91e7df1321d88a3076a5239b66a446d6.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Tehnoloogiate mainimised andmekinineeri ametikohtades 2020. aastal<\/i><\/p>\n<p>Hakkame kohe asja selgitama.<br \/>\n<noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<h4>Andmekinineeri kohustused<\/h4>\n<p>\nT\u00e4nap\u00e4eval on andmeinsenerite t\u00f6\u00f6 organisatsioonidele \u00e4\u00e4rmiselt oluline \u2013 just need inimesed vastutavad teabe s\u00e4ilitamise eest ning esitavad selle sellisel kujul, et teised t\u00f6\u00f6tajad saaksid sellega t\u00f6\u00f6tada. Andmeinsenerid loovad vooge, et korraldada andmete saamist erinevatest allikatest kas pidevalt v\u00f5i pakettidena. Edasi voogud viivad l\u00e4bi andmete kraapimise, transformatsiooni ja laadimise (teisis\u00f5nu ETL-protsessidega), muutes andmed edasiseks kasutamiseks sobivamaks. P\u00e4rast seda antakse andmed anal\u00fc\u00fctikutele ja andmeteadlastele s\u00fcvaarendamiseks. L\u00f5puks l\u00f5petavad andmed oma teekonna informatsiooni paneelidel, aruannetes ja masin\u00f5ppe mudelites.<\/p>\n<p>Otsisin teavet, mis v\u00f5imaldaks j\u00e4reldada, millised tehnoloogiad on praegu andmeinseneri t\u00f6\u00f6s k\u00f5ige n\u00f5utumad.<\/p>\n<h4>Meetodid<\/h4>\n<p>\nKogusin teavet kolmest t\u00f6\u00f6tamisportaali veebisaidist \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/www.simplyhired.com\/\">SimplyHired<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/www.indeed.com\/\">Indeed<\/a><\/noindex> ja <noindex><a rel=\"nofollow\" href=\"https:\/\/www.monster.com\/\">Monster<\/a><\/noindex> ja vaatasin, millised m\u00e4rks\u00f5nad esinevad koos \u00abandmeinsener\u00bb t\u00f6\u00f6kuulutustes, mis on m\u00f5eldud USA elanikele. Selle \u00fclesande t\u00e4itmiseks kasutasin kahte Python'i raamatukogu \u2014 <noindex><a rel=\"nofollow\" href=\"https:\/\/requests.readthedocs.io\/en\/master\/\">Requests<\/a><\/noindex> ja <noindex><a rel=\"nofollow\" href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/bs4\/doc\/\">Beautiful Soup<\/a><\/noindex>. S\u00f5nade hulka, mille valisin, kuulusid nii need, mis olid eelnevas nimekirjas data scientist'i ametikoha anal\u00fc\u00fcsi jaoks, kui ka need, mille valisin k\u00e4sitsi, lugedes data engineer'i t\u00f6\u00f6kuulutusi. LinkedIn ei kuulunud allikate hulka, kuna mind on seal p\u00e4rast eelmist katset andmeid koguda blokeeritud.<\/p>\n<p>Iga v\u00f5tmes\u00f5na kohta arvutasin v\u00e4lja protsendi, kui palju see esines iga veebisaidi tekstides eraldi, ja siis arvutasin kolme allika keskmise v\u00e4\u00e4rtuse.<\/p>\n<h4>Tulemused<\/h4>\n<p>\nAllpool on esitatud kolmk\u00fcmmend tehnilist m\u00f5istet andmeinseneride valdkonnast, millel on k\u00f5ige k\u00f5rgemad n\u00e4itajad k\u00f5ikidel kolmel t\u00f6\u00f6kuulutuste saidil.<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/a46401973d369dace7f53c890172af8c.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Siin on samad numbrid, kuid esitatud tabelina:<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/c29e2861806b0761bc5b1be6eb46ec5d.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p>Liigume edasi.<\/p>\n<p><b>Tulemuste \u00fclevaade<\/b><\/p>\n<p>N nii SQL kui ka Python ilmuvad enam kui kahel kolmandikul uuritud t\u00f6\u00f6kuulutustest. Just neid kahte tehnoloogiat on m\u00f5istlik k\u00f5igepealt uurida. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.python.org\/\">Python<\/a><\/noindex> \u2013 v\u00e4ga populaarne programmeerimiskeel, mida kasutatakse andmetega t\u00f6\u00f6tamiseks, veebisaitide loomiseks ja skriptide kirjutamiseks. <noindex><a rel=\"nofollow\" href=\"https:\/\/ru.wikipedia.org\/wiki\/SQL\">SQL<\/a><\/noindex> t\u00e4hendab Structured Query Language (struktureeritud p\u00e4ringute keel); see esindab standardit, mida rakendatakse mitme keele r\u00fchmas, ja seda kasutatakse andmete hankimiseks relatsioonilistest andmebaasidest. See ilmus juba ammu ja on t\u00f5estanud oma k\u00f5rge vastupidavuse.<\/p>\n<p>Sparkist r\u00e4\u00e4gitakse umbes poole t\u00f6\u00f6kuulutuste puhul. <noindex><a rel=\"nofollow\" href=\"https:\/\/spark.apache.org\/\">Apache Spark<\/a><\/noindex> on \u00ab\u00fchtne anal\u00fc\u00fcsimootor suurte andmete t\u00f6\u00f6tlemiseks, mis sisaldab sisseehitatud mooduleid voogedastamiseks, SQL-ile, masin\u00f5ppele ja graafit\u00f6\u00f6tlusele\u00bb. See on eriti populaarne nende seas, kes t\u00f6\u00f6tavad suurte andmebaasidega.<\/p>\n<p>AWS ilmneb umbes 45% t\u00f6\u00f6kuulutustes. See on Amazonase toodetud pilvekalkulatsiooni platvorm; tal on suurim turuosa k\u00f5igi pilveteenuste platvormide seas.<br \/>\nJ\u00e4rgnev on Java ja Hadoop \u2013 iga\u00fche osakaal on veidi \u00fcle 40%. <noindex><a rel=\"nofollow\" href=\"https:\/\/www.java.com\/en\/\">Java<\/a><\/noindex> on laialdaselt levinud, lahingutes t\u00f5estatud keel, mis <noindex><a rel=\"nofollow\" href=\"https:\/\/insights.stackoverflow.com\/survey\/2019#most-loved-dreaded-and-wanted\">Stack Overflow 2019. aasta arendajate k\u00fcsitluses<\/a><\/noindex> sai k\u00fcmnendat kohta programmeerijate seas hirmu tekitavate keelte kategoorias. Vastupidiselt sellele, Python osutus teiseks armastatuimaks keeliks. Java keelt juhib Oracle, ja k\u00f5ik, mida selle kohta teada, saab m\u00f5ista j\u00e4rgnevast ekraanipildist, mis on tehtud ametlikult 2020. aasta jaanuaris.<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/ed119ff8bac06c9d25b996d6be7f32dd.jpg\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\n<i>Nagu reis l\u00e4bi ajamasina<\/i><br \/>\n<noindex><a rel=\"nofollow\" href=\"https:\/\/hadoop.apache.org\/\">Apache Hadoop<\/a><\/noindex> kasutab suurte andmete jaoks MapReduce tarkvara mudelit serveriklastritega. Selle mudeli kasutamisest hakatakse j\u00e4rjest enam loobuma.<\/p>\n<p>Edasi n\u00e4eme Hive'i, Scala't, Kafka't ja NoSQL-i \u2013 iga\u00fcht neist tehnoloogiatest mainitakse neljandas osas esitatud t\u00f6\u00f6pakkumistest. Apache Hive on andmehoidla programm, mis \"lihtsustab suurte andmekogude lugemist, kirjutamist ja haldamist jaotatud salvestusse, kasutades SQLi.\" <noindex><a rel=\"nofollow\" href=\"https:\/\/www.scala-lang.org\/\">Scala<\/a><\/noindex> \u2013 programmeerimiskeel, mida kasutatakse aktiivselt suurte andmete t\u00f6\u00f6tlemisel. Eriti Scala'l loodi Spark. Varem mainitud hirmu tekitavate keelte edetabelis asub Scala \u00fcheteistk\u00fcmnendal kohal. <noindex><a rel=\"nofollow\" href=\"https:\/\/kafka.apache.org\/intro\">Apache Kafka<\/a><\/noindex> \u2013 jagatud platvorm voogedastuste t\u00f6\u00f6tlemiseks. V\u00e4ga populaarne andmevoogude edastamiseks.<\/p>\n<p><noindex><a rel=\"nofollow\" href=\"https:\/\/www.mongodb.com\/scale\/nosql-vs-relational-databases\">NoSQL andmebaasid<\/a><\/noindex> seavad SQL. Need on erinevad, kuna need ei ole reaalsed, ei ole struktureeritud ja omavad horisontaalset skaleeritavust. NoSQL on saavutanud teatud populaarsuse, kuid n\u00e4iliselt on selle l\u00e4henemisega seotud palavikuline vaimustus, sealhulgas ennustused, et see asendab SQL-i kui domineerivat salvestamise paradigmat, juba m\u00f6\u00f6das.<\/p>\n<h4>V\u00f5rdlus data scientist'i t\u00f6\u00f6kuulutuste terminitega<\/h4>\n<p>\nSiin on kolmk\u00fcmmend tehnoloogia terminit, mis on t\u00f6\u00f6andjate seas andmete teaduse valdkonnas k\u00f5ige levinumad. Selle loendi sain samamoodi, nagu eespool on kirjeldatud andmete inseneri osas.<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/d200159a3b56d0ceae1031b0b8d31e3b.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Tehnoloogiate mainimised data scientist'i ametikohtade t\u00f6\u00f6kuulutustes 2020. aastal<\/i><\/p>\n<p>Kokkuv\u00f5ttes, v\u00f5rreldes varem k\u00e4sitletud kogumiga, on t\u00f6\u00f6kuulutusi 28% rohkem (12 013 versus 9396). Vaadake, milliseid tehnoloogiaid kohtab data scientist'i t\u00f6\u00f6kuulutustes v\u00e4hem kui andmete inseneride omaduses.<\/p>\n<p><b>Populaarsed andmete insenerimise valdkonnas<\/b><\/p>\n<p>Alloleval diagrammil on n\u00e4idatud m\u00e4rks\u00f5nu, mille keskmine erinevus on suurem kui 10% v\u00f5i v\u00e4iksem kui -10%.<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/97fa2dca4ba7d4b821d4a8cea0e59214.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Suurimad erinevused m\u00e4rks\u00f5nade sageduses data inseneri ja data scientist'i vahel<\/i><\/p>\n<p>AWS n\u00e4itab k\u00f5ige suuremat kasvu: andmete inseneeria valdkonnas esineb see 25% sagedamini kui andmete teaduses (umbes 45% ja 20% vastavalt t\u00f6\u00f6kuulutuste koguhulgast). Erinevus on m\u00e4rkimisv\u00e4\u00e4rne!<\/p>\n<p>Siin on samad andmed veidi teistsuguses esituses \u2013 graafikul on tulemused sama m\u00e4rks\u00f5na jaoks andmeinseneri ja andmeteadlase ametikohtade kuulutustes k\u00f5rvuti.<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/1d71d42a17475f7c80cf6c1ff5d525af.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><i>Suurimad erinevused m\u00e4rks\u00f5nade sageduses data inseneri ja data scientist'i vahel<\/i><\/p>\n<p>Suurim h\u00fcpe on n\u00e4htav Sparkis \u2013 andmeinsener peab sageli t\u00f6\u00f6tama suurte andmetega. <noindex><a rel=\"nofollow\" href=\"https:\/\/kafka.apache.org\/\">Kafka<\/a><\/noindex> t\u00f5usis samuti 20%, mis on peaaegu neli korda rohkem v\u00f5rreldes andmeteadlase ametikohtadega. Andmete edastamine on \u00fcks peamisi andmeinseneri \u00fclesandeid. L\u00f5puks, andmete inseneeria valdkonnas oli Java, NoSQL, Redshift, SQL ja Hadoopi mainimiste arv 15% suurem.<\/p>\n<p><b>Andmete inseneerias v\u00e4hem populaarsed<\/b><\/p>\n<p>N\u00fc\u00fcd vaatame, millised tehnoloogiad on andmeinseneri ametikohtades v\u00e4hem populaarsed. <br \/>\nK\u00f5ige teravam langus v\u00f5rreldes andmete teaduse valdkonnaga toimus <noindex><a rel=\"nofollow\" href=\"https:\/\/www.r-project.org\/about.html\">R<\/a><\/noindex>: seal ilmus see umbes 56% ametikohtadest, siin \u2013 ainult 17%. Muljetavaldav. R \u2013 programmeerimiskeel, mida kasutavad teadlased ja statistikud ning mis on ka kaheksandal kohal k\u00f5ige hirmu\u00e4ratavamate keelte reitingus.<\/p>\n<p><noindex><a rel=\"nofollow\" href=\"https:\/\/www.sas.com\/en_us\/home.html\">SAS<\/a><\/noindex> kuulub t\u00f6\u00f6kohtadesse data engineer m\u00e4rgatavalt harvemini \u2013 erinevus on 14%. SAS on patenteeritud keel, mis on m\u00f5eldud statistika ja andmetega t\u00f6\u00f6tamiseks. Huvi pakkuv punkt: uuringu tulemuste p\u00f5hjal <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/the-most-in-demand-tech-skills-for-data-scientists-d716d10c191d\">data scientistide t\u00f6\u00f6kohtade kohta<\/a><\/noindex>, on see hiljuti oma positsioone tugevalt kaotanud \u2013 rohkem kui \u00fckski teine tehnoloogia.<\/p>\n<p><b>Omandamised nii data engineeringus kui data science'is<\/b><\/p>\n<p>Tuleb m\u00e4rkida, et kahe k\u00fcmne parema koha hulgas kattuvad kahe andmegrupi kokku kaheksa. SQL, Python, Spark, AWS, Java, Hadoop, Hive ja Scala p\u00e4\u00e4sesid k\u00fcmnesse nii data engineeringu kui data science'i valdkonnas. Alloleval graafikul n\u00e4ete viisteist k\u00f5ige populaarsemat tehnoloogiat, mida t\u00f6\u00f6andjad data engineeritele pakuvad ja nende vastavat n\u00e4itajat data scientistide t\u00f6\u00f6kohtades.<\/p>\n<p><img decoding=\"async\" alt=\"K\u00f5ige n\u00f5udlikumad oskused andmeinseneri ametis\" src=\"\/wp-content\/uploads\/2020\/01\/f2d36a492fd9dc8801d7541aa6cfb691.jpg\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<h4>Soovitused<\/h4>\n<p>\nKui soovite tegeleda data engineeringuga, soovitaksin \u00f5ppida j\u00e4rgmisi tehnoloogiaid \u2013 loetlen need ligikaudse prioriteedi j\u00e4rgi.<\/p>\n<p>Uurige SQL'i. Soovitan teil PostgreSQL'i, kuna see on avatud koodiga, omab suurt populaarsust kogukonnas ja on kasvufaasis. Kuidas keelt kasutada, saate teada My Memorable SQL raamatust \u2013 selle piloteeritud versioon on saadaval <noindex><a rel=\"nofollow\" href=\"https:\/\/memorablesql.com\/\">siit<\/a><\/noindex>.<\/p>\n<p>Omage Pythonit, kuid mitte k\u00f5ige raskemal tasemel. Raamat My Memorable Python on m\u00f5eldud just algajatele. Selle saab osta <noindex><a rel=\"nofollow\" href=\"https:\/\/www.amazon.com\/Memorable-Python-Learn-Faster-ebook\/dp\/B07ZXJKKSN\/\">Amazonilt<\/a><\/noindex>, kas elektroonilise koopia v\u00f5i f\u00fc\u00fcsilise, vastavalt teie valikule, v\u00f5i laadida alla PDF- v\u00f5i EPUB-formaadis <noindex><a rel=\"nofollow\" href=\"https:\/\/memorablepython.com\/\">sellel saidil<\/a><\/noindex>.<\/p>\n<p>Kui olete Pythoniga tuttavaks saanud, minge pandas'i \u2013 Python'i raamatukokku, mida kasutatakse andmete puhastamiseks ja t\u00f6\u00f6tlemiseks. Kui soovite t\u00f6\u00f6tada ettev\u00f5ttes, mis n\u00f5uab Pythonit (selliseid on enamik), v\u00f5ite olla kindel, et pandas'e tundmine on eeldatav. L\u00f5petan praegu sissejuhatavat juhendit pandas'iga t\u00f6\u00f6tamiseks \u2013 v\u00f5ite <noindex><a rel=\"nofollow\" href=\"https:\/\/dataawesome.com\/\">liituda<\/a><\/noindex>, et mitte j\u00e4\u00e4da ilma v\u00e4ljaandmise hetkest.<\/p>\n<p>Omage AWS-i. Kui soovite saada andmeinseneriks, ei saa te ilma pilveplatvormita hakkama, ja AWS on neist k\u00f5ige populaarsem. Kursused <noindex><a rel=\"nofollow\" href=\"https:\/\/linuxacademy.com\/\">Linux Academy<\/a><\/noindex>, kui \u00f5ppisin <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/10-days-to-become-a-google-cloud-certified-professional-data-engineer-fdb6c401f8e0\">andmeinseneeri Google Cloudis<\/a><\/noindex>, ja arvan, et ka AWS-i kohta leiate sealt h\u00e4id materjale.<\/p>\n<p>Kui olete selle nimekirjaga juba hakkama saanud ja soovite oma t\u00f6\u00f6andjate silmis data engineerina veelgi rohkem silma paista, soovitan lisada Apache Sparki suurte andmete t\u00f6\u00f6tlemiseks. Kuigi minu uurimus andmete teaduse t\u00f6\u00f6kuulutuste kohta n\u00e4itas huvi langust, ilmub Apache Spark siiski peaaegu igas teises t\u00f6\u00f6kuulutuses andmeinseneride jaoks.<\/p>\n<h4>L\u00f5petuseks<\/h4>\n<p>\nLoodan, et see \u00fclevaade k\u00f5ige n\u00f5utumatest tehnoloogiatest andmeinseneridele on olnud teile kasulik. Kui teid huvitab, kuidas on olukord anal\u00fc\u00fctikute t\u00f6\u00f6kuulutustes, lugege <noindex><a rel=\"nofollow\" href=\"https:\/\/towardsdatascience.com\/most-in-demand-tech-skills-for-data-analysts-26d4ea4450f8\">minu teist artiklit<\/a><\/noindex>. Edukaks insenerimiseks!<br \/>\n<br \/>Allikas: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/digital-ecosystems\/blog\/484120\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-55327","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.10 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.10\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-17T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:03:26+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47K\u00f5ige n\u00f5utavamad oskused andmeinseneri ametis | ProHoster","description":"2019. aasta statistika kohaselt on andmeinsener hetkel amet, mille j\u00e4rele n\u00f5udlus kasvab kiiremini kui teiste ametite j\u00e4rele. Andmeinsener m\u00e4ngib organisatsioonides kriitiliselt olulist rolli \u2013 loob ja hooldab andmevooge ja andmebaase, mida kasutatakse andmete t\u00f6\u00f6tlemiseks, \u00fcmberkujundamiseks ja salvestamiseks. Milliseid oskusi vajavad selle ametigruppi kuuluvad inimesed k\u00f5ige rohkem? Erinevad","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0421\u0430\u043c\u044b\u0435 \u0432\u043e\u0441\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043d\u043d\u044b\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u0432 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 data engineer | ProHoster","og:description":"\u0421\u043e\u0433\u043b\u0430\u0441\u043d\u043e \u0441\u0442\u0430\u0442\u0438\u0441\u0442\u0438\u043a\u0435 2019 \u0433\u043e\u0434\u0430, data engineer \u043d\u0430 \u0434\u0430\u043d\u043d\u044b\u0439 \u043c\u043e\u043c\u0435\u043d\u0442 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0435\u0439, \u0441\u043f\u0440\u043e\u0441 \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u0443\u044e \u0440\u0430\u0441\u0442\u0435\u0442 \u0431\u044b\u0441\u0442\u0440\u0435\u0435 \u0432\u0441\u0435\u0445 \u043f\u0440\u043e\u0447\u0438\u0445. Data engineer \u0438\u0433\u0440\u0430\u0435\u0442 \u0432 \u043e\u0440\u0433\u0430\u043d\u0438\u0437\u0430\u0446\u0438\u0438 \u043a\u0440\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438 \u0432\u0430\u0436\u043d\u0443\u044e \u0440\u043e\u043b\u044c \u2013 \u0441\u043e\u0437\u0434\u0430\u0435\u0442 \u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442 \u0432 \u0440\u0430\u0431\u043e\u0447\u0435\u043c \u0441\u043e\u0441\u0442\u043e\u044f\u043d\u0438\u0438 \u043f\u0430\u0439\u043f\u043b\u0430\u0439\u043d\u044b \u0438 \u0431\u0430\u0437\u044b \u0434\u0430\u043d\u043d\u044b\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442\u0441\u044f \u0434\u043b\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438, \u0442\u0440\u0430\u043d\u0441\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u0438 \u0438 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445. \u041a\u0430\u043a\u0438\u0435 \u043d\u0430\u0432\u044b\u043a\u0438 \u043d\u0443\u0436\u043d\u044b \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u0442\u0435\u043b\u044f\u043c \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0444\u0435\u0441\u0441\u0438\u0438 \u0432 \u043f\u0435\u0440\u0432\u0443\u044e \u043e\u0447\u0435\u0440\u0435\u0434\u044c? \u041e\u0442\u043b\u0438\u0447\u0430\u0435\u0442\u0441\u044f","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/samye-vostrebovannye-navyki-v-professii-data-engineer","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-17T21:00:00+00:00","article:modified_time":"2020-02-18T11:03:26+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"55327","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 13:45:53","updated":"2022-09-30 07:37:35"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/55327","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=55327"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/55327\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=55327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=55327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=55327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}