Sekureva kweStatista, panosvika 2025 saizi yemusika mukuru wedata ichakura kusvika 175 zettabytes zvichienzaniswa ne41 muna 2019 () Kuti uwane basa mundima iyi, unofanirwa kunzwisisa maitiro ekushanda nedata hombe rakachengetwa mugore. Cloud4Y yakanyora runyorwa rwegumi nemaviri akabhadharwa uye emahara data engineering makosi ayo anozowedzera ruzivo rwako mumunda uye inogona kuve yakanaka yekutanga nzvimbo munzira yako yekuenda kune makore zvitupa.
Foreword
Chii chinonzi data engineer? Uyu ndiye munhu ane basa rekugadzira nekuchengetedza iyo data architecture muData Science project. Mabasa anogona kusanganisira kuve nechokwadi chekuyerera kwedata pakati pesevha nekushandisa, kubatanidza software nyowani yekutarisira data, kuvandudza maitiro edata, uye kugadzira mapaipi edatha.
Kune huwandu hukuru hwetekinoroji uye maturusi ayo injiniya yedata anofanirwa kuita kuti ashande nekomputa yemakore, matura edhata, ETL (kubvisa, kushandura, kurodha), nezvimwe. Uyezve, huwandu hwehunyanzvi hunodiwa huri kukura nguva dzese, saka mainjiniya wedata anoda kugara achizadza ruzivo rwake ruzivo. Rondedzero yedu inosanganisira makosi evanotanga uye nyanzvi dzine ruzivo. Sarudza zvakakunakira.
1. Data Engineering Nanodegree Certification ()
Iwe unozodzidza kugadzira mamodheru edatha, kugadzira matura edatha uye madziva edata, otomatiki mapaipi edatha uye kushanda nehurongwa hwedataset. Pakupera kwechirongwa, iwe unoyedza hunyanzvi hwako nekuzadzisa chirongwa cheCapstone.
Nguva: Mwedzi 5, maawa mashanu pavhiki
Mutauro: Chirungu
mutengo: $ 1695
terama: kutanga
2. Iva Data Engineer Certification ()
Vanodzidzisa kubva pahwaro. Iwe unogona kufambira mberi nhanho nhanho, uchishandisa hurukuro uye maoko-pane mapurojekiti kushanda pahunyanzvi hwako. Pakupera kwekudzidziswa, iwe unenge wagadzirira kushanda neML uye data hombe. Zvinokurudzirwa kuziva Python kanokwana pane shoma nhanho.
Nguva: Mwedzi 8, maawa mashanu pavhiki
Mutauro: Chirungu
mutengoπ
terama: kutanga
3. Iva Injiniya Yedata: Kuziva Mafungiro ()
Iwe unovandudza data engineering uye hunyanzvi hweDevOps, dzidza kugadzira Big Data application, kugadzira mapaipi edatha, kugadzirisa maapplication munguva chaiyo uchishandisa Hazelcast uye dhatabhesi..
Nguva: Zvinoenderana newe
Mutauro: Chirungu
mutengo: mwedzi wekutanga - mahara
terama: kutanga
4. Data Engineering Courses ()
Heino nhevedzano yezvirongwa zvinokuzivisa iwe ku data engineering uye inokudzidzisa maitiro ekugadzira analytical mhinduro. Makosi akapatsanurwa muzvikamu zvichienderana nekuoma nhanho, saka iwe unogona kusarudza imwe zvinoenderana neruzivo rwako. Munguva yekudzidziswa iwe uchadzidza kushandisa Spark, Hadoop, Azure uye kubata data remakambani.
Nguva: Zvinoenderana newe
Mutauro: Chirungu
mutengo: zvinoenderana nekosi yakasarudzwa
terama: wekutanga, wepakati, wepamusoro
5. Data Engineer ()
Iyi kosi yakakosha kutora kana uine ruzivo nePython uye uchida kudzamisa ruzivo rwako uye kuvaka basa sesainzi wedata. Iwe unozodzidza kugadzira mapaipi edatha uchishandisa Python uye pandas, kurodha hombe data seti muPostgres dhatabhesi mushure mekuchenesa, kushandura uye kusimbisa.
Nguva: Zvinoenderana newe
Mutauro: Chirungu
mutengo: zvinoenderana nefomu rekunyorera
terama: anotanga, ari pakati
6. Data Engineering neGoogle Cloud ()
Iyi kosi ichakubatsira iwe kuwana hunyanzvi hwaunoda kuvaka basa mune hombe data. Semuenzaniso, kushanda neBigQuery, Spark. Iwe unozowana ruzivo rwaunoda kugadzirira indasitiri-inocherechedzwa Google Cloud Professional Data Engineer certification.
Nguva: 4 mwedzi
Mutauro: Chirungu
mutengo: free for now
terama: anotanga, ari pakati
7. Data Engineering, Big Data paGoogle Cloud Platform ()
Kosi inonakidza inopa ruzivo runoshanda rwematanho ekugadzirisa masisitimu muGCP. Munguva yekirasi, iwe uchadzidza kugadzira masisitimu usati watanga maitiro ekusimudzira. Uye zvakare, iwe unozoongororawo ese akaumbwa uye asina kurongeka data, shandisa otomatiki kuyera, uye shandisa ML matekiniki ekubvisa ruzivo.
Nguva: 3 mwedzi
Mutauro: Chirungu
mutengo: free for now
terama: anotanga, ari pakati
8. UC San Diego: Big Data Specialization ()
Iyo kosi yakavakirwa pakushandisa iyo Hadoop uye Spark chimiro uye kushandisa aya makuru data matekiniki kune iyo ML maitiro. Iwe unozodzidza izvo zvekutanga zvekushandisa Hadoop neMepuReduce, Spark, Nguruve, uye Mukoko. Dzidza maitiro ekugadzira mamodheru uye shandisa graph analytics kuenzanisira matambudziko. Ndokumbira utarise kuti kosi iyi haidi chero ruzivo rwekuronga.
Nguva: Mwedzi 8 maawa gumi pavhiki
Mutauro: Chirungu
mutengo: free for now
terama: kutanga
9. Kudzora Big Data NeApache Spark uye Python ()
Iwe unozodzidza mashandisiro erukova chimiro uye data mafuremu muSpark3, uye uwane nzwisiso yekushandisa yeAmazon Elastic MepuReduce sevhisi kushanda neHadoop cluster yako. Dzidza kuona matambudziko mukuongororwa kukuru kwedata uye unzwisise kuti maraibhurari eGraphX ββanoshanda sei nekuongorora network uye mashandisiro aungaite MLlib.
Nguva: Zvinoenderana newe
Mutauro: Chirungu
mutengo: kubva ku800 rubles kusvika $149,99 (zvichienderana nerombo rako)
terama: anotanga, ari pakati
10. PG Chirongwa muBig Data Engineering ()
Iyi kosi inokupa kunzwisisa kwemashandiro anoita Aadhaar, kuti Facebook inogadzirisa sei nhau dzekudya, uye kuti Injiniya yeData inogona kushandiswa sei zvachose. Misoro mikuru ichave yekugadzirisa data (kusanganisira chaiyo-nguva yekugadzirisa), MapReduce, hombe data analytics.
Nguva: Mwedzi 11
Mutauro: Chirungu
mutengo: inenge $3000
terama: kutanga
11. Profession Data Scientist ()
Iwe unozodzidza kuronga muPython, dzidza masisitimu ekudzidzisa neural network Tensorflow neKeras. Tenzi MongoDB, PostgreSQL, SQLite3 dhatabhesi, dzidza kushanda nemaraibhurari ePandas, NumPy uye Matpotlib.
Nguva: Maawa 300 ekudzidziswa
Mutauro: ChiRussian
mutengo: mwedzi mitanhatu yekutanga yemahara, ipapo 3900 rubles pamwedzi
terama: kutanga
12. Data Engineer 7.0 ()
Iwe uchagashira ongororo yakadzama yeKafka, HDFS, ClickHouse, Spark, Airflow, lambda architecture uye kappa architecture. Iwe unozodzidza nzira yekubatanidza maturusi kune mumwe nemumwe, kugadzira mapaipi, kuwana yekutanga mhinduro. Kuti udzidze, ruzivo rushoma rwePython 3 runodiwa.
Nguva: Zvidzidzo 21, mavhiki manomwe
Mutauro: ChiRussian
mutengo: kubva ku60 kusvika ku000 rubles
terama: kutanga
Kana iwe uchida kuwedzera imwe yakanaka kosi kune iyo rondedzero, unogona kuzvinyora mumashoko kana muPM. Tichagadzirisa iyo post.
Ndezvipi zvimwe zvaungaverenga pane blog?
β
β
β
β
β
Nyorera kune yedu -chiteshi kuti usapotsa chinyorwa chinotevera. Isu tinonyora kwete kanopfuura kaviri pavhiki uye chete pabhizinesi. Tinokuyeuchidzawo kuti musi waMay 21 pa15: 00 (nguva yeMoscow) tichabata pamusoro pemusoro wekuti "Business information security kana uchishanda kure." Kana iwe uchida kunzwisisa nzira yekudzivirira ruzivo uye rwehukama kana vashandi vanoshanda kubva kumba, nyoresa!
Source: www.habr.com