Izifundo eziyi-12 eziku-inthanethi ku-Data Engineering

Izifundo eziyi-12 eziku-inthanethi ku-Data Engineering
Ngokusho kwe-Statista, ngo-2025 ubukhulu bemakethe yedatha enkulu buzokhula bufinyelele ku-175 zettabytes uma kuqhathaniswa nama-41 ngo-2019 (isheduli). Ukuze uthole umsebenzi kulo mkhakha, udinga ukuqonda ukuthi usebenza kanjani ngedatha enkulu egcinwe emafini. I-Cloud4Y ihlanganise uhlu lwezifundo ezingu-12 ezikhokhelwayo nezamahhala zobunjiniyela bedatha ezizokwandisa ulwazi lwakho emkhakheni futhi zingaba isiqalo esihle endleleni yakho yokuthola izitifiketi zamafu.

Isibikezelo

Yini unjiniyela wedatha? Lona umuntu onomthwalo wemfanelo wokudala nokugcina ukwakheka kwedatha kuphrojekthi Yesayensi Yedatha. Izibopho zingabandakanya ukuqinisekisa ukugeleza kwedatha okushelelayo phakathi kweseva nohlelo lokusebenza, ukuhlanganisa isofthiwe entsha yokuphatha idatha, ukuthuthukisa izinqubo zedatha eziyisisekelo, nokudala amapayipi edatha.

Kunenani elikhulu lobuchwepheshe namathuluzi unjiniyela wedatha okufanele abe yingcweti ukuze asebenze ngekhompyutha yamafu, izindawo zokugcina idatha, i-ETL (ukukhishwa, ukuguqulwa, ukulayisha), njll. Ngaphezu kwalokho, inani lamakhono adingekayo likhula ngaso sonke isikhathi, ngakho-ke unjiniyela wedatha udinga ukugcwalisa ulwazi lwakhe lolwazi njalo. Uhlu lwethu luhlanganisa izifundo zabaqalayo kanye nochwepheshe abanolwazi. Khetha okukufanele.

1. Isitifiketi seNanodegree yobunjiniyela bedatha (Ukuzidla)

Uzofunda ukuklama amamodeli edatha, ukudala izinqolobane zedatha namachibi edatha, ukwenza ngokuzenzakalelayo amaphayiphi edatha nokusebenza ngamaqoqo edathasethi. Ekupheleni kohlelo, uzohlola amakhono akho amasha ngokuqedela iphrojekthi ye-Capstone.

Isikhathi: Izinyanga ezi-5, amahora angu-5 ngesonto
Ulimi: IsiNgisi
Izindleko: $ 1695
Ileveli:isiqalo

2. Iba Isitifiketi Sonjiniyela Wedatha (Coursera)

Bafundisa kusukela kokuyisisekelo. Ungathuthukela isinyathelo ngesinyathelo, usebenzisa izinkulumo namaphrojekthi osebenza ngezandla ukuze usebenze ngamakhono akho. Ekupheleni kokuqeqeshwa, uzobe usulungele ukusebenza ne-ML nedatha enkulu. Kunconywa ukwazi iPython okungenani ezingeni elincane.

Isikhathi: Izinyanga ezi-8, amahora angu-10 ngesonto
Ulimi: IsiNgisi
IzindlekoπŸ˜•
Ileveli:isiqalo

3. Iba Unjiniyela Wedatha: Ukuqonda Imiqondo (LinkedIn Learning)

Uzothuthukisa ubunjiniyela bedatha namakhono we-DevOps, ufunde ukwenza izinhlelo zokusebenza ze-Big Data, udale amapayipi edatha, ucubungule izinhlelo zokusebenza ngesikhathi sangempela usebenzisa i-Hazelcast kanye nesizindalwazi. Hadoop.

Isikhathi: Kuncike kuwe
Ulimi: IsiNgisi
Izindleko: inyanga yokuqala - mahhala
Ileveli:isiqalo

4. Izifundo zobunjiniyela bedatha (edX)

Nali uchungechunge lwezinhlelo ezikwethulela ubunjiniyela bedatha futhi zikufundisa ukuthi ungazithuthukisa kanjani izisombululo zokuhlaziya. Izifundo zihlukaniswe ngezigaba ngokusekelwe ezingeni lobunzima, ngakho-ke ungakhetha esisodwa ngokuya ngeleveli yakho yokuhlangenwe nakho. Ngesikhathi sokuqeqeshwa uzofunda ukusebenzisa i-Spark, i-Hadoop, i-Azure nokuphatha idatha yenkampani.

Isikhathi: Kuncike kuwe
Ulimi: IsiNgisi
Izindleko: kuncike esifundweni esikhethiwe
Ileveli: oqalayo, ophakathi, othuthukile

5. Unjiniyela Wedatha (IdathaQuest)

Lesi sifundo kufanele sithathwe uma unolwazi ngePython futhi ufuna ukujulisa ulwazi lwakho futhi wakhe umsebenzi wokuba usosayensi wedatha. Uzofunda indlela yokwakha amapayipi edatha usebenzisa iPython namapanda, ukulayisha amasethi amakhulu edatha kusizindalwazi se-Postgres ngemva kokuhlanza, ukuguqula nokuqinisekisa.

Isikhathi: Kuncike kuwe
Ulimi: IsiNgisi
Izindleko: kuncike efomini lokubhalisa
Ileveli: oqalayo, ophakathi

6. Ubunjiniyela bedatha nge-Google Cloud (Coursera)

Lesi sifundo sizokusiza ukuthi uthole amakhono owadingayo ukuze wakhe umsebenzi wedatha enkulu. Isibonelo, ukusebenza ne-BigQuery, Spark. Uzothola ulwazi oludingayo ukuze ulungiselele isitifiketi se-Google Cloud Professional Data Engineer esiqashelwa umkhakha.

Isikhathi: izinyanga ezi-4
Ulimi: IsiNgisi
Izindleko: mahhala okwamanje
Ileveli: oqalayo, ophakathi

7. Ubunjiniyela Bedatha, Idatha Enkulu ku-Google Cloud Platform (Coursera)

Isifundo esithokozisayo esihlinzeka ngolwazi olusebenzayo lwezinhlelo zokucubungula idatha ku-GCP. Phakathi nekilasi, uzofunda indlela yokuklama amasistimu ngaphambi kokuqala inqubo yokuthuthukisa. Ngaphezu kwalokho, uzophinda uhlaziye kokubili idatha ehlelekile nengahlelekile, usebenzise ukukala okuzenzakalelayo, futhi usebenzise amasu e-ML ukuze ukhiphe ulwazi.

Isikhathi: izinyanga ezi-3
Ulimi: IsiNgisi
Izindleko: mahhala okwamanje
Ileveli: oqalayo, ophakathi

8. UC San Diego: I-Big Data Specialization (Coursera)

Isifundo sisekelwe ekusebenziseni uhlaka lwe-Hadoop ne-Spark kanye nokusebenzisa lawa masu amakhulu edatha enqubweni ye-ML. Uzofunda izisekelo zokusebenzisa i-Hadoop nge-MapReduce, Spark, Pig, kanye neHive. Funda ukuthi ungawakha kanjani amamodeli aqagelayo futhi usebenzise izibalo zegrafu ukuze wenze imodeli yezinkinga. Sicela uqaphele ukuthi lesi sifundo asidingi ulwazi lokuhlela.

Isikhathi: Izinyanga ezingu-8 amahora angu-10 ngesonto
Ulimi: IsiNgisi
Izindleko: mahhala okwamanje
Ileveli:isiqalo

9. Ukulawula Idatha Enkulu Nge-Apache Spark nePython (Udemy)

Uzofunda ukusebenzisa isakhiwo sokusakaza kanye namafreyimu edatha ku-Spark3, futhi uthole ukuqonda ukuthi ungasebenzisa kanjani isevisi ye-Amazon Elastic MapReduce ukuze usebenze neqoqo lakho le-Hadoop. Funda ukuhlonza izinkinga ekuhlaziyweni kwedatha enkulu futhi uqonde ukuthi imitapo yolwazi ye-GraphX ​​isebenza kanjani nokuhlaziywa kwenethiwekhi nokuthi ungasebenzisa kanjani i-MLlib.

Isikhathi: Kuncike kuwe
Ulimi: IsiNgisi
Izindleko: kusuka kuma-ruble angu-800 kuya ku-$149,99 (kuye ngenhlanhla yakho)
Ileveli: oqalayo, ophakathi

10. Uhlelo lwe-PG kubunjiniyela bedatha enkulu (upGrad)

Lesi sifundo sizokunikeza ukuqonda ukuthi i-Aadhaar isebenza kanjani, ukuthi i-Facebook ikwenza kanjani okuphakelayo kwezindaba kube ngokwakho, nokuthi Ubunjiniyela Bedatha bungasetshenziswa kanjani ngokujwayelekile. Izihloko ezibalulekile kuzoba ukucutshungulwa kwedatha (okuhlanganisa ukucutshungulwa kwesikhathi sangempela), i-MapReduce, ukuhlaziya idatha enkulu.

Isikhathi: izinyanga ezi-11
Ulimi: IsiNgisi
Izindleko: cishe u-$3000
Ileveli:isiqalo

11. Uchwepheshe Wedatha Yesayensi (Ibhokisi lamakhono)

Uzofunda ukuhlela ku-Python, ufunde izinhlaka zokuqeqesha amanethiwekhi we-neural Tensorflow namaKeras. Bazi kahle imininingwane yolwazi ye-MongoDB, PostgreSQL, SQLite3, funda ukusebenzisana nemitapo yolwazi yePandas, NumPy kanye neMatpotlib.

Isikhathi: Amahora angu-300 okuqeqeshwa
Ulimi: isiRashiya
Izindleko: izinyanga eziyisithupha zokuqala mahhala, bese kuba ama-ruble angu-3900 ngenyanga
Ileveli:isiqalo

12. Unjiniyela Wedatha 7.0 (Ilebhu Yemisebenzi Entsha)

Uzothola isifundo esijulile se-Kafka, HDFS, ClickHouse, Spark, Airflow, lambda architecture kanye ne-kappa architecture. Uzofunda ukuthi ungaxhuma kanjani amathuluzi komunye nomunye, ukwakha amapayipi, ukuthola isisombululo esiyisisekelo. Ukuze ufunde, kudingeka ulwazi oluncane lwePython 3.

Isikhathi: Izifundo ezingama-21, amaviki ayi-7
Ulimi: isiRashiya
Izindleko: kusuka ku-60 kuya ku-000 ruble
Ileveli:isiqalo

Uma ufuna ukwengeza enye inkambo enhle ohlwini, ungazikhipha ohlwini lwamazwana noma ku-PM. Sizobuyekeza okuthunyelwe.

Yini enye ongayifunda kubhulogi? Cloud4Y

β†’ Iyini i-geometry ye-Universe?
β†’ Amaqanda e-Easter kumamephu we-topographic yaseSwitzerland
β†’ Umlando owenziwe lula futhi omfushane kakhulu wokuthuthukiswa "kwamafu"
β†’ Ibhange lehlulekile kanjani?
β†’ Imikhiqizo yekhompyutha yama-90s, ingxenye yesi-3, yokugcina

Bhalisela yethu yocingo-isiteshi ukuze ungaphuthelwa yisihloko esilandelayo. Asibhali ngaphezu kokuphindwe kabili ngesonto futhi ngebhizinisi kuphela. Siphinde sikukhumbuze ukuthi ngoMeyi 21 ngo-15: 00 (isikhathi saseMoscow) sizobamba webinar esihlokweni esithi β€œUkuphepha kolwazi lwebhizinisi lapho usebenza ukude.” Uma ufuna ukuqonda indlela yokuvikela ulwazi olubucayi nolwebhizinisi lapho abasebenzi besebenza ekhaya, bhalisa!

Source: www.habr.com

Engeza amazwana