Isicwangciso somgangatho wokufumana ubuNjineli beDatha yobungcali

Ndisebenze njengomphathi weprojekthi kule minyaka isibhozo idlulileyo (andibhali ikhowudi emsebenzini), nto leyo enefuthe elibi kwi-backend yam yetekhnoloji. Ndaye ndagqiba ekubeni ndinciphise i-gap yam yezobuchwepheshe kwaye ndifumane umsebenzi weNjineli yeDatha. Obona buchule beNjineli yeDatha kukukwazi ukuyila, ukwakha nokugcina iindawo zokugcina idatha.

Ndenze isicwangciso soqeqesho, ndicinga ukuba asiyi kuba luncedo kum kuphela. Isicwangciso sigxile kufundo oluzimeleyo lwezifundo. Okuphambili kunikwa iikhosi zasimahla ngesiRashiya.

ngokukhawuleza:

• I-algorithms kunye nezakhiwo zedatha. Icandelo eliphambili. Ukuba uyayifunda, yonke enye into iya kusebenza. Kubalulekile ukuba ube nobuchule bokubhala ikhowudi kunye nokusebenzisa izakhiwo ezisisiseko kunye ne-algorithms.
• Iidatabases kunye nedatha yokugcina, Intelligence yeShishini. Sisuka kwi-algorithms ukuya kugcino lwedatha kunye nokusebenza.
• IHadoop kunye neDatha enkulu. Xa i-database ayifanelekanga kwi-hard drive, okanye xa idatha idinga ukuhlalutya, kodwa i-Excel ayikwazi ukuyilayisha, idatha enkulu iqala. Ngokombono wam, kufuneka uqhubele phambili kweli candelo kuphela emva kokuphonononga ngokunzulu ezimbini ezidlulileyo.

I-algorithms kunye nezakhiwo zedatha

Kwisicwangciso sam ndiquka ukufunda iPython, ukuphonononga iziseko zemathematika kunye ne-algorithmization.

• Python Programming
• Python: Iziseko kunye nezicelo
• Umgca wealgebra
• Iprogram yezemfundo kwimathematika ecacileyo
• Ii-algorithms: ithiyori kunye nokusebenza. Iindlela
• Ii-algorithms: ithiyori kunye nokusebenza. Ulwakhiwo lwedatha

Iidatabases kunye nedatha yokugcina, Intelligence yeShishini

• Incwadi: UMartin Kleppmann - izicelo zomthwalo ophezulu. Ukucwangcisa, ukukala, inkxaso. Incwadi ichaza indlela imodeli yedatha eyahlukeneyo isebenza ngayo, ukuphunyezwa kwayo ngaphakathi, ukulinganiselwa kunye nokukhetha kuxhomekeke kumsebenzi.
• Intshayelelo koovimba beenkcukacha
• Ngena kwi-DBMS
• Intshayelelo kuVimba weeNkcukacha ezingezizo ezoBudlelwane

Izihloko ezinxulumene nokwakhiwa kweendawo zokugcina idatha, i-ETL, iityhubhu ze-OLAP zixhomekeke kakhulu kwizixhobo, ngoko ke kulo xwebhu andiboneleli ikhonkco kwiikhosi. Kucetyiswa ukuba ufunde iinkqubo ezinjalo xa usebenza kwiprojekthi ethile kwinkampani ethile. Ukuqhelana ne-ETL ungazama Italente okanye Ukuhamba komoya.

Ngokoluvo lwam, kubalulekile ukufunda indlela yoyilo lwale mihla yokugcina indawo yokugcina idatha ikhonkco 1, ikhonkco 2. Kwaye eyona ndlela ilungileyo yokuyifunda kukuyithatha kwaye uyiphumeze ngomzekelo olula. Kukho imizekelo emininzi yokuphunyezwa kweVault yeDatha kwiGitHub unxibelelwano. Incwadi yanamhlanje kwiindawo zokugcina idatha: Ukulinganisa i-Agile Data Warehouse kunye ne-Data Vault nguHans Hultgren.

Ukuqhelana nezixhobo zeBusiness Intelligence kubasebenzisi bokugqibela, ungasebenzisa umyili wamahhala weengxelo, iideshibhodi, kunye neendawo zokugcina idatha ye-Power BI Desktop. Izixhobo zokufunda: ikhonkco 1, ikhonkco 2.

IHadoop kunye neDatha enkulu

• Kufuneka uqale ngokuzizalisekisa kweMaphu Nciphisa ngaphandle kwamathala eencwadi angaphandle. Oku kuya kuvumela ukuqonda ngcono ukuphunyezwa kwemisonto emininzi kwixesha elizayo. Umzekelo obalaseleyo kwiPython uchaziwe apha.
• Hadoop. Inkqubo yokusetyenzwa kwemithamo emikhulu yedatha.
• Intshayelelo kubuNjineli beDatha enkulu

isiphelo

Ayiyiyo yonke into oyifundayo enokusetyenziswa emsebenzini. Ke ngoko, udinga iprojekthi yokuphumelela apho uya kuzama ukusebenzisa ulwazi olutsha.

Isicwangciso asibandakanyi izihloko ezinxulumene nohlalutyo lwedatha kunye nokuFunda koMatshini, kuba oku kuhambelana kakhulu nomsebenzi weNzululwazi yeDatha. Kananjalo akukho zihloko ezinxulumene ne-AWS kunye namafu e-Azure. ezi zihloko zixhomekeke kakhulu kukhetho lweqonga.

Imibuzo yabahlali:
Sanele kangakanani isicwangciso sam sokumpompa? Yintoni omele uyisuse okanye uyifake?
Yeyiphi iprojekthi onokuyicebisa njengethisisi?

umthombo: www.habr.com