Namhlanje kuphela abantu abangenalo uxhulumaniso lwangaphandle kunye nehlabathi langaphandle abazange beve ngedatha enkulu. Kwi-HabrΓ©, isihloko se-Big Data analytics kunye nezihloko ezinxulumene nazo zithandwa. Kodwa kubantu abangengoochwephesha abangathanda ukuzinikela kwisifundo seDatha enkulu, akusoloko kucaca ukuba yiyiphi i-prospects le ndawo, apho i-Big Data analytics ingasetyenziswa kwaye yintoni umhlalutyi olungileyo onokuthembela kuyo. Masizame ukuyiqonda.
Ubuninzi bolwazi oluveliswa ngabantu luyanda minyaka le. Ngo-2020, inani ledatha egciniweyo liya kunyuka ukuya kwi-40-44 zettabytes (1 ZB ~ 1 billion GB). Ngo-2025 - ukuya kutsho malunga ne-400 zettabytes. Ngokufanelekileyo, ukulawula idatha ecwangcisiweyo nengacwangciswanga kusetyenziswa itekhnoloji yanamhlanje ngummandla obaluleke kakhulu. Zombini iinkampani kunye namazwe onke anomdla kwidatha enkulu.
Ngendlela, kwakukho ngexesha lengxoxo ye-boom yolwazi kunye neendlela zokucubungula idatha eyenziwe ngabantu ukuba igama elithi Big Data lavela. Kukholelwa ukuba yacetywa okokuqala ngo-2008 ngumhleli wejenali yeNdalo, uClifford Lynch.
Ukusukela ngoko, imakethi yeDatha enkulu iye yanda minyaka le ngamashumi alishumi epesenti. Kwaye lo mkhwa, ngokutsho kweengcali, uya kuqhubeka. Ngoko ke, ngokoqikelelo lwenkampani ngo-2021, imarike yohlalutyo lwedatha yehlabathi iyonke iya kunyuka iye kwi-67,2 yeebhiliyoni zeedola.
Kutheni sifuna uhlalutyo olukhulu lwedatha?
Ikuvumela ukuba uchonge ulwazi oluxabiseke kakhulu kwiiseti zedatha ezicwangcisiweyo okanye ezingalungiswanga. Ndiyabulela kule nto, ishishini linokuthi, umzekelo, lichonge iindlela, liqikelele ukusebenza kwemveliso kunye nokwandisa iindleko zalo. Kucacile ukuba ukuze kuncitshiswe iindleko, iinkampani zilungele ukuphumeza izisombululo zamva nje.
Itekhnoloji kunye neendlela zokuhlalutya ezisetyenziselwa ukuhlalutya iDatha enkulu:
- Imayini yedatha;
- abantu abaninzi;
- ukudibanisa idatha kunye nokudibanisa;
- ukufunda koomatshini;
- inethiwekhi ye-neural eyenziweyo;
- ukuqondwa kwepateni;
- uhlalutyo oluqikelelweyo;
- ukulinganisa ukulinganisa;
- uhlalutyo lwendawo;
- uhlalutyo lwamanani;
- ukubonwa kwedatha yohlalutyo.
Uhlalutyo lweDatha enkulu kwihlabathi
Uhlalutyo lwedatha enkulu ngoku lusetyenziswa ngaphezu kwe-50% yeenkampani kwihlabathi jikelele. Nangona inyani yokuba ngo-2015 eli nani laliyi-17% kuphela. IDatha enkulu isetyenziswa kakhulu ziinkampani ezisebenza kumacandelo onxibelelwano kunye neenkonzo zezemali. Zikhona ke iinkampani ezisebenza ngobuchwephesha bezempilo. Ukusetyenziswa okuncinci kwe-Big Data analytics kwiinkampani zemfundo: kwiimeko ezininzi, abameli beli candelo babhengeze injongo yabo yokusebenzisa iteknoloji kwixesha elizayo.
EUnited States, i-Big Data analytics isetyenziswa kakhulu: ngaphezu kwe-55% yeenkampani ezivela kwiinkalo ezahlukeneyo zisebenza ngobu buchwepheshe. EYurophu naseAsia, imfuno yohlalutyo lwedatha enkulu ayikho ngaphantsi kakhulu - malunga ne-53%.
Kuthekani eRashiya?
Ngokutsho kwabahlalutyi be-IDC,. Ukukhula kwemarike yezisombululo ezinjalo kuMbindi nakwiMpuma Yurophu kusebenza kakhulu, eli nani linyuka nge-11% ngonyaka. Ngo-2022, iya kufikelela kwi-5,4 yeebhiliyoni zeedola ngokwemiqathango yobuninzi.
Ngeendlela ezininzi, olu phuhliso olukhawulezayo lwentengiso lubangelwa ukukhula kwale ndawo eRashiya. Ngo-2018, ingeniso evela ekuthengisweni kwezisombululo ezifanelekileyo kwi-Russian Federation yafikelela kwi-40% yotyalo-mali olupheleleyo kwi-Big Data processing teknoloji kuwo wonke ummandla.
Kwi-Russian Federation, iinkampani ezivela kwiibhanki kunye necandelo likarhulumente, ishishini lonxibelelwano kunye neshishini lichitha kakhulu kwi-Big Data processing.
Wenza ntoni uMhlalutyi weDatha omkhulu kwaye ufumana malini eRashiya?
Umhlalutyi omkhulu wedatha unoxanduva lokuphonononga izixa ezikhulu zolwazi, zombini ezilungelelanisiweyo kunye nezingacwangciswanga. Kwimibutho yebhanki ezi zintengiselwano, kubaqhubi - iifowuni kunye ne-traffic, kwintengiso - ukutyelela abathengi kunye nokuthenga. Njengoko kukhankanyiwe ngasentla, uhlalutyo lweDatha enkulu luvumela ukuba sifumane uxhulumaniso phakathi kwezinto ezahlukeneyo "kwimbali yolwazi oluluhlaza", umzekelo, inkqubo yokuvelisa okanye ukusabela kweekhemikhali. Ngokusekelwe kwidatha yohlalutyo, iindlela ezintsha kunye nezisombululo ziphuhliswa kwiindawo ezahlukeneyo - ukusuka kwimveliso ukuya kwiyeza.
Izakhono ezifunekayo kumhlalutyi weDatha enkulu:
- Ukukwazi ukuqonda ngokukhawuleza iimpawu kwindawo apho uhlalutyo lwenziwa khona, kunye nokuntywila kwimiba yendawo efunwayo. Oku kunokuba yintengiso, i-oyile kunye ne-gas industry, iyeza, njl.
- Ulwazi lweendlela zokuhlalutya idatha yeenkcukacha-manani, ukwakhiwa kweemodeli zemathematika (uthungelwano lwe-neural, uthungelwano lwaseBayesi, ukudibanisa, ukubuyisela umva, into, ukuhluka kunye nohlalutyo lokulungelelanisa, njl.).
- Ukwazi ukukhupha idatha kwimithombo eyahlukeneyo, ukuyiguqulela ukuhlalutya, kwaye uyilayishe kwi-database yohlalutyo.
- Unobuchule kwiSQL.
- Ulwazi lwesiNgesi kwinqanaba elaneleyo lokufunda ngokulula amaxwebhu obugcisa.
- Ulwazi lwePython (ubuncinci izinto ezisisiseko), iBash (kunzima kakhulu ukwenza ngaphandle kwayo kwinkqubo yomsebenzi), kwaye kuyanqweneleka ukwazi iziseko zeJava kunye neScala (ezifunekayo ekusebenziseni ngokusebenzayo kweSpark, enye ye eyona nkqubo idumileyo yokusebenza ngedatha enkulu).
- Ukukwazi ukusebenza kunye neHadoop.
Ewe, uzuza malini umhlalutyi weDatha enkulu?
Iingcali zeDatha enkulu zinqongophele ngoku; imfuno ingaphezulu kobonelelo. Oku kungenxa yokuba ishishini lifikelela ekuqondweni: uphuhliso lufuna itekhnoloji entsha, kwaye uphuhliso lwetekhnoloji lufuna iingcaphephe.
Ke, iNzululwazi yeDatha kunye noHlaziyo lweDatha e-USA ngokwe-arhente yokuqesha i-Glassdoor. Umvuzo ophakathi kwezi ngcali eMelika uqala ukusuka kwi-100 lamawaka eerandi ngonyaka.
ERashiya, iingcali zokufunda umatshini zifumana kwi-130 ukuya kwi-300 eyiwaka ngenyanga, abahlalutyi bedatha enkulu - ukusuka kwi-73 ukuya kwi-200 eyiwaka ngenyanga. Konke kuxhomekeke kumava kunye neziqinisekiso. Kakade ke, kukho izithuba ezinemivuzo ephantsi, kwaye ezinye ezinemivuzo ephezulu. Ubuninzi bemfuno yabahlalutyi bedatha enkulu eMoscow naseSt. I-Moscow, akumangalisi, i-akhawunti malunga ne-50% yezithuba ezisebenzayo (ngokwe-hh.ru). Imfuno encinci kakhulu iseMinsk naseKyiv. Kuyaphawuleka ukuba ezinye izithuba zibonelela ngeeyure eziguquguqukayo kunye nomsebenzi okude. Kodwa ngokubanzi, iinkampani zifuna iingcali ezisebenza eofisini.
Ngokuhamba kwexesha, sinokulindela ukwanda kwemfuno yabahlalutyi beDatha enkulu kunye nabameli beengcali ezihambelanayo. Njengoko kukhankanyiwe ngasentla, ukunqongophala kwabasebenzi kwicandelo lobuchwephesha akukakhanselwa. Kodwa, ngokuqinisekileyo, ukuze ube ngumhlalutyi weDatha enkulu, kufuneka ufunde kwaye usebenze, uphucule zombini izakhono ezidweliswe ngasentla kunye nezongezelelweyo. Elinye lamathuba okuqalisa umendo womhlalutyi weDatha enkulu kwaye uzame isandla sakho ekusebenzeni ngedatha enkulu.
umthombo: www.habr.com