A yau kawai mutanen da ba su da alaƙa ta waje da duniyar waje ba su ji labarin manyan bayanai ba. A kan Habré, batun nazarin manyan bayanai da batutuwa masu alaƙa sun shahara. Amma ga waɗanda ba ƙwararrun ƙwararru ba waɗanda ke son sadaukar da kansu don nazarin Big Data, ba koyaushe ake bayyana abubuwan da wannan yanki ke da shi ba, inda za a iya yin amfani da nazarin manyan bayanai da kuma abin da manazarci nagari zai iya dogara da shi. Mu yi kokarin gano shi.
Adadin bayanan da mutane ke samarwa yana ƙaruwa kowace shekara. Nan da 2020, adadin bayanan da aka adana zai ƙaru zuwa 40-44 zettabytes (1 ZB ~ 1 biliyan GB). By 2025 - har zuwa kusan 400 zettabytes. Saboda haka, sarrafa bayanai masu tsari da marasa tsari ta amfani da fasahohin zamani wani yanki ne da ke kara zama muhimmi. Dukansu kamfanoni da dukan ƙasashe suna sha'awar manyan bayanai.
Af, a lokacin da ake tattaunawa kan bunkasar bayanai da hanyoyin sarrafa bayanan da mutane ke samarwa ne kalmar Big Data ta taso. An yi imanin cewa editan mujallar Nature, Clifford Lynch ne ya fara gabatar da shi a cikin 2008.
Tun daga wannan lokacin, Babban Kasuwar Bayanai tana ƙaruwa kowace shekara da dubun-duba bisa ɗari. Kuma wannan yanayin, a cewar masana, zai ci gaba. Don haka, bisa ga kimanta kamfanin a shekarar 2021, jimillar babbar kasuwar nazarin bayanai ta duniya za ta karu zuwa dala biliyan 67,2. Ci gaban kowace shekara zai kasance kusan kashi 35,9%.
Me ya sa muke buƙatar babban nazarin bayanai?
Yana ba ku damar gano mahimman bayanai masu mahimmanci daga tsararrun bayanai ko waɗanda ba a tsara su ba. Godiya ga wannan, kasuwanci na iya, alal misali, gano abubuwan da ke faruwa, tsinkaya aikin samarwa da haɓaka farashinsa. A bayyane yake cewa don rage farashi, kamfanoni suna shirye don aiwatar da sababbin hanyoyin magance.
Fasaha da hanyoyin bincike waɗanda ake amfani da su don nazarin Babban Bayanai:
- Ma'adinan Bayanai;
- taron jama'a;
- haɗakar bayanai da haɗin kai;
- koyon inji;
- hanyoyin sadarwa na wucin gadi;
- ƙirar ƙira;
- nazari na tsinkaya;
- ƙirar ƙira;
- nazarin sararin samaniya;
- ƙididdigar ƙididdiga;
- hangen nesa na bayanan nazari.
Big Data Analytics a cikin duniya
Ana amfani da babban nazarin bayanai yanzu fiye da 50% na kamfanoni a duk duniya. Duk da cewa a cikin 2015 wannan adadi ya kasance kawai 17%. Kamfanonin da ke aiki a sassan sadarwar sadarwa da na kuɗi suna amfani da Big Data sosai. Sannan akwai kamfanoni da suka kware a fasahar kiwon lafiya. Karamin amfani da Big Data Analytics a cikin kamfanonin ilimi: a mafi yawan lokuta, wakilan wannan filin sun sanar da aniyarsu ta amfani da fasaha a nan gaba.
A cikin Amurka, ana amfani da ƙididdigar Big Data sosai sosai: fiye da 55% na kamfanoni daga fannoni daban-daban suna aiki tare da wannan fasaha. A cikin Turai da Asiya, buƙatun manyan ƙididdigar bayanai ba su da ƙasa sosai - kusan 53%.
A Rasha fa?
A cewar manazarta IDC,. Haɓaka kasuwa don irin waɗannan mafita a Tsakiya da Gabashin Turai yana aiki sosai, wannan adadi yana ƙaruwa da 11% kowace shekara. Nan da shekarar 2022, za ta kai dala biliyan 5,4 a adadi mai yawa.
A hanyoyi da yawa, wannan saurin ci gaban kasuwa ya faru ne saboda ci gaban wannan yanki a Rasha. A cikin 2018, kudaden shiga daga siyar da hanyoyin da suka dace a cikin Tarayyar Rasha sun kai kashi 40 cikin XNUMX na jimlar zuba jari a fasahar sarrafa manyan bayanai a duk yankin.
A cikin Tarayyar Rasha, kamfanoni daga bankunan banki da na jama'a, masana'antar sadarwa da masana'antu suna kashe mafi yawa akan sarrafa Big Data.
Menene Babban Manazarcin Bayanai ke yi kuma nawa yake samu a Rasha?
Babban manazarcin bayanai yana da alhakin yin nazarin ɗimbin bayanai, duka biyun da aka tsara da kuma waɗanda ba a tsara su ba. Ga ƙungiyoyin banki waɗannan ma'amaloli ne, ga masu aiki - kira da zirga-zirga, a cikin kiri - ziyarar abokin ciniki da sayayya. Kamar yadda aka ambata a sama, Binciken Babban Bayanai yana ba mu damar gano alaƙa tsakanin abubuwa daban-daban a cikin “tarihin bayanan danye”, misali, tsarin samarwa ko halayen sinadarai. Dangane da bayanan bincike, ana haɓaka sabbin hanyoyin da mafita a fannoni daban-daban - daga masana'anta zuwa magani.
Ƙwarewar da ake buƙata don Babban Manazarcin Bayanai:
- Ikon saurin fahimtar abubuwan da ke cikin yankin da ake gudanar da bincike, da kuma nutsar da kanku a cikin sassan yankin da ake so. Wannan na iya zama dillali, masana'antar mai da iskar gas, magani, da sauransu.
- Sanin hanyoyin nazarin bayanan ƙididdiga, gina nau'ikan ilimin lissafi (cibiyoyin sadarwa na jijiyoyi, cibiyoyin sadarwa na Bayesian, clustering, regression, factor, bambance-bambancen da daidaitawa, da dai sauransu).
- Samun damar fitar da bayanai daga tushe daban-daban, canza shi don bincike, da loda shi zuwa bayanan nazari.
- Kwarewar SQL.
- Ilimin Ingilishi a matakin da ya isa don sauƙin karanta takaddun fasaha.
- Ilimin Python (aƙalla abubuwan yau da kullun), Bash (yana da matukar wahala a yi ba tare da shi a cikin aikin ba), ƙari kuma yana da kyawawa don sanin tushen Java da Scala (an buƙata don amfani mai ƙarfi na Spark, ɗaya daga cikin mafi mashahuri tsarin tsarin aiki tare da manyan bayanai).
- Ability don aiki tare da Hadoop.
To, nawa ne babban manazarcin bayanai ke samu?
Kwararrun Manyan Bayanai yanzu sun yi karanci; bukatu ya wuce wadata. Wannan shi ne saboda kasuwanci yana zuwa ga fahimta: ci gaba yana buƙatar sababbin fasaha, kuma ci gaban fasaha yana buƙatar kwararru.
Don haka, Masanin Kimiyyar Bayanai da Binciken Bayanai a Amurka a cewar hukumar daukar ma'aikata Glassdoor. Matsakaicin albashin waɗannan ƙwararrun a Amurka yana farawa daga $ 100 dubu kowace shekara.
A cikin Rasha, ƙwararrun koyon injin suna karɓar daga 130 zuwa 300 dubu rubles a kowane wata, manyan manazarta bayanai - daga 73 zuwa 200 dubu rubles a wata. Duk ya dogara da kwarewa da cancanta. Tabbas, akwai guraben aiki tare da ƙananan albashi, wasu kuma masu girma. Matsakaicin buƙatu don manyan manazarta bayanai a Moscow da St. Petersburg. Moscow, wanda ba abin mamaki bane, yana da kusan kashi 50% na guraben aiki (bisa ga hh.ru). Mafi ƙarancin buƙata yana cikin Minsk da Kyiv. Yana da kyau a lura cewa wasu guraben aiki suna ba da sa'o'i masu sassauƙa da aiki mai nisa. Amma gabaɗaya, kamfanoni suna buƙatar kwararru waɗanda ke aiki a ofis.
A tsawon lokaci, zamu iya tsammanin karuwar buƙatun manyan manazarta na Babban Bayanai da wakilan ƙwararrun ƙwararru. Kamar yadda aka ambata a sama, ba a soke ƙarancin ma'aikata a fannin fasaha ba. Amma, ba shakka, don zama babban manazarcin bayanai, kuna buƙatar yin karatu da aiki, haɓaka ƙwarewar da aka lissafa a sama da ƙari. Ɗaya daga cikin damar da za a fara hanyar Big Data Analyst shine kuma gwada hannunka don yin aiki tare da manyan bayanai.
source: www.habr.com