I kēia mau lā, ʻaʻole i lohe wale ka poʻe i pili ʻole i waho me ka honua o waho. Ma Habré, kaulana ke kumuhana o Big Data analytics a me nā kumuhana pili. Akā no ka poʻe ʻaʻole loea e makemake e hoʻolaʻa iā lākou iho i ke aʻo ʻana i ka Big Data, ʻaʻole maopopo i nā mea e manaʻo ai kēia wahi, kahi e hoʻopili ʻia ai ka ʻikepili Big Data a me ka mea hiki ke hilinaʻi ʻia e ka mea loiloi maikaʻi. E ho'āʻo kākou e noʻonoʻo.
Hoʻonui ka nui o ka ʻike i hana ʻia e nā kānaka i kēlā me kēia makahiki. Ma ka 2020, e hoʻonui ka nui o ka ʻikepili i mālama ʻia i 40-44 zettabytes (1 ZB ~ 1 biliona GB). Ma 2025 - a hiki i ka 400 zettabytes. No laila, ʻo ka hoʻokele ʻana i ka ʻikepili i kūkulu ʻia a i hoʻonohonoho ʻole ʻia me ka hoʻohana ʻana i nā ʻenehana hou kahi wahi e ulu nui ana. ʻO nā hui ʻelua a me nā ʻāina holoʻokoʻa makemake i ka ʻikepili nui.
Ma ke ala, ʻo ia i ka wā o ke kūkākūkā ʻana o ka boom ʻike a me nā ʻano o ka hoʻoili ʻana i ka ʻikepili i hana ʻia e ke kanaka i kū mai ai ka huaʻōlelo Big Data. Manaʻo ʻia ua hoʻopuka mua ʻia i ka makahiki 2008 e ka mea hoʻoponopono o ka puke pai Nature, ʻo Clifford Lynch.
Mai ia manawa, ua hoʻonui ʻia ka mākeke Big Data i kēlā me kēia makahiki e kekahi mau ʻumi pakeneka. A e hoʻomau kēia ʻano, e like me ka poʻe loea. No laila, e like me ka manaʻo o ka hui
No ke aha mākou e pono ai i ka ʻikepili nui?
Hāʻawi ia iā ʻoe e ʻike i ka ʻike waiwai nui mai nā pūʻulu ʻikepili i kūkulu ʻia a i hoʻonohonoho ʻole ʻia. Mahalo i kēia, hiki i kahi ʻoihana, no ka laʻana, ʻike i nā ʻano, wānana i ka hana hana a hoʻopaʻa i kāna mau kumukūʻai. Ua maopopo i mea e hōʻemi ai i nā kumukūʻai, ua mākaukau nā hui e hoʻokō i nā hopena hou loa.
ʻO nā ʻenehana a me nā ʻano loiloi i hoʻohana ʻia no ka nānā ʻana i ka Big Data:
- ʻIke ʻIke;
- lehulehu;
- ka hui ʻana o ka ʻikepili a me ka hoʻohui ʻana;
- aʻo mīkini;
- nā pūnaewele neural artificial;
- ʻike kumu;
- ʻikepili wānana;
- hoʻohālike hoʻohālike;
- ka nānā ʻana i nā kikoʻī;
- ʻikepili helu;
- ʻike ʻike ʻike ʻike.
ʻIkepili ʻikepili nui ma ka honua
Hoʻohana ʻia ka ʻikepili ʻikepili nui e ʻoi aku ma mua o 50% o nā ʻoihana a puni ka honua. ʻOiai i ka makahiki 2015 he 17% wale nō kēia helu. Hoʻohana ikaika ʻia ʻo Big Data e nā ʻoihana e hana ana i ka ʻoihana kelepona a me nā lawelawe kālā. A laila aia nā hui kūikawā i ka ʻenehana mālama olakino. ʻO ka liʻiliʻi o ka hoʻohana ʻana i ka ʻikepili Big Data i nā ʻoihana hoʻonaʻauao: i ka hapanui o nā hihia, hoʻolaha nā ʻelele o kēia kahua i ko lākou manaʻo e hoʻohana i ka ʻenehana i ka wā e hiki mai ana.
Ma ʻAmelika Hui Pū ʻIa, hoʻohana ikaika ʻia ka ʻikepili Big Data: ʻoi aku ma mua o 55% o nā ʻoihana mai nā ʻano hana like ʻole e hana me kēia ʻenehana. Ma ʻEulopa a me ʻAsia, ʻaʻole haʻahaʻa loa ka noi no ka ʻikepili nui - ma kahi o 53%.
Pehea ma Rusia?
Wahi a nā mea loiloi IDC,
Ma nā ʻano he nui, ʻo kēia ulu wikiwiki o ka mākeke ma muli o ka ulu ʻana o kēia wahi ma Rūsia. Ma 2018, loaʻa ka loaʻa kālā mai ke kūʻai aku ʻana i nā hopena kūpono i ka Russian Federation i ka 40% o ka nui o ka hoʻopukapuka ʻana i nā ʻenehana hoʻoili ʻikepili Big ma ka ʻāina holoʻokoʻa.
I ka Russian Federation, ʻoi aku ka nui o nā ʻoihana mai ka waihona kālā a me ka lehulehu, ka ʻoihana kelepona a me ka ʻoihana i ka hoʻoili ʻana o Big Data.
He aha ka mea e hana ai kahi mea noiʻi ʻikepili nui a pehea ka nui o kāna loaʻa ma Rusia?
ʻO ka mea loiloi ʻikepili nui ke kuleana no ka nānā ʻana i ka nui o ka ʻike, ʻelua semi-structured a me unstructured. No nā hui panakō he mau kālepa kēia, no nā mea hoʻokele - kelepona a me nā kaʻa, ma ke kūʻai aku - kipa nā mea kūʻai aku a kūʻai. E like me ka mea i ʻōlelo ʻia ma luna nei, ʻo ka ʻikepili Big Data hiki iā mākou ke ʻike i nā pilina ma waena o nā mea like ʻole i ka "moʻolelo ʻike maka", no ka laʻana, kahi kaʻina hana a i ʻole ka hopena kemika. Ma muli o ka ʻikepili loiloi, hoʻomohala ʻia nā ala hou a me nā hoʻonā i nā wahi like ʻole - mai ka hana ʻana i ka lāʻau lapaʻau.
Pono nā mākau no ka mea loiloi ʻikepili Nui:
- ʻO ka hiki ke hoʻomaopopo koke i nā hiʻohiʻona ma kahi e hanaʻia ai ka nānāʻana, a e hoʻokomo iāʻoe iho i nāʻano o ka wahi i makemakeʻia. ʻO kēia paha ka hale kūʻai, ʻoihana ʻaila a me ka hau, lāʻau lapaʻau, etc.
- ʻIke i nā ʻano o ka ʻikepili helu helu, ke kūkulu ʻana i nā hiʻohiʻona makemakika (neural networks, Bayesian networks, clustering, regression, factor, variance and correlation analyses, etc.).
- Hiki iā ʻoe ke unuhi i ka ʻikepili mai nā kumu like ʻole, hoʻololi iā ia no ka nānā ʻana, a hoʻouka i loko o kahi waihona analytical.
- Mākaukau ma SQL.
- Ka ʻike o ka ʻōlelo Pelekania ma kahi pae e hiki ke heluhelu maʻalahi i nā palapala ʻenehana.
- ʻO ka ʻike o Python (ma ka liʻiliʻi o nā kumu kumu), Bash (he paʻakikī loa ke hana me ka ʻole o ke kaʻina hana), a makemake ʻia e ʻike i nā kumu o Java a me Scala (pono no ka hoʻohana ikaika ʻana iā Spark, kekahi o nā ʻO nā papa hana kaulana loa no ka hana ʻana me ka ʻikepili nui).
- Hiki ke hana me Hadoop.
ʻAe, ehia ka nui o ka loaʻa ʻana o kahi mea loiloi Big Data?
Loaʻa pōkole nā loea Big Data; ʻoi aku ka makemake ma mua o ka lako. ʻO kēia no ka mea e hiki mai ana ka ʻoihana i kahi ʻike: pono ka hoʻomohala ʻana i nā ʻenehana hou, a ʻo ka hoʻomohala ʻenehana e koi i nā loea.
No laila, Data Scientist a me Data Analytics ma USA
Ma Rūsia, loaʻa i nā loea aʻo mīkini mai 130 a 300 tausani rubles i kēlā me kēia mahina, nā mea ʻikepili nui - mai 73 a 200 tausani rubles i kēlā me kēia mahina. Aia nā mea a pau i ka ʻike a me nā mākau. ʻOiaʻiʻo, aia nā hakahaka me nā uku haʻahaʻa, a me nā mea ʻē aʻe me nā mea kiʻekiʻe. ʻO ka koi nui loa no nā mea noiʻi ʻikepili nui ma Moscow a me St. ʻO Moscow, ʻaʻole ia he mea kupanaha, aia ma kahi o 50% o nā hakahaka hana (e like me hh.ru). ʻOi aku ka liʻiliʻi o ka noi ma Minsk a me Kyiv. He mea pono e hoʻomaopopo i kekahi mau hakahaka hāʻawi i nā hola maʻalahi a me ka hana mamao. Akā ma ka laulā, pono nā ʻoihana i nā loea e hana ana ma ke keʻena.
I ka wā lōʻihi, hiki iā mākou ke manaʻo i ka piʻi ʻana o ka noi no nā mea loiloi Big Data a me nā ʻelele o nā loea pili. E like me ka mea i ʻōlelo ʻia ma luna, ʻaʻole i hoʻopau ʻia ka hemahema o nā limahana ma ka ʻenehana ʻenehana. Akā, ʻoiaʻiʻo, i mea e lilo ai i mea loiloi Big Data, pono ʻoe e aʻo a hana, e hoʻomaikaʻi i nā mākau i helu ʻia ma luna a me nā mea hou aʻe. ʻO kekahi o nā manawa e hoʻomaka ai i ke ala o Big Data analyst ʻo ia
Source: www.habr.com