Mu 2008 BigData inali nthawi yatsopano komanso yodziwika bwino. Mu 2019, BigData ndi chinthu chogulitsidwa, gwero la phindu komanso chifukwa cha ngongole zatsopano.
Kugwa komaliza, boma la Russia lidayambitsa lamulo lowongolera deta yayikulu. Ndizoletsedwa kuzindikira anthu kuchokera ku chidziwitso, koma amaloledwa kuchita izi pa pempho la akuluakulu a boma. Kukonza BigData kwa anthu ena - pokhapokha atadziwitsidwa ndi Roskomnadzor. Makampani omwe ali ndi maadiresi oposa 100 zikwizikwi amagwera pansi pa lamulo. Ndipo, ndithudi, kumene popanda zolembera - ziyenera kupanga imodzi ndi mndandanda wa ogwiritsira ntchito database. Ndipo ngati kale BigData sinatengedwe mozama ndi aliyense, tsopano iyenera kuwerengedwa.
Ine, monga mkulu wa kampani yopanga zolipirira yomwe imayendetsa BigData iyi, sindingathe kunyalanyaza nkhokwe. Ndiganiza za data yayikulu kudzera mu prism ya oyendetsa ma telecom, omwe njira zawo zolipirira zimayenda zidziwitso za masauzande ambiri olembetsa tsiku lililonse.
Theorem
Tiyeni tiyambe, monga vuto la masamu: choyamba, timatsimikizira kuti deta ya ogwiritsira ntchito telecom imatha kutchedwa BigDat. Deta yayikulu yodziwika imadziwika ndi zinthu zitatu za VVV, ngakhale pakutanthauzira kwaulere chiwerengero cha "V" chinafika mpaka zisanu ndi ziwiri.
kuchuluka. MVNO ya Rostelecom yokha imatumikira olembetsa oposa milioni. Othandizira ochititsa chidwi amasanthula deta kuchokera kwa anthu 44 miliyoni mpaka 78 miliyoni. Magalimoto akukula sekondi iliyonse: m'gawo loyamba la 2019, olembetsa adutsa kale 3,3 biliyoni GB kuchokera pama foni am'manja.
Kuthamanga. Palibe wabwino kuposa ziwerengero zomwe zinganene zamphamvu, kotero ndidutsa zolosera za Cisco. Pofika chaka cha 2021, 20% ya magalimoto a IP apita kumayendedwe am'manja - ikhala pafupifupi katatu m'zaka zisanu. Gawo limodzi mwa magawo atatu a maulumikizidwe am'manja adzakhala pa M2M - chitukuko cha IoT chidzapangitsa kuti maulumikizidwe achuluke kasanu ndi kamodzi. Intaneti ya Zinthu sidzakhala yopindulitsa, komanso yogwiritsa ntchito kwambiri, kotero ena ogwira ntchito azingoyang'ana pa izo. Ndipo iwo omwe amapanga IoT ngati ntchito yapadera adzalandira maulendo awiri.
Zosiyanasiyana. Kusiyanasiyana ndi lingaliro lokhazikika, koma ogwira ntchito pa telecom amadziwa pafupifupi chilichonse chokhudza omwe amalembetsa. Kuchokera pa dzina ndi pasipoti mpaka mtundu wa foni, kugula, malo omwe adayendera ndi zokonda. Malinga ndi lamulo la Yarovaya, mafayilo amakanema amasungidwa kwa miyezi isanu ndi umodzi. Chifukwa chake tiyeni titenge ngati axiom kuti zomwe zasonkhanitsidwa ndizosiyanasiyana.
Mapulogalamu ndi njira
Othandizira ndi m'modzi mwa omwe amagula BigData, chifukwa chake njira zazikulu zowunikira deta zimagwira ntchito pamakampani a telecom. Funso lina ndiloti ndani ali wokonzeka kuyika ndalama pa chitukuko cha ML, AI, Deep Learning, kuyika ndalama m'malo opangira deta ndi migodi ya deta. Ntchito yokhazikika ndi database imakhala ndi zomangamanga ndi gulu, ndalama zomwe si aliyense angakwanitse. Ndikoyenera kubetcha pa BigData kwa mabizinesi omwe ali kale ndi malo osungirako makampani kapena kupanga njira ya Ulamuliro wa Data. Kwa iwo omwe sanakonzekerebe ndalama za nthawi yayitali, ndikukulangizani kuti mupange pang'onopang'ono mapangidwe a mapulogalamu ndikuyika zigawo chimodzi ndi chimodzi. Ma module olemera ndi Hadoop akhoza kusiyidwa komaliza. Anthu owerengeka amagula njira yokonzekera yokonzekera ntchito monga Data Quality ndi Data Mining, makamaka makampani amasintha makinawo kuti agwirizane ndi zomwe akufuna komanso zosowa zawo - paokha kapena mothandizidwa ndi opanga.
Koma palibe malipiro aliwonse omwe angasinthidwe kuti agwire ntchito ndi BigData. M'malo mwake, si aliyense amene angasinthe. Ndi anthu ochepa amene angachite.
Zizindikiro zitatu zosonyeza kuti njira yolipirira ili ndi mwayi wokhala chida chopangira database:
- Horizontal scalability. Mapulogalamu ayenera kukhala osinthika - tikukamba za deta yaikulu. Kuwonjezeka kwachidziwitso kuyenera kuthandizidwa ndi kuwonjezeka kwapakati pa hardware mumagulu.
- Kulekerera zolakwa. Makina olipidwa kwambiri nthawi zambiri amakhala olekerera zolakwika mwachisawawa: zolipiritsa zimayikidwa mumagulu angapo m'malo angapo kuti atsimikizirena okha. Payeneranso kukhala makompyuta okwanira mu gulu la Hadoop ngati mmodzi kapena angapo alephera.
- Malo. Deta iyenera kusungidwa ndikusinthidwa pa seva yomweyo, apo ayi mutha kusweka pakusamutsa deta. Chimodzi mwazinthu zodziwika bwino za Map-Reduce approach: Masitolo a HDFS, njira za Spark. Momwemonso, pulogalamuyo iyenera kuphatikizika mosasunthika ku malo opangira data ndikutha kuchita zinthu zitatu pachimodzi: kusonkhanitsa, kukonza ndi kusanthula zambiri.
timu
Zomwe, momwe komanso cholinga chomwe pulogalamuyo idzagwiritsire ntchito deta yayikulu imasankhidwa ndi gulu. Nthawi zambiri imakhala ndi munthu mmodzi - wasayansi wa data. Ngakhale, m'malingaliro anga, phukusi lochepera la ogwira ntchito ku BigData limaphatikizansopo Woyang'anira Zamalonda, Wopanga Data, ndi manejala. Woyamba amamvetsetsa mautumikiwa, amamasulira chinenero chamakono kukhala munthu ndi mosemphanitsa. The Data Engineer amabweretsa zitsanzo kukhala zamoyo ndi Java/Scala ndi kuyesa ndi Machine Learning. Mtsogoleri amagwirizanitsa, amaika zolinga, amawongolera magawo.
Mavuto
Ndi mbali ya gulu la BigData kuti mavuto amadza nthawi zambiri posonkhanitsa ndi kukonza deta. Pulogalamuyi iyenera kufotokozedwa zomwe mungasonkhanitse komanso momwe mungachitire - kuti mufotokoze izi, muyenera kumvetsetsa nokha. Koma opereka si ophweka. Ndikulankhula za mavuto pogwiritsa ntchito chitsanzo cha ntchito yochepetsera kutuluka kwa olembetsa - ndi ntchito iyi yomwe ogwira ntchito pa telecom akuyesera kuthetsa mothandizidwa ndi BigData poyamba.
Kukhala ndi zolinga. TOR yopangidwa mwaluso komanso kumvetsetsa kosiyana kwa mawu ndi zowawa zazaka mazana ambiri osati kwa odziyimira pawokha. Ngakhale olembetsa "otayika" amatha kutanthauziridwa m'njira zosiyanasiyana - osagwiritsa ntchito ntchito za opareshoni kwa mwezi, miyezi isanu ndi umodzi kapena chaka. Ndipo kuti mupange MVP kutengera mbiri yakale, muyenera kumvetsetsa kuchuluka kwa kubwerera kwa olembetsa kuchokera ku kutuluka - omwe adayesa kugwirizana kwa ogwira ntchito ena kapena kuchoka mumzinda ndikugwiritsa ntchito nambala yosiyana. Funso lina lofunika kwambiri: nthawi yayitali bwanji kuti wolembetsa ayambe kunyamuka kuti adziwe izi ndikuchitapo kanthu? Theka la chaka ndi molawirira kwambiri, sabata lachedwa kale.
Kusintha kwa malingaliro. Nthawi zambiri, ogwiritsa ntchito amazindikira kasitomala ndi nambala yafoni, motero ndizomveka kuti zizindikilo ziyenera kuyikidwa ndi izo. Nanga bwanji akaunti yanu kapena nambala yofunsira ntchito? Ndikofunika kusankha kuti ndi gawo liti lomwe liyenera kutengedwa ngati kasitomala kuti deta mu dongosolo la oyendetsa zisasiyane. Kuyerekeza mtengo wa kasitomala kumafunsidwanso - ndi ndani amene amalembetsa ndi wofunika kwambiri kwa kampaniyo, yemwe wogwiritsa ntchito amafunikira kuyesetsa kuti asunge, ndi omwe "adzagwa" mulimonse momwe zingakhalire ndipo sizomveka kugwiritsa ntchito ndalama pa iwo.
Kusowa chidziwitso. Sikuti onse ogwira ntchito othandizira amatha kufotokozera gulu la BigData zomwe zimakhudza kwambiri kutuluka kwa olembetsa komanso momwe zinthu zingatheke zimaganiziridwa polipira. Ngakhale m'modzi wa iwo adatchedwa - ARPU - zikuwoneka kuti zitha kuwerengedwa m'njira zosiyanasiyana: mwina ndi malipiro a kasitomala nthawi ndi nthawi, kapena ndi zolipiritsa zokha. Ndipo mkati mwake, mafunso ena miliyoni amabuka. Kodi chitsanzocho chimaphimba makasitomala onse, mtengo wake wosunga kasitomala ndi wotani, kodi ndizomveka kuganiza kudzera mumitundu ina, ndi choti muchite ndi makasitomala omwe asungidwa molakwika.
Kukhazikitsa zolinga. Ndikudziwa mitundu itatu ya zolakwika zokhudzana ndi zotsatira zomwe zimapangitsa ogwiritsa ntchito kukhumudwa ndi nkhokwe.
- Woperekayo amaika ndalama ku BigData, amakonza ma gigabytes azidziwitso, koma amalandira zotsatira zomwe zikanapezeka zotsika mtengo. Njira zosavuta ndi zitsanzo, ma analytics akale amagwiritsidwa ntchito. Mtengo wake ndi wokwera nthawi zambiri, koma zotsatira zake zimakhala zofanana.
- Wogwiritsa ntchito amalandira zambiri pazotulutsa, koma samamvetsetsa momwe angagwiritsire ntchito. Pali ma analytics - izi ndi izi, zomveka komanso zowoneka bwino, koma palibe tanthauzo kuchokera pamenepo. Zotsatira zake sizimaganiziridwa, zomwe sizingakhale ndi cholinga cha "kukonza deta". Kukonza sikokwanira - kusanthula kuyenera kukhala maziko osinthira mabizinesi.
- Cholepheretsa kugwiritsa ntchito ma analytics a BigData chitha kukhala njira zamabizinesi zakale ndi mapulogalamu omwe si oyenera zolinga zatsopano. Izi zikutanthauza kuti analakwitsa pokonzekera - sanaganizire za aligorivimu ya zochita ndi magawo oyambitsa BigData kugwira ntchito.
Chifukwa
Kulankhula za zotsatira. Ndikambirana njira zogwiritsira ntchito ndikupangira ndalama za BigData, zomwe ogwiritsa ntchito pa telecom akugwiritsa ntchito kale.
Opereka amalosera osati kutuluka kwa olembetsa, komanso katundu pamasiteshoni oyambira.
- Zambiri zokhudzana ndi kayendetsedwe ka olembetsa, zochitika ndi maulendo afupipafupi zimawunikidwa. Zotsatira: kuchepetsedwa kwa kuchuluka kwazochulukira chifukwa cha kukhathamiritsa komanso kusinthika kwa madera ovuta a zomangamanga.
- Ogwiritsa ntchito ma telecom amagwiritsa ntchito zidziwitso za malo olembetsa komanso kuchuluka kwa magalimoto akatsegula malo ogulitsa. Kotero BigData analytics imagwiritsidwa ntchito kale ndi MTS ndi Vimpelcom kukonzekera malo a maofesi atsopano.
- Otsatsa amapangira ndalama zawo zazikuluzikulu pozipereka kumakampani ena. Makasitomala akuluakulu a BigData ndi mabanki azamalonda. Mothandizidwa ndi nkhokwe, amatsata zokayikitsa za SIM khadi ya olembetsa pomwe makhadiwo amalumikizidwa, amagwiritsa ntchito zigoli zowopsa, zotsimikizira komanso zowunikira. Ndipo mu 2017, boma la Moscow linapempha kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe ka kayendetsedwe kake.
- BigData analytics ndi mgodi wagolide kwa ogulitsa omwe amatha kupanga makampeni otsatsa makonda amagulu ambiri olembetsa ngati angafune. Makampani a telecom amaphatikiza mbiri ya anthu, zokonda za ogula, ndi machitidwe a olembetsa, kenako amagwiritsa ntchito BigData yomwe yasonkhanitsidwa kukopa makasitomala atsopano. Koma pakukwezeleza kwakukulu ndi kukonzekera kwa PR, kubweza sikukhala ndi magwiridwe antchito okwanira nthawi zonse: pulogalamuyo iyenera nthawi imodzi kuganizira zinthu zambiri zofananira ndi zambiri za makasitomala.
Pomwe wina amawonabe BigData ngati mawu opanda kanthu, Big Four akupanga kale ndalama. MTS imalandira ma ruble 14 biliyoni pakukonza deta yayikulu m'miyezi isanu ndi umodzi, ndipo Tele2 idachulukitsa ndalama zama projekiti katatu ndi theka. BigData ikusintha kuchoka pachikhalidwe kukhala chofunikira, pomwe mawonekedwe onse a ogwiritsira ntchito ma telecom adzamangidwanso.
Source: www.habr.com