Muna 2008, BigData yaive temu nyowani uye yemafashoni maitiro. Muna 2019, BigData chinhu chiri kutengeswa, sosi yepurofiti uye chikonzero chezvikwereti zvitsva.
Kudonha kwekupedzisira, hurumende yeRussia yakatanga bhiri rekudzora data hombe. Vanhu vanogona kusazivikanwa kubva paruzivo, asi vanogona kuzviita nekukumbira kwevakuru vehurumende. Kugadzirisa BigData kune vechitatu mapato chete mushure mekuzivisa kweRoskomnadzor. Makambani ane anopfuura 100 zviuru kero network anowira pasi pemutemo. Uye, hongu, kupi pasina marejista - inofanirwa kugadzira imwe ine runyorwa rwevashandisi ve database. Uye kana iyi Big Data isati yatorwa zvakanyanya nemunhu wese, ikozvino ichafanirwa kuverengerwa.
Ini, semutungamiriri wekambani yekuvandudza mabhiri iyo inogadzirisa iyi Big Data, haigone kufuratira dhatabhesi. Ini ndichafunga nezve data hombe kuburikidza neprism yevanofambisa telecom, kuburikidza neayo masisitimu ekubhadhara anoyerera eruzivo nezve zviuru zvevanyoreri vanopfuura zuva rega rega.
Theorem
Ngatitangei, senge mudambudziko remasvomhu: chekutanga tinotaridza kuti data yevanofambisa telecom inogona kunzi BigDat. Kazhinji, data huru inoratidzirwa nemhando nhatu dzeVVV, kunyange mukududzirwa kwemahara nhamba ye "Vs" yakasvika manomwe.
Volume. Rostelecom's MVNO chete inoshandisa vanopfuura miriyoni vanyoreri. Key host vanoshanda vanobata data ye44 kusvika 78 miriyoni vanhu. Trafiki iri kukura sekondi yega yega: mukota yekutanga ye2019, vanyoreri vakatowana 3,3 bhiriyoni GB kubva kunharembozha.
Velocity. Hapana anogona kukuudza nezve dynamics zviri nani pane manhamba, saka ini ndichaenda kuburikidza nekufanotaura kwaCisco. Pakazosvika 2021, 20% yeIP traffic ichaenda kune mobile traffic - ingangoita katatu mumakore mashanu. Chetatu chekubatanidza nhare ichave M2M - kuvandudzwa kweIoT kunotungamira kuwedzera katanhatu kwekubatanidza. Iyo Internet yeZvinhu haizongoite purofiti, asiwo zviwanikwa-yakanyanya, saka vamwe vashandisi vanongotarisa pairi chete. Uye avo vanogadzira IoT sevhisi yakaparadzana vanogashira kaviri traffic.
Variety. Diversity ipfungwa yekuzvimiririra, asi telecom vanoshanda vanonyatsoziva zvinenge zvese nezve vanyoreri vavo. Kubva pazita uye pasipoti ruzivo kusvika kumhando yefoni, kutenga, nzvimbo dzakashanyirwa uye zvaunofarira. Maererano nemutemo weYarovaya, mafaira enhau anochengetwa kwemwedzi mitanhatu. Saka ngatitorei seaxiom yekuti data rakaunganidzwa rakasiyana.
Software uye methodology
Vanopa ndevamwe vevatengi vakuru veBigData, saka akawanda makuru ekuongorora data maitiro anoshanda kune indasitiri yenhare. Mumwe mubvunzo ndewekuti ndiani akagadzirira kuisa mari mukuvandudza kweML, AI, Kudzidza Kwakadzika, kuisa mari munzvimbo dzedata uye kuchera data. Basa rakazara-rakakwana rine dhatabhesi rine zvivakwa uye timu, iyo mitengo iyo isingagoneki nemunhu wese. Mabhizinesi atove nekambani yekuchengetera zvinhu kana ari kugadzira Data Governance methodology anofanirwa kubheja paBigData. Kune avo vasati vagadzirira kudyara kwenguva refu, ini ndinokuraira kuti zvishoma nezvishoma uvake iyo software yekuvakisa uye kuisa zvikamu chimwe nechimwe. Iwe unogona kusiya inorema module uye Hadoop kwekupedzisira. Vashoma vanhu vanotenga yakagadzirira-yakagadzirirwa mhinduro yezvinetso zvakaita seData Quality uye Data Mining; makambani anowanzo gadzirisa sisitimu kune avo chaiwo maidi uye zvavanoda - ivo pachavo kana nerubatsiro rwevagadziri.
Asi hazvisi zvese zvekubhadhara zvinogona kugadziridzwa kuti zvishande neBigData. Kana kuti, hazvisi zvese chete zvinogona kugadziriswa. Vanhu vashoma vanogona kuita izvi.
Zviratidzo zvitatu zvekuti system yekubhadhara ine mukana wekuve dhatabhesi yekugadzirisa chishandiso:
- Horizontal scalability. Software inofanirwa kuchinjika - tiri kutaura nezve data hombe. Kuwedzera kwehuwandu hwemashoko kunofanira kurapwa nekuwedzera kwakaenzana kwe hardware musumbu.
- Kushivirira mhosva. Maserious prepaid masisitimu anowanzo kutadza-kushivirira nekusarudzika: kubhadharisa kunoiswa muchikwata mune akati wandei geolocations kuitira kuti ivo pachavo inshuwarisi imwe neimwe. Panofanirawo kunge paine makomputa akakwana muHadoop cluster kana imwe kana anopfuura akatadza.
- Nzvimbo. Dhata inofanirwa kuchengetwa uye kugadziridzwa pane imwe sevha, zvikasadaro unogona kuenda wakatyoka pakuendesa data. Imwe yeanozivikanwa Mepu-Drusa nzira zvirongwa: HDFS zvitoro, Spark maitiro. Nenzira yakanaka, iyo software inofanirwa kusanganisa zvisina mutsindo mu data center zvivakwa uye kukwanisa kuita zvinhu zvitatu mune imwe: kuunganidza, kuronga uye kuongorora ruzivo.
chikwata
Chii, sei uye nechinangwa chei chirongwa chichagadzirisa data hombe inosarudzwa nechikwata. Kazhinji inoumbwa nemunhu mumwe - musayendisiti wedata. Kunyangwe, mumaonero angu, iyo shoma pasuru yevashandi yeBig Data inosanganisirawo Chigadzirwa Maneja, Data Injiniya, uye Maneja. Yekutanga inonzwisisa masevhisi, inoturikira mutauro wehunyanzvi mumutauro wevanhu uye neimwe nzira. Data Engineer inounza modhi kuhupenyu ichishandisa Java/Scala uye kuyedza neMuchina Kudzidza. Maneja anoronga, anoisa zvinangwa, uye anodzora nhanho.
Matambudziko
Iko kune chikamu cheBigData timu iyo matambudziko anowanzo simuka kana uchiunganidza nekugadzirisa data. Iyo purogiramu inoda kutsanangura zvekuunganidza uye maitiro - kuti utsanangure izvi, iwe unofanirwa kutanga wazvinzwisisa iwe pachako. Asi kune vanopa, zvinhu hazvisi nyore. Ndiri kutaura nezvematambudziko ndichishandisa muenzaniso webasa rekudzikisa munyoreri churn - izvi ndizvo zviri kuedza kugadzirisa nerubatsiro rweBig Data pakutanga.
Kugadza zvinangwa. Kunyorwa-kwakanyatso kunyorwa kwehunyanzvi uye kunzwisisa kwakasiyana kwemazwi kwave kurwadza kwemazana emakore kwete chete kune vanozvimiririra. Kunyangwe "vakadonha" vanyoreri vanogona kududzirwa nenzira dzakasiyana - sevaya vasina kushandisa masevhisi emushandisi kwemwedzi, mwedzi mitanhatu kana gore. Uye kuti ugadzire MVP yakavakirwa pane zvakaitika kare, unofanirwa kunzwisisa kuwanda kwekudzoka kwevanyoreri kubva kuchurn - avo vakaedza vamwe vashandisi kana kusiya guta uye vakashandisa imwe nhamba. Mumwe mubvunzo unokosha: inguva yakareba sei munyoreri asati atarisirwa kuenda kana mupi anofanirwa kuona izvi uye kutora matanho? Mwedzi mitanhatu yakakurumidza, vhiki yanyanya kunonoka.
Kutsiva pfungwa. Kazhinji, vashandisi vanozivisa mutengi nenhamba dzerunhare, saka zvine musoro kuti zviratidzo zvipinzwe uchiishandisa. Zvakadini neakaundi yako yega kana nhamba yekushandisa sevhisi? Izvo zvinodikanwa kuti usarudze kuti ndeipi unit inofanira kutorwa semutengi kuitira kuti data iri muhurongwa hwemushandisi risasiyane. Kuongorora kukosha kwemutengi zvakare kunopokana - ndeupi munyoreri anonyanya kukosha kukambani, uyo mushandisi anoda kuwedzera simba kuchengetedza, uye ndeapi "achadonha" chero zvakadaro uye hapana chikonzero chekushandisa zviwanikwa pazviri.
Kushaya ruzivo. Havasi vese vashandi vanopa vanokwanisa kutsanangurira kuboka reBigData izvo zvinonyanya kukanganisa vanyoreri churn uye kuti zvinobvira sei zvinhu mukubhadharisa zvinoverengerwa. Kunyangwe vakatumidza imwe yacho - ARPU - zvinozoitika kuti inogona kuverengerwa nenzira dzakasiyana: kungave nekubhadharwa kwevatengi nguva nenguva, kana nekubhadhara otomatiki. Uye mukuita basa, mamwe miriyoni mimwe mibvunzo inomuka. Iyo modhi inovhara vese vatengi, chii mutengo wekuchengetedza mutengi, pane chero pfungwa yekufunga kuburikidza nemamwe mamodheru, uye zvekuita nevatengi vakachengetwa zvisirizvo.
Kuronga zvinangwa. Ndinoziva mhando nhatu dzezvikanganiso zvemhedzisiro izvo zvinoita kuti vashandisi vaoreswe nedhatabhesi.
- Mupi anodyara muBigData, anoita magigabytes eruzivo, asi anowana mhedzisiro yaigona kunge yakawanikwa zvakachipa. Madhayagiramu akareruka uye modhi, primitive analytics inoshandiswa. Mutengo wacho wakapetwa kakawanda, asi mhedzisiro yacho yakafanana.
- Mushandi anogamuchira data rakasiyana-siyana sekubuda, asi haanzwisise mashandisiro ayo. Pane analytics - heino, inonzwisisika uye yakawanda, asi haina basa. Mhedzisiro, iyo isingagoni kuve nechinangwa che "processing data," haina kufungidzirwa. Izvo hazvina kukwana kugadzirisa - analytics inofanirwa kuve hwaro hwekuvandudza mabhizinesi maitiro.
- Zvipingamupinyi pakushandiswa kweBigData analytics zvinogona kuve zvechinyakare bhizinesi maitiro uye software isina kukodzera kune zvitsva zvinangwa. Izvi zvinoreva kuti vakakanganisa padanho rekugadzirira - havana kufunga kuburikidza nealgorithm yezviito uye matanho ekuunza Big Data kubasa.
Nei
Kutaura nezve maresults. Ini ndichaenda pamusoro penzira dzekushandisa uye kuita mari Big Data iri kutoshandiswa nevashandisi venhare.
Vanopa vanofanotaura kwete chete kubuda kwevanyoresa, asiwo mutoro pazviteshi zvepasi.
- Ruzivo nezve mafambiro evanyoreri, chiitiko uye frequency masevhisi anoongororwa. Mhedzisiro: kuderedzwa kwehuwandu hwekuremerwa nekuda kwe optimization uye yemazuva ano yezvinetso zvezvivakwa.
- Telecom vanoshanda vanoshandisa ruzivo nezve geolocation yevanyoresa uye traffic density pakuvhura nzvimbo dzekutengesa. Saka, BigData analytics yakatoshandiswa neMTS neVimpelCom kuronga nzvimbo yemahofisi matsva.
- Vanopa mari vanoita mari yavo huru data nekupa kune wechitatu mapato. Vatengi vakuru veBigData vanoshanda mabhangi ekutengesa. Vachishandisa dhatabhesi, vanotarisisa zviitiko zvekufungira zvemunyoreri SIM kadhi uko makadhi akabatanidzwa, uye vanoshandisa njodzi yekurova, yekuongorora uye yekutarisa masevhisi. Uye muna 2017, hurumende yeMoscow yakakumbira mafambiro anoenderana neBigData data kubva kuTele2 kuronga tekinoroji uye zvekufambisa.
- BigData analytics mugodhi wegoridhe wevashambadziri, vanogona kugadzira mishandirapamwe yekushambadzira yevakawanda sezviuru zvemapoka evanyoreri kana vakasarudza. Makambani eTelecom anounganidza maprofiles emagariro, zvinofarirwa nevatengi uye maitiro evanyoreri, wobva washandisa yakaunganidzwa BigData kukwezva vatengi vatsva. Asi kune hukuru hwekusimudzira uye kuronga kwePR, kubhadharisa hakuwanzo kuve nekushanda kwakakwana: chirongwa chinofanira panguva imwe chete ichifunga zvinhu zvakawanda zvinoenderana neruzivo rwakadzama nezvevatengi.
Nepo vamwe vachiri kufunga BigData mutsara usina chinhu, Iwo Big Four ari kutoita mari pazviri. MTS inowana 14 bhiriyoni rubles kubva kune yakakura data kugadzirisa mumwedzi mitanhatu, uye Tele2 yakawedzera mari kubva kumapurojekiti nekatatu nehafu. BigData iri kutendeuka kubva pamaitiro kuita iyo inofanirwa kuve, pasi payo iyo yese chimiro chevafambisi venhare ichavakwa patsva.
Source: www.habr.com