Mune 2013 gore IBS, iyo yakabva yaita seyaigadzira Data Division, yakandikumbira kuti ndiite braindump yakadaro (zvichienderana neruzivo rwekudyidzana nemakambani emafuta uye gasi vatengi) zvine chekuita nedambudziko renzvimbo yeBig Data, uye Dhata zvakazara. Saka ndakazosangana nazvo 7 years gare gare ndofunga zvaisekesa. Zvimwe zvinhu zviri pachena. Zvimwe zvakazove zvisiri zvechokwadi zvachose, asi ... 7 makore apfuura.
Ndakanyora nechiRungu uye zvino ndafunga kuchiturikira muchiRussian. Zvakadini kana chimwe chinhu chichiri kushanda iye zvino? (Ndichashandura mabulletins, asi siya zviratidzo muChirungu kunze kwehusimbe. Green is good, red is dangerous, blue is a dream).
Ndichagadzirisa zvinyorwa zvishoma kubva "nhasi" ChiItaliankuitira kuti zvive zvakajeka uye zvinosiyanisa.
Saka, DATA! Tine data ...
Iyo Data Division ndiyo Ropa Divisheni, nekuti data inogona kuenzaniswa, semuenzaniso, neropa rinomhanya nemutsinga uye tsinga dzemuviri webhizinesi. Zvisinei, kunyange zvazvo ropa rakafanana, zvipenyu zvakasiyana uye naizvozvo productization yakaoma kwazvo, asi inomiririrawo mukana webudiriro.
Kune vanhu avo iyo data inosvetukira mumaziso avo - ivava Isu tiri.
Uye kune vanhu avo, zvinosuruvarisa, havaone iyo data point isina chinhu. Izvi, zvakare, nhamo, ndezvedu Vatengi!
Uye saka, business principles...
- Tinotengesa businessasi kwete IT (dai vese nyanzvi dzeIT vandiregerere kamwechete) nekuti tiri kugadzirisa matambudziko enyika, uye, zvakanaka, mari yakawanda.
- Matambudziko ese ebhizinesi anonangana nepamusoro peiyo thematic indasitiri verticals uye inoda zvakakwana specializations.
- Kuedza kuratidza kukosha kwe "data" kana, zvakatonyanya kuoma, kukosha kwe "data management" kune bhizinesi kutambura kusingaperi uye kurwadziwa. Zvikurukuru, kwakafanana nokuuya kumunhu ari kunzwa zvakanaka ndokuti: βShamwari, ticharapa ropa rako zvino, uye, shamwari, rinodhura!β
- Kurota kwangu "kunyorova" ndiko kutengesa "data extraction" uye "analytics" mukati meiyo SaaS modhi mabhizimisi madiki nepakatiuyo akakwira mu123 cloud services ine inotonhorera interfaces: manejimendi manejimendi, dhesiki rekubatsira, accounting, CRM, mubhadharo, nguva yekubika, kushambadzira, ... Youcalc uye Successfactors (pamwe havachisina) Izvi zvakanaka!
- Tsvaka vanhu vanoda kutara "kupwanya" nedata. Iwo haawanzo uye anoshamisa (semashizha etii), asi kiyi kune bhizinesi. Mudetembi, semuenzaniso, anogona kuve akanaka kwazvo pakuwirirana.
- Engineers zvinodiwa! Inodiwa kushandura matambudziko akadhonzwa neCrunchers kubva kune data kuita mhinduro. Uye kubudirira kana kukundikana kwechisarudzo kunoenderana zvachose navo.
- Development opensource mapurojekiti ane kukosha kukuru uye anoita kuti zvikwanise "kuunganidza" zvigadziriso zvakaoma kubva pakutanga.
- Asi ... hatifaniri kukanganwa kuti Hadoop iraibhurari, uye Lucene zvakare raibhurari, uye chinhambwe chiri pakati raibhurari uye indasitiri chigadzirwa zvakawanda!
- Iyo yakavakirwa mhinduro ichafanirwa kuchinjika zvakanyanya, nekuti modularity ΠΈ integrability - pfungwa huru.
- Agile (Mwari ndiregererei) inzira yakakosha mukudyidzana nemutengi uye ongororo hypotheses, zvichava zvizhinji.
- Zvinonyanya kuitika uye zvinodikanwa kuburitsa ese coding uye UI. Yese bhizinesi analytics uye zvakatemwa backend kuda kubva mukati uye inoonekwa seyakakosha kugona.
- Vagadziri vezvisarudzo zvebhizinesi vanofanirwa kugara "vachiziviswa" nezve kudiwa kwekushanda nemazvo nedata uye kugara uchitsvaga nzira itsva dzekuaongorora. Iko kusanganiswa kwehunyanzvi uye bhizinesi kugona kwevashandi vedu kuchabatsira kusimudza chimiro chesangano rose zvakazara.
- Internet - kune mhedzisiro isingaperi yekurudziro (kwakanga kusina katsi dzakawanda kudaro kare ikako) zvine chekuita nemaitiro ebhizinesi manejimendi data, kunyangwe zvibodzwa uye chiyero zvichisiyana zvakanyanya.
Technological postulates...
- Pane yakakura budiriro mukana mukati kurerutsa kuti data inoratidzwa sei kuvanhu. Unogona kudaidza iri izwi rekuti "iPhonisation".
- Kunyangwe chokwadi chekuti vatengesi veBI vanoti ivo vakananga unza analytics kune vashandisi vekupedzisira, (uye ivo vari kufamba nenzira iyi) - kubudirira hakusati kwaitika. Vanhu havangonzwisisi zvakanaka multidimensional data.
- A mushandisi interface inomiririra yakawanda kana kushoma yakaoma, yakasununguka yakarongeka data mukati faceted fomu - inopawo nhamba isingaperi yezvinetso. Mhedziso: iyo yakabata kumeso ndiyo iri nani.
- Ipuratifomu yakavakirwa pahwaro hweotomatiki data kutorwa kubva kune masosi (ayo asina kugara akagadzirirwa kutorwa kwakadaro) anonyanya kutsamira pane kwakabva, kugadzikana kwezvibatanidza, uye zvivakwa. Nzvimbo (mutumwa) inogara ichipomerwa mhosva yekutadza kuunza mhedzisiro. Vimba - capital yemhando iyi yemapuratifomu. Capital iyo yakaoma kuwana uye nyore kurasikirwa.
- Kubva pane bhizinesi rekuona, hapana mutsauko pakati peBig Data kuongororwa uye Just Data. Kazhinji kuseri kwenhamba dziri nyore se2x2 kune mamirioni emadhora akakosha emikana. Muenzaniso wakanaka ndeye data pamagumo ehupenyu hwezvivakwa zvinhu pasherufu yeNorway. Ndeapi mazuva ese emangwana caps. kugadziridzwa kwemidziyo yese kwakaiswa paakisi imwe chete uye vakawana kuti mumakore eN sherufu yeAmagedhoni yakanga ichiuya - mumwe murume akapfuma kwazvo akasimuka pachigaro chake uye akakurumidza kupfugama achibuda mukamuri nemashoko okuti: βNdine urombo, handina. ndine nguva yakawanda, ndinofanira kugadzirira zvikepe ... "
- Excel, uye chaizvo yakajeka uye yakapfupika tabular kuratidzwa kwedata, ine simba rakakura uye remangwana rakakura. Ndinotenda mumatafura akanaka (uye zvakadaro) uye ndizvozvo!
- Uta hukuru hwezvose izvi "analytics" ndeye sarudzo otomatiki. Kune mikana mikuru, asiwo njodzi dzakakwirira, ndicho chikonzero mikana yakapfuma, ndicho chikonzero kune njodzi, ndicho chikonzero kune mikana, ndicho chikonzero ivo vari toffee ... π Zvakanaka kuchera kutarisira, semuenzaniso ...
- Kana "kusagadzikana" chiri chinhu chakakosha, saka iyo data inofanirwa kuratidzwa sevhisi. REST mitemo, asi hatifanire kukanganwa nezve optimization kugadzirwa, iyo ikozvino inowanzobairwa kuti ibatane sezvo simba remakomputa richiramba richikura.
- Master data - izvi ndizvo zvinoda kuiswa munharaunda, kutorwa, kumiswa pamberi pekugadzirisa chero nyaya dzebhizinesi. Master data idiki, asi matambudziko nayo akakura! Sekutaura kunoita hama dze semantics, 50% yematambudziko ose enyika imhaka yekuti vanhu vanodana zvinhu zvakafanana nemazita akasiyana, imwe 50% imhaka yekuti vanodana zvinhu zvakasiyana nemazita rimwe chete.
- Chero encapsulation padanho rekuchengetedza, inogadzirisa kuvhurika kwemhinduro uye inotungamirira kuSILO-fication. Zvakanaka kana iwe uri mutengesi mukuru, zvikasadaro ndizvo-saka. (Pano tiri kutaura, hongu, kwete nezve block level uye kwete nezveAWS S3, iyo yakanga yatova nemakore matanhatu panguva iyoyo, asi nezvemafaira.).
- Relational modelling data haisisiri shamwari yedu. RDF uye kiyi-kukosha - inotonhorera! Isu takaona shanduko yemashiripiti yehukama dhatabhesi ine mhando dze2000 matafura mumatafura gumi nemashanu, uye hapana wevashandisi akarasikirwa chero chinhu.
- IInternet inoshanda nekuti iripo URL senzira yakabatana yekutaura. Kukosha kweURL kana kuti URI kune bhizinesi ruzivo zviwanikwa zvakaoma kuwedzeredza.
- Zvinyorwa zvemigodhi uye NLP zvakakurumbira. MuInternet. Asi kunyangwe muchikamu chemakambani, budiriro huru inogona kuwanikwa nekuburitsa data rakarongeka kubva kune isina kurongeka data yekambani.
- Mubatanidzwa pakati pe data rakarongeka uye ruzivo rwakatorwa kubva kune isina kuumbwa data, i.e. mafaira - analytical Klondike.
- Paunenge uchitora data, usakanganwa nezvekodzero uye kodzero dzekodzero.
- Iyo kambani yekubvisa data inofanirwa kuumba ahackers department, mupfungwa yakanaka yeshoko racho. Kufemerwa nehondo yekukwira kurwisa Yellow Pages crawler bot kudzivirira masisitimu.
- Usati washanda nedata, zvinodikanwa kuti "ona" zvachose. Zvakaoma kutsanangura. Mafomu eTabular anouya mupfungwa. Kune vamwe, mifananidzo inomiririra, asi chero girafu yatove dudziro. Imwe nzira kana imwe ... "ona"!
- Kudzokorora nyaya yemushandisi "vimbo" kumberi. Vimba mukubatanidza / kugadzirwa kwedata, kuvimba mune data, kuvimba nezvisarudzo zvakaitwa.
Source: www.habr.com