Data Engineer uye Data Scientist: zvavanogona kuita uye kuti yakawanda sei yavanowana

Pamwe chete naElena Gerasimova, mukuru wechikoro "Data Science uye AnalyticsΒ»muNetology tinoenderera mberi nekunzwisisa mabatiro avanoita mumwe nemumwe uye kuti maData Sainzi neData Injiniya anosiyana sei.

Muchikamu chekutanga vakaudza nezve misiyano mikuru pakati peData Scientist uye Data Engineer.

Muchinyorwa ichi tichataura pamusoro peruzivo nehunyanzvi nyanzvi dzinofanirwa kuve nazvo, ndedzipi dzidzo inokosheswa nevashandirwi, mabvunzurudzo anoitwa sei, uye kuti yakawanda sei mainjiniya edata nemasainzi edata vanowana. 

Izvo masayendisiti uye mainjiniya anofanira kuziva

Dzidzo yakasarudzika yevaviri nyanzvi ndeyeComputer Science.

Data Engineer uye Data Scientist: zvavanogona kuita uye kuti yakawanda sei yavanowana

Chero sainzi wedata-data sainzi kana muongorori-anofanira kukwanisa kuratidza chokwadi chemhedzisiro yavo. Nokuda kweizvi haugone kuita pasina ruzivo manhamba uye manhamba ane chekuita neBasic mathematics.

Kudzidza kwemuchina uye data analytics maturusi akakosha munyika yanhasi. Kana zvishandiso zvakajairika zvisipo, unofanirwa kuve nehunyanzvi kukurumidza kudzidza maturusi matsva, kugadzira zvinyorwa zviri nyore kuti uzvigadzirise mabasa.

Izvo zvakakosha kuti uzive kuti data sainzi anofanira kutaurirana zvinobudirira mhedzisiro yekuongorora. Zvichamubatsira izvi data visualization kana mhedzisiro yekutsvagisa uye kuyedzwa kwekufungidzira. Nyanzvi dzinofanirwa kukwanisa kugadzira machati uye magirafu, kushandisa maturusi ekuona, uye kunzwisisa nekutsanangura data kubva kumabhodhi.

Data Engineer uye Data Scientist: zvavanogona kuita uye kuti yakawanda sei yavanowana

Kune injinjini yedata, nzvimbo nhatu dzinouya pamberi.

Algorithms uye data zvimiro. Izvo zvakakosha kuti uwane zvakanaka pakunyora kodhi uye kushandisa zvakakosha zvimiro uye algorithms:

  • algorithm kuomarara kuongororwa,
  • kukwanisa kunyora kodhi yakajeka, inochengeteka, 
  • batch processing,
  • real-time processing.

Databases uye data warehouses, Bhizinesi Intelligence:

  • kuchengetedza uye kugadzirisa data,
  • dhizaini yehurongwa hwakakwana,
  • Kupinza data,
  • akagoverwa mafaira masisitimu.

Hadoop uye Big Data. Kune data rakawanda uye rakawanda, uye pamusoro pemakore 3-5, matekinoroji aya anozove madikanwa kune ese mainjiniya. Uyezve:

  • Data Lakes
  • kushanda nevanopa makore.

Machine kudzidza ichashandiswa kwese kwese, uye zvakakosha kuti unzwisise kuti ndeapi matambudziko ebhizinesi ayo achabatsira kugadzirisa. Hazvina kudikanwa kuti ukwanise kugadzira mhando (data masayendisiti anogona kubata izvi), asi iwe unofanirwa kunzwisisa mashandisiro avo uye zvinoenderana nezvinodiwa.

Yakawanda sei mainjiniya nemasainzi vanowana?

Data Engineer Income

In international practice kutanga mihoro inowanzoita $100 pagore uye inowedzera zvakanyanya neruzivo, maererano neGlassdoor. Pamusoro pezvo, makambani anowanzo kupa sarudzo dzemasheya uye 000-5% mabhonasi epagore.

MuRussia pakutanga kwebasa, muhoro kazhinji hausi pasi pe50 zviuru zveRubles mumatunhu uye 80 zviuru muMoscow. Hapana ruzivo kunze kwekupedza kudzidziswa kunodiwa panguva ino.

Mushure memakore 1-2 ekushanda - forogo ye90-100 zviuru rubles.

Iyo forogo inowedzera kusvika 120-160 zviuru mumakore 2-5. Zvinhu zvakadai sehunyanzvi hwemakambani apfuura, saizi yemapurojekiti, kushanda nedata hombe, nezvimwe zvinowedzerwa.

Mushure memakore mashanu ebasa, zviri nyore kutsvaga zvinzvimbo mumadhipatimendi ane hukama kana kunyorera zvinzvimbo zvehunyanzvi zvakaita se:

  • Architect kana mutungamiri anotungamira mubhangi kana telecom - anenge 250 zviuru.

  • Pre-Sales kubva kumutengesi ane matekinoroji awakashanda nawo zvakanyanya - zviuru mazana maviri pamwe nebhonasi inogoneka (200-1 miriyoni rubles). 

  • Nyanzvi mukushandiswa kweBusiness business applications, dzakadai seSAP - kusvika ku350 zviuru.

Mari ye data masayendisiti

Kutsvakurudza musika wevanoongorora wekambani "Normal Tsvagurudzo" uye sangano rekunyorera New.HR rinoratidza kuti nyanzvi dzeSainzi dzeData dzinogamuchira paavhareji muhoro wepamusoro pane vanoongorora mamwe hunyanzvi. 

MuRussia, muhoro wekutanga wesaenzi wedata ane anosvika gore rechiitiko kubva ku113 zviuru rubles. 

Kupedzwa kwezvirongwa zvekudzidzisa iko zvino kwave kutariswa sechiitiko chebasa.

Mushure memakore 1-2, nyanzvi yakadaro inogona kutogamuchira kusvika 160 zviuru.

Kune mushandi ane makore 4-5 ane ruzivo, forogo inowedzera kusvika 310 zviuru.

Kubvunzurudza kunoitwa sei?

Kumadokero, vakapedza kudzidza mapurogiramu ekudzidzira basa vane hurukuro yavo yekutanga paavhareji mavhiki mashanu mushure mekupedza kudzidza. Vanosvika 5% vanowana basa mushure memwedzi mitatu.

Iyo yekubvunzurudza maitiro einjiniya yedata uye data sainzi zvinzvimbo zvakangofanana. Kazhinji ine zvikamu zvishanu.

Summary. Vanokwikwidza vasina-musimboti chiitiko chekutanga (semuenzaniso, kushambadzira) vanosungirwa kugadzirira yakadzama yekuvhara tsamba yekambani yega yega kana kuve nereferensi kubva kune mumiriri wekambani iyoyo.

Kuongorora kwehunyanzvi. Zvinowanzoitika parunhare. Inosanganisira imwe kana miviri yakaoma uye yakawanda mibvunzo yakapusa ine chekuita nemushandirwi parizvino.

Hurukuro yeHR. Inogona kuitwa parunhare. Panguva ino, mukwikwidzi anoedzwa kuti akwane zvakakwana uye kugona kutaura.

Kubvunzurudza kwehunyanzvi. Kazhinji kazhinji zvinoitika mumunhu. Mumakambani akasiyana, chiyero chezvinzvimbo mutafura yevashandi chakasiyana, uye zvinzvimbo zvinogona kutumidzwa zvakasiyana. Naizvozvo, panguva ino, ruzivo rwehunyanzvi rwunoedzwa.

Hurukuro neCTO/Chief Architect. Injiniya nesainzi zvinzvimbo zvine hunyanzvi, uye kumakambani mazhinji ivo zvakare vatsva. Zvakakosha kuti maneja ade uyo angangoshanda naye uye anobvumirana naye mumaonero ake.

Chii chichabatsira masayendisiti uye mainjiniya mukukura kwavo kwebasa?

Zvakawanda zvekushandisa zvitsva zvekushanda nedata zvakaonekwa. Uye vashoma vanhu vakanaka zvakaenzana pamunhu wese. 

Makambani mazhinji haana kugadzirira kuhaya vashandi vasina ruzivo rwebasa. Nekudaro, vavhoti vane hushoma hwemashure uye ruzivo rwezvakakosha zvezvishandiso zvakakurumbira vanogona kuwana ruzivo rwunodiwa kana vakadzidza nekukudziridza vega.

Hunhu hunobatsira hweinjiniya yedata uye sainzi yedata

Chido uye kugona kudzidza. Haufanire kumhanyisa ruzivo kana kushandura mabasa kune chishandiso chitsva, asi iwe unofanirwa kuve wakagadzirira kuchinjira kune imwe nzvimbo.

Chishuwo che automate routine process. Izvi zvakakosha kwete chete pakubudirira, asiwo kuchengetedza yakakwirira data data uye nekukurumidza kwekutumira kune mutengi.

Kuteerera uye kunzwisisa kwe "zviri pasi pehodhi" yemaitiro. Nyanzvi ine kucherechedza uye ruzivo rwakakwana rwemaitiro achagadzirisa dambudziko nekukurumidza.

Kuwedzera kune yakanakisa ruzivo rwealgorithms, data zvimiro uye mapaipi, iwe unoda dzidza kufunga mune zvigadzirwa - ona zvivakwa uye bhizinesi mhinduro semufananidzo mumwe. 

Semuenzaniso, zvinobatsira kutora chero basa rinozivikanwa uye uuye nedatabase yayo. Wobva wafunga nezve nzira yekuvandudza ETL neDW iyo inoizadza nedata, rudzii rwevatengi ruchava uye chii chakakosha kuti vazive nezve data, uye zvakare mabatiro anoita vatengi nezvikumbiro: yekutsvaga basa uye kufambidzana, kukodha mota. , podcast application, yedzidzo chikuva.

Zvinzvimbo zvemuongorori, sainzi yedata uye injiniya ari padyo, saka unogona kubva kune imwe nzira kuenda kune imwe nekukurumidza kupfuura kubva kune dzimwe nzvimbo.

Chero zvazvingava, zvichave nyore kune avo vane chero IT kumashure pane avo vasina. Paavhareji, vanhu vakuru vanokurudzirwa vanodzidzisazve uye vanochinja mabasa makore 1,5–2 ega ega. Izvi zviri nyore kune avo vanodzidza muboka uye neanopa chipangamazano, zvichienzaniswa neavo vanovimba chete neakavhurika masosi.

Kubva kuvapepeti veNetology

Kana iwe uri kutarisa basa reData Injiniya kana Dhata Scientist, tinokukoka iwe kuti udzidze zvirongwa zvedu zvekosi:

Source: www.habr.com

Voeg