Ukuthathwa kwesibili kwabafundi bohlelo lwesayensi yedatha ye-Ozon Masters nohlelo lwezobunhloli bebhizinisi sekuqalile. Ukukusiza ukuthi unqume ukuthi uyasifaka yini isicelo futhi uthathe ukuhlolwa kwe-inthanethi, sibuze ubuhlakani bohlelo mayelana nokuthi yini ongayilindela ekuqeqeshweni nasekusebenzeni ngedatha.
I-NVIDIA Chief Data Scientist kanye nothisha UPavel Klemenkov uchaze ukuthi kungani izazi zezibalo kufanele zikhode futhi zifunde iminyaka emibili e-Ozon Masters.
- Ingabe zikhona izinkampani eziningi ezisebenzisa idatha yesayensi algorithm?
- Okumbalwa, empeleni. Izinkampani ezimbalwa ezinkulu ezinedatha enkulu ngempela seziqala ukusebenza nayo ngempumelelo noma sezinesikhathi eside zikwenza lokho. Kuyacaca ukuthi ingxenye yemakethe isebenzisa idatha elingana kuspredishithi se-Excel noma engabalwa kuseva enkulu, kodwa akunakwenzeka ukusho ukuthi amabhizinisi azi ukusebenza ngedatha ambalwa futhi aphakathi kakhulu.
— Sitshele okuncane mayelana namaphrojekthi lapho kusetshenziswa isayensi yedatha.
Isibonelo, ngenkathi sisebenza e-Rambler, sasenza isistimu yokukhangisa esekelwe kuzimiso ze-RTB (Real Time Bidding). Besidinga ukwakha amamodeli amaningi azothuthukisa ukuthengwa kwezikhangiso noma, isibonelo, sibikezele amathuba okuchofoza, izinga lokuguqulwa, nokunye. Ngesikhathi esifanayo, indali yokukhangisa ikhiqiza inani elikhulu ledatha: amalogi esicelo sesayithi kulabo abangase babe ngabathengi bezikhangiso, amalogi emikhangiso, chofoza amalogi—lokho okungamashumi amaterabhayithi edatha ngosuku.
Ngaphezu kwalokho, kule misebenzi, sibone into ethokozisayo: uma unikeza idatha eyengeziwe yokuqeqesha imodeli, ikhwalithi yayo iyanda. Ngokuvamile, ngenani elithile ledatha, ikhwalithi yesibikezelo iyayeka ukuba ngcono, futhi ukuze uqhubeke uthuthukisa ukunemba, udinga ukusebenzisa imodeli ehluke kakhulu, indlela ehlukile yokulungiselela idatha, izici, njalonjalo. Kulesi simo, siphakele idatha eyengeziwe, futhi ikhwalithi iyathuthuka.
Lesi yisimo esijwayelekile lapho abahlaziyi bekumele basebenze namasethi edatha amakhulu ukuze benze isilingo, nalapho isampula elincane elilingana ku-MacBook encane lingakwazi ukwanela. Sasidinga namamodeli asakazwayo, njengoba kwakungenakwenzeka ukubaqeqesha ngaphandle kwawo. Ngokwethulwa kombono wekhompiyutha ekukhiqizeni, izibonelo ezinjalo zivame kakhulu, njengoba izithombe zimelela inani elikhulu ledatha, futhi ukuqeqesha imodeli enkulu kudinga izigidi zezithombe.
Umbuzo uphakama ngokushesha: indlela yokugcina lonke lolu lwazi, indlela yokulucubungula kahle, indlela yokusebenzisa ama-algorithms okufunda okusabalalisiwe—okugxilwe kukho kuyasuka kuzibalo ezimsulwa kuye kobunjiniyela. Ngisho noma ungabhali ikhodi yokukhiqiza, udinga ukwazi ukusebenza ngamathuluzi obunjiniyela ukuze wenze izivivinyo.
- Ishintshe kanjani indlela yokuthola izikhala zesayensi yedatha eminyakeni yamuva nje?
Idatha enkulu iyekile ukuba yi-hype futhi isibe ngokoqobo. Ama-hard drive awabizi, okusho ukuthi manje sekungenzeka ukuqoqa yonke idatha edingekayo ukuze kuhlolwe noma iyiphi inkolelo-mbono esikhathini esizayo. Ngenxa yalokho, ulwazi lwamathuluzi amakhulu edatha lufunwa kakhulu, okuholela ezikhundleni eziningi kakhulu zobunjiniyela bedatha.
Ngokuqonda kwami, umphumela womsebenzi wososayensi wedatha awukona ukuhlola, kodwa umkhiqizo osufinyelele ukukhiqizwa. Futhi kusukela kulo mbono, ngaphambi kwe-hype enkulu yedatha, inqubo yayilula: onjiniyela bagxile ekufundeni komshini ukuxazulula izinkinga ezithile, futhi ukuletha ama-algorithms ekukhiqizeni kwakuqondile.
- Yini edingekayo ukuze uhlale unguchwepheshe ofunwayo?
- Manje, abantu abaningi bafake isayensi yedatha abaye bafunda izibalo kanye nethiyori yokufunda komshini, futhi abaye babamba iqhaza emiqhudelwaneni yokuhlaziywa kwedatha, lapho kunikezwa khona ingqalasizinda esenziwe ngomumo: idatha iyahlanzwa, amamethrikhi achazwe, futhi azikho izidingo zesixazululo ukuze sikhiqizeke futhi sisheshe.
Ngenxa yalokho, abantu beza bezosebenza bengalungiselelwanga kahle amaqiniso ebhizinisi, kanye negebe elikhona phakathi kwabasanda kungena kanye nonjiniyela abanolwazi.
Ngokuthuthukiswa kwamathuluzi okwakha amamodeli angokwezifiso kusuka kumamojula enziwe ngomumo—futhi izixazululo ezinjalo sezivele zikhona kwa-Microsoft, Google, nakwabanye abaningi—kanye nokuzenzakalela kokufunda komshini, leli gebe lizogqama nakakhulu. Ngokuzayo, umsebenzi uzodinga abacwaningi abazimisele abakha ama-algorithms amasha kanye nabasebenzi abanamakhono obunjiniyela athuthukile abazosebenzisa amamodeli kanye nezinqubo ezizenzakalelayo. Isifundo se-Ozon Masters kwezobunjiniyela bedatha yakhelwe ukuthuthukisa amakhono obunjiniyela kanye nekhono lokusebenzisa ama-algorithms okufunda omshini asabalalisiwe kudatha enkulu. Silwela ukunciphisa igebe phakathi kwalokho usosayensi wedatha angakwenza nalokho okufanele akwazi ukukwenza lapho esebenza.
— Kungani isazi sezibalo esineziqu singangena kwezamabhizinisi?
— Umphakathi wesayensi yedatha yaseRussia usuqonde ukuthi ikhono nolwazi kuguqulwa ngokushesha kube yimali, ngakho ngokushesha nje lapho uchwepheshe ezuza ulwazi olusebenzayo, inani labo liqala ukukhuphuka ngokushesha, nabantu abanekhono kakhulu belanda amanani aphezulu kakhulu—futhi lokhu kuyiqiniso esigabeni samanje sokuthuthuka kwemakethe.
Ingxenye enkulu yomsebenzi wososayensi wedatha ukuhlolisisa idatha, ukuqonda ukuthi yini ekhona, ukubonisana nabantu abanesibopho sezinqubo zebhizinisi nokukhiqiza idatha—bese uyisebenzisela ukwakha amamodeli. Ukuze uqale ukusebenza ngedatha enkulu, kubalulekile ukuba namakhono onjiniyela—lokhu kwenza kube lula kakhulu ukuzulazula ezinkingeni eziningi zesayensi yedatha.
Isimo esijwayelekile: ubhala umbuzo we-SQL owenziwe kusetshenziswa uhlaka lwe-Hive, olusebenza ngedatha enkulu. Umbuzo uthatha imizuzu eyishumi ukucutshungulwa, noma okubi kakhulu, ihora noma amabili. Ngokuvamile, lapho uthola ukulahlwa kwedatha, uyabona ukuthi ukhohlwe ukuziphendulela ngento ethile noma ulwazi olwengeziwe. Kufanele uphinde uthumele umbuzo bese ulinda leyo mizuzu noma amahora. Uma uhlakaniphile ekusebenzeni kahle, uzodlulela komunye umsebenzi, kodwa njengoba umkhuba ubonisa, izihlakaniphi ezisebenza kahle zimbalwa futhi zikude phakathi, futhi abantu bavele balinde. Ngakho-ke, ezifundweni zethu, sizonikela ngesikhathi esibalulekile ekusebenzeni kahle, ukuze kwasekuqaleni sikwazi ukubhala imibuzo ethatha imizuzu, hhayi amahora amabili. Leli khono likhulisa kakhulu ukukhiqiza, futhi ngalo, inani lochwepheshe.
- Ihluke kanjani i-Ozon Masters kwezinye izifundo?
I-Ozon Masters ifundiswa ngabasebenzi base-Ozon, futhi izabelo zisekelwe emacaleni angempela ebhizinisi axazululwa ezinkampanini. Eqinisweni, ngaphezu kokuntuleka kwamakhono onjiniyela, othile owafunda isayensi yedatha eyunivesithi ubhekene nenye inselele: inkinga yebhizinisi ihlelwe ngolimi lwebhizinisi, futhi umgomo wayo ulula kakhulu: ukwenza imali eyengeziwe. Isazi sezibalo siyakwazi ukuthuthukisa amamethrikhi ezibalo kahle, kodwa ukuthola inkomba ehambisana nemethrikhi yebhizinisi kunzima. Udinga ukuqonda ukuthi uxazulula inkinga yebhizinisi futhi, kanye nebhizinisi, yenza amamethrikhi angathuthukiswa ngokwezibalo. Leli khono litholwa ngamacala omhlaba wangempela, futhi i-Ozon iyawahlinzeka.
Ngisho nokubeka izifundo zecala eceleni, othisha besikole bangabasebenzi abaningi abaxazulula izinkinga zebhizinisi ezinkampanini zangempela. Ngenxa yalokho, indlela yokufundisa ngokwayo igxile kakhulu. Okungenani esifundweni sami, ngizozama ukugxilisa ukugxila endleleni yokusebenzisa amathuluzi, yiziphi izindlela ezikhona, nokunye. Kanye nabafundi, sizoqonda ukuthi kunethuluzi lawo wonke umsebenzi, futhi ithuluzi ngalinye linendawo yalo elisebenza ngayo.
- Uhlelo oludume kakhulu lokuqeqeshwa kokuhlaziywa kwedatha, vele, i-SHAD. Ihluke kanjani ngempela kuyo?
Kuyacaca ukuthi iSikole Sokuhlaziywa Nokuphathwa Kwedatha (SDA) kanye ne-Ozon Masters, ngaphezu komsebenzi wabo wezemfundo, zibhekana nenkinga yendawo yokuqeqeshwa. Abafundi abaphezulu be-SDA baqashwa ngokuyinhloko yi-Yandex, kodwa okubanjiwe ukuthi i-Yandex, ngenxa yesimo sayo esithile—inkulu futhi yadalwa lapho amathuluzi amakhulu edatha eyivelakancane—inengqalasizinda yayo kanye namathuluzi edatha, okusho ukuthi kuzodingeka uwazi kahle. I-Ozon Masters inomlayezo ohlukile: uma uphumelele uhlelo futhi i-Ozon noma enye ye-99% yezinye izinkampani ikunikeza umsebenzi, kuzoba lula kakhulu ukuqala ukufaka isandla ebhizinisini; amakhono atholwe nge-Ozon Masters azokwanela ukuthi aqalise.
- Isifundo sithatha iminyaka emibili. Kungani kuthatha isikhathi eside kangaka?
- Umbuzo omuhle. Yinde, ngoba ngokokuqukethwe kanye nezinga labafundisi, iwuhlelo oluphelele lwenkosi, oludinga isikhathi esiningi sokuluqonda, kuhlanganise nomsebenzi wesikole.
Ngokombono wami wesifundo, ukulindela ukuthi abafundi bachithe amahora angu-2-3 ngesonto ezabelweni kuyinto evamile. Okokuqala, ama-asayinimenti aqedwa kuqoqo lokuqeqeshwa, futhi noma yiliphi iqoqo elihlanganyelwe lisho ukuthi abantu abambalwa bayalisebenzisa ngesikhathi esisodwa. Lokhu kusho ukuthi kuzodingeka ulinde ukuthi umsebenzi uqale ukusebenza, futhi ezinye izinsiza zingase zikhethwe futhi zihanjiswe kulayini obaluleke kakhulu. Ngakolunye uhlangothi, noma yimuphi umsebenzi onedatha enkulu udla isikhathi.
Uma uneminye imibuzo mayelana nohlelo, ukusebenza ngedatha enkulu, noma amakhono wobunjiniyela, i-Ozon Masters izobamba usuku oluvuliwe ku-inthanethi ngoMgqibelo, Ephreli 25 ngo-12:00 PM. Sizohlangana nothisha nabafundi futhi kuqhubeke .
Source: www.habr.com
