Mu 2018, lingaliro la MLOps lidawonekera m'magulu a akatswiri komanso pamisonkhano yamaphunziro yoperekedwa kwa AI, yomwe idayamba kugwira ntchito pakampaniyo ndipo tsopano ikukula ngati njira yodziyimira pawokha. M'tsogolomu, MLOps ikhoza kukhala imodzi mwamadera otchuka kwambiri mu IT. Ndi chiyani ndipo imadyedwa ndi chiyani? Tiyeni tifufuze pansipa.
Kodi MLOps ndi chiyani
MLOps (kuphatikiza matekinoloje ophunzirira makina ndi njira ndi njira zoyendetsera zitsanzo zomwe zapangidwa kukhala bizinesi) ndi njira yatsopano yolumikizirana pakati pa oyimira mabizinesi, asayansi, masamu, akatswiri ophunzirira makina ndi mainjiniya a IT popanga machitidwe anzeru opangira.
Mwanjira ina, ndi njira yosinthira njira zophunzirira zamakina ndi matekinoloje kukhala chida chothandizira kuthetsa mavuto abizinesi.
Ndikofunikira kumvetsetsa kuti unyolo wa zokolola umayamba kale chisanadze chitukuko cha chitsanzo. Gawo lake loyamba ndikutanthauzira vuto la bizinesi, lingaliro la mtengo womwe ungachotsedwe ku data, ndi lingaliro labizinesi kuti mugwiritse ntchito.
Lingaliro lomwe la MLOps lidawuka ngati fanizo la lingaliro la DevOps pokhudzana ndi makina ophunzirira makina ndi matekinoloje. DevOps ndi njira yopangira mapulogalamu omwe amakulolani kuti muwonjezere kuthamanga kwa kusintha kwa munthu payekha ndikusunga kusinthasintha ndi kudalirika pogwiritsa ntchito njira zingapo, kuphatikizapo chitukuko chosalekeza, kugawanitsa ntchito kukhala ma microservices angapo odziyimira pawokha, kuyesa pawokha ndi kutumizidwa kwa munthu payekha. kusintha, kuwunika zaumoyo padziko lonse lapansi, njira yoyankhira mwachangu pazolephera zomwe zadziwika, ndi zina.
DevOps yatanthauzira moyo wa pulogalamuyo, ndipo anthu ammudzi abwera ndi lingaliro logwiritsa ntchito njira yomweyo pazida zazikulu. DataOps ndikuyesera kusintha ndikukulitsa njirayo poganizira za kusunga, kutumiza ndi kukonza deta yochuluka m'mapulatifomu osiyanasiyana komanso ogwirizana.
Kubwera kwa mitundu ina yovuta yophunzirira makina yomwe imakhazikitsidwa pamabizinesi amabizinesi, kufanana kwakukulu kunadziwika pakati pa moyo wamasamu ophunzirira makina a masamu ndi moyo wa mapulogalamu. Kusiyana kokha ndikuti ma aligorivimu achitsanzo amapangidwa pogwiritsa ntchito zida zophunzirira makina ndi njira. Chifukwa chake, lingaliro lachilengedwe lidawuka kuti ligwiritse ntchito ndikusintha njira zodziwika kale pakupanga mapulogalamu amitundu yophunzirira makina. Chifukwa chake, magawo ofunikira otsatirawa amatha kusiyanitsidwa pamayendedwe amoyo wamitundu yophunzirira makina:
- kufotokozera lingaliro la bizinesi;
- maphunziro achitsanzo;
- kuyesa ndi kukhazikitsa chitsanzo mu ndondomeko ya bizinesi;
- ntchito ya chitsanzo.
Pamene pakugwira ntchito pakufunika kusintha kapena kubwezeretsanso chitsanzo pa deta yatsopano, kuzungulira kumayambiranso - chitsanzocho chimayeretsedwa, choyesedwa, ndipo mtundu watsopano umayikidwa.
Kubwerera. Chifukwa chiyani kuyambiranso osayambiranso? Mawu akuti "kubwezeretsanso chitsanzo" ali ndi tanthawuzo lachiwiri: pakati pa akatswiri amatanthauza chilema chachitsanzo, pamene chitsanzocho chikuwonetseratu bwino, chimabwereza ndondomeko yomwe inanenedweratu pa maphunziro a maphunziro, koma imachita zoipa kwambiri pa chitsanzo cha kunja. Mwachibadwa, chitsanzo choterocho ndi cholakwika, popeza chilemachi sichilola kugwiritsidwa ntchito kwake.
Munthawi yamoyo uno, zikuwoneka kuti ndizomveka kugwiritsa ntchito zida za DevOps: kuyesa pawokha, kutumiza ndi kuyang'anira, kupanga mawerengedwe amitundu m'njira zosiyanasiyana ma microservices. Koma palinso zinthu zingapo zomwe zimalepheretsa kugwiritsa ntchito zida izi mwachindunji popanda kumangiriza ML.
Momwe mungapangire zitsanzo kuti zigwire ntchito ndikukhala zopindulitsa
Monga chitsanzo chomwe tidzasonyezera kugwiritsa ntchito njira ya MLOps, tidzatenga ntchito yapamwamba yopangira macheza othandizira kubanki (kapena china chilichonse). Kawirikawiri, ndondomeko ya bizinesi yothandizira macheza imawoneka motere: kasitomala amalowetsa uthenga ndi funso muzokambirana ndikulandira yankho kuchokera kwa katswiri mkati mwa mtengo wofotokozera. Ntchito yopangira macheza otere nthawi zambiri imathetsedwa pogwiritsa ntchito malamulo omwe amafotokozedwa mwaukadaulo, omwe ndi olimbikira kwambiri kuti akhazikitse ndikuwongolera. Kuchita bwino kwa makina otere, kutengera kuchuluka kwa zovuta za ntchitoyi, kumatha kukhala 20-30%. Mwachilengedwe, lingaliro limakhala lopindulitsa kwambiri kugwiritsa ntchito gawo lanzeru - fanizo lopangidwa pogwiritsa ntchito makina ophunzirira, omwe:
- amatha kukonza zopempha zambiri popanda kutenga nawo mbali (kutengera mutuwo, nthawi zina kuchita bwino kumatha kufika 70-80%);
- amasintha bwino mawu osagwirizana ndi mawu pazokambirana - amatha kudziwa cholinga, chikhumbo chenicheni cha wogwiritsa ntchito potengera pempho lomwe silinapangidwe bwino;
- amadziwa momwe angadziwire ngati yankho lachitsanzo ndilokwanira, ndipo ngati pali kukayikira za "kuzindikira" kwa yankho ili ndipo muyenera kufunsa funso lomveka bwino kapena kusintha kwa woyendetsa;
- akhoza kuphunzitsidwanso mwachisawawa (m'malo mwa gulu la omanga kusinthasintha nthawi zonse ndikuwongolera malemba oyankha, chitsanzocho chimaphunzitsidwanso ndi katswiri wa Data Science pogwiritsa ntchito malaibulale oyenerera ophunzirira makina).
Momwe mungapangire chitsanzo chapamwamba choterocho chigwire ntchito?
Monga kuthana ndi vuto lina lililonse, musanapange gawo lotere, ndikofunikira kufotokozera momwe bizinesi ikugwirira ntchito ndikufotokozera mwachindunji ntchito yomwe tidzathetsa pogwiritsa ntchito njira yophunzirira makina. Panthawiyi, njira yogwiritsira ntchito, yotchulidwa ndi Ops, imayamba.
Chotsatira ndi chakuti Data Scientist, mogwirizana ndi Data Engineer, amayang'ana kupezeka ndi kukwanira kwa deta ndi malingaliro abizinesi okhudzana ndi kuthekera kwa lingaliro la bizinesi, kupanga chitsanzo cha chitsanzo ndikuyesa mphamvu zake zenizeni. Pokhapokha pambuyo pa kutsimikiziridwa ndi bizinesi kungasinthe kuchoka pakupanga chitsanzo kuti chiphatikize mu machitidwe omwe amapanga ndondomeko yeniyeni ya bizinesi. Kukonzekera komaliza mpaka kumapeto, kumvetsetsa mozama pa gawo lililonse la momwe chitsanzocho chidzagwiritsidwire ntchito komanso momwe chuma chidzabweretsere, ndilofunika kwambiri pakuyambitsa njira za MLOps muzochitika zamakono zamakampani.
Ndi chitukuko cha matekinoloje a AI, chiwerengero ndi mavuto osiyanasiyana omwe angathetsedwe pogwiritsa ntchito makina ophunzirira akuchulukirachulukira. Njira iliyonse yamabizinesi yotereyi ndikupulumutsa kampaniyo chifukwa chodzipangira okha ntchito za anthu ambiri (malo oimbira foni, kuyang'ana ndi kusanja zikalata, ndi zina), ndikukulitsa makasitomala powonjezera ntchito zatsopano zowoneka bwino komanso zosavuta. ikupulumutsa ndalama chifukwa chogwiritsa ntchito bwino ndikugawanso zinthu zina ndi zina zambiri. Pamapeto pake, njira iliyonse imayang'ana pakupanga phindu ndipo, chifukwa chake, iyenera kubweretsa zotsatira zina zachuma. Apa ndikofunikira kwambiri kupanga malingaliro abizinesi momveka bwino ndikuwerengera phindu lomwe likuyembekezeka kuchokera pakukhazikitsa chitsanzo pakupanga phindu lonse la kampani. Pali zochitika pamene kukhazikitsa chitsanzo sikudzilungamitsa, ndipo nthawi yomwe akatswiri ophunzirira makina amachitira ndi okwera mtengo kwambiri kusiyana ndi malo ogwira ntchito omwe akugwira ntchitoyi. Ndicho chifukwa chake ndikofunikira kuyesa kuzindikira milandu yotereyi kumayambiriro kwa kupanga machitidwe a AI.
Chifukwa chake, zitsanzo zimayamba kupanga phindu pokhapokha ngati vuto la bizinesi lakonzedwa molondola mu ndondomeko ya MLOps, zofunikira zakhazikitsidwa, ndipo ndondomeko yowonetsera chitsanzo mu dongosolo lakonzedwa kumayambiriro kwa chitukuko.
Njira yatsopano - zovuta zatsopano
Yankho lathunthu ku funso lofunikira labizinesi lokhudzana ndi momwe mitundu ya ML ingagwiritsire ntchito kuthetsa mavuto, nkhani yayikulu yodalirika mu AI ndi imodzi mwazovuta zazikulu pakukhazikitsa ndikukhazikitsa njira za MLOps. Poyambirira, mabizinesi amakayikira za kukhazikitsidwa kwa kuphunzira makina munjira - ndizovuta kudalira zitsanzo m'malo omwe kale, monga lamulo, anthu amagwira ntchito. Kwa bizinesi, mapulogalamu amawoneka ngati "bokosi lakuda", kufunikira kwake komwe kumafunikirabe kutsimikiziridwa. Kuphatikiza apo, mu mabanki, mu bizinesi ya oyendetsa ma telecom ndi ena, pali zofunikira zokhwima za owongolera boma. Machitidwe onse ndi ma algorithms omwe amakhazikitsidwa pamabanki amayesedwa. Kuti athetse vutoli, kuti atsimikizire kwa bizinesi ndi owongolera kutsimikizika ndi kulondola kwa mayankho anzeru zopangira, zida zowunikira zikuyambitsidwa limodzi ndi chitsanzo. Kuphatikiza apo, pali njira yodziyimira yokha yovomerezeka, yovomerezeka yamitundu yowongolera, yomwe imakwaniritsa zofunikira za Banki Yaikulu. Gulu la akatswiri odziyimira pawokha limayang'ana zotsatira zomwe zapezedwa ndi chitsanzocho poganizira zomwe zalowetsedwa.
Vuto lachiwiri ndikuwunika ndikuganizira zoopsa zachitsanzo mukamagwiritsa ntchito makina ophunzirira makina. Ngakhale ngati munthu sangathe kuyankha funsoli ndi chitsimikizo cha zana limodzi pa zana ngati chovala chomwecho chinali choyera kapena chabuluu, ndiye kuti nzeru zopangira zimakhalanso ndi ufulu wolakwitsa. Ndikoyeneranso kulingalira kuti deta ingasinthe pakapita nthawi, ndipo zitsanzo ziyenera kuphunzitsidwanso kuti zipereke zotsatira zolondola mokwanira. Kuonetsetsa kuti ntchito yamalonda sichikuvutikira, m'pofunika kuyang'anira zoopsa zachitsanzo ndikuwunika momwe chitsanzocho chikuyendera, ndikuchibwezeretsanso nthawi zonse pazidziwitso zatsopano.
Koma pambuyo pa gawo loyamba la kusakhulupirirana, zotsatira zosiyana zimayamba kuonekera. Zitsanzo zambiri zimayendetsedwa bwino m'njira, m'pamenenso chilakolako cha bizinesi chogwiritsa ntchito nzeru zopangira chimakula - mavuto atsopano ndi atsopano akupezeka omwe angathetsedwe pogwiritsa ntchito njira zophunzirira makina. Ntchito iliyonse imayambitsa ndondomeko yonse yomwe imafuna luso linalake:
- akatswiri opanga deta amakonza ndi kukonza deta;
- asayansi a data amagwiritsa ntchito zida zophunzirira makina ndikupanga chitsanzo;
- IT imagwiritsa ntchito chitsanzo mu dongosolo;
- Katswiri wa ML amasankha momwe angaphatikizire molunjika chitsanzochi munjira, zomwe zida za IT zigwiritse ntchito, kutengera zofunikira pakugwiritsa ntchito chitsanzocho, poganizira zakuyenda kwa zopempha, nthawi yoyankha, ndi zina zambiri.
- Katswiri wokonza mapulani a ML amapanga momwe pulogalamu yamapulogalamu ingagwiritsire ntchito mwakuthupi pamafakitale.
Kuzungulira konseko kumafunikira akatswiri ambiri oyenerera. Panthawi ina pakukula ndi kulowetsedwa kwa mitundu ya ML m'njira zamabizinesi, zikuwoneka kuti kukulitsa akatswiri molingana ndi kuchuluka kwa ntchito kumakhala kokwera mtengo komanso kosagwira ntchito. Chifukwa chake, funso likubwera la automating process ya MLOps - kufotokozera magulu angapo amavuto ophunzirira makina, kupanga mapaipi opangira ma data ndi maphunziro owonjezera amitundu. Pachithunzithunzi choyenera, kuthetsa mavuto otere kumafuna akatswiri omwe ali ndi luso lofanana pamzere wa Big Data, Data Science, DevOps ndi IT. Chifukwa chake, vuto lalikulu pamsika wa Data Science komanso vuto lalikulu pakukonza njira za MLOps ndikusowa kwa luso lotere pamsika wophunzitsira womwe ulipo. Akatswiri omwe amakwaniritsa zofunikirazi pakali pano ndi osowa pamsika wogwira ntchito ndipo ndi ofunika kulemera kwawo kwa golidi.
Pankhani ya luso
Mwachidziwitso, ntchito zonse za MLOps zitha kuthetsedwa pogwiritsa ntchito zida zapamwamba za DevOps ndipo osagwiritsa ntchito njira yowonjezera yachitsanzo. Ndiye, monga taonera pamwambapa, wasayansi deta sayenera kukhala katswiri masamu ndi deta analyst, komanso guru lonse payipi - ali ndi udindo kupanga zomangamanga, zitsanzo mapulogalamu m'zinenero zingapo malinga ndi zomangamanga, kukonzekera. data mart ndikuyika pulogalamu yokha. Komabe, kupanga luso laukadaulo lomwe likugwiritsidwa ntchito kumapeto mpaka kumapeto kwa MLOps kumatenga mpaka 80% ya ndalama zogwirira ntchito, zomwe zikutanthauza kuti katswiri wamasamu woyenerera, yemwe ndi waukadaulo wa Data Scientist, amangogwiritsa ntchito 20% ya nthawi yake ku luso lake. . Chifukwa chake, kufotokozera maudindo a akatswiri omwe akukhudzidwa ndikugwiritsa ntchito makina ophunzirira makina kumakhala kofunika.
Momwe maudindowo ayenera kufotokozedwera zimatengera kukula kwa bizinesiyo. Ndi chinthu chimodzi pamene oyambitsa ali ndi katswiri m'modzi, wogwira ntchito mwakhama m'malo osungirako mphamvu, yemwe ndi injiniya wake, womanga mapulani, ndi DevOps. Ndi nkhani yosiyana kwambiri pamene, m'makampani akuluakulu, njira zonse zachitsanzo zachitsanzo zimayang'aniridwa ndi akatswiri angapo apamwamba a Sayansi ya Data, pamene wolemba mapulogalamu kapena katswiri wachinsinsi - luso lodziwika bwino komanso lotsika mtengo pamsika wogwira ntchito - akhoza kutenga. pa ntchito zambiri.
Chifukwa chake, liwiro ndi mtundu wamitundu yotukuka, zokolola za gulu ndi microclimate momwemo zimatengera komwe malire ali pakusankhidwa kwa akatswiri kuti athandizire njira ya MLOps ndi momwe njira yogwirira ntchito yamitundu yopangidwira imapangidwira. .
Zomwe timu yathu yachita kale
Posachedwapa tayamba kupanga luso komanso njira za MLOps. Koma mapulojekiti athu okhudzana ndi kasamalidwe ka moyo wathanzi komanso kugwiritsa ntchito zitsanzo ngati ntchito ali kale pagawo loyesa la MVP.
Tidatsimikizanso momwe angagwiritsire ntchito bwino bizinesi yayikulu komanso momwe amagwirira ntchito pakati pa onse omwe akutenga nawo mbali pantchitoyi. Magulu a Agile adakonzedwa kuti athetse mavuto kwa makasitomala onse amalonda, ndipo njira yolumikizirana ndi magulu a polojekiti kuti apange nsanja ndi zomangamanga, zomwe ndizo maziko a nyumba ya MLOps yomwe ikumangidwa, inakhazikitsidwa.
Mafunso amtsogolo
MLOps ndi dera lomwe likukula lomwe likukumana ndi kusowa kwa luso ndipo lidzakula kwambiri m'tsogolomu. Pakalipano, ndi bwino kumanga pazitukuko ndi machitidwe a DevOps. Cholinga chachikulu cha MLOps ndikugwiritsa ntchito bwino mitundu ya ML kuthetsa mavuto abizinesi. Koma izi zimabweretsa mafunso ambiri:
- Kodi mungachepetse bwanji nthawi yoyambitsa zitsanzo pakupanga?
- Kodi mungachepetse bwanji mikangano pakati pa magulu aluso losiyanasiyana ndikukulitsa chidwi cha mgwirizano?
- Kodi mungatsatire bwanji zitsanzo, kuyang'anira zomasulira ndikukonzekera kuwunika kogwira mtima?
- Kodi mungapangire bwanji moyo wozungulira wamtundu wamakono wa ML?
- Momwe mungasinthire njira yophunzirira makina?
Mayankho a mafunsowa awonetsa momwe ma MLOps angafikire momwe angathere mwachangu.
Source: www.habr.com