{"id":113637,"date":"2024-02-16T10:02:43","date_gmt":"2024-02-16T08:02:44","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/google-otkryl-kod-ai-sistemy-magika-dlya-opredeleniya-tipa-soderzhimogo-fajlov"},"modified":"2024-02-16T10:02:43","modified_gmt":"2024-02-16T08:02:44","slug":"google-otkryl-kod-ai-sistemy-magika-dlya-opredeleniya-tipa-soderzhimogo-fajlov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hr\/blog\/news\/google-otkryl-kod-ai-sistemy-magika-dlya-opredeleniya-tipa-soderzhimogo-fajlov","title":{"rendered":"Google je otvorio kod AI sustava Magika za odre\u0111ivanje vrste sadr\u017eaja datoteka","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Tvrtka Google je objavila otvoreni kod projekta Magika, koji je namijenjen odre\u0111ivanju vrste sadr\u017eaja na temelju analize podataka sadr\u017eanih u datoteci. Magika mo\u017ee to\u010dno prepoznati programerske jezike kori\u0161tene u sadr\u017eaju, metode kompresije, instalacijske pakete, izvr\u0161ne kodove, vrste markup-a, formate zvuka, video, dokumenata i slika. Alati povezani s projektom i gotovi modeli strojnog u\u010denja su objavljeni pod licencom Apache 2.0. <\/p>\n

Za razliku od sli\u010dnih projekata koji odre\u0111uju MIME tip na temelju sadr\u017eaja, Magika se isti\u010de primjenom metoda strojnog u\u010denja, visokom u\u010dinkovito\u0161\u0107u i izvanrednom to\u010dno\u0161\u0107u identifikacije. Model je treniran koriste\u0107i Keras okvir na 25 milijuna primjera datoteka i podr\u017eava prepoznavanje 116 vrsta podataka s to\u010dno\u0161\u0107u od najmanje 99%. Model je sastavljen u ONNX formatu i ima veli\u010dinu od samo 1 MB. Kori\u0161tenje metoda dubokog strojnog u\u010denja omogu\u0107ilo je pove\u0107anje to\u010dnosti prepoznavanja za 50% u odnosu na ranije kori\u0161teni sustav u Googleu koji se temeljio na ru\u010dno definiranim pravilima.

\"Google<\/center> <\/p>\n

U Googleu se sustav koristi za klasifikaciju datoteka u uslugama Gmail, Drive, Code Insight i Safe Browsing prilikom obavljanja sigurnosnih provjera i uskla\u0111enosti s pravilima usluga. U tijeku su radovi na integraciji Magika u platformu VirusTotal kao prvog koraka za filtriranje datoteka prije izvo\u0111enja specifi\u010dnih analizatora. Konfiguracija Magika implementirana unutar Googleove infrastrukture omogu\u0107uje skeniranje nekoliko milijuna datoteka u sekundi i nekoliko stotina milijardi datoteka tjedno. Nakon u\u010ditavanja modela, vrijeme za generiranje izlaza iznosi 5-6 ms tijekom testiranja na jednom CPU jezgri. Vrijeme odre\u0111ivanja gotovo da nije ovisno o veli\u010dini datoteke. <\/p>\n

Za kori\u0161tenje Magika u svojim projektima pripremljeni su alat za naredbeni redak, paket za Python i JavaScript biblioteka koja mo\u017ee raditi u pregledniku ili u projektima temeljenim na Node.js. Naredbeni su\u010delje i API podr\u017eavaju izvo\u0111enje operacija u seriji, tj. omogu\u0107uju provjeru vi\u0161e datoteka u jednom zahtjevu. Tu je i na\u010din rekurzivnog skeniranja cjelokupnog sadr\u017eaja direktorija te tri na\u010dina predikcije za pode\u0161avanje otpornosti na pogre\u0161ke (visoka sigurnost, srednja sigurnost i najbolja pretpostavka).

\"Google<\/center>
\n
Izvor: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Google \u043e\u0431\u044a\u044f\u0432\u0438\u043b\u0430 \u043e\u0431 \u043e\u0442\u043a\u0440\u044b\u0442\u0438\u0438 \u043a\u043e\u0434\u0430 \u043f\u0440\u043e\u0435\u043a\u0442\u0430 Magika, \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0435\u043d\u043d\u043e\u0433\u043e \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438\u043c\u0435\u044e\u0449\u0438\u0445\u0441\u044f \u0432 \u0444\u0430\u0439\u043b\u0435 \u0434\u0430\u043d\u043d\u044b\u0445. Magika \u043c\u043e\u0436\u0435\u0442 \u0442\u043e\u0447\u043d\u043e \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u044f\u0442\u044c \u0432 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u044b\u0435 \u044f\u0437\u044b\u043a\u0438 \u043f\u0440\u043e\u0433\u0440\u0430\u043c\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f, \u043c\u0435\u0442\u043e\u0434\u044b \u0441\u0436\u0430\u0442\u0438\u044f, \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043e\u0447\u043d\u044b\u0435 \u043f\u0430\u043a\u0435\u0442\u044b, \u0438\u0441\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u0439 \u043a\u043e\u0434, \u0432\u0438\u0434\u044b \u0440\u0430\u0437\u043c\u0435\u0442\u043a\u0438, \u0444\u043e\u0440\u043c\u0430\u0442\u044b \u0437\u0432\u0443\u043a\u0430, \u0432\u0438\u0434\u0435\u043e, \u0434\u043e\u043a\u0443\u043c\u0435\u043d\u0442\u043e\u0432 \u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u0421\u0432\u044f\u0437\u0430\u043d\u043d\u044b\u0439 \u0441 \u043f\u0440\u043e\u0435\u043a\u0442\u043e\u043c \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439 \u0438 \u0433\u043e\u0442\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043d\u044b \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":113638,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-113637","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Google je otvorio kod AI sustava Magika za odre\u0111ivanje tipa sadr\u017eaja datoteka | ProHoster","description":"Tvrtka Google objavila je otvaranje koda projekta Magika, koji je namijenjen odre\u0111ivanju tipa sadr\u017eaja na temelju analize podataka prisutnih u datoteci.","canonical_url":"https:\/\/prohoster.info\/hr\/blog\/news\/google-otkryl-kod-ai-sistemy-magika-dlya-opredeleniya-tipa-soderzhimogo-fajlov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hr_HR","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Google \u043e\u0442\u043a\u0440\u044b\u043b \u043a\u043e\u0434 AI-\u0441\u0438\u0441\u0442\u0435\u043c\u044b Magika \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0444\u0430\u0439\u043b\u043e\u0432 | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Google \u043e\u0431\u044a\u044f\u0432\u0438\u043b\u0430 \u043e\u0431 \u043e\u0442\u043a\u0440\u044b\u0442\u0438\u0438 \u043a\u043e\u0434\u0430 \u043f\u0440\u043e\u0435\u043a\u0442\u0430 Magika, \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0435\u043d\u043d\u043e\u0433\u043e \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438\u043c\u0435\u044e\u0449\u0438\u0445\u0441\u044f \u0432 \u0444\u0430\u0439\u043b\u0435 \u0434\u0430\u043d\u043d\u044b\u0445.","og:url":"https:\/\/prohoster.info\/hr\/blog\/news\/google-otkryl-kod-ai-sistemy-magika-dlya-opredeleniya-tipa-soderzhimogo-fajlov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-02-16T08:02:44+00:00","article:modified_time":"2024-02-16T08:02:44+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts\/113637","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/comments?post=113637"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/posts\/113637\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/media\/113638"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/media?parent=113637"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/categories?post=113637"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hr\/wp-json\/wp\/v2\/tags?post=113637"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}