{"id":147635,"date":"2025-11-07T17:12:02","date_gmt":"2025-11-07T15:12:02","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov"},"modified":"2026-02-26T20:20:26","modified_gmt":"2026-02-26T18:20:26","slug":"google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","title":{"rendered":"Google avaldas Magika 1.0, t\u00f6\u00f6riista, mis m\u00e4\u00e4rab failide sisu t\u00fc\u00fcbi","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Google esitles t\u00f6\u00f6riista Magika 1.0, mis on loodud sisu t\u00fc\u00fcbi m\u00e4\u00e4ramiseks failis leiduvate andmete anal\u00fc\u00fcsi p\u00f5hjal. Magika suudab t\u00e4pselt kindlaks teha sisu kasutatavad programmeerimiskeeled, kokkusurumismeetodid, paigalduspaketid, t\u00e4idetavad koodid, m\u00e4rgistusvormid, heliformaadid, videod, dokumendid ja pildid. Projekti osana levitatakse t\u00f6\u00f6riista ja valmis masin\u00f5ppe mudelit Apache 2.0 litsentsi alusel. Raamistikke on ette valmistatud keelte jaoks Rust, Python, JavaScript\/TypeScript ja Go. <\/p>\n

Erinevalt sarnastest projektidest, mis m\u00e4\u00e4ravad MIME-t\u00fc\u00fcbi sisu p\u00f5hjal, kasutab Magika masin\u00f5ppe meetodeid, k\u00f5rge j\u00f5udlusega<\/a> ja m\u00e4\u00e4ramise t\u00e4psus. Mudel on koolitatud Keras raamistikus 100 miljoni faili n\u00e4ite p\u00f5hjal (andmekogumi suurus on \u00fcle 3 TB) ja toetab 200 andmeliigi tuvastamist v\u00e4hemalt 99% t\u00e4psusega. Mudel on kokku pandud ONNX formaadis ja selle suurus on vaid m\u00f5ned megabait. S\u00fcgava masin\u00f5ppe meetodite rakendamine on v\u00f5imaldanud t\u00f5sta m\u00e4\u00e4ramise t\u00e4psust 50% v\u00f5rreldes Google'i varasema k\u00e4sitsi m\u00e4\u00e4ratud reeglite s\u00fcsteemiga. <\/p>\n

Google'i s\u00fcsteemi kasutatakse failide klassifitseerimiseks Gmaili, Drive'i, Code Insight'i ja Safe Browsing teenustes, tehes turbekontrolle ja vastavust regulatiivsetele n\u00f5uetele. Magika integreerimine VirusTotal'i ja abuse.ch platvormidesse v\u00f5imaldab failide esmast filtreerimist enne konkreetsete anal\u00fcsaatorite k\u00e4ivitamist. Google'i infrastruktuuris \u00fcles seatud Magika konfiguratsioon tagab mitu miljonit faili skaneerimist sekundis ja sadu miljardeid faile n\u00e4dalas. P\u00e4rast mudeli laadimist on v\u00e4ljundi genereerimise aeg 5 ms \u00fche CPU s\u00fcdamiku testimisel. Tuvastamise aeg ei s\u00f5ltu peaaegu failide suurusest. <\/p>\n

Magika kasutamiseks oma projektides on valmis command-line t\u00f6\u00f6riist, paketid Pythonile, Rustile ja Go-le, samuti JavaScripti teek, mis t\u00f6\u00f6tab nii brauseris kui ka Node.js projektides. Command-line liides ja API toetavad operatsioone graafikure\u017eiimis, mis t\u00e4hendab, et saate kontrollida mitut faili \u00fche p\u00e4ringuga. On olemas rekurssiivne skannimisre\u017eiim kogu katalooge sisule ja kolm prognoosimisre\u017eiimi, et kohandada veakindlust (k\u00f5rge usaldusv\u00e4\u00e4rsus, keskmine usaldusv\u00e4\u00e4rsus ja parim oletus). <\/p>\n

Alguses arendati projekti Pythonis, kuid versiooni 1.0 v\u00e4ljalaske ettevalmistamisel kirjutati sisu t\u00fc\u00fcbi m\u00e4\u00e4ramise mootor \u00fcmber Rustis, mis v\u00f5imaldas saavutada k\u00f5rgemat j\u00f5udlust, s\u00e4ilitades samas vajaliku koodikaitse taseme. Masin\u00f5ppemudeli t\u00e4itmiseks kasutatakse ONNX Runtime raamistikku ja p\u00e4ringute paralleelseks as\u00fcnkroonselt t\u00f6\u00f6tlemiseks \u2014 raamatukogu Tokio. MacBook Pro (M4) t\u00f6\u00f6tlusv\u00f5imekus v\u00f5imaldab mootoril t\u00f6\u00f6delda umbes 1000 faili sekundis. <\/p>\n

Lisaks uuele mootorile on 1.0 v\u00e4ljalaske muudatusteks toe ulatuse laiendamine umbes 100 t\u00fc\u00fcbist 200-le; uue k\u00e4sureakliendi lisamine, mis on kirjutatud Rustis; t\u00e4psuse suurendamine tekstiformaatide, n\u00e4iteks konfiguratsioonifailide ja koodi tuvastamisel; Pythonile ja TypeScriptile m\u00f5eldud moodulite \u00fcmberkasutamine, et lihtsustada nende integreerimist teiste projektidega. Uute toetatud sisu t\u00fc\u00fcpide seas on: masin\u00f5ppes ja AI-s kasutatavad formaadid; programmeerimiskeeled Swift, Kotlin, TypeScript, Dart, Solidity (solidity), WebAssembly ja Zig; DevOps-komponendid (Dockerfile'id, TOML, HashiCorp, Bazeli ehitusfailid ja YARA reeglid); SQLite andmebaasid; AutoCAD failid (dwg, dxf), Adobe Photoshop (psd) ja fondid (woff, woff2). C++ ja C, JavaScripti ja TypeScripti koodi eraldamine on paranenud.
\n
Allikas: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Google \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u044f Magika 1.0, \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0435\u043d\u043d\u043e\u0433\u043e \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438\u043c\u0435\u044e\u0449\u0438\u0445\u0441\u044f \u0432 \u0444\u0430\u0439\u043b\u0435 \u0434\u0430\u043d\u043d\u044b\u0445. Magika \u043c\u043e\u0436\u0435\u0442 \u0442\u043e\u0447\u043d\u043e \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u044f\u0442\u044c \u0432 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u044b\u0435 \u044f\u0437\u044b\u043a\u0438 \u043f\u0440\u043e\u0433\u0440\u0430\u043c\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f, \u043c\u0435\u0442\u043e\u0434\u044b \u0441\u0436\u0430\u0442\u0438\u044f, \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043e\u0447\u043d\u044b\u0435 \u043f\u0430\u043a\u0435\u0442\u044b, \u0438\u0441\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u0439 \u043a\u043e\u0434, \u0432\u0438\u0434\u044b \u0440\u0430\u0437\u043c\u0435\u0442\u043a\u0438, \u0444\u043e\u0440\u043c\u0430\u0442\u044b \u0437\u0432\u0443\u043a\u0430, \u0432\u0438\u0434\u0435\u043e, \u0434\u043e\u043a\u0443\u043c\u0435\u043d\u0442\u043e\u0432 \u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u0421\u0432\u044f\u0437\u0430\u043d\u043d\u044b\u0439 \u0441 \u043f\u0440\u043e\u0435\u043a\u0442\u043e\u043c \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439 \u0438 \u0433\u043e\u0442\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u044e\u0442\u0441\u044f \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-147635","post","type-post","status-publish","format-standard","hentry","category-novosti-interneta"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Google avaldas Magika 1.0, faili sisu m\u00e4\u00e4ramise t\u00f6\u00f6riista | ProHoster","description":"Google esitles Magika 1.0 t\u00f6\u00f6riista, mis on m\u00f5eldud failides olevate andmete anal\u00fc\u00fcsi p\u00f5hjal sisu t\u00fc\u00fcbi m\u00e4\u00e4ramiseks. Magika suudab t\u00e4pselt tuvastada sisu kasutatud programmeerimiskeeled, pakkimise meetodid, paigalduspaketid, t\u00e4itevkood, m\u00e4rgistust\u00fc\u00fcbid, helifailide, video, dokumentide ja piltide formaadid. Seotud projektile m\u00f5eldud t\u00f6\u00f6riist ja valmis masin\u00f5ppe mudel on saadaval Apache'i litsentsi alusel.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Google \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b Magika 1.0, \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439 \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0444\u0430\u0439\u043b\u043e\u0432 | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Google \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u044f Magika 1.0, \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0435\u043d\u043d\u043e\u0433\u043e \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438\u043c\u0435\u044e\u0449\u0438\u0445\u0441\u044f \u0432 \u0444\u0430\u0439\u043b\u0435 \u0434\u0430\u043d\u043d\u044b\u0445. Magika \u043c\u043e\u0436\u0435\u0442 \u0442\u043e\u0447\u043d\u043e \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u044f\u0442\u044c \u0432 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u044b\u0435 \u044f\u0437\u044b\u043a\u0438 \u043f\u0440\u043e\u0433\u0440\u0430\u043c\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f, \u043c\u0435\u0442\u043e\u0434\u044b \u0441\u0436\u0430\u0442\u0438\u044f, \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043e\u0447\u043d\u044b\u0435 \u043f\u0430\u043a\u0435\u0442\u044b, \u0438\u0441\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u0439 \u043a\u043e\u0434, \u0432\u0438\u0434\u044b \u0440\u0430\u0437\u043c\u0435\u0442\u043a\u0438, \u0444\u043e\u0440\u043c\u0430\u0442\u044b \u0437\u0432\u0443\u043a\u0430, \u0432\u0438\u0434\u0435\u043e, \u0434\u043e\u043a\u0443\u043c\u0435\u043d\u0442\u043e\u0432 \u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u0421\u0432\u044f\u0437\u0430\u043d\u043d\u044b\u0439 \u0441 \u043f\u0440\u043e\u0435\u043a\u0442\u043e\u043c \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439 \u0438 \u0433\u043e\u0442\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u044e\u0442\u0441\u044f \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache","og:url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2025-11-07T15:12:02+00:00","article:modified_time":"2026-02-26T18:20:26+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"147635","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-26 18:21:29","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-01-23 15:49:19","updated":"2026-02-26 18:21:29"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/147635","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=147635"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/147635\/revisions"}],"predecessor-version":[{"id":162834,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/147635\/revisions\/162834"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=147635"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=147635"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=147635"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}