{"id":147635,"date":"2025-11-07T17:12:02","date_gmt":"2025-11-07T15:12:02","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov"},"modified":"2026-02-26T20:20:26","modified_gmt":"2026-02-26T18:20:26","slug":"google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/news\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","title":{"rendered":"Google avaldas Magika 1.0, komplekti failide sisu m\u00e4\u00e4ratlemiseks.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Google esitles Magika 1.0 t\u00f6\u00f6riista, mis on m\u00f5eldud sisu t\u00fc\u00fcbi m\u00e4\u00e4ramiseks failide andmete anal\u00fc\u00fcsi p\u00f5hjal. Magika suudab t\u00e4pselt tuvastada failis kasutatavad programmeerimiskeeled, kompressioonimeetodid, installipaketid, t\u00e4itmisfaile, m\u00e4rgistusviise, heliformaadid, videod, dokumendid ja pildid. Projekti raames t\u00f6\u00f6tati v\u00e4lja t\u00f6\u00f6riistad ja valmis masin\u00f5ppe mudel, mis on litsentseeritud Apache 2.0 alusel. Raamistikke on valmistatud keeltele Rust, Python, JavaScript\/TypeScript ja Go. <\/p>\n

Erinevalt sarnastest projektidest, mis m\u00e4\u00e4ravad MIME-t\u00fc\u00fcbi sisu p\u00f5hjal, kasutab Magika masin\u00f5ppemeetodeid, k\u00f5rge j\u00f5udlusega<\/a> ja m\u00e4\u00e4ramise t\u00e4psust. Mudel on koolitatud Keras platvormil 100 miljoni failin\u00e4ite p\u00f5hjal (andmestiku kogusuurus \u00fcle 3 TB) ning toetab tuvastamist 200 andmetaipaga, s\u00e4ilitades v\u00e4hemalt 99% t\u00e4psuse. Mudel on kokku pandud ONNX formaadis ja selle suurus on vaid paar megabaiti. S\u00fcgava masin\u00f5ppe meetodite rakendamine v\u00f5imaldas 50% v\u00f5rra suurendada m\u00e4\u00e4ramise t\u00e4psust v\u00f5rreldes Google'i varasema k\u00e4sitsi m\u00e4\u00e4ratud reeglitel baseeruva s\u00fcsteemiga. <\/p>\n

Google'is kasutatakse s\u00fcsteemi failide klassifitseerimiseks Gmaili, Drive'i, Code Insight'i ja Safe Browsing teenustes turvakontrollide ja teenuste reeglite j\u00e4rgimise tagamiseks. Magika integreeritakse VirusTotal ja abuse.ch platvormidesse esmase failifiltreerimise lingina enne spetsiifiliste anal\u00fcsaatorite t\u00f6\u00f6tlust. Google'i infrastruktuuris rakendatud Magika konfigureerimine v\u00f5imaldab skaneerida mitut miljonit faili sekundis ja sadu miljardeid faile n\u00e4dalas. P\u00e4rast mudeli laadimist on v\u00e4ljundi genereerimiseks vajalik aeg 5 ms, kui testimine toimub \u00fches CPU tuumas. M\u00e4\u00e4ramise aeg ei s\u00f5ltu peaaegu faili suurusest. <\/p>\n

Magika kasutamiseks oma projektides on ette valmistatud k\u00e4surea t\u00f6\u00f6riist, paketid Pythonile, Rustile ja Go-le, samuti JavaScripti teek, mis suudab t\u00f6\u00f6tada brauseris v\u00f5i Node.js-p\u00f5histes projektides. K\u00e4surea liides ja API toetavad toimingute l\u00e4biviimist r\u00fchmitatud viisil ehk v\u00f5imaldavad kontrollida mitu faili \u00fche p\u00e4ringu jooksul. On olemas rekursiivse skaneerimise re\u017eiim kogu katalooge sisu jaoks ja kolm prognoosimisre\u017eiimi, et kohandada veaotsingu vastupidavust (k\u00f5rge kindlus, keskmine kindlus ja parim oletus). <\/p>\n

Alguses arendati projekt Pythonis, kuid versiooni 1.0 v\u00e4ljalaske ettevalmistamisel kirjutati sisu t\u00fc\u00fcbi m\u00e4\u00e4ramise mootor \u00fcmber Rustis, mis v\u00f5imaldas saavutada k\u00f5rgemat j\u00f5udlust, s\u00e4ilitades samas koodi piisava kaitsetaseme. Masin\u00f5ppemudeli t\u00e4itmiseks kasutatakse ONNX Runtime raamistikku, samas kui p\u00e4ringute paralleelseks as\u00fcnkroonseks t\u00f6\u00f6tlemiseks on kasutusel Tokio teek. MacBook Pro (M4) korral v\u00f5imaldab mootori j\u00f5udlus t\u00f6\u00f6delda umbes 1000 faili sekundis. <\/p>\n

Lisaks uuele mootorile on versioonis 1.0 muutunud toetatavate t\u00fc\u00fcpide arv umbes 100-lt 200-le; lisatud on uus k\u00e4surea klient, mis on kirjutatud Rustis; t\u00f5hustatud on tekstivormingute m\u00e4\u00e4ramise t\u00e4psust, nagu konfiguratsioonifailid ja kood; Pythonile ja TypeScriptille on \u00fcmber kujundatud moodulid, et lihtsustada nende integreerimist teiste projektidega. Uute toetatud sisu t\u00fc\u00fcpide seas on: masin\u00f5ppes ja AI-s kasutatavad formaadid; programmeerimiskeeled Swift, Kotlin, TypeScript, Dart, Solidity (solidity), Web Assembly ja Zig; DevOpsi komponendid (Dockerfiles, TOML, HashiCorp, Bazel ehitusfailid ja YARA reeglid); SQLite andmebaasid; AutoCADi failid (dwg, dxf), Adobe Photoshopi (psd) ja fondid (woff, woff2). Parandatud on koodi eraldust C++ ja C, JavaScripti ja TypeScripti vahel.
\n
Allikas: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Google \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u044f Magika 1.0, \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0435\u043d\u043d\u043e\u0433\u043e \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438\u043c\u0435\u044e\u0449\u0438\u0445\u0441\u044f \u0432 \u0444\u0430\u0439\u043b\u0435 \u0434\u0430\u043d\u043d\u044b\u0445. Magika \u043c\u043e\u0436\u0435\u0442 \u0442\u043e\u0447\u043d\u043e \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u044f\u0442\u044c \u0432 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u0435\u043c\u044b\u0435 \u044f\u0437\u044b\u043a\u0438 \u043f\u0440\u043e\u0433\u0440\u0430\u043c\u043c\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f, \u043c\u0435\u0442\u043e\u0434\u044b \u0441\u0436\u0430\u0442\u0438\u044f, \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043e\u0447\u043d\u044b\u0435 \u043f\u0430\u043a\u0435\u0442\u044b, \u0438\u0441\u043f\u043e\u043b\u043d\u044f\u0435\u043c\u044b\u0439 \u043a\u043e\u0434, \u0432\u0438\u0434\u044b \u0440\u0430\u0437\u043c\u0435\u0442\u043a\u0438, \u0444\u043e\u0440\u043c\u0430\u0442\u044b \u0437\u0432\u0443\u043a\u0430, \u0432\u0438\u0434\u0435\u043e, \u0434\u043e\u043a\u0443\u043c\u0435\u043d\u0442\u043e\u0432 \u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439. \u0421\u0432\u044f\u0437\u0430\u043d\u043d\u044b\u0439 \u0441 \u043f\u0440\u043e\u0435\u043a\u0442\u043e\u043c \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439 \u0438 \u0433\u043e\u0442\u043e\u0432\u0430\u044f \u043c\u043e\u0434\u0435\u043b\u044c \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u044e\u0442\u0441\u044f \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-147635","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Google avaldas Magika 1.0, t\u00f6\u00f6riista failide sisu t\u00fc\u00fcbi m\u00e4\u00e4ramiseks | ProHoster","description":"Google esitles Magika 1.0 t\u00f6\u00f6riista, mis on m\u00f5eldud sisu t\u00fc\u00fcbi m\u00e4\u00e4ramiseks, anal\u00fc\u00fcsides failis olevaid andmeid.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/news\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Google \u043e\u043f\u0443\u0431\u043b\u0438\u043a\u043e\u0432\u0430\u043b Magika 1.0, \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439 \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0444\u0430\u0439\u043b\u043e\u0432 | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Google \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b\u0430 \u0440\u0435\u043b\u0438\u0437 \u0438\u043d\u0441\u0442\u0440\u0443\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u044f Magika 1.0, \u043f\u0440\u0435\u0434\u043d\u0430\u0437\u043d\u0430\u0447\u0435\u043d\u043d\u043e\u0433\u043e \u0434\u043b\u044f \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0442\u0438\u043f\u0430 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438\u043c\u0435\u044e\u0449\u0438\u0445\u0441\u044f \u0432 \u0444\u0430\u0439\u043b\u0435 \u0434\u0430\u043d\u043d\u044b\u0445.","og:url":"https:\/\/prohoster.info\/et\/blog\/news\/google-opublikoval-magika-1-0-instrumentarij-dlya-opredeleniya-tipa-soderzhimogo-fajlov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2025-11-07T15:12:02+00:00","article:modified_time":"2026-02-26T18:20:26+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"147635","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-26 18:21:29","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-01-23 15:49:19","updated":"2026-02-26 18:21:29","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/147635","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=147635"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/147635\/revisions"}],"predecessor-version":[{"id":162834,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/147635\/revisions\/162834"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=147635"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=147635"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=147635"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}