{"id":138909,"date":"2025-07-11T17:11:55","date_gmt":"2025-07-11T15:11:55","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov"},"modified":"2025-07-11T17:11:55","modified_gmt":"2025-07-11T15:11:55","slug":"brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","title":{"rendered":"Brauserilaiendused kaasavad jaotatud v\u00f5rgustiku loomisse AI-botide jaoks.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Turvaettevused Secure Annexist on t\u00e4helepanu p\u00f6\u00f6ranud uue brauseri lisandmoodulite monetiseerimise meetodi kasvavale populaarsusele, kus brauseri lisandmoodulite kasutajatest moodustatakse jaotatud v\u00f5rk, mida kasutatakse veebisaitide sisu kraapimiseks (indekseerimiseks). Kasutajate s\u00fcsteeme kasutatakse veebibotidena ja proksidena saitide sisu allalaadimiseks \u2014 installitud brauseri lisandmoodul saab v\u00e4liselt serverilt juhised saidi indekseerimiseks, seej\u00e4rel k\u00e4ivitab see eraldi varjatud iframe'is n\u00f5utud sisu allalaadimise ja edastab saadud andmed v\u00e4lisele teenusele. Chrome'i, Firefoxi ja Edge'i kataloogides on sellise monetiseerimise skeemi kasutamine tuvastatud 245 lisandmoodulis, mille kogutoodang on kokku 909 tuhat installi. <\/p>\n

T\u00f6\u00f6 korraldatakse l\u00e4bi brauserilaiendite koodi lisamise avatud JavaScripti teegi mellowtel.js kaudu, mis on v\u00e4lja antud LGPLv3 litsentsi alusel. Teeki arendab Mellowtel, mis edendab uut monetiseerimise platvormi, mida saab kasutada mitte ainult brauserilaiendites, vaid ka Flutteri ja Electroni raamistikul p\u00f5hinevates rakendustes. Platvormi p\u00f5hieesm\u00e4rk on see, et brauserilaiendite ja rakenduste arendajad saavad raha teenida mitte reklaamide kuvamise v\u00f5i kasutaja privaatsust m\u00f5jutavate kahtlaste meetodite, n\u00e4iteks andmete m\u00fc\u00fcmise, vaid AI-s\u00fcsteemide \u00f5petamiseks web-sisu indekseerimise \u00fclesannete t\u00e4itmise kaudu. <\/p>\n

AI-ettev\u00f5tete vajadus andmete j\u00e4rele mudelite koolitamiseks on loonud hulga roboteid, mis indekseerivad saite ilma m\u00f5istliku piiranguta p\u00e4ringute saatmise intensiivsusele ning eiravad robots.txt indekseerimise reegleid. Need robotid genereerivad tohutut parasiitset koormust serverid<\/a>, rikuvad s\u00fcsteemide normaalset toimimist ja v\u00f5tavad administraatorite aega; viimase aja jooksul on neid aktiivselt hakanud blokeerima (n\u00e4iteks, Cloudflare on rakendanud vaikimisi selliste botide blokeerimise v\u00f5imaluse). <\/p>\n

AI-ettev\u00f5tted on valmis maksma indekseerimise eest ning platvorm Mellowtel on loonud v\u00f5imaluse rahuldada sarnast vajadust, kaasates tavalisi kasutajaid andmete kogumisse veebilehtedelt. Platvorm edastab lisandmoodulite omanikele 55% tuludest, mis on saadud koost\u00f6\u00f6st AI-ettev\u00f5tetega. Projekt on t\u00e4ielikult legaalne ja n\u00f5uab, et osalemine kraapimises oleks vabatahtlik ning aktiveeritaks ainult p\u00e4rast kasutaja selges\u00f5nalist n\u00f5usolekut. Eeldatakse, et kasutaja v\u00f5ib t\u00e4nutundes arendajatele lisandmooduli arendamise eest aktiveerida kraapimisre\u017eiimi ja pakkuda neile kaudset rahalist toetust. <\/p>\n

Probleem on selles, et mitte k\u00f5ik lisade arendajad ei ole valmis t\u00f6\u00f6tama ausalt ja avatult. M\u00f5nedel lisadel p\u00fc\u00fcavad nad varjatult kasutaja eest aktiveerida Mellowteli monetiseerimist teenuse reeglite rikkumisega, mis viib selleni, et kasutaja saab ilma selges\u00f5nalise n\u00f5usolekuta osaleda jaotuss\u00fcsteemis andmete laadimiseks saitidelt. 45 Chrome'i lisast, mis kasutavad Mellowteli, on 12 juba Google'i poolt pahatahtliku tegevuse t\u00f5ttu blokeeritud. Microsofti kataloogis on 129 lisast blokeeritud 8 ning Mozilla kataloogis 71 lisast blokeeritud 2. Eemaldamise p\u00f5hjuseid ei ole detailselt kirjeldatud, kuid ei saa v\u00e4listada, et p\u00f5hjuseks oli Mellowteli eba\u00f5ige kasutamine. <\/p>\n

Mellowteli arendaja teatas, et v\u00f5imaliku varjatud skriptingu probleemi lahendamiseks tuleb k\u00f5ikidel Mellowteli kasutavatel lisadel kohustuslikult l\u00e4bi viia kontroll, et skripting oleks vaikimisi keelatud (aktiveerimine alles p\u00e4rast kasutaja selges\u00f5nalist n\u00f5usolekut) ja olemas oleks n\u00e4htav nupp selle keelamiseks. Lisade kontrollimist mittel\u00e4binud \u00fclesannete p\u00e4ringud paigutatakse karantiini ja neid ignoreeritakse. <\/p>\n

T\u00f6\u00f6tamise k\u00e4igus lisandused, mis kasutavad Mellowtel raamatukogu, loovad websocket-\u00fchenduse AWS-i pilves asuva v\u00e4listootjaga, mille kaudu edastatakse teavet kasutaja k\u00e4ttesaadavuse, riigi, v\u00f5rgu ribalaiuse ja skrapingu toetuse aktiveerimise kohta. Aeg-ajalt saadetakse \u00fchenduse kaudu heartbeat-p\u00e4ringud, mis kontrollivad kliendi k\u00e4ttesaadavust. Kui kasutaja vaadatavatele lehtedele on \u00fclesandeid sisu laadimiseks, sisestatakse peidetud iframe, millest toimub skraping. <\/p>\n

Veebilehtede laadimiseks iframe'i kaudu, mille kaudu vaadatakse teisi saite, \u00fcletab teek ajutiselt brauseris pakutud kaitse kolmanda osapoole sisu laadimise vastu, eemaldades HTTP-pealkirjad Content-Security-Policy ja X-Frame-Options ning tagastades need p\u00e4rast vajaliku lehe laadimist. Eemaldamine toimub v\u00f5rgu p\u00e4ringute muutmise kaudu API declarativeNetRequest abil (selle API juurde p\u00e4\u00e4semiseks peavad laiendused taotlema eraldi \u00f5igusi). Content-Security-Policy ja X-Frame-Options pealkirjade ajutine v\u00e4ljal\u00fclitamine m\u00f5jutab turvalisust negatiivselt, kuna see eemaldab teatud ajaks standardse kaitse ristsaidetega skriptimise (XSS) r\u00fcnnakute eest. <\/p>\n

Mellowtel platvorm on seotud ettev\u00f5ttega Olostep, mis pakub API-t skriptaamiseks, suudab m\u00f6\u00f6da minna robotite kaitset ja teostada samal ajal kuni 100 000 p\u00e4ringut minutis. Sellist teenuse tegevust, mida rakendatakse \u00fche saidi kontekstis, saab v\u00f5rrelda jaotatud DoS-r\u00fcnnakuga. Teenust v\u00f5ib samuti potentsiaalselt kasutada kasutajaid proxy-na, et sisu k\u00e4tte saada privaatsetelt saitidelt, mis on juurdep\u00e4\u00e4setavad ainult alav\u00f5rkudest, kuhu kasutaja p\u00e4\u00e4seb kaudu VPN<\/a>.
\n
Allikas: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0435\u043c\u0430\u044f \u0434\u043b\u044f \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 (\u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432). \u0421\u0438\u0441\u0442\u0435\u043c\u044b \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442 \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 web-\u0431\u043e\u0442\u043e\u0432 \u0438 \u043f\u0440\u043e\u043a\u0441\u0438 \u0434\u043b\u044f \u0441\u043a\u0430\u0447\u0438\u0432\u0430\u043d\u0438\u044f \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432 — \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043b\u0435\u043d\u043d\u043e\u0435 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u043e\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0435 \u043f\u043e\u043b\u0443\u0447\u0430\u0435\u0442 \u0441 \u0432\u043d\u0435\u0448\u043d\u0435\u0433\u043e \u0441\u0435\u0440\u0432\u0435\u0440\u0430 \u0438\u043d\u0441\u0442\u0440\u0443\u043a\u0446\u0438\u0438 \u043f\u043e \u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u0430\u0439\u0442\u043e\u0432, \u043f\u043e\u0441\u043b\u0435 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-138909","post","type-post","status-publish","format-standard","hentry","category-novosti-interneta"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Brauserilaiendid kaasavad jaotatud skriptaamisv\u00f5rgu loomisse AI-bote | ProHoster","description":"K\u00fcberturbe teadlased ettev\u00f5ttest Secure Annex on p\u00f6\u00f6ranud t\u00e4helepanu uue brauserilaiendite rahastamisviisi populaarsuse kasvule, kus laiendite kasutajatest moodustatakse jaotatud v\u00f5rk, mida kasutatakse skriptaamiseks (saitide sisu indekseerimiseks). Kasutajate s\u00fcsteeme kasutatakse veebibotidena ja proxy-na saitide sisu allalaadimiseks - installitud brauserilaiend saab v\u00e4liselt serverilt juhiseid saitide indekseerimiseks, p\u00e4rast","canonical_url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0411\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0432\u043e\u0432\u043b\u0435\u043a\u0430\u044e\u0442 \u0432 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u0435 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0435\u0442\u0438 \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 \u0434\u043b\u044f AI-\u0431\u043e\u0442\u043e\u0432 | ProHoster","og:description":"\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0435\u043c\u0430\u044f \u0434\u043b\u044f \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 (\u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432). \u0421\u0438\u0441\u0442\u0435\u043c\u044b \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442 \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 web-\u0431\u043e\u0442\u043e\u0432 \u0438 \u043f\u0440\u043e\u043a\u0441\u0438 \u0434\u043b\u044f \u0441\u043a\u0430\u0447\u0438\u0432\u0430\u043d\u0438\u044f \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432 - \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043b\u0435\u043d\u043d\u043e\u0435 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u043e\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0435 \u043f\u043e\u043b\u0443\u0447\u0430\u0435\u0442 \u0441 \u0432\u043d\u0435\u0448\u043d\u0435\u0433\u043e \u0441\u0435\u0440\u0432\u0435\u0440\u0430 \u0438\u043d\u0441\u0442\u0440\u0443\u043a\u0446\u0438\u0438 \u043f\u043e \u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u0430\u0439\u0442\u043e\u0432, \u043f\u043e\u0441\u043b\u0435","og:url":"https:\/\/prohoster.info\/et\/blog\/novosti-interneta\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2025-07-11T15:11:55+00:00","article:modified_time":"2025-07-11T15:11:55+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"138909","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-09 17:49:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-01-23 13:47:22","updated":"2026-02-09 17:49:20"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/138909","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=138909"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/138909\/revisions"}],"predecessor-version":[{"id":159225,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/138909\/revisions\/159225"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=138909"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=138909"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=138909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}