{"id":138909,"date":"2025-07-11T17:11:55","date_gmt":"2025-07-11T15:11:55","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov"},"modified":"2025-07-11T17:11:55","modified_gmt":"2025-07-11T15:11:55","slug":"brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","title":{"rendered":"Brahivori laiendused kaasavad AI-robotite jaotatud v\u00f5rgu ehitamisse","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Turvauurimiskeskuse Secure Annex teadlased on m\u00e4rganud uue brauserilaiendite monetsimise meetodi kasvavat populaarsust, mille raames luuakse kasutajatest jaotatud v\u00f5rk, mida kasutatakse veebilehtede sisu kraapimiseks (indeksimiseks). Kasutajate s\u00fcsteemid toimivad veebibottidena ja proksi serveritena veebilehtede sisu allalaadimiseks \u2014 installitud brauserilaiend saab v\u00e4liselt serverilt juhised veebilehtede indeksimiseks, seej\u00e4rel k\u00e4ivitab see eraldi varjatud iframe'is n\u00f5utud sisu allalaadimise ning edastab saadud andmed v\u00e4lisele teenusele. Chrome'i, Firefoxi ja Edge'i kataloogides on selle monetiseerimiskeemi rakendamine tuvastatud 245 laienduses, mille koguarv on 909 tuhat installi. <\/p>\n

T\u00f6\u00f6 korraldatakse avatud JavaScripti raamatukogu mellowtel.js, mis tarnitakse LGPLv3 litsentsi all, integreerimise kaudu brahivori laienduste koodiga. Raamatukogu arendatakse Mellowtel projekti poolt, mis edendab uut rahastamisplatvormi, mida saab kasutada mitte ainult brahivori laiendustes, vaid ka Flutteri ja Electoni raamistike p\u00f5hjal arendatud programmides. Platvormi peamine idee on, et brahivori laienduste ja rakenduste arendajad saavad raha teenida mitte reklaamide n\u00e4itamise v\u00f5i kahtlaste meetodite, nagu kasutajate privaatsust rikkumise kaudu andmete m\u00fc\u00fcmise, vaid veebisisu indekseerimise \u00fclesannete t\u00e4itmise kaudu AI-s\u00fcsteemide \u00f5petamiseks. <\/p>\n

AI-ettev\u00f5tete vajadus andmete j\u00e4rele mudelite koolitamiseks on suurendanud arvukate robotite hulka, mis indekseerivad veebilehti, j\u00e4rgimata m\u00f5istlikult p\u00e4ringute saatmise intensiivsust ja eirates robots.txt indekseerimise reegleid. Need robotid loovad tohutu parasiitliku koormuse serverid<\/a>, rikuvad s\u00fcsteemide normaalset toimimist ja v\u00f5tavad administraatorite ajast, seet\u00f5ttu on viimastel aegadel hakanud neid aktiivselt blokeerima (n\u00e4iteks Cloudflare'i sisu edastamise v\u00f5rk on juurutanud vaikimisi sarnaste robotite blokeerimise v\u00f5imaluse). <\/p>\n

AI-ettev\u00f5tted on valmis maksma indekseerimise eest ja platvorm Mellowtel on loonud v\u00f5imaluse rahuldada seda vajadust, kaasates tavakasutajaid andmete kogumise protsessi veebisaitidelt. Platvorm edastab t\u00e4ienduste omanikele 55% tuludest, mis saadakse koost\u00f6\u00f6st AI-ettev\u00f5tetega. Projekt on t\u00e4iesti legitiimne ja r\u00f5hutab, et osalemine skreipimises peaks olema vabatahtlik ning aktiveeritud ainult p\u00e4rast kasutaja selget n\u00f5usolekut. Eeldatavasti v\u00f5ib kasutaja t\u00e4nutunde t\u00f5ttu arendajatele aktiveerida skreipimise re\u017eiimi ja pakkuda neile kaudset rahalist toetust. <\/p>\n

Probleem on selles, et mitte k\u00f5ik t\u00e4ienduste arendajad ei ole valmis t\u00f6\u00f6tama ausalt ja avatud. M\u00f5nes t\u00e4ienduses \u00fcritatakse varjatult aktiveerida Mellowteli monetiseerimist, m\u00f6\u00f6da minnes teenuse reeglitest, mis toob kaasa selle, et kasutaja satub ilma selge n\u00f5usolekuta jaotunud v\u00f5rku andmete allalaadimiseks veebisaitidelt. 45 Chrome'i t\u00e4iendusest, mis kasutavad Mellowteli, on 12 juba Google'i poolt blokeeritud kahjuliku aktiivsuse t\u00f5ttu. Microsofti kataloogis on 129 t\u00e4iendusest blokeeritud 8, ning Mozilla kataloogis 71 t\u00e4iendusest on blokeeritud 2. Eemaldamise p\u00f5hjuseid ei detailiseerita, kuid ei exkludeerita, et p\u00f5hjus v\u00f5ib olla Mellowteli vale kasutamine. <\/p>\n

Mellowteli arendaja teatas, et v\u00f5imaliku varjatud skreipimise aktiveerimise probleemi lahendamiseks l\u00e4heb teenus \u00fcle kohustuslikule kontrollile k\u00f5ikide Mellowteli kasutavate t\u00e4ienduste osas, et tagada, et skreipimine on vaikimisi deaktiveeritud (aktiveerimine ainult p\u00e4rast kasutaja selget n\u00f5usolekut) ja et on olemas n\u00e4htav nupp, et skreipimist deaktiveerida. Kontrollimata t\u00e4iendustelt saadetud \u00fclesannete p\u00e4ringud paigutatakse karantiini ja neid ignoreeritakse. <\/p>\n

T\u00f6\u00f6protsessi k\u00e4igus kasutavad Mellowtel'i lisandmoodulid veebisocket'i \u00fchendust v\u00e4lise serveriga, mis asub AWS-is, kus edastatakse teavet kasutaja k\u00e4ttesaadavuse, riigi, kanalite lairiba ja kasutaja skrapingu toe aktiveerimise kohta. Perioodiliselt saadetakse \u00fchenduse kaudu s\u00fcdame l\u00f6\u00f6gik\u00fcsimusi, et kontrollida kliendi olemasolu. Kui ilmnevad sisulehe allalaadimise \u00fclesanded, lisatakse vaadatavatele lehtedele peidetud iframe, kust toimub skraping. <\/p>\n

V\u00e4liste lehtede laadimiseks iframe'ist, mis lisatakse teiste veebisaitide vaatamisel, \u00fcletab raamatukogu ajutiselt brauseris pakutud kaitset kolmanda osapoole sisu laadimise vastu, l\u00f5igates v\u00e4lja HTTP-pealkirjad Content-Security-Policy ja X-Frame-Options, ning tagastades need p\u00e4rast vajaliku lehe laadimist. L\u00f5ikamine toimub v\u00f5rgu p\u00e4ringute modifitseerimise kaudu API declarativeNetRequest abil (selle API juurde juurdep\u00e4\u00e4suks k\u00fcsivad lisandmoodulid eraldi \u00f5igusi). Content-Security-Policy ja X-Frame-Options pealkirjade ajutine v\u00e4ljal\u00fclitamine m\u00f5jutab turvalisust negatiivselt, kuna see eemaldab mingiks ajaks sisseehitatud kaitse ristsaidir\u00fcnnakute (XSS) eest. <\/p>\n

Mellowtel'i platvorm on seotud ettev\u00f5ttega Olostep, mis pakub skrapingu API-d, mis suudab v\u00e4ltida botikaitset ja samal ajal teostada kuni 100 000 p\u00e4ringut minutis. Sellist teenuse aktiivsust, rakendatuna \u00fche saidi kontekstis, v\u00f5ib v\u00f5rrelda jaotatud DoS-r\u00fcnnakuga. Teenust saab ka potentsiaalselt kasutada kasutajad proksi kaudu privaatsete lehtede sisu hankimiseks, mis on kergesti juurdep\u00e4\u00e4setavad ainult alamv\u00f5rkudest, kuhu kasutaja p\u00e4\u00e4seb juurde. VPN<\/a>.
\n
Allikas: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0435\u043c\u0430\u044f \u0434\u043b\u044f \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 (\u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432). \u0421\u0438\u0441\u0442\u0435\u043c\u044b \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442 \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 web-\u0431\u043e\u0442\u043e\u0432 \u0438 \u043f\u0440\u043e\u043a\u0441\u0438 \u0434\u043b\u044f \u0441\u043a\u0430\u0447\u0438\u0432\u0430\u043d\u0438\u044f \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432 — \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043b\u0435\u043d\u043d\u043e\u0435 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u043e\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0435 \u043f\u043e\u043b\u0443\u0447\u0430\u0435\u0442 \u0441 \u0432\u043d\u0435\u0448\u043d\u0435\u0433\u043e \u0441\u0435\u0440\u0432\u0435\u0440\u0430 \u0438\u043d\u0441\u0442\u0440\u0443\u043a\u0446\u0438\u0438 \u043f\u043e \u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u0430\u0439\u0442\u043e\u0432, \u043f\u043e\u0441\u043b\u0435 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-138909","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Brauseri lisandmoodulid kaasavad AI-botide skrapimise jaotatud v\u00f5rgustiku loomisse | ProHoster","description":"Turvauuringute ettev\u00f5tte Secure Annex teadlased on m\u00e4rganud, et uue brauseri lisandmoodulite monetiseerimise meetodi populaarsus, kus lisandmoodulite kasutajatest moodustatakse jaotatud v\u00f5rk, on kasvanud.","canonical_url":"https:\/\/prohoster.info\/et\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0411\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0432\u043e\u0432\u043b\u0435\u043a\u0430\u044e\u0442 \u0432 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u0435 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0435\u0442\u0438 \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 \u0434\u043b\u044f AI-\u0431\u043e\u0442\u043e\u0432 | ProHoster","og:description":"\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c.","og:url":"https:\/\/prohoster.info\/et\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2025-07-11T15:11:55+00:00","article:modified_time":"2025-07-11T15:11:55+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"138909","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-09 17:49:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-01-23 13:47:22","updated":"2026-02-09 17:49:20","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/138909","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=138909"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/138909\/revisions"}],"predecessor-version":[{"id":159225,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/138909\/revisions\/159225"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=138909"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=138909"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=138909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}