{"id":138909,"date":"2025-07-11T17:11:55","date_gmt":"2025-07-11T15:11:55","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov"},"modified":"2025-07-11T17:11:55","modified_gmt":"2025-07-11T15:11:55","slug":"brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/pt\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","title":{"rendered":"Extens\u00f5es do navegador envolvem a constru\u00e7\u00e3o de uma rede distribu\u00edda de scraping para bots de IA","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>Pesquisadores de seguran\u00e7a da empresa Secure Annex observaram o aumento da popularidade de um novo m\u00e9todo de monetiza\u00e7\u00e3o de extens\u00f5es de navegador, onde os usu\u00e1rios das extens\u00f5es formam uma rede distribu\u00edda utilizada para scraping (indexa\u00e7\u00e3o de conte\u00fados de sites). Os sistemas dos usu\u00e1rios s\u00e3o utilizados como web bots e proxies para baixar conte\u00fados de sites \u2014 a extens\u00e3o de navegador instalada recebe de um servidor externo instru\u00e7\u00f5es sobre a indexa\u00e7\u00e3o dos sites, ap\u00f3s o que, em um iframe oculto, inicia o download do conte\u00fado solicitado e transmite os dados obtidos para um servi\u00e7o externo. Nos cat\u00e1logos do Chrome, Firefox e Edge, essa forma de monetiza\u00e7\u00e3o foi identificada em 245 extens\u00f5es, totalizando 909 mil instala\u00e7\u00f5es.      <\/p>\n<p>O funcionamento \u00e9 organizado pela inclus\u00e3o no c\u00f3digo das extens\u00f5es de navegador de uma biblioteca JavaScript aberta, mellowtel.js, fornecida sob a licen\u00e7a LGPLv3. A biblioteca \u00e9 desenvolvida pelo projeto Mellowtel, que promove uma nova plataforma de monetiza\u00e7\u00e3o que, al\u00e9m das extens\u00f5es de navegador, pode ser aplicada em programas baseados em frameworks como Flutter e Electron. A ideia principal da plataforma \u00e9 que desenvolvedores de extens\u00f5es de navegador e aplicativos possam ganhar dinheiro n\u00e3o por meio da exibi\u00e7\u00e3o de an\u00fancios ou m\u00e9todos duvidosos, como a venda de dados que comprometam a privacidade dos usu\u00e1rios, mas executando tarefas de indexa\u00e7\u00e3o de conte\u00fado web para treinar sistemas de IA.     <\/p>\n<p>A demanda das empresas de IA por dados para treinar modelos levou ao surgimento de in\u00fameros bots que indexam sites sem limitar razoavelmente a intensidade das requisi\u00e7\u00f5es e ignorando as regras de indexa\u00e7\u00e3o do robots.txt. Esses bots criam uma enorme carga parasit\u00e1ria nos <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/pt\/server\/\"   title=\"servidores\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"1981\">servidores<\/a>, prejudicando o funcionamento normal dos sistemas e consumindo o tempo dos administradores. Recentemente, eles come\u00e7aram a ser bloqueados ativamente (por exemplo, a rede de entrega de conte\u00fado Cloudflare implementou uma op\u00e7\u00e3o para bloquear esses bots por padr\u00e3o).       <\/p>\n<p>As empresas de IA est\u00e3o dispostas a pagar pela indexa\u00e7\u00e3o e a plataforma Mellowtel ofereceu uma forma de satisfazer essa necessidade, envolvendo usu\u00e1rios comuns no processo de coleta de dados de sites. A plataforma repassa 55% dos recursos arrecadados com a colabora\u00e7\u00e3o de empresas de IA para os propriet\u00e1rios de extens\u00f5es. O projeto \u00e9 totalmente leg\u00edtimo e afirma que a participa\u00e7\u00e3o na coleta de dados deve ser volunt\u00e1ria e ativada apenas ap\u00f3s o consentimento expl\u00edcito do usu\u00e1rio. Sup\u00f5e-se que o usu\u00e1rio, como forma de agradecimento aos desenvolvedores da extens\u00e3o, possa ativar o modo de coleta de dados e oferecer apoio financeiro indireto a eles.    <\/p>\n<p>O problema \u00e9 que nem todos os desenvolvedores de extens\u00f5es est\u00e3o dispostos a trabalhar de maneira honesta e transparente. Algumas extens\u00f5es tentam ativar secretamente a monetiza\u00e7\u00e3o do Mellowtel, contornando as regras do servi\u00e7o, o que leva o usu\u00e1rio a se tornar um participante de uma rede distribu\u00edda para download de dados de sites sem seu consentimento expl\u00edcito. Das 45 extens\u00f5es do Chrome que utilizam o Mellowtel, 12 j\u00e1 foram bloqueadas pelo Google por atividade maliciosa. No cat\u00e1logo da Microsoft, 8 das 129 extens\u00f5es foram bloqueadas, e no cat\u00e1logo da Mozilla, 2 das 71 extens\u00f5es foram bloqueadas. As raz\u00f5es para a remo\u00e7\u00e3o n\u00e3o s\u00e3o detalhadas, mas n\u00e3o se pode descartar que a causa tenha sido o uso inadequado do Mellowtel.      <\/p>\n<p>O desenvolvedor do Mellowtel afirmou que, para resolver o problema com a poss\u00edvel ativa\u00e7\u00e3o oculta da coleta de dados, o servi\u00e7o est\u00e1 implementando a verifica\u00e7\u00e3o obrigat\u00f3ria de todas as extens\u00f5es que utilizam o Mellowtel, para garantir que a coleta de dados esteja desativada por padr\u00e3o (sendo ativada apenas ap\u00f3s o consentimento expl\u00edcito do usu\u00e1rio) e que haja um bot\u00e3o vis\u00edvel para desativ\u00e1-la. Pedidos de tarefas de extens\u00f5es que n\u00e3o passaram pela verifica\u00e7\u00e3o ser\u00e3o colocados em quarentena e ignorados.      <\/p>\n<p>Durante o funcionamento das extens\u00f5es que utilizam a biblioteca Mellowtel, uma conex\u00e3o websocket \u00e9 estabelecida com um servidor externo localizado em nuvem AWS, atrav\u00e9s da qual s\u00e3o transmitidas informa\u00e7\u00f5es sobre a disponibilidade do usu\u00e1rio, pa\u00eds, largura de banda da conex\u00e3o e ativa\u00e7\u00e3o do suporte a scraping pelo usu\u00e1rio. Periodicamente, solicita\u00e7\u00f5es heartbeat s\u00e3o enviadas atrav\u00e9s da conex\u00e3o para verificar a disponibilidade do cliente. Quando h\u00e1 tarefas para carregar conte\u00fado, um iframe oculto \u00e9 inserido nas p\u00e1ginas visitadas pelo usu\u00e1rio, de onde o scraping \u00e9 realizado.      <\/p>\n<p>Para carregar p\u00e1ginas externas a partir do iframe inserido ao visitar outros sites, a biblioteca contorna temporariamente a prote\u00e7\u00e3o contra o carregamento de conte\u00fado de terceiros fornecida pelo navegador, removendo os cabe\u00e7alhos HTTP Content-Security-Policy e X-Frame-Options e restaurando-os ap\u00f3s o carregamento da p\u00e1gina desejada. A remo\u00e7\u00e3o \u00e9 feita atrav\u00e9s da modifica\u00e7\u00e3o das solicita\u00e7\u00f5es de rede utilizando a API declarativeNetRequest (para acessar essa API, as extens\u00f5es solicitam uma permiss\u00e3o separada). A suspens\u00e3o tempor\u00e1ria dos cabe\u00e7alhos Content-Security-Policy e X-Frame-Options afeta negativamente a seguran\u00e7a, pois remove a prote\u00e7\u00e3o padr\u00e3o contra ataques de script entre sites (XSS) por um tempo.      <\/p>\n<p>A plataforma Mellowtel est\u00e1 afiliada \u00e0 empresa Olostep, que oferece uma API de scraping capaz de contornar a prote\u00e7\u00e3o contra bots e executar at\u00e9 100 mil solicita\u00e7\u00f5es por minuto. Essa atividade do servi\u00e7o, aplicada em um \u00fanico site, pode ser comparada \u00e0 realiza\u00e7\u00e3o de um ataque DoS distribu\u00eddo. O servi\u00e7o tamb\u00e9m pode potencialmente usar os usu\u00e1rios como proxies para extrair conte\u00fado de sites privados acess\u00edveis apenas em subredes que o usu\u00e1rio consegue acessar atrav\u00e9s de <a class=\"wpil_keyword_link\" href=\"https:\/\/prohoster.info\/pt\/vpn\/\"   title=\"VPN\" data-wpil-keyword-link=\"linked\"  data-wpil-monitor-id=\"271\">VPN<\/a>.<br \/>\n<br \/>Fonte: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=63568\">opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0435\u043c\u0430\u044f \u0434\u043b\u044f \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 (\u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432). \u0421\u0438\u0441\u0442\u0435\u043c\u044b \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0442 \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 web-\u0431\u043e\u0442\u043e\u0432 \u0438 \u043f\u0440\u043e\u043a\u0441\u0438 \u0434\u043b\u044f \u0441\u043a\u0430\u0447\u0438\u0432\u0430\u043d\u0438\u044f \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u043c\u043e\u0433\u043e \u0441\u0430\u0439\u0442\u043e\u0432 &#8212; \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043b\u0435\u043d\u043d\u043e\u0435 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u043e\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0435 \u043f\u043e\u043b\u0443\u0447\u0430\u0435\u0442 \u0441 \u0432\u043d\u0435\u0448\u043d\u0435\u0433\u043e \u0441\u0435\u0440\u0432\u0435\u0440\u0430 \u0438\u043d\u0441\u0442\u0440\u0443\u043a\u0446\u0438\u0438 \u043f\u043e \u0438\u043d\u0434\u0435\u043a\u0441\u0430\u0446\u0438\u0438 \u0441\u0430\u0439\u0442\u043e\u0432, \u043f\u043e\u0441\u043b\u0435 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-138909","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.3 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/pt\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov\" \/>\n\t\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.3\" \/>\n\t\t<meta property=\"og:locale\" content=\"pt_PT\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u0411\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0432\u043e\u0432\u043b\u0435\u043a\u0430\u044e\u0442 \u0432 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u0435 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0435\u0442\u0438 \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 \u0434\u043b\u044f AI-\u0431\u043e\u0442\u043e\u0432 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/pt\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2025-07-11T15:11:55+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2025-07-11T15:11:55+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Extens\u00f5es de navegador envolvem a constru\u00e7\u00e3o de uma rede distribu\u00edda de scraping para bots de IA | ProHoster","description":"Pesquisadores de seguran\u00e7a da empresa Secure Annex notaram o aumento da popularidade de um novo m\u00e9todo de monetiza\u00e7\u00e3o de extens\u00f5es de navegador, onde usu\u00e1rios das extens\u00f5es s\u00e3o transformados em uma rede distribu\u00edda.","canonical_url":"https:\/\/prohoster.info\/pt\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"pt_PT","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0411\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0435 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0432\u043e\u0432\u043b\u0435\u043a\u0430\u044e\u0442 \u0432 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u0435 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0435\u0442\u0438 \u0441\u043a\u0440\u0430\u043f\u0438\u043d\u0433\u0430 \u0434\u043b\u044f AI-\u0431\u043e\u0442\u043e\u0432 | ProHoster","og:description":"\u0418\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0438 \u0431\u0435\u0437\u043e\u043f\u0430\u0441\u043d\u043e\u0441\u0442\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Secure Annex \u043e\u0431\u0440\u0430\u0442\u0438\u043b\u0438 \u0432\u043d\u0438\u043c\u0430\u043d\u0438\u0435 \u043d\u0430 \u0440\u043e\u0441\u0442 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u0438 \u043d\u043e\u0432\u043e\u0433\u043e \u043c\u0435\u0442\u043e\u0434\u0430 \u043c\u043e\u043d\u0435\u0442\u0438\u0437\u0430\u0446\u0438\u0438 \u0431\u0440\u0430\u0443\u0437\u0435\u0440\u043d\u044b\u0445 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439, \u043f\u0440\u0438 \u043a\u043e\u0442\u043e\u0440\u043e\u043c \u0438\u0437 \u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0434\u043e\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u0439 \u0444\u043e\u0440\u043c\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0430\u044f \u0441\u0435\u0442\u044c.","og:url":"https:\/\/prohoster.info\/pt\/blog\/news\/brauzernye-dopolneniya-vovlekayut-v-postroenie-raspredelyonnoj-seti-skrapinga-dlya-ai-botov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2025-07-11T15:11:55+00:00","article:modified_time":"2025-07-11T15:11:55+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"138909","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-09 17:49:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-01-23 13:47:22","updated":"2026-02-09 17:49:20","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts\/138909","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/comments?post=138909"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts\/138909\/revisions"}],"predecessor-version":[{"id":159225,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts\/138909\/revisions\/159225"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/media?parent=138909"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/categories?post=138909"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/tags?post=138909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}