{"id":114069,"date":"2024-03-03T12:25:49","date_gmt":"2024-03-03T10:25:53","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/artprompt-ataka-na-ai-sistemy-pozvolyayushhaya-obojti-filtry-pri-pomoshhi-ascii-kartinok"},"modified":"2024-03-03T12:25:49","modified_gmt":"2024-03-03T10:25:53","slug":"artprompt-ataka-na-ai-sistemy-pozvolyayushhaya-obojti-filtry-pri-pomoshhi-ascii-kartinok","status":"publish","type":"post","link":"https:\/\/prohoster.info\/cs\/blog\/news\/artprompt-ataka-na-ai-sistemy-pozvolyayushhaya-obojti-filtry-pri-pomoshhi-ascii-kartinok","title":{"rendered":"ArtPrompt \u2014 \u00fatok na AI syst\u00e9my, kter\u00fd umo\u017e\u0148uje obch\u00e1zet filtry pomoc\u00ed ASCII obr\u00e1zk\u016f.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Skupina v\u00fdzkumn\u00edk\u016f z Washingtonsk\u00e9, Illinois State a Chicagsk\u00e9 univerzity objevila novou metodu, jak obch\u00e1zet omezen\u00ed p\u0159i zpracov\u00e1n\u00ed nebezpe\u010dn\u00e9ho obsahu v AI chatbotech zalo\u017een\u00fdch na velk\u00fdch jazykov\u00fdch modelech (LLM). \u00datok vych\u00e1z\u00ed z toho, \u017ee jazykov\u00e9 modely GPT-3.5, GPT-4 (OpenAI), Gemini (Google), Claude (Anthropic) a Llama2 (Meta) \u00fasp\u011b\u0161n\u011b rozpozn\u00e1vaj\u00ed a zohled\u0148uj\u00ed v \u017e\u00e1dostech text zpracovan\u00fd formou ASCII grafiky. Tak\u017ee pro obch\u00e1zen\u00ed filtr\u016f nebezpe\u010dn\u00fdch dotaz\u016f sta\u010dilo uv\u00e9st zak\u00e1zan\u00e1 slova ve form\u011b ASCII obr\u00e1zku.

\"ArtPrompt<\/center>
\"ArtPrompt<\/center> <\/p>\n

Pokud jde o efektivitu, nov\u00e1 metoda \u00fatoku v\u00fdznamn\u011b p\u0159ekonala jin\u00e9 zn\u00e1m\u00e9 zp\u016fsoby obch\u00e1zen\u00ed filtr\u016f v chatbotech. Nejvy\u0161\u0161\u00ed kvalita rozpozn\u00e1n\u00ed ASCII grafiky byla zaznamen\u00e1na u model\u016f Gemini, GPT-4 a GPT-3.5, \u00farove\u0148 \u00fasp\u011b\u0161n\u00e9ho obch\u00e1zen\u00ed filtr\u016f pomoc\u00ed testovac\u00edch dotaz\u016f (HPR, Helpful Rate, koeficient \u00fasp\u011b\u0161n\u00e9ho zpracov\u00e1n\u00ed \u017e\u00e1dosti) byla v testov\u00e1n\u00ed hodnocena na 100%, 98% a 92%, m\u00edra \u00fasp\u011b\u0161nosti proveden\u00ed \u00fatoku (ASR, Attack Success Rate) byla 76%, 32% a 76%, a \u00farove\u0148 nebezpe\u010dnosti z\u00edskan\u00fdch odpov\u011bd\u00ed (HS, Harmfulness Score) podle p\u011btibodov\u00e9 \u0161k\u00e1ly byla 4.42, 3.38 a 4.56 bod\u016f, v tomto po\u0159ad\u00ed.

\"ArtPrompt<\/center>
\"ArtPrompt<\/center> <\/p>\n

V\u00fdzkumn\u00edci tak\u00e9 prok\u00e1zali, \u017ee v sou\u010dasnosti b\u011b\u017en\u00e9 metody ochrany proti obch\u00e1zen\u00ed filtr\u016f (PPL, Paraphrase a Retokenization) jsou neefektivn\u00ed pro blokaci \u00fatoku ArtPrompt. Co je hor\u0161\u00ed, pou\u017eit\u00ed metody Retokenization dokonce zv\u00fd\u0161ilo po\u010det \u00fasp\u011b\u0161n\u00fdch zpracovan\u00fdch dotaz\u016f.

\"ArtPrompt<\/center> <\/p>\n

Dopln\u011bk: Yandex GPT2 tak\u00e9 skv\u011ble odpov\u00edd\u00e1 na ot\u00e1zky s ASCII grafikou. P\u0159\u00edklad se slovem \u201eHELLO\u201c:

\"ArtPrompt<\/center>
\n
Zdroj: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0413\u0440\u0443\u043f\u043f\u0430 \u0438\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0438\u0437 \u0412\u0430\u0448\u0438\u043d\u0433\u0442\u043e\u043d\u0441\u043a\u043e\u0433\u043e, \u0418\u043b\u043b\u0438\u043d\u043e\u0439\u0441\u0441\u043a\u043e\u0433\u043e \u0438 \u0427\u0438\u043a\u0430\u0433\u0441\u043a\u043e\u0433\u043e \u0443\u043d\u0438\u0432\u0435\u0440\u0441\u0438\u0442\u0435\u0442\u043e\u0432 \u0432\u044b\u044f\u0432\u0438\u043b\u0430 \u043d\u043e\u0432\u044b\u0439 \u043c\u0435\u0442\u043e\u0434 \u043e\u0431\u0445\u043e\u0434\u0430 \u043e\u0433\u0440\u0430\u043d\u0438\u0447\u0435\u043d\u0438\u0439 \u043f\u043e \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u043e\u043f\u0430\u0441\u043d\u043e\u0433\u043e \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0432 AI-\u0447\u0430\u0442\u043e\u0431\u043e\u0442\u0430\u0445, \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u044b\u0445 \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u044f\u0437\u044b\u043a\u043e\u0432\u044b\u0445 \u043c\u043e\u0434\u0435\u043b\u0435\u0439 (LLM). \u0410\u0442\u0430\u043a\u0430 \u043e\u0441\u043d\u043e\u0432\u0430\u043d\u0430 \u043d\u0430 \u0442\u043e\u043c, \u0447\u0442\u043e \u044f\u0437\u044b\u043a\u043e\u0432\u044b\u0435 \u043c\u043e\u0434\u0435\u043b\u0438 GPT-3.5, GPT-4 (OpenAI), Gemini (Google), Claude (Anthropic) \u0438 Llama2 (Meta) \u0443\u0441\u043f\u0435\u0448\u043d\u043e \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u044e\u0442 \u0438 \u0443\u0447\u0438\u0442\u044b\u0432\u0430\u044e\u0442 \u0432 \u0437\u0430\u043f\u0440\u043e\u0441\u0430\u0445 \u0442\u0435\u043a\u0441\u0442, \u043e\u0444\u043e\u0440\u043c\u043b\u0435\u043d\u043d\u044b\u0439 \u0432 \u0432\u0438\u0434\u0435 ASCII-\u0433\u0440\u0430\u0444\u0438\u043a\u0438. \u0422\u0430\u043a\u0438\u043c […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":114070,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-114069","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47ArtPrompt \u2014 \u00fatok na AI syst\u00e9my, umo\u017e\u0148uj\u00edc\u00ed obch\u00e1zet filtry pomoc\u00ed ASCII obr\u00e1zk\u016f | ProHoster","description":"Skupina v\u00fdzkumn\u00edk\u016f z Washingtonsk\u00e9, Illinois State a Chicagsk\u00e9 univerzity objevila novou metodu, jak obch\u00e1zet omezen\u00ed p\u0159i zpracov\u00e1n\u00ed nebezpe\u010dn\u00e9ho obsahu v AI chatbotech zalo\u017een\u00fdch na velk\u00fdch jazykov\u00fdch modelech.","canonical_url":"https:\/\/prohoster.info\/cs\/blog\/news\/artprompt-ataka-na-ai-sistemy-pozvolyayushhaya-obojti-filtry-pri-pomoshhi-ascii-kartinok","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"cs_CZ","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47ArtPrompt \u2014 \u0430\u0442\u0430\u043a\u0430 \u043d\u0430 AI-\u0441\u0438\u0441\u0442\u0435\u043c\u044b, \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u044e\u0449\u0430\u044f \u043e\u0431\u043e\u0439\u0442\u0438 \u0444\u0438\u043b\u044c\u0442\u0440\u044b \u043f\u0440\u0438 \u043f\u043e\u043c\u043e\u0449\u0438 ASCII-\u043a\u0430\u0440\u0442\u0438\u043d\u043e\u043a | ProHoster","og:description":"\u0413\u0440\u0443\u043f\u043f\u0430 \u0438\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u0435\u0439 \u0438\u0437 \u0412\u0430\u0448\u0438\u043d\u0433\u0442\u043e\u043d\u0441\u043a\u043e\u0433\u043e, \u0418\u043b\u043b\u0438\u043d\u043e\u0439\u0441\u0441\u043a\u043e\u0433\u043e \u0438 \u0427\u0438\u043a\u0430\u0433\u0441\u043a\u043e\u0433\u043e \u0443\u043d\u0438\u0432\u0435\u0440\u0441\u0438\u0442\u0435\u0442\u043e\u0432 \u0432\u044b\u044f\u0432\u0438\u043b\u0430 \u043d\u043e\u0432\u044b\u0439 \u043c\u0435\u0442\u043e\u0434 \u043e\u0431\u0445\u043e\u0434\u0430 \u043e\u0433\u0440\u0430\u043d\u0438\u0447\u0435\u043d\u0438\u0439 \u043f\u043e \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0435 \u043e\u043f\u0430\u0441\u043d\u043e\u0433\u043e \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0432 AI-\u0447\u0430\u0442\u043e\u0431\u043e\u0442\u0430\u0445, \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u044b\u0445 \u043d\u0430 \u043e\u0441\u043d\u043e\u0432\u0435 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u044f\u0437\u044b\u043a\u043e\u0432\u044b\u0445 \u043c\u043e\u0434\u0435\u043b\u0435\u0439.","og:url":"https:\/\/prohoster.info\/cs\/blog\/news\/artprompt-ataka-na-ai-sistemy-pozvolyayushhaya-obojti-filtry-pri-pomoshhi-ascii-kartinok","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-03-03T10:25:53+00:00","article:modified_time":"2024-03-03T10:25:53+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/114069","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/comments?post=114069"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/114069\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/media\/114070"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/media?parent=114069"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/categories?post=114069"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/tags?post=114069"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}