{"id":114563,"date":"2024-03-25T18:26:02","date_gmt":"2024-03-25T16:26:02","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov"},"modified":"2024-03-25T18:26:02","modified_gmt":"2024-03-25T16:26:02","slug":"eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/cs\/blog\/news\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","title":{"rendered":"Experiment s pou\u017eit\u00edm SQLite jako kontejneru pro archivaci soubor\u016f","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Projekt Pack se pokusil vytvo\u0159it form\u00e1t pro archivaci soubor\u016f, zalo\u017een\u00fd na knihovn\u011b SQLite a algoritmu komprese ZSTD (Zstandard). P\u0159ipraven\u00fd prototyp, napsan\u00fd v jazyce Pascal a distribuovan\u00fd pod licenc\u00ed Apache 2.0, p\u0159ekonal v rychlosti vytv\u00e1\u0159en\u00ed archivu nejroz\u0161\u00ed\u0159en\u011bj\u0161\u00ed archiva\u010dn\u00ed n\u00e1stroje, p\u0159i\u010dem\u017e jeho pr\u00e1ce spo\u010d\u00edvala v \u010dten\u00ed dat, kompresi knihovnou libzstd a prov\u00e1d\u011bn\u00ed SQL operac\u00ed pro p\u0159id\u00e1v\u00e1n\u00ed komprimovan\u00fdch dat do souboru s datab\u00e1z\u00ed SQLite. <\/p>\n

P\u0159i zkomprimov\u00e1n\u00ed katalogu s 81 tis\u00edci soubor\u016f o celkov\u00e9 velikosti 1,25 GB, byl pack 112kr\u00e1t rychlej\u0161\u00ed ne\u017e utilita ZIP, vykon\u00e1vaj\u00edc\u00ed operaci za 1,3 sekundy oproti 146 sekund\u00e1m u ZIP. Velikost archivu byla p\u0159i tom u pack o 23 % men\u0161\u00ed (194 MB u Pack a 253 MB u ZIP). Pro srovn\u00e1n\u00ed utilita tar zkomprimovala za 4,7 sekundy bez komprese a za 28,5 sekundy s kompres\u00ed metodou gzip, archiver RAR zvl\u00e1dl test za 27,5 sekundy, a 7z za 54,2 sekundy. Velikosti archiv\u016f byly: tar.gz \u2014 214 MB, RAR \u2014 235 MB, 7z \u2014 135 MB. Je t\u0159eba poznamenat, \u017ee co se t\u00fd\u010de rychlosti dekomprese a n\u00e1hodn\u00e9ho p\u0159\u00edstupu k soubor\u016fm, Pack tak\u00e9 p\u0159ed\u010d\u00ed ostatn\u00ed archiva\u010dn\u00ed n\u00e1stroje, p\u0159i\u010dem\u017e spot\u0159ebov\u00e1v\u00e1 m\u00e9n\u011b opera\u010dn\u00ed pam\u011bti. ZIP: 253 MB, 146 s 7z: 135 MB, 54,2 s rychleji ne\u017e ZIP 2,7kr\u00e1t tar.gz: 214 MB, 28,5 s x 5,1 RAR: 235 MB, 27,5 s x 5,3 tar: 1345 MB, 4,7 s x 31 Pack: 194 MB, 1,3 s x 112 <\/p>\n

O vlivu souborov\u00e9 cache na v\u00fdsledky testu se nezmi\u0148uje. Pravd\u011bpodobn\u011b n\u00edzk\u00e1 rychlost ZIP je zp\u016fsobena po\u0159ad\u00edm spu\u0161t\u011bn\u00ed test\u016f bez z\u0159etele na cache dat v pam\u011bti \u2014 test s zip byl spu\u0161t\u011bn p\u0159i studen\u00e9 cache, zat\u00edmco ostatn\u00ed testy p\u0159i zah\u0159\u00e1t\u00e9. V b\u011b\u017en\u00fdch podm\u00ednk\u00e1ch Zstandard vykazuje 3-5kr\u00e1t vy\u0161\u0161\u00ed rychlost komprese ve srovn\u00e1n\u00ed se zlib a dvakr\u00e1t rychlej\u0161\u00ed dekompresi, p\u0159i\u010dem\u017e \u00farove\u0148 komprese je vy\u0161\u0161\u00ed o 10-15 %. <\/p>\n

Dodatek: Podobn\u00e1 my\u0161lenka uchov\u00e1v\u00e1n\u00ed komprimovan\u00fdch soubor\u016f ve form\u011b blob\u016f v datab\u00e1zi SQLite byla v roce 2014 realizov\u00e1na v archiva\u010dn\u00edm n\u00e1stroji sqlar, kter\u00fd byl vytvo\u0159en v\u00fdvoj\u00e1\u0159i SQLite jako experiment pro posouzen\u00ed efektivity uchov\u00e1v\u00e1n\u00ed blob\u016f v SQLite. V sqlar se pro kompresi pou\u017e\u00edv\u00e1 zlib a velikost soubor\u016f je p\u0159ibli\u017en\u011b o 2 % v\u011bt\u0161\u00ed ne\u017e u utilit ZIP.
\n
Zdroj: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u0440\u043e\u0435\u043a\u0442 Pack \u043f\u0440\u0435\u0434\u043f\u0440\u0438\u043d\u044f\u043b \u043f\u043e\u043f\u044b\u0442\u043a\u0443 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0444\u043e\u0440\u043c\u0430\u0442\u0430 \u0434\u043b\u044f \u0430\u0440\u0445\u0438\u0432\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0444\u0430\u0439\u043b\u043e\u0432, \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u043e\u0433\u043e \u043d\u0430 \u0431\u0430\u0437\u0435 \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 SQLite \u0438 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u0430 \u0441\u0436\u0430\u0442\u0438\u044f ZSTD (Zstandard). \u041f\u043e\u0434\u0433\u043e\u0442\u043e\u0432\u043b\u0435\u043d\u043d\u044b\u0439 \u043f\u0440\u043e\u0442\u043e\u0442\u0438\u043f, \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u043d\u044b\u0439 \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Pascal \u0438 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u0435\u043c\u044b\u0439 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0, \u043e\u0431\u043e\u0433\u043d\u0430\u043b \u043f\u043e \u0441\u043a\u043e\u0440\u043e\u0441\u0442\u0438 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0430\u0440\u0445\u0438\u0432\u043e\u0432 \u043d\u0430\u0438\u0431\u043e\u043b\u0435\u0435 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0451\u043d\u043d\u044b\u0435 \u0430\u0440\u0445\u0438\u0432\u0430\u0442\u043e\u0440\u044b, \u043f\u0440\u0438 \u0442\u043e\u043c, \u0447\u0442\u043e \u0435\u0433\u043e \u0440\u0430\u0431\u043e\u0442\u0430 \u0441\u0432\u043e\u0434\u0438\u043b\u0430\u0441\u044c \u043a \u0447\u0442\u0435\u043d\u0438\u044e \u0434\u0430\u043d\u043d\u044b\u0445, \u0441\u0436\u0430\u0442\u0438\u044e \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u043e\u0439 libzstd \u0438 \u0432\u044b\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044e SQL-\u043e\u043f\u0435\u0440\u0430\u0446\u0438\u0439 \u043f\u043e […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-114563","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Experiment s vyu\u017eit\u00edm SQLite jako kontejneru pro archivaci soubor\u016f | ProHoster","description":"Projekt Pack se pokusil vytvo\u0159it form\u00e1t pro archivaci soubor\u016f, zalo\u017een\u00fd na knihovn\u011b SQLite a algoritmu komprese ZSTD (Zstandard).","canonical_url":"https:\/\/prohoster.info\/cs\/blog\/news\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"cs_CZ","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c SQLite \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 \u043a\u043e\u043d\u0442\u0435\u0439\u043d\u0435\u0440\u0430 \u0434\u043b\u044f \u0430\u0440\u0445\u0438\u0432\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0444\u0430\u0439\u043b\u043e\u0432 | ProHoster","og:description":"\u041f\u0440\u043e\u0435\u043a\u0442 Pack \u043f\u0440\u0435\u0434\u043f\u0440\u0438\u043d\u044f\u043b \u043f\u043e\u043f\u044b\u0442\u043a\u0443 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0444\u043e\u0440\u043c\u0430\u0442\u0430 \u0434\u043b\u044f \u0430\u0440\u0445\u0438\u0432\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0444\u0430\u0439\u043b\u043e\u0432, \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u043e\u0433\u043e \u043d\u0430 \u0431\u0430\u0437\u0435 \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 SQLite \u0438 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u0430 \u0441\u0436\u0430\u0442\u0438\u044f ZSTD (Zstandard).","og:url":"https:\/\/prohoster.info\/cs\/blog\/news\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-03-25T16:26:02+00:00","article:modified_time":"2024-03-25T16:26:02+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/114563","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/comments?post=114563"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/posts\/114563\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/media?parent=114563"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/categories?post=114563"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/cs\/wp-json\/wp\/v2\/tags?post=114563"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}