{"id":114563,"date":"2024-03-25T18:26:02","date_gmt":"2024-03-25T16:26:02","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov"},"modified":"2024-03-25T18:26:02","modified_gmt":"2024-03-25T16:26:02","slug":"eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","title":{"rendered":"Eksperimenti q\u00eb p\u00ebrdor SQLite si nj\u00eb kontejner p\u00ebr arkivimin e skedar\u00ebve","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Projekti Pack u p\u00ebrpoq t\u00eb krijoj\u00eb nj\u00eb format p\u00ebr arkivimin e skedar\u00ebve, t\u00eb nd\u00ebrtuar mbi bibliotek\u00ebn SQLite dhe algoritmin e kompresimit ZSTD (Zstandard). Prototipi i p\u00ebrgatitur, i shkruar n\u00eb gjuh\u00ebn Pascal dhe i shp\u00ebrndar\u00eb n\u00ebn licenc\u00ebn Apache 2.0, e kaloi me shpejt\u00ebsi krijimin e arkivave programet m\u00eb t\u00eb zakonshme t\u00eb arkivimit, duke u mb\u00ebshtetur vet\u00ebm n\u00eb leximin e t\u00eb dh\u00ebnave, kompresimin nga biblioteka libzstd dhe kryerjen e operacioneve SQL p\u00ebr t\u00eb shkuar t\u00eb dh\u00ebnat e kompresuara n\u00eb skedarin me baz\u00ebn e t\u00eb dh\u00ebnave SQLite. <\/p>\n

Gjat\u00eb kompresimit t\u00eb nj\u00eb katalogu me 81 mij\u00eb skeda, me nj\u00eb madh\u00ebsi totale prej 1.25 GB, Pack u tregua m\u00eb i shpejt\u00eb se utilitari ZIP 112 her\u00eb, duke kryer operacionin p\u00ebr 1.3 sekonda n\u00eb krahasim me 146 sekonda t\u00eb ZIP. Madh\u00ebsia e arkivit rezultoi n\u00eb 23% m\u00eb t\u00eb vog\u00ebl me Pack (194 MB me Pack dhe 253 MB me ZIP). P\u00ebr t\u00eb b\u00ebr\u00eb nj\u00eb krahasim, utilitari tar e kryeu paketimin p\u00ebr 4.7 sekonda pa kompresim dhe p\u00ebr 28.5 sekonda me metod\u00ebn gzip, arkivatori RAR e p\u00ebrfundoi testin p\u00ebr 27.5 sekonda, nd\u00ebrsa 7z p\u00ebr 54.2 sekonda. Madh\u00ebsit\u00eb e arkivave ishin: tar.gz \u2014 214 MB, RAR \u2014 235 MB, 7z \u2014 135 MB. Vlen t\u00eb theksohet se sa i p\u00ebrket shpejt\u00ebsis\u00eb s\u00eb shkarkimit dhe qasjes s\u00eb rast\u00ebsishme n\u00eb skedar\u00eb, Pack gjithashtu e kalon arkivator\u00ebt e tjer\u00eb, duke konsumuar m\u00eb pak memorie operative n\u00eb t\u00eb nj\u00ebjt\u00ebn koh\u00eb. ZIP: 253 MB, 146 s 7z: 135 MB, 54.2 s m\u00eb shpejt se ZIP n\u00eb 2.7 her\u00eb tar.gz: 214 MB, 28.5 s x 5.1 RAR: 235 MB, 27.5 s x 5.3 tar: 1345 MB, 4.7 s x 31 Pack: 194 MB, 1.3 s x 112 <\/p>\n

P\u00ebr ndikimin e caches t\u00eb skedar\u00ebve mbi rezultatet e testit nuk p\u00ebrmendet asgj\u00eb. Probabiliteti \u00ebsht\u00eb se shpejt\u00ebsia e ul\u00ebt e ZIP-it \u00ebsht\u00eb shkaktuar nga rendi i ekzekutimit t\u00eb testeve pa u marr\u00eb parasysh mbajtja e t\u00eb dh\u00ebnave n\u00eb memorie \u2014 testi me zip u ekzekutua me cache t\u00eb ftoht\u00eb, nd\u00ebrsa testet e tjera me cache t\u00eb ngroht\u00eb. N\u00eb kushte normale, Zstandard demonstron nj\u00eb shpejt\u00ebsi kompresimi 3-5 her\u00eb m\u00eb t\u00eb lart\u00eb n\u00eb krahasim me zlib dhe nj\u00eb shkarkim dyfish m\u00eb t\u00eb shpejt\u00eb, me nj\u00eb nivel kompresimi q\u00eb \u00ebsht\u00eb m\u00eb i lart\u00eb me 10-15%. <\/p>\n

Shtesa: Nj\u00eb ide e ngjashme p\u00ebr ruajtjen e skedar\u00ebve t\u00eb kompresuar si blob n\u00eb baz\u00ebn e t\u00eb dh\u00ebnave SQLite u realizua n\u00eb vitin 2014 n\u00eb arkivatorin sqlar, t\u00eb krijuar nga zhvilluesit e SQLite si nj\u00eb eksperiment p\u00ebr t\u00eb vler\u00ebsuar efikasitetin e ruajtjes s\u00eb blob-eve n\u00eb SQLite. N\u00eb sqlar, p\u00ebr kompresim p\u00ebrdoret zlib dhe madh\u00ebsia e skedar\u00ebve \u00ebsht\u00eb af\u00ebrsisht 2% m\u00eb e madhe se ajo e utilitarit ZIP.
\n
Burimi: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041f\u0440\u043e\u0435\u043a\u0442 Pack \u043f\u0440\u0435\u0434\u043f\u0440\u0438\u043d\u044f\u043b \u043f\u043e\u043f\u044b\u0442\u043a\u0443 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0444\u043e\u0440\u043c\u0430\u0442\u0430 \u0434\u043b\u044f \u0430\u0440\u0445\u0438\u0432\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0444\u0430\u0439\u043b\u043e\u0432, \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u043e\u0433\u043e \u043d\u0430 \u0431\u0430\u0437\u0435 \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 SQLite \u0438 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u0430 \u0441\u0436\u0430\u0442\u0438\u044f ZSTD (Zstandard). \u041f\u043e\u0434\u0433\u043e\u0442\u043e\u0432\u043b\u0435\u043d\u043d\u044b\u0439 \u043f\u0440\u043e\u0442\u043e\u0442\u0438\u043f, \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u043d\u044b\u0439 \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Pascal \u0438 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u0435\u043c\u044b\u0439 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0, \u043e\u0431\u043e\u0433\u043d\u0430\u043b \u043f\u043e \u0441\u043a\u043e\u0440\u043e\u0441\u0442\u0438 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0430\u0440\u0445\u0438\u0432\u043e\u0432 \u043d\u0430\u0438\u0431\u043e\u043b\u0435\u0435 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0451\u043d\u043d\u044b\u0435 \u0430\u0440\u0445\u0438\u0432\u0430\u0442\u043e\u0440\u044b, \u043f\u0440\u0438 \u0442\u043e\u043c, \u0447\u0442\u043e \u0435\u0433\u043e \u0440\u0430\u0431\u043e\u0442\u0430 \u0441\u0432\u043e\u0434\u0438\u043b\u0430\u0441\u044c \u043a \u0447\u0442\u0435\u043d\u0438\u044e \u0434\u0430\u043d\u043d\u044b\u0445, \u0441\u0436\u0430\u0442\u0438\u044e \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u043e\u0439 libzstd \u0438 \u0432\u044b\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044e SQL-\u043e\u043f\u0435\u0440\u0430\u0446\u0438\u0439 \u043f\u043e […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-114563","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Eksperimenti me p\u00ebrdorimin e SQLite si nj\u00eb en\u00eb p\u00ebr arkivimin e skedar\u00ebve | ProHoster","description":"Projekti Pack nd\u00ebrmori nj\u00eb p\u00ebrpjekje p\u00ebr t\u00eb krijuar nj\u00eb format p\u00ebr arkivimin e skedar\u00ebve, i nd\u00ebrtuar mbi bibliotek\u00ebn SQLite dhe algoritmin e kompresimit ZSTD (Zstandard).","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u042d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442 \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c SQLite \u0432 \u043a\u0430\u0447\u0435\u0441\u0442\u0432\u0435 \u043a\u043e\u043d\u0442\u0435\u0439\u043d\u0435\u0440\u0430 \u0434\u043b\u044f \u0430\u0440\u0445\u0438\u0432\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0444\u0430\u0439\u043b\u043e\u0432 | ProHoster","og:description":"\u041f\u0440\u043e\u0435\u043a\u0442 Pack \u043f\u0440\u0435\u0434\u043f\u0440\u0438\u043d\u044f\u043b \u043f\u043e\u043f\u044b\u0442\u043a\u0443 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0444\u043e\u0440\u043c\u0430\u0442\u0430 \u0434\u043b\u044f \u0430\u0440\u0445\u0438\u0432\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0444\u0430\u0439\u043b\u043e\u0432, \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u043e\u0433\u043e \u043d\u0430 \u0431\u0430\u0437\u0435 \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0438 SQLite \u0438 \u0430\u043b\u0433\u043e\u0440\u0438\u0442\u043c\u0430 \u0441\u0436\u0430\u0442\u0438\u044f ZSTD (Zstandard).","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/eksperiment-s-ispolzovaniem-sqlite-v-kachestve-kontejnera-dlya-arhivirovaniya-fajlov","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-03-25T16:26:02+00:00","article:modified_time":"2024-03-25T16:26:02+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/114563","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=114563"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/114563\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=114563"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=114563"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=114563"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}