{"id":121901,"date":"2025-02-13T14:22:07","date_gmt":"2025-02-13T12:22:07","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/reliz-subd-duckdb-1-2-0"},"modified":"2025-02-13T14:22:07","modified_gmt":"2025-02-13T12:22:07","slug":"reliz-subd-duckdb-1-2-0","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/novosti-interneta\/reliz-subd-duckdb-1-2-0","title":{"rendered":"Lan\u00e7imi i DBMS DuckDB 1.2.0","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"
L\u00ebshohet versioni i DBMS DuckDB 1.2.0, i fokusuar n\u00eb ekzekutimin e k\u00ebrkesave analitike dhe konceptualisht i ngjash\u00ebm me SQLite. DuckDB bashkon ve\u00e7orit\u00eb si kompakt\u00ebsia, lidhja n\u00eb form\u00ebn e nj\u00eb biblioteke t\u00eb integruar, ruajtja e databaz\u00ebs n\u00eb nj\u00eb skedar t\u00eb vet\u00ebm dhe nd\u00ebrfaqja CLI, me mund\u00ebsit\u00eb dhe optimizimet p\u00ebr ekzekutimin e k\u00ebrkesave analitike q\u00eb mbulojn\u00eb nj\u00eb pjes\u00eb t\u00eb konsiderueshme t\u00eb t\u00eb dh\u00ebnave t\u00eb ruajtura, p\u00ebr shembull, duke kryer agregimin e t\u00eb gjith\u00eb p\u00ebrmbajtjes s\u00eb tabelave ose bashkimin e disa tabelave t\u00eb m\u00ebdha. Kodi i projektit \u00ebsht\u00eb shkruar n\u00eb gjuh\u00ebn C++ dhe shp\u00ebrndahet n\u00ebn licenc\u00ebn MIT. <\/p>\n
DuckDB ofron nj\u00eb dialekt t\u00eb zgjeruar t\u00eb gjuh\u00ebs SQL, i cili p\u00ebrfshin mund\u00ebsi shtes\u00eb p\u00ebr p\u00ebrpunimin e k\u00ebrkesave shum\u00eb komplekse dhe afatgjata. \u00cbsht\u00eb e mundur t\u00eb p\u00ebrdoren tipe t\u00eb komplikuara (array, struktura, bashkime), si dhe t\u00eb ekzekutohen n\u00ebnk\u00ebrkesa t\u00eb rast\u00ebsishme dhe t\u00eb ngulitura. Mb\u00ebshtetet ekzekutimi paralel i k\u00ebrkesave t\u00eb shumta, ekzekutimi i k\u00ebrkesave drejtp\u00ebrdrejt nga skedar\u00ebt n\u00eb formatet CSV dhe Parquet. Mb\u00ebshtetja e importit nga DBMS PostgreSQL \u00ebsht\u00eb gjithashtu e disponueshme. <\/p>\n
Projekti p\u00ebrdor nj\u00eb shell nga SQLite, parser nga PostgreSQL, komponentin Date Math nga MonetDB, implementimin e tij t\u00eb funksioneve dritare (baze n\u00eb algoritmin e Segment Tree Aggregation), nj\u00eb p\u00ebrpunues regex-i t\u00eb bazuar n\u00eb bibliotek\u00ebn RE2, optimizator\u00eb t\u00eb ve\u00e7ant\u00eb pyetjesh, mekanizmin MVCC p\u00ebr menaxhimin e konkurenc\u00ebs (Kontrolli i Konkurrenc\u00ebs me Versione t\u00eb Shumta), si dhe nj\u00eb motor t\u00eb vectorizuar p\u00ebr ekzekutimin e pyetjeve t\u00eb bazuar n\u00eb algoritmin Hyper-Pipelining Query Execution, q\u00eb lejon p\u00ebrpunimin e grupeve t\u00eb m\u00ebdha t\u00eb vlerave n\u00eb nj\u00eb operacion t\u00eb vet\u00ebm. <\/p>\n
N\u00eb k\u00ebt\u00eb version t\u00eb ri: <\/p>\n
\n
Implementuar mb\u00ebshtetje p\u00ebr metoda t\u00eb reja kompresimi, t\u00eb cilat nuk jan\u00eb t\u00eb p\u00ebrfshira si parazgjedhje p\u00ebr t\u00eb ruajtur p\u00ebrputhshm\u00ebrin\u00eb e skedar\u00ebve t\u00eb DB me versionet e m\u00ebparshme t\u00eb DuckDB. P\u00ebr t\u00eb p\u00ebrdorur formatin e p\u00ebrmir\u00ebsuar t\u00eb skedar\u00ebve t\u00eb DB, ofrohet mund\u00ebsia p\u00ebr t\u00eb lidhur DB me numrin e versionit \u2014 kur hapni skedarin duke p\u00ebrdorur parametrin \u00abSTORAGE_VERSION\u00bb, tani mund t\u00eb p\u00ebrcaktoni versionin minimal t\u00eb mb\u00ebshtetur t\u00eb DB (\u00abATTACH 'file.db' (STORAGE_VERSION 'v1.2.0');\u00bb). P\u00ebr t\u00eb konvertuar formatin e ri n\u00eb at\u00eb t\u00eb vjet\u00ebr, mund t\u00eb p\u00ebrdorni komand\u00ebn SQL COPY, p\u00ebr shembull: ATTACH 'file1.db'; ATTACH 'converted_file.db' (STORAGE_VERSION 'v1.0.0'); COPY FROM DATABASE file1 TO converted_file;\n
U hoq kufizimi q\u00eb nuk lejonte rishqyrtimin e identifikuesve, p\u00ebr t\u00eb cil\u00ebt ekziston indeksi p\u00ebr ndjekjen e unik\u00ebsis\u00eb, n\u00ebse k\u00ebto identifikues ishin fshir\u00eb n\u00eb transaksionin aktual. P\u00ebr shembull, kodi SQL m\u00eb posht\u00eb tani nuk \u00e7on n\u00eb nj\u00eb gabim: CREATE TABLE students (id INTEGER PRIMARY KEY, name VARCHAR); INSERT INTO students VALUES (1, 'John Doe'); BEGIN; DELETE FROM students WHERE id = 1; INSERT INTO students VALUES (1, 'Jane Doe');\n
Shtuar mb\u00ebshtetje p\u00ebr ngarkimin e skedar\u00ebve CSV n\u00eb kodimet Latin-1 dhe UTF-16 (m\u00eb par\u00eb mb\u00ebshtetej vet\u00ebm kodimi UTF-8). FROM read_csv('cities-latin-1.csv', encoding = 'latin-1');\n
Shtuar mb\u00ebshtetje p\u00ebr p\u00ebrdorimin n\u00eb skedar\u00ebt CSV t\u00eb ndar\u00ebsve me shum\u00eb byte (deri n\u00eb 4 byte), duke lejuar specifikimin e emoji si ndar\u00ebs p\u00ebr kolonat. a\ud83d\udc68\u200d\ud83c\udf93b hello\ud83d\udc68\u200d\ud83c\udf93world FROM read_csv('example.dsv', sep = '\ud83d\udc68\u200d\ud83c\udf93');\n
Si parazgjedhje, \u00ebsht\u00eb aktivizuar nj\u00eb modalitet i rrept\u00eb n\u00eb analiz\u00ebn e skedar\u00ebve CSV ('strict_mode = true'), i cili kontrollon p\u00ebrputhshm\u00ebrin\u00eb me formatin e specifikimit RFC 4180. N\u00eb modalitetin e rrept\u00eb, lejohet p\u00ebrdorimi i vet\u00ebm nj\u00eb simboli p\u00ebr ndarjen e rreshtave, gj\u00eb q\u00eb do t\u00eb \u00e7oj\u00eb n\u00eb nj\u00eb gabim n\u00eb p\u00ebrpjekjen p\u00ebr t\u00eb analizuar skedar\u00ebt, t\u00eb cil\u00ebt ndajn\u00eb rreshtat jo vet\u00ebm me simbolin e kalimit t\u00eb rreshtit, por edhe me simbolin e kthimit t\u00eb karroc\u00ebs ('\r\n').\n
N\u00eb parserin CSV \u00ebsht\u00eb p\u00ebrdorur nj\u00eb algorit\u00ebm i ri p\u00ebr p\u00ebrcaktimin e rreshtit t\u00eb ri, duke mb\u00ebshtetur ndarjen e operacioneve. P\u00ebrdorimi i algoritmit t\u00eb ri ka p\u00ebrshpejtuar analizimin e CSV-t\u00eb rreth 15%.\n
\u00cbsht\u00eb hequr kufizimi mbi madh\u00ebsin\u00eb e rreshtit n\u00eb skedar\u00ebt CSV (m\u00eb par\u00eb rreshti nuk duhej t\u00eb kalonte 8 MB).\n
N\u00eb nd\u00ebrfaqen e linj\u00ebs s\u00eb komand\u00ebs \u00ebsht\u00eb shtuar nj\u00eb modalitet i sigurt, i aktivizuar p\u00ebrmes opsionit '-safe' ose komand\u00ebs '.safe_mode'. N\u00eb k\u00ebt\u00eb modalitet, lejohet akses vet\u00ebm n\u00eb skedarin e DB t\u00eb specifikuar fillimisht, dhe p\u00ebrpjekjet p\u00ebr t\u00eb hapur skedar\u00eb t\u00eb tjer\u00eb do t\u00eb \u00e7ojn\u00eb n\u00eb nj\u00eb mesazh gabimi.\n
N\u00eb nd\u00ebrfaqen e linj\u00ebs s\u00eb komandave, \u00ebsht\u00eb p\u00ebrmir\u00ebsuar plot\u00ebsimi automatik i hyrjes. Kodi p\u00ebr plot\u00ebsimin automatik \u00ebsht\u00eb kthyer n\u00eb p\u00ebrdorimin e PEG (Gramatika e Shprehjeve t\u00eb Parse-imit).\n
Gjat\u00eb ekzekutimit t\u00eb komandave n\u00eb nd\u00ebrfaqen e linj\u00ebs s\u00eb komand\u00ebs, \u00ebsht\u00eb realizuar nj\u00eb pamje e qart\u00eb p\u00ebr numrat e m\u00ebdhenj, p\u00ebr shembull, gjat\u00eb shfaqjes s\u00eb numrit 100000000, do t\u00eb shtohet gjithashtu '(100 milion\u00eb)'.\n
N\u00eb SQL \u00ebsht\u00eb shtuar mb\u00ebshtetje p\u00ebr sintaks\u00ebn, ku emrat e shkurtuar t\u00eb tabelave dhe shprehjeve mund t\u00eb specifikohen para vlerave q\u00eb ato i tregojn\u00eb (n\u00eb vend t\u00eb p\u00ebrdorimit t\u00eb sintaks\u00ebs 'shprehja AS emri'): SELECT e1: some_long_and_winding_expression, e2: t2.a_column_name FROM t1: long_schema.some_long_table_name, t2: short_s.tbl;\n
N\u00eb komand\u00ebn \u00abSELECT\u00bb \u00ebsht\u00eb realizuar mb\u00ebshtetje p\u00ebr operacionin \u00abRENAME\u00bb p\u00ebr rinovimin e fushave, q\u00eb shfaqen kur specifikohet shprehja \u00ab*\u00bb: SELECT * RENAME (col1 AS new_col1) FROM integers;\n
N\u00eb komand\u00ebn \u00abSELECT\u00bb \u00ebsht\u00eb lejuar p\u00ebrdorimi i operacioneve \u00abLIKE\u00bb dhe \u00abSIMILAR TO\u00bb gjat\u00eb shfaqjes p\u00ebrmes \u00ab*\u00bb: SELECT * LIKE 'val%' FROM key_val;\n
Cil\u00ebsia e gjenerimit t\u00eb numrave pseudo-rasor \u00ebsht\u00eb p\u00ebrmir\u00ebsuar.\n
Optimizuesi i k\u00ebrkesave \u00ebsht\u00eb modernizuar. Performanca gjat\u00eb testit TPC-H SF100 \u00ebsht\u00eb rritur me 13%.\n
Nj\u00eb API e re e ngjashme me C \u00ebsht\u00eb propozuar p\u00ebr zhvillimin e shtesave, e cila mund t\u00eb p\u00ebrdoret, p\u00ebr shembull, p\u00ebr krijimin e funksioneve t\u00eb reja agreguese ose tabulare.\n
Mb\u00ebshtetje \u00ebsht\u00eb shtuar p\u00ebr sistemet me bibliotek\u00ebn standarde C Musl. <\/ul>\n