Amazon announced the acquisition of DuckLabs, the developer of the open-source database management system DuckDB. The acquisition was completed on August 31st, and the transaction amount was not disclosed. The DuckDB development team will join AWS and continue to develop DuckDB technologies under the leadership of DuckLabs' co-founders.
DuckDB's developments are planned to be used to modernize, simplify, and improve the efficiency of the analytics stack offered on the AWS platform. Amazon S3 is intended to be transformed into a storage service with built-in data analytics capabilities. DuckDB's codebase will continue to be developed as an open-source project, distributed under the MIT license and curated by the non-profit DuckDB Foundation. Joining AWS will expand DuckDB's user base and provide additional resources for implementing new scaling ideas.
The DuckDB DBMS is conceptually similar to SQLite and combines features such as compactness, embeddable library support, single-file database storage, and a CLI interface, with capabilities and optimizations for running analytical queries that cover a significant portion of stored data, such as aggregating the entire contents of tables or merging several large tables. The DBMS supports an extended dialect of the SQL language, including additional capabilities for processing complex, long-running, and nested queries.
The project uses a shell from SQLite, a parser from PostgreSQL, a Date Math component from MonetDB, its own implementation of window functions (based on the Segment Tree Aggregation algorithm), a regular expression processor based on the RE2 library, its own query optimizer, a MVCC mechanism for managing the simultaneous execution of tasks (Multi-Version Concurrency Control), and a vectorized query execution engine based on the Hyper-Pipelining Query Execution algorithm, which allows large sets of values to be processed in one operation.
Source: opennet.ru
