Apache Cloudberry 2.0.0 is the latest release of the distributed DBMS, continuing the development of the open source Greenplum DBMS codebase, which was closed sourced by Broadcom after its acquisition of VMware. Apache Cloudberry 2.0.0 marks the first release of the project after the code was transferred to the Apache community. The project is currently in the Apache Incubator and will be promoted to a primary Apache project once the infrastructure and maintainers are ready.
Cloudberry DBMS is a distributed edition of the open-source PostgreSQL DBMS, optimized for running analytical queries on large data sets (Data Warehouse). For parallel data processing, it uses a massively parallel processing (MPP) architecture, enabling storage scalability to petabytes by dividing data into segments and using a cluster of data for storage and processing. servers.
Improvements in Apache Cloudberry 2.0.0 include:
- The transition to the PostgreSQL 14 code base was completed (Greenplum was based on PostgreSQL 12).
- Added support for dynamic tables, allowing you to automatically update query results. This new feature is useful when you need to work with up-to-date data, such as real-time data analysis, Lakehouse architectures, and automated ETL (Extract, Transform, Load) processors.
- A new hybrid storage format, PAX (Partition Attributes Across), has been implemented, combining the capabilities of row-based and column-based storage. The PAX format allows achieving high performance both under high write load and when executing analytical queries.
- Planning and execution of distributed queries has been significantly optimized.
- Improved resource management: increased efficiency of working with memory and CPU on cluster nodes.
- Improved data distribution across nodes and parallel query processing.
- Expanded backup strategies in distributed environments.
- License information and header formatting of code files have been adjusted to comply with Apache Foundation requirements. Binary artifacts have been removed from source code releases.
- Improved the process of building project components in C++ and Python.
Source: opennet.ru
