Today, for most companies and organizations, data is one of the strategic assets. And with the expansion of analytics capabilities, the value of data collected and accumulated by companies is constantly increasing. At the same time, there is often talk of an explosive, exponential growth in the volume of generated corporate data. It is noted that 90% of all data was created in the last two years.
The growth of data volumes is accompanied by an increase in their value
Data is created and used by big data analytics systems, the Internet of Things (IoT), artificial intelligence, etc. The collected data is the basis for improving the quality of customer service, decision-making, supporting the operations of companies, for various research and development.
90% of all data was created in the last two years.
IDC predicts that global data storage will double between 2018 and 2023, with total data storage capacity reaching 11,7 zettabytes, with enterprise databases accounting for more than three-quarters of the total. It is characteristic that if back in 2018 the total capacity of supplied hard disk drives (HDD), which so far remain the main storage medium, amounted to 869 exabytes, then by 2023 this figure may exceed 2,6 zettabytes.
Data management platforms: what are they for and what role do they play?
Not surprisingly, data management issues are becoming a priority for enterprises, having a direct impact on their work. To solve them, it is sometimes necessary to overcome such difficulties as the heterogeneity of systems, data formats, methods of their storage and use, approaches to management in a βzooβ of solutions that were introduced at different times.
The result of such a non-unified approach is the fragmentation of data arrays stored and processed in different systems, different procedures for ensuring data quality. These typical problems increase the labor and financial costs when working with data, for example, when obtaining statistics and reports, or when making management decisions.
The data management business model should be customized, adapted to the needs, objectives and goals of the enterprise. There is no single automated system, data management platform that would close all tasks. However, today's comprehensive, flexible and scalable data management systems are often generic data management and storage software. They include the necessary tools and services for effective data management.
The latest developments allow businesses to rethink how data is managed across the organization, gaining a clear understanding of what data is available, what policies are associated with it, where and for how long the data is stored, and finally, they enable the right information to be delivered to the right people in a timely manner. These are solutions that expand the capabilities of enterprises and allow:
- Manage files, objects, application data, databases, virtual and cloud data, access data of different types.
- With the help of orchestration and automation tools, move data to where it is most efficiently stored - to the primary, secondary storage infrastructure, to the provider's data center or to the cloud.
- Use comprehensive data protection features.
- Provide data integration.
- Get real-time analytics from your data.
The data management platform can be built on the basis of several software products or be a single unified system. The end-to-end platform provides unified data management across the entire IT infrastructure, including data backup, recovery, archiving, hardware snapshot management, and reporting.
This platform allows you to implement a multi-cloud strategy, expand your data center to the cloud, quickly migrate to the cloud, take advantage of hardware replacement options, and implement the most cost-effective storage options.
Some solutions are capable of automatically archiving data. And with the help of artificial intelligence, they can detect that βsomething went wrongβ and automatically take corrective action or notify the administrator, as well as identify and stop various types of attacks. Service automation helps streamline IT operations, freeing up IT staff, minimizing human error, and minimizing downtime.
What qualities should a modern data management platform have, and where are such solutions applied in practice?
The βone solution for allβ approach does not work for data management platforms. Each company has its own requirements for data, they depend on the type of business, work experience, etc. A universal platform should, on the one hand, provide settings for working with data in a particular enterprise, and on the other hand, be independent of the specifics of the applied industry, scope the product built on its basis and its information environment.
Practical areas of data management (source; CMMI Institute).
Here are some practical applications for data management platforms:
Component
Application area
Data management strategy
Goals and objectives of management, corporate culture of data management, definition of requirements for the data life cycle.
Data management
Data and metadata management
Data operations
Standards and procedures for working with data sources
Data quality
Quality assurance, data quality framework
Platform and architecture
Architectural framework, platforms and integration
Supporting processes
Assessment and Analysis, Process Management, Quality Assurance, Risk Management, Configuration Management
In addition, such platforms play an important role in the process of transforming an organization into a βdata-driven enterpriseβ, which can be divided into several stages:
- Changing data management in existing systems, introducing a role model with separation of duties and powers. Data quality control, cross-checking of data between systems, correction of invalid data.
- Setting up processes for extracting and collecting data, their transformation and loading. Bringing data to a single system without complicating data quality control and changing business processes.
- Data integration. Automate the process of delivering the right data to the right place at the right time.
- Introduction of full-fledged data quality control. Determination of quality control parameters, development of a methodology for the use of automatic systems.
- Implementation of tools for managing data collection processes, their verification, deduplication and cleaning. As a result, there is an increase in the quality, reliability and unification of data from all enterprise systems.
Benefits of Data Management Platforms
Companies that work effectively with data tend to be more successful than competitors, bring products and services to market faster, better understand the needs of the target audience, and can quickly respond to changes in demand. Data management platforms provide the ability to βcleanseβ data, obtain high-quality and relevant information, transform data, and strategically evaluate enterprise data.
An example of a universal platform for building corporate data management systems is the Russian Unidata, created on the basis of open source software. It offers tools for creating a data model and tools for expanding functionality when integrating into various IT environments and third-party information systems: from maintaining inventory to secure processing of large amounts of personal data.
The architecture of the Unidata platform of the company of the same name.
This multifunctional platform provides centralized data collection (inventory and resource accounting), information standardization (normalization and enrichment), current and historical information accounting (record version control, data validity periods), data quality and statistics. Automation of such tasks as collection, accumulation, cleaning, comparison, consolidation, quality control, data dissemination, as well as tools for automating the decision-making system is provided.
Data Management Platforms (DPM) in Advertising and Marketing
In advertising and marketing, the concept of a DMP (Data Management Platform) has a narrower meaning. It is a software platform that, based on the data it collects, allows companies to define audience segments to target ads to specific users and the context of online advertising campaigns. Such software is able to collect, process and store any type of classroom data, and also has the ability to use them through the usual media channels.
According to Market Research Future (MRFR), the global data management platform (DMP) market could reach $2023 billion by the end of 3 with an average annual growth of 15%, and in 2025 its volume will exceed $3,5 billion.
DMP system:
- Makes it possible to collect and structure all types of classroom data; analyze available data; transfer data to any media space for targeted advertising.
- Helps to collect, organize and activate data from various sources and translate it into a useful form.
- Organizes all data into categories based on business goals and marketing models. The system analyzes the data and generates audience segments that accurately represent the customer base across a wide range of channels based on various common characteristics.
- Allows you to increase the accuracy of online advertising targeting and build personalized communications with a relevant audience. Based on DMP, you can also set up communication chains with each target segment so that users receive relevant messages at the right time and in the right place.
The increase in the share of digital marketing is largely affecting the growth of the data management platform market. DMP systems can quickly unify data from multiple sources and categorize users based on their behavior patterns. Such opportunities contribute to the demand for DMP among marketers.
The global data management platform market is represented by a number of leading players as well as several emerging companies, including Lotame Solutions, KBM Group, Rocket Fuel, Krux Digital), Oracle, Neustar, SAS Institute, SAP, Adobe Systems, Cloudera, Turn, Informatica and others
An example of a Russian solution is an infrastructure product released by Mail.ru Group, which is a single data management and processing platform (Data Management Platform, DMP). The solution allows you to build an extended description of the profile of audience segments within a platform integrated with marketing tools. DMP combines Mail.ru Group solutions and services in the field of omnichannel marketing and work with the audience. Clients will be able to store, process and structure their own depersonalized data, as well as activate it in advertising communications, increasing the efficiency of business and marketing.
Cloud data management
Another category of data management solutions is cloud platforms. In particular, the use of a modern data protection solution as part of cloud data management helps to avoid possible problems - from security threats to data migration problems and performance degradation, as well as solve the digital transformation challenges facing the company. Of course, the functions of such systems are not limited to data protection.
Features of the cloud data management platform in the Gartner view: resource allocation, automation and orchestration; service request management; high-level management and policy enforcement; monitoring and measurement of parameters; support for multi-cloud environments; cost optimization and transparency; optimization of capacities and resources; cloud migration and disaster recovery (DR); service level management; security and identification; configuration update automation.
Data management in a cloud environment should provide a high level of data availability, control, automation of data management in data centers, along the network perimeter and in the cloud.
Cloud Data Management (CDM) is a platform that is used to manage enterprise data in various cloud environments, taking into account private, public, hybrid and multi-cloud approaches.
An example of such a solution is the Veeam Cloud Data Management Platform. According to the developers of the system, it helps organizations change the approach to data management, provides intelligent automated data management and its availability in any application or cloud infrastructure.
Veeam sees cloud data management as an integral part of intelligent data management, ensuring that data is available to businesses from anywhere.
Veeam Cloud Data Management Platform enables you to modernize your backups and retire legacy systems, accelerate hybrid cloud adoption and data migration, and automate data security and compliance.
Veeam Cloud Data Management Platform is βa modern data management platform that supports any cloud.β
As you can see, modern data management platforms represent a fairly extensive and diverse class of solutions. Perhaps one thing unites them: the focus on effective work with corporate data and the transformation of a company or organization into a modern data-driven enterprise.
Data management platforms are a necessary evolution of traditional data management. With more organizations moving data to the cloud, a growing number of different on-premises and cloud configurations are creating new challenges that need to be addressed specifically from a data management perspective. Cloud data management is an updated approach, a new paradigm that expands data management to support new platforms, applications, and use cases.
In addition, according to the 2019 Veeam Cloud Data Management Report, companies plan to further integrate cloud, hybrid cloud, big data analytics, artificial intelligence, and the Internet of Things. The implementation of these digital initiatives is expected to bring significant benefits to companies.
Businesses are accelerating their adoption of data platform technologies and are poised to leverage the cloud to run analytics workloads, but many face challenges trying to leverage all of their data to drive better business results, according to analysts at 451 Research. The latest data management platforms will help enterprises navigate complex data workflows across multiple clouds, use data management tools, and perform data analysis no matter where the data resides.
Since we are trying to keep up with the times and focus on the wishes of our customers (both current and potential), we want to ask the habra community if you would like to see Veeam in our ? You can answer in the poll below.
Only registered users can participate in the survey. , you are welcome.
Package offer with Veeam in the marketplace
-
Present in several = 62,5%Yes, good idea
-
Present in several = 37,5%I don't think it will take off
8 users voted. 4 users abstained.
Source: habr.com