{"id":36843,"date":"2019-10-31T22:14:11","date_gmt":"2019-10-31T19:14:11","guid":{"rendered":"https:\/\/prohoster.info\/blog\/otkryt-kod-sql-dvizhka-blazingsql-ispolzuyushhego-gpu-dlya-uskoreniya\/"},"modified":"2019-10-31T22:14:11","modified_gmt":"2019-10-31T19:14:11","slug":"otkryt-kod-sql-dvizhka-blazingsql-ispolzuyushhego-gpu-dlya-uskoreniya","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/news\/otkryt-kod-sql-dvizhka-blazingsql-ispolzuyushhego-gpu-dlya-uskoreniya","title":{"rendered":"The code for the BlazingSQL SQL engine, which uses GPU for acceleration, has been opened.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Announced<\/a><\/noindex> about the release of the SQL engine source code BlazingSQL<\/a><\/noindex>, which uses GPU to accelerate data processing. BlazingSQL is not a full-fledged DBMS, but positions itself as an engine for analyzing and processing large datasets, comparable in its tasks to Apache Spark<\/a><\/noindex>. The code is written in Python and is open<\/a><\/noindex> under the Apache 2.0 license. <\/p>\n

BlazingSQL is suitable for executing single analytical queries over large datasets (tens of gigabytes), stored in tabular formats (e.g., logs, NetFlow statistics, etc.). BlazingSQL can execute queries from raw files in formats such as CSV and Apache Parquet, located in network and cloud file systems like HDFS and AWS S3, directly transferring the results to GPU memory. Thanks to parallel processing on the GPU and the use of faster video memory, query execution in BlazingSQL is done up to 20 times<\/a><\/noindex> faster than in Apache Spark.<\/p>\n

\"The<\/a><\/noindex><\/center><\/p>\n

For working with the GPU, a library set developed with the participation of NVIDIA is used open-source<\/a><\/noindex> called RAPIDS<\/a><\/noindex>, which allows creating applications for data processing and analytics executed entirely on the GPU side (a Python interface<\/a><\/noindex> is provided for using low-level CUDA primitives and parallelizing computations). <\/p>\n

BlazingSQL provides the ability to use SQL instead of the data processing API cuUDF<\/a><\/noindex> (based on Apache Arrow<\/a><\/noindex>), used in RAPIDS. BlazingSQL is an additional layer working over cuDF and uses the cuIO library to read data from disk. SQL queries are translated into cuUDF function calls, allowing data to be loaded into the GPU and operations like merging, aggregating, and filtering to be performed. Support for creating distributed configurations covering thousands of GPUs is included. <\/p>\n

BlazingSQL significantly simplifies data management\u2014rather than making hundreds of cuDF function calls, you can achieve this with a single SQL query. The use of SQL allows for the integration of RAPIDS with existing analytics systems, without the need for writing specific handlers or resorting to intermediate data loading into an additional database, but
\nmaintaining full compatibility with all components of RAPIDS, translating existing functionality into SQL and providing performance on the level of cuDF. This includes support for integration with libraries XGBoost<\/a><\/noindex> and cuML<\/a><\/noindex> for solving analytics and machine learning tasks. <\/p>\n

<\/a><\/noindex><\/p>\n

Source: opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041e\u0431\u044a\u044f\u0432\u043b\u0435\u043d\u043e \u043e\u0431 \u043e\u0442\u043a\u0440\u044b\u0442\u0438\u0438 \u0438\u0441\u0445\u043e\u0434\u043d\u044b\u0445 \u0442\u0435\u043a\u0441\u0442\u043e\u0432 SQL-\u0434\u0432\u0438\u0436\u043a\u0430 BlazingSQL, \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0449\u0435\u0433\u043e GPU \u0434\u043b\u044f \u0443\u0441\u043a\u043e\u0440\u0435\u043d\u0438\u044f \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0434\u0430\u043d\u043d\u044b\u0445. BlazingSQL \u043d\u0435 \u044f\u0432\u043b\u044f\u0435\u0442\u0441\u044f \u043f\u043e\u043b\u043d\u043e\u0446\u0435\u043d\u043d\u043e\u0439 \u0421\u0423\u0411\u0414, \u0430 \u043f\u043e\u0437\u0438\u0446\u0438\u043e\u043d\u0438\u0440\u0443\u0435\u0442\u0441\u044f \u043a\u0430\u043a \u0434\u0432\u0438\u0436\u043e\u043a \u0434\u043b\u044f \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u0438 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0438 \u0431\u043e\u043b\u044c\u0448\u0438\u0445 \u043d\u0430\u0431\u043e\u0440\u043e\u0432 \u0434\u0430\u043d\u043d\u044b\u0445, \u0441\u0440\u0430\u0432\u043d\u0438\u043c\u044b\u0439 \u043f\u043e \u0441\u0432\u043e\u0438\u043c \u0437\u0430\u0434\u0430\u0447\u0430\u043c \u0441 Apache Spark. \u041a\u043e\u0434 \u043d\u0430\u043f\u0438\u0441\u0430\u043d \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Python \u0438 \u043e\u0442\u043a\u0440\u044b\u0442 \u043f\u043e\u0434 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 Apache 2.0. BlazingSQL \u043f\u043e\u0434\u0445\u043e\u0434\u0438\u0442 \u0434\u043b\u044f \u0432\u044b\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0435\u0434\u0438\u043d\u0438\u0447\u043d\u044b\u0445 \u0430\u043d\u0430\u043b\u0438\u0442\u0438\u0447\u0435\u0441\u043a\u0438\u0445 \u0437\u0430\u043f\u0440\u043e\u0441\u043e\u0432 \u043d\u0430\u0434 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":27603,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-36843","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47The source code of the SQL engine BlazingSQL, which uses GPU for acceleration, is now open | ProHoster","description":"The announcement has been made about the release of the SQL engine source code","canonical_url":"https:\/\/prohoster.info\/en\/blog\/news\/otkryt-kod-sql-dvizhka-blazingsql-ispolzuyushhego-gpu-dlya-uskoreniya","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u0442\u043a\u0440\u044b\u0442 \u043a\u043e\u0434 SQL-\u0434\u0432\u0438\u0436\u043a\u0430 BlazingSQL, \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0449\u0435\u0433\u043e GPU \u0434\u043b\u044f \u0443\u0441\u043a\u043e\u0440\u0435\u043d\u0438\u044f | ProHoster","og:description":"\u041e\u0431\u044a\u044f\u0432\u043b\u0435\u043d\u043e \u043e\u0431 \u043e\u0442\u043a\u0440\u044b\u0442\u0438\u0438 \u0438\u0441\u0445\u043e\u0434\u043d\u044b\u0445 \u0442\u0435\u043a\u0441\u0442\u043e\u0432 SQL-\u0434\u0432\u0438\u0436\u043a\u0430","og:url":"https:\/\/prohoster.info\/en\/blog\/news\/otkryt-kod-sql-dvizhka-blazingsql-ispolzuyushhego-gpu-dlya-uskoreniya","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:14:11+00:00","article:modified_time":"2019-10-31T19:14:11+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"36843","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-22 05:02:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:37:23","updated":"2026-01-22 05:02:19","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/36843","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=36843"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/36843\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media\/27603"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=36843"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=36843"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=36843"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}