{"id":113018,"date":"2024-01-20T23:28:04","date_gmt":"2024-01-20T21:28:06","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu"},"modified":"2024-01-20T23:28:04","modified_gmt":"2024-01-20T21:28:06","slug":"opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/novosti-interneta\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","title":{"rendered":"P\u00ebrvoja e krijimit t\u00eb nj\u00eb depo Ceph me bandwidth t\u00eb tebibit n\u00eb sekond\u00eb","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Inxhinieri nga kompania Clyso p\u00ebrmbledh p\u00ebrvoj\u00ebn e krijimit t\u00eb nj\u00eb grupi ruajtjeje mbi nj\u00eb sistem t\u00eb shp\u00ebrndar\u00eb t\u00eb besuesh\u00ebm Ceph me kapacitet q\u00eb kalon tebibyte n\u00eb sekond\u00eb. V\u00ebren se kjo \u00ebsht\u00eb klusteri i par\u00eb mbi Ceph q\u00eb arriti nj\u00eb tregues t\u00eb till\u00eb, por p\u00ebr t\u00eb arritur rezultatin e paraqitur, inxhinier\u00ebt duhej t\u00eb kalonin nj\u00eb seri pengesash t\u00eb natyrshme. <\/p>\n

P\u00ebr shembull, p\u00ebr t\u00eb rritur performanc\u00ebn me 10-20%, mjaftonte t\u00eb aktivizohej n\u00eb server\u00ebt me cil\u00ebsimet e energjis\u00eb n\u00eb BIOS m\u00ebnyra e maksimumit t\u00eb performanc\u00ebs dhe t\u00eb \u00e7aktivizohej c-state (c-state ndryshon parametrat e kursimit t\u00eb energjis\u00eb n\u00eb var\u00ebsi t\u00eb ngarkes\u00ebs, e cila ndikon n\u00eb Ceph). Po ashtu, doli se gjat\u00eb p\u00ebrdorimit t\u00eb disqeve NVMe, b\u00ebrthama e Linux-it kalonte nj\u00eb koh\u00eb t\u00eb konsiderueshme n\u00eb p\u00ebrpunimin e spin-locks gjat\u00eb rinovimit t\u00eb mapimit IOMMU. \u00c7aktivizimi i IOMMU n\u00eb b\u00ebrtham\u00eb \u00e7oi n\u00eb nj\u00eb rritje t\u00eb dukshme t\u00eb performanc\u00ebs n\u00eb testet e shkruarjes dhe leximeve t\u00eb blloqeve me p\u00ebrmas\u00eb 4MB. <\/p>\n

Megjithat\u00eb, \u00e7aktivizimi i IOMMU nuk zgjidhi problemin e r\u00ebnies s\u00eb performanc\u00ebs gjat\u00eb shkarkimeve t\u00eb rastit t\u00eb bllokut prej 4KB. Duke hetuar se \u00e7far\u00eb ndodhte, inxhinier\u00ebt u p\u00ebrball\u00ebn me riparime n\u00eb skenar\u00ebt e nd\u00ebrtimit t\u00eb Ceph nga projektet Gentoo dhe Ubuntu, t\u00eb cilat p\u00ebrfshinin nd\u00ebrtimin me opsionin RelWithDebInfo, pasi me t\u00eb n\u00eb GCC aplikohej moda e optimizimit \u201c-O2\u201d, e cila rritte ndjesh\u00ebm performanc\u00ebn e Ceph. R\u00ebnia e performanc\u00ebs gjithashtu u shkaktua nga kompilimi me bibliotek\u00ebn TCMalloc. Ndryshimi i flamujve t\u00eb kompilimit dhe ndalimi i p\u00ebrdorimit t\u00eb TCMalloc \u00e7oi n\u00eb nj\u00eb ulje t\u00eb koh\u00ebs s\u00eb paketimit (compaction) me tre her\u00eb dhe rritje t\u00eb performanc\u00ebs s\u00eb operacioneve t\u00eb rastit t\u00eb shkarkimeve me blloqe 4K me dy her\u00eb. N\u00eb fund, gjithashtu u optimizuan vendosjet e Reef RocksDB dhe grupet e vendosjes (PG). <\/p>\n

Grupi \u00ebsht\u00eb formuar nga 68 nyje mbi servera<\/a> Dell PowerEdge R6615 me CPU AMD EPYC 9454P 48C\/96T. \u00c7do nyje p\u00ebrmban 10 disqe NVMe Dell 15.36TB, dy adaptues Ethernet 100GbE Mellanox ConnectX-6 dhe 192 GB RAM. Programi baz\u00eb \u00ebsht\u00eb i nd\u00ebrtuar mbi Ubuntu 20.04.6 dhe Ceph 17.2.7. N\u00eb grupin me 63 nyje jan\u00eb ngritur 630 OSD (Oobje Kumbimi, procesi i prapamsht\u00ebsis\u00eb q\u00eb menaxhon ruajtjen e t\u00eb dh\u00ebnave n\u00eb ruajtjen lokale, nj\u00eb OSD p\u00ebr \u00e7do NVMe), tre procese MON (monitorojn\u00eb statusin e grupit) dhe nj\u00eb proces MGR (Menaxher, sh\u00ebrbimi menaxhues). Madh\u00ebsia e ruajtjes \u00ebsht\u00eb 8.2 PB. <\/p>\n

Kapaciteti gjat\u00eb operacioneve sekondare t\u00eb leximit t\u00eb blloqeve 4M arriti 1025 GiB\/s, nd\u00ebrsa shkarkimi \u2014 270 GiB\/s. Gjat\u00eb leximit t\u00eb rastit t\u00eb blloqeve 4KB, performanca arriti 25.5 milion operacione leximi n\u00eb sekond\u00eb dhe 4.9 milion n\u00eb shkarkim. Aktivizimi i enkriptimit e ulte kapacitetin gjat\u00eb leximit n\u00eb rreth 750 GiB\/s. Kur u aktivizuan kodet e korrigjimit t\u00eb gabimeve EC62, kapaciteti ishte 547 GiB\/s gjat\u00eb leximit dhe 387 GiB\/s gjat\u00eb shkarkimit (shpejt\u00ebsia e shkarkimit u tregua m\u00eb e lart\u00eb se pa kodet e korrigjimit), nd\u00ebrsa gjat\u00eb aksesit t\u00eb rastit 3.4M IOPS gjat\u00eb leximit dhe 936K IOPS gjat\u00eb shkarkimit.

\"P\u00ebrvoja<\/center>
\"P\u00ebrvoja<\/center> <\/p>\n

Mund t\u00eb v\u00ebrehet gjithashtu se n\u00eb shtator, nj\u00eb arritje e ngjashme e kapacitetit n\u00eb tebibyte n\u00eb sekond\u00eb u arrit n\u00eb grupin e ruajtjes s\u00eb CERN t\u00eb exabytes, i realizuar mbi hap\u00ebsir\u00ebn e shp\u00ebrndar\u00eb t\u00eb hapur EOS, t\u00eb nd\u00ebrtuar mbi protokollin XRootD.
\n
Burimi: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0418\u043d\u0436\u0435\u043d\u0435\u0440 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Clyso \u043e\u0431\u043e\u0431\u0449\u0438\u043b \u043e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043d\u0430 \u0431\u0430\u0437\u0435 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b Ceph \u0441 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e, \u043f\u0440\u0435\u0432\u044b\u0448\u0430\u044e\u0449\u0435\u0439 \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443. \u041e\u0442\u043c\u0435\u0447\u0430\u0435\u0442\u0441\u044f, \u0447\u0442\u043e \u044d\u0442\u043e \u043f\u0435\u0440\u0432\u044b\u0439 \u043a\u043b\u0430\u0441\u0442\u0435\u0440 \u043d\u0430 \u0431\u0430\u0437\u0435 Ceph, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u0441\u043c\u043e\u0433 \u0434\u043e\u0441\u0442\u0438\u0433\u043d\u0443\u0442\u044c \u043f\u043e\u0434\u043e\u0431\u043d\u043e\u0433\u043e \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f, \u043d\u043e \u043f\u0435\u0440\u0435\u0434 \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u043e\u0433\u043e \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0430 \u0438\u043d\u0436\u0435\u043d\u0435\u0440\u0430\u043c \u043f\u043e\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043b\u043e\u0441\u044c \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0442\u044c \u0441\u0435\u0440\u0438\u044e \u043d\u0435 \u043e\u0447\u0435\u0432\u0438\u0434\u043d\u044b\u0445 \u043f\u043e\u0434\u0432\u043e\u0434\u043d\u044b\u0445 \u043a\u0430\u043c\u043d\u0435\u0439. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440, \u0434\u043b\u044f \u043f\u043e\u0432\u044b\u0448\u0435\u043d\u0438\u044f \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u043d\u0430 10-20% \u0431\u044b\u043b\u043e […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":113019,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-113018","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-novosti-interneta"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47P\u00ebrvoja e krijimit t\u00eb ruajtjes Ceph me kapacitet tebibyte n\u00eb sekond\u00eb | ProHoster","description":"Inxhinieri nga kompania Clyso p\u00ebrmbledh p\u00ebrvoj\u00ebn e krijimit t\u00eb nj\u00eb grupi ruajtjeje mbi nj\u00eb sistem t\u00eb shp\u00ebrndar\u00eb t\u00eb besuesh\u00ebm Ceph me kapacitet q\u00eb kalon tebibyte n\u00eb sekond\u00eb. V\u00ebren se kjo \u00ebsht\u00eb klusteri i par\u00eb mbi Ceph q\u00eb arriti nj\u00eb tregues t\u00eb till\u00eb, por p\u00ebr t\u00eb arritur rezultatin e paraqitur, inxhinier\u00ebt duhej t\u00eb kalonin nj\u00eb seri pengesash t\u00eb natyrshme. P\u00ebr shembull, p\u00ebr t\u00eb rritur performanc\u00ebn me 10-20% ishte","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/novosti-interneta\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 Ceph c \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443 | ProHoster","og:description":"\u0418\u043d\u0436\u0435\u043d\u0435\u0440 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Clyso \u043e\u0431\u043e\u0431\u0449\u0438\u043b \u043e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043d\u0430 \u0431\u0430\u0437\u0435 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b Ceph \u0441 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e, \u043f\u0440\u0435\u0432\u044b\u0448\u0430\u044e\u0449\u0435\u0439 \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443. \u041e\u0442\u043c\u0435\u0447\u0430\u0435\u0442\u0441\u044f, \u0447\u0442\u043e \u044d\u0442\u043e \u043f\u0435\u0440\u0432\u044b\u0439 \u043a\u043b\u0430\u0441\u0442\u0435\u0440 \u043d\u0430 \u0431\u0430\u0437\u0435 Ceph, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u0441\u043c\u043e\u0433 \u0434\u043e\u0441\u0442\u0438\u0433\u043d\u0443\u0442\u044c \u043f\u043e\u0434\u043e\u0431\u043d\u043e\u0433\u043e \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f, \u043d\u043e \u043f\u0435\u0440\u0435\u0434 \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u043e\u0433\u043e \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0430 \u0438\u043d\u0436\u0435\u043d\u0435\u0440\u0430\u043c \u043f\u043e\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043b\u043e\u0441\u044c \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0442\u044c \u0441\u0435\u0440\u0438\u044e \u043d\u0435 \u043e\u0447\u0435\u0432\u0438\u0434\u043d\u044b\u0445 \u043f\u043e\u0434\u0432\u043e\u0434\u043d\u044b\u0445 \u043a\u0430\u043c\u043d\u0435\u0439. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440, \u0434\u043b\u044f \u043f\u043e\u0432\u044b\u0448\u0435\u043d\u0438\u044f \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u043d\u0430 10-20% \u0431\u044b\u043b\u043e","og:url":"https:\/\/prohoster.info\/sq\/blog\/novosti-interneta\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-01-20T21:28:06+00:00","article:modified_time":"2024-01-20T21:28:06+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"113018","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-02-09 16:50:41","updated":"2026-02-09 16:50:41","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/113018","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=113018"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/113018\/revisions"}],"predecessor-version":[{"id":158784,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/113018\/revisions\/158784"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media\/113019"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=113018"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=113018"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=113018"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}