{"id":113018,"date":"2024-01-20T23:28:04","date_gmt":"2024-01-20T21:28:06","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu"},"modified":"2024-01-20T23:28:04","modified_gmt":"2024-01-20T21:28:06","slug":"opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","status":"publish","type":"post","link":"https:\/\/prohoster.info\/sq\/blog\/news\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","title":{"rendered":"P\u00ebrvoja e krijimit t\u00eb nj\u00eb ruajtjeje Ceph me kapacitet transmetimi nj\u00eb tebibajt n\u00eb sekond\u00eb","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Nj\u00eb inxhinier nga kompania Clyso p\u00ebrmblodhi p\u00ebrvoj\u00ebn e krijimit t\u00eb nj\u00eb klasteri ruajtjeje t\u00eb bazuar n\u00eb sistemin e shp\u00ebrndar\u00eb dhe rezistent ndaj d\u00ebshtimeve Ceph, me gjer\u00ebsi bande q\u00eb tejkalon nj\u00eb tebibajt n\u00eb sekond\u00eb. Theksohet se ky \u00ebsht\u00eb klasteri i par\u00eb i bazuar n\u00eb Ceph q\u00eb ka arritur nj\u00eb tregues t\u00eb till\u00eb, por p\u00ebr t\u00eb marr\u00eb rezultatin e paraqitur, inxhinier\u00ebve iu desh t\u00eb kap\u00ebrcenin nj\u00eb s\u00ebr\u00eb v\u00ebshtir\u00ebsish jo aq t\u00eb dukshme. <\/p>\n

P\u00ebr shembull, p\u00ebr t\u00eb rritur performanc\u00ebn me 10-20%, mjaftoi q\u00eb n\u00eb server\u00eb t\u00eb aktivizohej n\u00eb cil\u00ebsimet e kursimit t\u00eb energjis\u00eb t\u00eb BIOS vet\u00ebm modaliteti i performanc\u00ebs maksimale dhe t\u00eb \u00e7aktivizohej c-state (c-state ndryshon parametrat e kursimit t\u00eb energjis\u00eb n\u00eb var\u00ebsi t\u00eb ngarkes\u00ebs, gj\u00eb q\u00eb ndikon te Ceph). Gjithashtu doli se, gjat\u00eb p\u00ebrdorimit t\u00eb disqeve NVMe, kerneli Linux shpenzon shum\u00eb koh\u00eb n\u00eb p\u00ebrpunimin e spin-lock gjat\u00eb p\u00ebrdit\u00ebsimit t\u00eb hart\u00ebzimit IOMMU. \u00c7aktivizimi i IOMMU n\u00eb kernel \u00e7oi n\u00eb nj\u00eb rritje t\u00eb dukshme t\u00eb performanc\u00ebs n\u00eb testet e shkrimit dhe leximit t\u00eb blloqeve me madh\u00ebsi 4MB. <\/p>\n

Megjithat\u00eb, \u00e7aktivizimi i IOMMU nuk e zgjidhi problemin me r\u00ebnien e performanc\u00ebs gjat\u00eb shkrimeve rast\u00ebsore t\u00eb blloqeve me madh\u00ebsi 4KB. Duke u thelluar n\u00eb \u00e7\u00ebshtjen, inxhinier\u00ebt u ndesh\u00ebn me rregullimet n\u00eb skenaret e nd\u00ebrtimit t\u00eb Ceph nga projektet Gentoo dhe Ubuntu, t\u00eb cilat p\u00ebrfshinin nd\u00ebrtimin me opsionin RelWithDebInfo, pasi me t\u00eb n\u00eb GCC aplikohej regjimi i optimizimit '-O2', q\u00eb ndihmonte n\u00eb rritjen e performanc\u00ebs s\u00eb Ceph. Po ashtu, kompilimi me bibliotek\u00ebn TCMalloc \u00e7onte n\u00eb uljen e performanc\u00ebs. Ndryshimi i flamujve t\u00eb kompilimit dhe ndalimi i p\u00ebrdorimit t\u00eb TCMalloc \u00e7oi n\u00eb uljen e koh\u00ebs s\u00eb paketimit (compaction) deri n\u00eb tre her\u00eb dhe dyfishimin e performanc\u00ebs s\u00eb operacioneve t\u00eb shkrimit rast\u00ebsor me blloqe 4K. N\u00eb fund, u b\u00eb nj\u00eb optimizim shtes\u00eb i konfigurimeve t\u00eb Reef RocksDB dhe grupeve t\u00eb vendosjes (PG). <\/p>\n

Klasteri \u00ebsht\u00eb formuar nga 68 nyje t\u00eb bazuara n\u00eb server\u00ebsh<\/a> Dell PowerEdge R6615 me CPU AMD EPYC 9454P 48C\/96T. \u00c7do nyje p\u00ebrmban 10 disqe NVMe Dell 15.36TB, dy adaptor\u00eb Ethernet 100GbE Mellanox ConnectX-6 dhe 192 GB RAM. Softueri bazohet n\u00eb Ubuntu 20.04.6 dhe Ceph 17.2.7. N\u00eb klaster, n\u00eb 63 nyje jan\u00eb ngritur 630 OSD (Object Storage Daemon, proces n\u00eb sfond q\u00eb menaxhon ruajtjen e t\u00eb dh\u00ebnave n\u00eb hap\u00ebsir\u00ebn lokale, nga nj\u00eb OSD p\u00ebr \u00e7do disk NVMe), tre procese MON (monitor, q\u00eb ndjek gjendjen e klasterit) dhe nj\u00eb proces MGR (Manager, sh\u00ebrbim menaxhues). Madh\u00ebsia e ruajtjes \u00ebsht\u00eb 8.2 PB. <\/p>\n

Banda e transmetimit gjat\u00eb operacioneve sekondare t\u00eb leximit t\u00eb blloqeve 4M arriti 1025 GiB\/s, nd\u00ebrsa shkrimi ishte 270 GiB\/s. Gjat\u00eb leximit rast\u00ebsor t\u00eb blloqeve 4KB, performanca ishte 25.5 milion operacione leximi p\u00ebr sekond\u00eb dhe 4.9 milion gjat\u00eb shkrimit. Aktivizimi i enkriptimit ulte band\u00ebn e transmetimit gjat\u00eb leximit deri n\u00eb rreth 750 GiB\/s. Me angazhimin e kodit t\u00eb korrigjimit t\u00eb gabimeve EC62, banda e transmetimit arriti 547 GiB\/s gjat\u00eb leximit dhe 387 GiB\/s gjat\u00eb shkrimit (shkalla e shkrimit ishte m\u00eb e lart\u00eb sesa pa kodet e korrigjimit), dhe gjat\u00eb qasjes rast\u00ebsore 3.4M IOPS gjat\u00eb leximit dhe 936K IOPS gjat\u00eb shkrimit.

\"P\u00ebrvoja<\/center>
\"P\u00ebrvoja<\/center> <\/p>\n

Gjithashtu, vlen t\u00eb theksohet se n\u00eb shtator nj\u00eb prag i ngjash\u00ebm i gjer\u00ebsis\u00eb s\u00eb brezit, n\u00eb nivel tebibajt p\u00ebr sekond\u00eb, u arrit n\u00eb klasterin ekzabajt t\u00eb ruajtjes s\u00eb CERN, i realizuar mbi baz\u00ebn e sistemit t\u00eb hapur t\u00eb ruajtjes s\u00eb shp\u00ebrndar\u00eb EOS, t\u00eb nd\u00ebrtuar mbi protokollin XRootD.
\n
Burimi: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0418\u043d\u0436\u0435\u043d\u0435\u0440 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Clyso \u043e\u0431\u043e\u0431\u0449\u0438\u043b \u043e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043d\u0430 \u0431\u0430\u0437\u0435 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b Ceph \u0441 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e, \u043f\u0440\u0435\u0432\u044b\u0448\u0430\u044e\u0449\u0435\u0439 \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443. \u041e\u0442\u043c\u0435\u0447\u0430\u0435\u0442\u0441\u044f, \u0447\u0442\u043e \u044d\u0442\u043e \u043f\u0435\u0440\u0432\u044b\u0439 \u043a\u043b\u0430\u0441\u0442\u0435\u0440 \u043d\u0430 \u0431\u0430\u0437\u0435 Ceph, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u0441\u043c\u043e\u0433 \u0434\u043e\u0441\u0442\u0438\u0433\u043d\u0443\u0442\u044c \u043f\u043e\u0434\u043e\u0431\u043d\u043e\u0433\u043e \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f, \u043d\u043e \u043f\u0435\u0440\u0435\u0434 \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u043e\u0433\u043e \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0430 \u0438\u043d\u0436\u0435\u043d\u0435\u0440\u0430\u043c \u043f\u043e\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043b\u043e\u0441\u044c \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0442\u044c \u0441\u0435\u0440\u0438\u044e \u043d\u0435 \u043e\u0447\u0435\u0432\u0438\u0434\u043d\u044b\u0445 \u043f\u043e\u0434\u0432\u043e\u0434\u043d\u044b\u0445 \u043a\u0430\u043c\u043d\u0435\u0439. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440, \u0434\u043b\u044f \u043f\u043e\u0432\u044b\u0448\u0435\u043d\u0438\u044f \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u043d\u0430 10-20% \u0431\u044b\u043b\u043e […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":113019,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-113018","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47P\u00ebrvoja e nd\u00ebrtimit t\u00eb nj\u00eb ruajtjeje Ceph me gjer\u00ebsi brezi prej nj\u00eb tebibajt n\u00eb sekond\u00eb | ProHoster","description":"Nj\u00eb inxhinier nga kompania Clyso p\u00ebrmblodhi p\u00ebrvoj\u00ebn e nd\u00ebrtimit t\u00eb nj\u00eb klasteri ruajtjeje t\u00eb bazuar n\u00eb sistemin e shp\u00ebrndar\u00eb dhe rezistent ndaj d\u00ebshtimeve Ceph, me gjer\u00ebsi brezi q\u00eb tejkalon nj\u00eb tebibajt n\u00eb sekond\u00eb.","canonical_url":"https:\/\/prohoster.info\/sq\/blog\/news\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"sq_AL","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 Ceph c \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443 | ProHoster","og:description":"\u0418\u043d\u0436\u0435\u043d\u0435\u0440 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Clyso \u043e\u0431\u043e\u0431\u0449\u0438\u043b \u043e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043d\u0430 \u0431\u0430\u0437\u0435 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b Ceph \u0441 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e, \u043f\u0440\u0435\u0432\u044b\u0448\u0430\u044e\u0449\u0435\u0439 \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443.","og:url":"https:\/\/prohoster.info\/sq\/blog\/news\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-01-20T21:28:06+00:00","article:modified_time":"2024-01-20T21:28:06+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"113018","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-02-09 16:50:41","updated":"2026-02-09 16:50:41","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/113018","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/comments?post=113018"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/113018\/revisions"}],"predecessor-version":[{"id":158784,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/posts\/113018\/revisions\/158784"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media\/113019"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/media?parent=113018"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/categories?post=113018"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/sq\/wp-json\/wp\/v2\/tags?post=113018"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}