{"id":113018,"date":"2024-01-20T23:28:04","date_gmt":"2024-01-20T21:28:06","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu"},"modified":"2024-01-20T23:28:04","modified_gmt":"2024-01-20T21:28:06","slug":"opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hu\/blog\/news\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","title":{"rendered":"Tebib\u00e1jt m\u00e1sodperc sebess\u00e9g\u0171 Ceph t\u00e1rol\u00f3 l\u00e9trehoz\u00e1s\u00e1nak tapasztalata","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

A m\u00e9rn\u00f6k a Clyso c\u00e9gt\u0151l \u00f6sszegzett tapasztalatokat a Ceph alap\u00fa, hibat\u0171r\u0151 elosztott t\u00e1rol\u00f3rendszer klaszter\u00e9nek l\u00e9trehoz\u00e1s\u00e1r\u00f3l, amelynek sebess\u00e9ge meghaladja a tebib\u00e1jtot m\u00e1sodpercenk\u00e9nt. Megjegyzik, hogy ez az els\u0151 Ceph alap\u00fa klaszter, amely el\u00e9rte ezt az eredm\u00e9nyt, de a bemutatott eredm\u00e9ny el\u00e9r\u00e9se el\u0151tt a m\u00e9rn\u00f6k\u00f6knek sz\u00e1mos nem nyilv\u00e1nval\u00f3 neh\u00e9zs\u00e9get kellett lek\u00fczdeni\u00fck. <\/p>\n

P\u00e9ld\u00e1ul a teljes\u00edtm\u00e9ny 10-20%-os n\u00f6vel\u00e9s\u00e9hez elegend\u0151 volt a BIOS energiatakar\u00e9kos be\u00e1ll\u00edt\u00e1saiban a maxim\u00e1lis teljes\u00edtm\u00e9ny \u00fczemm\u00f3d aktiv\u00e1l\u00e1sa \u00e9s a c-state letilt\u00e1sa (a c-state a terhel\u00e9st\u0151l f\u00fcgg\u0151en m\u00f3dos\u00edtja az energiatakar\u00e9kos be\u00e1ll\u00edt\u00e1sokat, ami hat\u00e1ssal van a Ceph-re). Azt is felfedezt\u00e9k, hogy NVMe t\u00e1rol\u00f3k haszn\u00e1lata eset\u00e9n a Linux kernel jelent\u0151s id\u0151t t\u00f6lt spin-lockok feldolgoz\u00e1s\u00e1val az IOMMU t\u00e9rk\u00e9pez\u00e9s\u00e9nek friss\u00edt\u00e9se k\u00f6zben. Az IOMMU letilt\u00e1sa a kernelben \u00e9rz\u00e9kelhet\u0151en n\u00f6velte a blokkok 4MB \u00edr\u00e1si \u00e9s olvas\u00e1si tesztjeinek teljes\u00edtm\u00e9ny\u00e9t. <\/p>\n

A IOMMU letilt\u00e1sa nem oldotta meg a 4KB-os blokkok v\u00e9letlenszer\u0171 \u00edr\u00e1sakor jelentkez\u0151 teljes\u00edtm\u00e9nycs\u00f6kken\u00e9st. A m\u00e9rn\u00f6k\u00f6k, mik\u00f6zben pr\u00f3b\u00e1lt\u00e1k kider\u00edteni az okokat, a Gentoo \u00e9s az Ubuntu Ceph build szkriptjeiben tal\u00e1lkoztak jav\u00edt\u00e1sokkal, amelyek a RelWithDebInfo opci\u00f3val val\u00f3 buildel\u00e9st tartalmazt\u00e1k, mivel ezzel a GCC az «-O2» optimaliz\u00e1ci\u00f3s m\u00f3dot alkalmazta, amely jelent\u0151sen n\u00f6velte a Ceph teljes\u00edtm\u00e9ny\u00e9t. A TCMalloc k\u00f6nyvt\u00e1rral val\u00f3 ford\u00edt\u00e1s szint\u00e9n hozz\u00e1j\u00e1rult a teljes\u00edtm\u00e9ny cs\u00f6kken\u00e9s\u00e9hez. A ford\u00edt\u00e1si z\u00e1szl\u00f3k m\u00f3dos\u00edt\u00e1sa \u00e9s a TCMalloc haszn\u00e1lat\u00e1nak le\u00e1ll\u00edt\u00e1sa a t\u00f6m\u00f6r\u00edt\u00e9si id\u0151 h\u00e1romszoros cs\u00f6kken\u00e9s\u00e9t \u00e9s a 4K blokkok v\u00e9letlenszer\u0171 \u00edr\u00e1si m\u0171veleteinek k\u00e9tszeres teljes\u00edtm\u00e9nyjavul\u00e1s\u00e1t eredm\u00e9nyezte. V\u00e9g\u00fcl tov\u00e1bbi optimaliz\u00e1l\u00e1sra ker\u00fclt sor a Reef RocksDB be\u00e1ll\u00edt\u00e1saiban \u00e9s a helyez\u00e9si csoportok (PG) konfigur\u00e1ci\u00f3j\u00e1ban. <\/p>\n

A klaszter 68 csom\u00f3pontb\u00f3l \u00e1ll szerverek<\/a> Dell PowerEdge R6615 alapokon, AMD EPYC 9454P 48C\/96T CPU-val. Minden csom\u00f3pont 10 NVMe Dell 15.36TB t\u00e1rol\u00f3t, k\u00e9t 100GbE Mellanox ConnectX-6 Ethernet adaptert \u00e9s 192 GB RAM-ot tartalmaz. A szoftver Ubuntu 20.04.6 \u00e9s Ceph 17.2.7 alap\u00fa. A klaszter 63 csom\u00f3pontj\u00e1n 630 OSD (Object Storage Daemon, a helyi t\u00e1rol\u00f3ban az adatok kezel\u00e9s\u00e9\u00e9rt felel\u0151s h\u00e1tt\u00e9rfolyamat, egy OSD NVMe t\u00e1rol\u00f3nk\u00e9nt), h\u00e1rom MON (monitor, amely nyomon k\u00f6veti a klaszter \u00e1llapot\u00e1t) \u00e9s egy MGR (Manager, a kezel\u0151 szolg\u00e1ltat\u00e1s) fut. A t\u00e1rol\u00f3 m\u00e9rete 8.2 PB. <\/p>\n

A 4MB-os blokkok szekvenci\u00e1lis olvas\u00e1si m\u0171veleteinek \u00e1tbocs\u00e1t\u00f3k\u00e9pess\u00e9ge 1025 GiB\/s, az \u00edr\u00e1s\u00e9 pedig 270 GiB\/s volt. A 4KB-os blokkok v\u00e9letlenszer\u0171 olvas\u00e1sa sor\u00e1n a teljes\u00edtm\u00e9ny el\u00e9rte a m\u00e1sodpercenk\u00e9nt 25,5 milli\u00f3 olvas\u00e1si m\u0171veletet, m\u00edg \u00edr\u00e1sn\u00e1l 4,9 milli\u00f3t. A titkos\u00edt\u00e1s bekapcsol\u00e1sa k\u00f6r\u00fclbel\u00fcl 750 GiB\/s-ra cs\u00f6kkentette az olvas\u00e1si \u00e1tbocs\u00e1t\u00f3k\u00e9pess\u00e9get. A hibajav\u00edt\u00f3 k\u00f3dok, az EC62 felhaszn\u00e1l\u00e1s\u00e1val, az olvas\u00e1sn\u00e1l 547 GiB\/s, m\u00edg az \u00edr\u00e1sn\u00e1l 387 GiB\/s \u00e1tbocs\u00e1t\u00f3k\u00e9pess\u00e9get mutattak (az \u00edr\u00e1si sebess\u00e9g magasabb volt, mint hibajav\u00edt\u00f3 k\u00f3dok n\u00e9lk\u00fcl), a v\u00e9letlen hozz\u00e1f\u00e9r\u00e9s sor\u00e1n pedig 3,4M IOPS olvas\u00e1si \u00e9s 936K IOPS \u00edr\u00e1si teljes\u00edtm\u00e9nyt \u00e9rtek el.

\"Tebib\u00e1jt<\/center>
\"Tebib\u00e1jt<\/center> <\/p>\n

Tov\u00e1bbi \u00e9rdekess\u00e9g, hogy szeptemberben hasonl\u00f3 sebess\u00e9gkorl\u00e1tot, tebib\u00e1jtM\u00e1sodpercenk\u00e9nti sebess\u00e9get, \u00e9rtek el a CERN exab\u00e1jt t\u00e1rol\u00f3 klaszter\u00e9ben, amely az EOS ny\u00edlt elosztott t\u00e1rol\u00f3 alapjain val\u00f3sult meg, az XRootD protokollra \u00e9p\u00edtve.
\n
Forr\u00e1s: opennet.ru<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0418\u043d\u0436\u0435\u043d\u0435\u0440 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Clyso \u043e\u0431\u043e\u0431\u0449\u0438\u043b \u043e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043d\u0430 \u0431\u0430\u0437\u0435 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b Ceph \u0441 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e, \u043f\u0440\u0435\u0432\u044b\u0448\u0430\u044e\u0449\u0435\u0439 \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443. \u041e\u0442\u043c\u0435\u0447\u0430\u0435\u0442\u0441\u044f, \u0447\u0442\u043e \u044d\u0442\u043e \u043f\u0435\u0440\u0432\u044b\u0439 \u043a\u043b\u0430\u0441\u0442\u0435\u0440 \u043d\u0430 \u0431\u0430\u0437\u0435 Ceph, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u0441\u043c\u043e\u0433 \u0434\u043e\u0441\u0442\u0438\u0433\u043d\u0443\u0442\u044c \u043f\u043e\u0434\u043e\u0431\u043d\u043e\u0433\u043e \u043f\u043e\u043a\u0430\u0437\u0430\u0442\u0435\u043b\u044f, \u043d\u043e \u043f\u0435\u0440\u0435\u0434 \u043f\u043e\u043b\u0443\u0447\u0435\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u043e\u0433\u043e \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u0430 \u0438\u043d\u0436\u0435\u043d\u0435\u0440\u0430\u043c \u043f\u043e\u0442\u0440\u0435\u0431\u043e\u0432\u0430\u043b\u043e\u0441\u044c \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0442\u044c \u0441\u0435\u0440\u0438\u044e \u043d\u0435 \u043e\u0447\u0435\u0432\u0438\u0434\u043d\u044b\u0445 \u043f\u043e\u0434\u0432\u043e\u0434\u043d\u044b\u0445 \u043a\u0430\u043c\u043d\u0435\u0439. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440, \u0434\u043b\u044f \u043f\u043e\u0432\u044b\u0448\u0435\u043d\u0438\u044f \u043f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u043d\u0430 10-20% \u0431\u044b\u043b\u043e […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":113019,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-113018","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Ceph t\u00e1rol\u00f3 l\u00e9trehoz\u00e1s\u00e1nak tapasztalata tebib\u00e1jt m\u00e1sodpercenk\u00e9nti teljes\u00edtm\u00e9nnyel | ProHoster","description":"A Clyso m\u00e9rn\u00f6ke \u00f6sszefoglalta a Ceph alap\u00fa hibat\u0171r\u0151 elosztott t\u00e1rol\u00f3 klaszter l\u00e9trehoz\u00e1s\u00e1nak tapasztalatait, amelynek teljes\u00edtm\u00e9nye meghaladja az egy tebib\u00e1jt m\u00e1sodpercenk\u00e9nt.","canonical_url":"https:\/\/prohoster.info\/hu\/blog\/news\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hu_HU","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0430 Ceph c \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443 | ProHoster","og:description":"\u0418\u043d\u0436\u0435\u043d\u0435\u0440 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Clyso \u043e\u0431\u043e\u0431\u0449\u0438\u043b \u043e\u043f\u044b\u0442 \u0441\u043e\u0437\u0434\u0430\u043d\u0438\u044f \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0430 \u0445\u0440\u0430\u043d\u0435\u043d\u0438\u044f \u043d\u0430 \u0431\u0430\u0437\u0435 \u043e\u0442\u043a\u0430\u0437\u043e\u0443\u0441\u0442\u043e\u0439\u0447\u0438\u0432\u043e\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0441\u0438\u0441\u0442\u0435\u043c\u044b Ceph \u0441 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u044c\u044e, \u043f\u0440\u0435\u0432\u044b\u0448\u0430\u044e\u0449\u0435\u0439 \u0442\u0435\u0431\u0438\u0431\u0430\u0439\u0442 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443.","og:url":"https:\/\/prohoster.info\/hu\/blog\/news\/opyt-sozdaniya-hranilishha-ceph-c-propusknoj-sposobnostyu-tebibajt-v-sekundu","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2024-01-20T21:28:06+00:00","article:modified_time":"2024-01-20T21:28:06+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"113018","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2026-02-09 16:50:41","updated":"2026-02-09 16:50:41","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/113018","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/comments?post=113018"}],"version-history":[{"count":1,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/113018\/revisions"}],"predecessor-version":[{"id":158784,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/113018\/revisions\/158784"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media\/113019"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media?parent=113018"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/categories?post=113018"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/tags?post=113018"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}