{"id":33803,"date":"2019-10-31T21:54:45","date_gmt":"2019-10-31T18:54:45","guid":{"rendered":"https:\/\/prohoster.info\/blog\/on-vam-ne-drook\/"},"modified":"2019-10-31T21:54:45","modified_gmt":"2019-10-31T18:54:45","slug":"on-vam-ne-drook","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/on-vam-ne-drook","title":{"rendered":"Ta ei ole teile DRoook.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Seoses Rook'i kasvava populaarsusega on soov r\u00e4\u00e4kida selle varjatud probleemidest ja takistustest, millega v\u00f5ite silmitsi seista.<\/p>\n

Minust: Ceph administraatori kogemus alates versioonist hammer, kogukonna asutaja t.me\/ceph_ru<\/a><\/noindex> Telegramis.<\/p>\n

Et mitte olla t\u00fchja juttu ajav, viitan vastu v\u00f5etud Habr'i (hinnangute p\u00f5hjal) postitustele Ceph'i probleemide kohta. Suurem osa probleemidest, millega seal silmitsi seisti, on ka mind puudutanud. Kasutatud materjalide lingid postituse l\u00f5pus.<\/p>\n

Rook'i postituses ei mainita Ceph'i ilma p\u00f5hjuseta \u2014 Rook on tegelikult Ceph, mis on pakitud Kubernetesesse, t\u00e4hendades, et see p\u00e4rib k\u00f5ik selle probleemid. Alustame Ceph'i probleemidest.
\n<\/a><\/noindex><\/p>\n

Klastri haldamise lihtsustamine<\/h3>\n

\n\u00dcks Rook'i eeliseid on Ceph'i mugav haldamine l\u00e4bi Kubernetes.<\/p>\n

Kuid Ceph sisaldab rohkem kui 1000 seadistamise parameetrit, samas kui Rook'i kaudu saame muuta vaid v\u00e4iksemat osa neist.<\/p>\n

N\u00e4ide Luminouselt
\n> ceph daemon mon.a config show | wc -l
\n1401<\/p><\/blockquote>\n

Rook positsioneerib end kui mugav viis Ceph'i installimiseks ja uuendamiseks<\/b>
\nCeph'i installimisega ilma Rook'ita pole probleeme \u2014 ansible'i m\u00e4ngukava kirjutamine v\u00f5tab 30 minutit, kuid uuendamisega on palju probleeme. <\/p>\n

Tsitaat Krok'i postitusest<\/i><\/p>\n

N\u00e4ide: crush tunable'ite vale t\u00f6\u00f6 p\u00e4rast uuendamist hummer'ilt jewel'ile<\/p>\n

> ceph osd crush show-tunables
\n{
\n\u2026
\n \u00abstraw_calc_version\u00bb: 1,
\n \u00aballowed_bucket_algs\u00bb: 22,
\n \u00abprofile\u00bb: \u00abunknown\u00bb,
\n \u00aboptimal_tunables\u00bb: 0,
\n\u2026
\n}<\/p><\/blockquote>\n

Kuid isegi v\u00e4ikeste versioonide vahel v\u00f5ivad esineda probleemid.<\/p>\n

N\u00e4ide: Uuendus 12.2.6, mis viib klastrit tervislikku erisse ja tinglikult katki PG.
\nceph.com\/releases\/v12-2-8-released<\/a><\/noindex><\/p>\n

Kas mitte uuendada, vaid oodata ja testida? Kuid me kasutame Rook'i ka selleks, et h\u00f5lbustada uuendusi.<\/p>\n

Klastri h\u00e4daolukorra taastamise keerukus Rook'is. <\/h3>\n

\nN\u00e4ide: OSD kukub, visates endale jalgade alla vigu. Kahtlete, et probleem on \u00fches konfigureerimise parameetris, soovite muuta konfi konkreetse deemoniga, kuid ei saa, kuna teil on Kubernetes ja DaemonSet.<\/p>\n

Alternatiivi pole. ceph tell osd.Num injectargs ei t\u00f6\u00f6ta \u2014 OSD on ju maas.<\/p>\n

Debugimise keerukus.<\/h3>\n

\nM\u00f5nede seadistuste ja j\u00f5udluse testide jaoks on vajalik otse osd deemoniga pistikupessa \u00fchenduda. Rook'i puhul peate esmalt leidma vajaliku konteineri, seej\u00e4rel sisenema sellesse, avama debugimiseks vajalike t\u00f6\u00f6riistade puudumise ja v\u00e4ga pettuma.<\/p>\n

OSD j\u00e4rjestikuse t\u00f5stmise keerukus.<\/h3>\n

\nN\u00e4ide: OSD kukub OOM-i p\u00e4rast, algab \u00fcmberjaotamine, seej\u00e4rel kukuvad j\u00e4rgmised.<\/p>\n

Lahendus: t\u00f5stke OSD-d \u00fckshaaval, oodake, kuni need t\u00e4ielikult klastrisse l\u00fclitatakse, ja t\u00f5stke j\u00e4rgmised. (\u00dcksikasjad Cephi raportis. Katastroofi anatoomia).<\/p>\n

Baremetal paigalduse korral toimub see lihtsalt k\u00e4sitsi, Rooki ja \u00fche OSD-ga s\u00f5lme ei ole erilisi probleeme, probleeme tekib j\u00e4rjestikuste t\u00f5usudega, kui OSD-d on > 1 s\u00f5lmes. <\/p>\n

Loomulikult on need lahendatavad, kuid me ju toome Rooki lihtsustamiseks, mitte keerukuse tekitamiseks.<\/p>\n

Ceph daemonite piiride sobitamise keerukus<\/h3>\n

\nBaremetal Ceph installatsioonide puhul on klastrile vajalike ressursside arvutamine piisavalt kerge \u2014 valemid ja uuringud on olemas. N\u00f5rkade CPU-de kasutamise korral peavad teil riskima tegeleda mitme j\u00f5udluse testimisega, \u00f5ppida, mis on Numa, kuid see on ikkagi lihtsam kui Rookis.<\/p>\n

Rooki korral lisandub teile m\u00e4lupiiride, mida saab arvutada, k\u00fcsimus CPU piiri seadmisest.<\/p>\n

Ja siin peate j\u00f5udluse testidega t\u00f5siselt vaeva n\u00e4gema. Kui seate piirid liiga madalaks, saate aeglase klastriga, kui m\u00e4\u00e4rate unlimi, p\u00f5hjustate aktiivset CPU kasutamist uuesti tasakaalustamisel, mis avaldab negatiivset m\u00f5ju teie rakendustele Kuberneteses.<\/p>\n

Probleemid v\u00f5rgu\u00fchendusega v1<\/h3>\n

\nCephi puhul soovitatakse kasutada 2x10Gb v\u00f5rku. \u00dcks kliendiliikluse jaoks ja teine cephi meditsiiniliste \u00fclesannete (rebalance) jaoks. Kui kasutate cephi baremetal'is, on see jaotus lihtne seadistada, kuid Rook'i puhul v\u00f5ib see p\u00f5hjustada probleeme, kuna kaugel ei ole iga klastrikonfiguratsioon v\u00f5imaldada pod'ile kahte erinevat v\u00f5rku.<\/p>\n

V\u00f5rgus suhtlemise probleemid v2<\/h3>\n

\nKui te ei soovi v\u00f5rke jagada, siis rebalance'i k\u00e4igus t\u00e4idab ceph kogu kanalit ja teie rakendused Kubernetes'is v\u00f5ivad aeglustuda v\u00f5i kokku t\u00f5mmata. Cephi rebalance'i kiirus on v\u00f5imalik v\u00e4hendada, kuid pika rebalance'i t\u00f5ttu tekib k\u00f5rgem risk, et teine node langeb kettat\u00f5rgete v\u00f5i OOM-i t\u00f5ttu v\u00e4lja klastrist, mis toob endaga kaasa garanteeritud read only oleku klastris.<\/p>\n

Pikk rebalance \u2014 pikad rakenduste viivitused<\/h3>\n

\nTsitaat Cephi postitusest. H\u00e4daolukordade anatoomia.<\/i><\/p>\n

Testklastri j\u00f5udlus:<\/p>\n

4 Kbyte kirjutamisoperatsioon v\u00f5tab aega 1 ms, j\u00f5udlus 1000 operatsiooni\/sekundi \u00fche l\u00f5ime jooksul.<\/p>\n

4 Mbyte (objekti suurus) operatsioon v\u00f5tab aega 22 ms, j\u00f5udlus 45 operatsiooni\/sekundi.<\/p>\n

Seega, kui \u00fcks kolme domeeni eba\u00f5nnestub, on klaster m\u00f5nda aega degradeerunud olekus ja pool kuumadest objektidest jaotub erinevatele versioonidele, hakkab pool kirjutamise operatsioonidest toimuma sundtaastumisega.<\/p>\n

Sundtaastumise aeg arvutatakse ligikaudu \u2014 kirjutamise operatsioonid degradeerunud objektile.<\/p>\n

Esmalt loeme 4 MB 22 ms jooksul, kirjutame 22 ms, ja seej\u00e4rel kirjutame 1 ms 4 KB tegelikke andmeid. Kokku 45 ms \u00fche kirjutamise operatsiooni jaoks degradeerunud objekti puhul SSD-l, kui meie tavaline j\u00f5udlus oli 1 ms \u2014 j\u00f5udluse langus 45 korda.<\/p>\n

Mida suurem on meie degradeerunud objektide protsent, seda hirmsamaks k\u00f5ik muutub.<\/p><\/blockquote>\n

Selgub, et tasakaalustamise kiirus on klastrite n\u00f5uetekohase toimimise jaoks kriitilise t\u00e4htsusega.<\/p>\n

Spetsiifilised serveri seaded ceph jaoks<\/h3>\n

\nceph vajab m\u00f5nikord hosti spetsiifilist tuningut. <\/p>\n

N\u00e4ide: sysctl seaded ja samuti JumboFrame, m\u00f5ned neist seadetest v\u00f5ivad teie payloadi negatiivselt m\u00f5jutada.<\/p>\n

Rooki tegelik vajadus j\u00e4\u00e4b k\u00fcsim\u00e4rgiks.<\/h3>\n

\nKui olete pilves, on teil oma pilveteenuse pakkujalt salvestusruum, mis on oluliselt mugavam. <\/p>\n

Kui olete oma serverites, siis on ceph-i haldamine mugavam ilma kuberneteseta. <\/p>\n

Kas rendite servereid m\u00f5nes madalate hindadega hostimisteenuses? Siis ootab teid palju naljakaid hetki v\u00f5rgu, selle latentsuse ja l\u00e4bilaskev\u00f5imega, mis m\u00f5jutab ceph-i selgelt negatiivselt.<\/p>\n

Kokku:<\/b> Kubernetese rakendamine ja salvestuss\u00fcsteemi rakendamine on erinevad \u00fclesanded, erinevate sisendite ja erinevate lahenduste valikutega \u2014 nende segamine t\u00e4hendab, et teete potentsiaalselt ohtlikku trade-off'i \u00fche v\u00f5i teise kasuks. Nende lahenduste \u00fchitamine on isegi projekteerimise etapis v\u00e4ga keeruline, r\u00e4\u00e4kimata kasutusperioodist.<\/p>\n

Kasutatud kirjanduse nimekiri:<\/p>\n

Post #1<\/a><\/noindex> Aga te \u00fctlete Ceph... kas see on t\u00f5esti nii hea?
\nPost #2<\/a><\/noindex> Ceph. Katastroofi anatoomia
\n
Allikas: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0412 \u0441\u0432\u044f\u0437\u0438 \u0441 \u043d\u0430\u0431\u0438\u0440\u0430\u044e\u0449\u0435\u0439 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u044c\u044e Rook \u0445\u043e\u0447\u0435\u0442\u0441\u044f \u043f\u043e\u0433\u043e\u0432\u043e\u0440\u0438\u0442\u044c \u043e \u0435\u0433\u043e \u043f\u043e\u0434\u0432\u043e\u0434\u043d\u044b\u0445 \u043a\u0430\u043c\u043d\u044f\u0445 \u0438 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0430\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0436\u0434\u0443\u0442 \u0432\u0430\u0441 \u043d\u0430 \u043f\u0443\u0442\u0438. \u041e \u0441\u0435\u0431\u0435: \u041e\u043f\u044b\u0442 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f ceph \u0441 \u0432\u0435\u0440\u0441\u0438\u0438 hammer, \u043e\u0441\u043d\u043e\u0432\u0430\u0442\u0435\u043b\u044c \u043a\u043e\u043c\u044c\u044e\u043d\u0438\u0442\u0438 t.me\/ceph_ru \u0432 \u0442\u0435\u043b\u0435\u0433\u0440\u0430\u043c. \u0414\u0430\u0431\u044b \u043d\u0435 \u0431\u044b\u0442\u044c \u0433\u043e\u043b\u043e\u0441\u043b\u043e\u0432\u043d\u044b\u043c \u044f \u0431\u0443\u0434\u0443 \u0441\u0441\u044b\u043b\u0430\u0442\u044c\u0441\u044f \u043d\u0430 \u043f\u0440\u0438\u043d\u044f\u0442\u044b\u0435 \u0445\u0430\u0431\u0440\u043e\u043c (\u0441\u0443\u0434\u044f \u043f\u043e \u0440\u0435\u0439\u0442\u0438\u043d\u0433\u0443) \u043f\u043e\u0441\u0442\u044b \u043e \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0430\u0445 \u0441 ceph. \u0421 \u0431\u041e\u043b\u044c\u0448\u0435\u0439 \u0447\u0430\u0441\u0442\u044c\u044e \u043f\u0440\u043e\u0431\u043b\u0435\u043c \u0432 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-33803","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Ta ei ole dRook | ProHoster","description":"Seoses Rooki suureneva populariteediga tahan r\u00e4\u00e4kida selle allveelaevadest ja probleemidest, mis teid teel ootavad. Minust: Ceph-i haldamise kogemus alates versioonist hammer, t.me\/ceph_ru kogukonna asutaja telegrammis. Et mitte olla s\u00f5napidaja, viitan vastu v\u00f5etud habra (reitingu p\u00f5hjal) postitustele ceph-i probleemide kohta. Suurema osa probleemidest","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/on-vam-ne-drook","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043d \u0432\u0430\u043c \u043d\u0435 \u0434Rook | ProHoster","og:description":"\u0412 \u0441\u0432\u044f\u0437\u0438 \u0441 \u043d\u0430\u0431\u0438\u0440\u0430\u044e\u0449\u0435\u0439 \u043f\u043e\u043f\u0443\u043b\u044f\u0440\u043d\u043e\u0441\u0442\u044c\u044e Rook \u0445\u043e\u0447\u0435\u0442\u0441\u044f \u043f\u043e\u0433\u043e\u0432\u043e\u0440\u0438\u0442\u044c \u043e \u0435\u0433\u043e \u043f\u043e\u0434\u0432\u043e\u0434\u043d\u044b\u0445 \u043a\u0430\u043c\u043d\u044f\u0445 \u0438 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0430\u0445, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0436\u0434\u0443\u0442 \u0432\u0430\u0441 \u043d\u0430 \u043f\u0443\u0442\u0438. \u041e \u0441\u0435\u0431\u0435: \u041e\u043f\u044b\u0442 \u0430\u0434\u043c\u0438\u043d\u0438\u0441\u0442\u0440\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f ceph \u0441 \u0432\u0435\u0440\u0441\u0438\u0438 hammer, \u043e\u0441\u043d\u043e\u0432\u0430\u0442\u0435\u043b\u044c \u043a\u043e\u043c\u044c\u044e\u043d\u0438\u0442\u0438 t.me\/ceph_ru \u0432 \u0442\u0435\u043b\u0435\u0433\u0440\u0430\u043c. \u0414\u0430\u0431\u044b \u043d\u0435 \u0431\u044b\u0442\u044c \u0433\u043e\u043b\u043e\u0441\u043b\u043e\u0432\u043d\u044b\u043c \u044f \u0431\u0443\u0434\u0443 \u0441\u0441\u044b\u043b\u0430\u0442\u044c\u0441\u044f \u043d\u0430 \u043f\u0440\u0438\u043d\u044f\u0442\u044b\u0435 \u0445\u0430\u0431\u0440\u043e\u043c (\u0441\u0443\u0434\u044f \u043f\u043e \u0440\u0435\u0439\u0442\u0438\u043d\u0433\u0443) \u043f\u043e\u0441\u0442\u044b \u043e \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0430\u0445 \u0441 ceph. \u0421 \u0431\u041e\u043b\u044c\u0448\u0435\u0439 \u0447\u0430\u0441\u0442\u044c\u044e \u043f\u0440\u043e\u0431\u043b\u0435\u043c \u0432","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/on-vam-ne-drook","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:54:45+00:00","article:modified_time":"2019-10-31T18:54:45+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"33803","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-21 16:46:22","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 02:33:24","updated":"2026-01-21 16:46:22","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/33803","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=33803"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/33803\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=33803"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=33803"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=33803"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}