{"id":77266,"date":"2020-04-09T13:42:08","date_gmt":"2020-04-09T11:42:08","guid":{"rendered":"https:\/\/prohoster.info\/blog\/administrirovanie\/tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah"},"modified":"2020-04-09T13:42:08","modified_gmt":"2020-04-09T11:42:08","slug":"tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah","title":{"rendered":"Nippe ja trikke Cephiga t\u00f6\u00f6tamiseks koormatud projektides.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p><img decoding=\"async\" alt=\"Tips &amp; tricks Ceph-i kasutamisel koormatud projektides\" src=\"\/wp-content\/uploads\/2020\/04\/1d60f91e55b20a5dc4346bd8087bc11e.png\" style=\"display:block;margin: 0 auto;\" \/><br \/>\n<br \/>\nKasutades Cephi kui v\u00f5rgu salvestust erineva koormusega projektides, v\u00f5ime silmitsi seista mitmesuguste \u00fclesannetega, mis esmapilgul ei tundu lihtsad v\u00f5i triviaalsetena. N\u00e4iteks:<\/p>\n<ul>\n<li> andmete migreerimine vanast Cephist uude osaliselt varasemaid servereid uues klastris kasutades;<\/li>\n<li> ketta ruumi jaotuse probleemide lahendamine Cephis.<\/li>\n<\/ul>\n<p>\nSelliste \u00fclesannete lahendamisel seisame silmitsi vajadusega \u00f5igesti OSDd eemaldada andmete kaotamata, mis on eriti oluline suurte andmemahtude puhul. Just sellest r\u00e4\u00e4gitakse artiklis.<\/p>\n<p>Allpool kirjeldatud meetodid kehtivad igasuguste Cephi versioonide jaoks. Samuti arvestatakse, et Cephis v\u00f5ib olla suures koguses andmeid: andmekao ja teiste probleemide v\u00e4ltimiseks jagatakse m\u00f5ned toimingud mitmeks.<noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<h3>Sissejuhatus OSD-le<\/h3>\n<p>\nKuna kaks kolmest k\u00e4sitletavast retseptist on p\u00fchendatud OSD-le (<noindex><a rel=\"nofollow\" href=\"https:\/\/docs.ceph.com\/docs\/master\/man\/8\/ceph-osd\/\">Object Storage Daemon<\/a><\/noindex>), enne praktilisse ossa sukeldumist \u2014 l\u00fchidalt, mis see Cephis \u00fcldse on ja miks see nii oluline on.<\/p>\n<p>Esiteks tuleb \u00f6elda, et kogu Ceph-klaster koosneb paljusid OSD-dest. Mida rohkem OSD-sid, seda suurem on Ceph-i vaba andmemaht. Siit on lihtne m\u00f5ista <b>peamist OSD funktsiooni<\/b>: see salvestab Ceph objektide andmed klasteri k\u00f5igi s\u00f5lmede failis\u00fcsteemides ja tagab neile v\u00f5rgu\u00fchenduse (lugemiseks, kirjutamiseks ja muude taotlusteks).<\/p>\n<p>Samas tasemes seadistatakse replikatsiooni parameetrid, kopeerides objekte erinevate OSD-de vahel. Siin v\u00f5ivad tekkida erinevad probleemid, mille lahendamisest r\u00e4\u00e4gitakse j\u00e4rgmiselt.<\/p>\n<h2>Juhtum nr 1. OSD ohutu eemaldamine Ceph-klastrist andmete kaotuseta<\/h2>\n<p>\nOSD eemaldamise vajadus v\u00f5ib tuleneda serveri v\u00e4ljav\u00f5tmisest klastrist \u2014 n\u00e4iteks teise serveri asendamiseks, \u2014 mis juhtus ka meil ja mis oli p\u00f5hjuseks selle artikli kirjutamiseks. Nii et toimingute l\u00f5ppeesm\u00e4rk on eemaldada k\u00f5ik OSD-d ja mon\u2019id sellest serverist, et see saaks peatada.<\/p>\n<p>Mugavuse ja olukorra v\u00e4ltimiseks, kus me k\u00e4ske t\u00e4ites eksime vajaliku OSD m\u00e4\u00e4ramisel, m\u00e4\u00e4rame eraldi muutuja, mille v\u00e4\u00e4rtuseks on eemaldatava OSD number. Nimeks paneme selle <code>${ID}<\/code> \u2014 siin ja edaspidi selline muutuja asendab OSD numbri, millega me t\u00f6\u00f6tame.<\/p>\n<p>Vaadake seisundit enne t\u00f6\u00f6de alustamist:<\/p>\n<pre><code class=\"bash\">root@hv-1 ~ # ceph osd tree\nID CLASS WEIGHT  TYPE NAME      STATUS REWEIGHT PRI-AFF\n-1       0.46857 root default\n-3       0.15619      host hv-1\n-5       0.15619      host hv-2\n 1   ssd 0.15619      osd.1     up     1.00000  1.00000\n-7       0.15619      host hv-3\n 2   ssd 0.15619      osd.2     up     1.00000  1.00000<\/code><\/pre>\n<p>\nOSD eemaldamise algatamiseks on vaja sujuvalt teostada <code>reweight<\/code> sellel nulliks. Nii v\u00e4hendame OSD-s toimuvaid andmeid, tasakaalustades need teistesse OSD-desse. Selleks t\u00e4idetakse j\u00e4rgmised k\u00e4sklused:<\/p>\n<pre><code class=\"bash\">ceph osd reweight osd.${ID} 0.98\nceph osd reweight osd.${ID} 0.88\nceph osd reweight osd.${ID} 0.78<\/code><\/pre>\n<p>\n\u2026 ja nii edasi kuni nullini.<\/p>\n<p><b>Sujuv tasakaalustamine on vajalik<\/b>, et mitte kaotada andmeid. See on eriti oluline, kui OSD-s on suur andmemaht. Et veenduda, et p\u00e4rast k\u00e4skluste t\u00e4itmist <code>reweight<\/code> k\u00f5ik on l\u00e4inud edukalt, v\u00f5ib t\u00e4ita <code>ceph -s<\/code> v\u00f5i avada eraldi terminaliaknas <code>ceph -w<\/code> et j\u00e4lgida muudatusi reaalajas.<\/p>\n<p>Kui OSD on \"t\u00fchjendatud\", v\u00f5ib alustada selle eemaldamise standardprotseduuri. Selleks viime vajalik OSD seisundisse <code>down<\/code>:<\/p>\n<pre><code class=\"bash\">ceph osd down osd.${ID}<\/code><\/pre>\n<p>\n\"T\u00f5mbame\" OSD klastrist v\u00e4lja:<\/p>\n<pre><code class=\"bash\">ceph osd out osd.${ID}<\/code><\/pre>\n<p>\nPeatame OSD teenuse ja demonteerime selle faili s\u00fcsteemis:<\/p>\n<pre><code class=\"bash\">systemctl stop ceph-osd@${ID}\numount \/var\/lib\/ceph\/osd\/ceph-${ID}<\/code><\/pre>\n<p>\nKustutame OSD-st <noindex><a rel=\"nofollow\" href=\"https:\/\/docs.ceph.com\/docs\/nautilus\/rados\/operations\/crush-map\/\">CRUSH kaardist<\/a><\/noindex>:<\/p>\n<pre><code class=\"bash\">ceph osd crush remove osd.${ID}<\/code><\/pre>\n<p>\nKustutame OSD kasutaja:<\/p>\n<pre><code class=\"bash\">ceph auth del osd.${ID}<\/code><\/pre>\n<p>\nJa l\u00f5puks kustutame OSD enda:<\/p>\n<pre><code class=\"bash\">ceph osd rm osd.${ID}<\/code><\/pre>\n<p>\n<b>M\u00e4rkus<\/b>: kui kasutate Ceph Luminous v\u00f5i uuemat versiooni, saab \u00fclaltoodud OSD eemaldamisprotseduurid minimaliseerida kahele k\u00e4sule:<\/p>\n<pre><code class=\"bash\">ceph osd out osd.${ID}\nceph osd purge osd.${ID}\n<\/code><\/pre>\n<p>\nKui p\u00e4rast \u00fclaltoodud toimingute tegemist k\u00e4ivitate k\u00e4su <code>ceph osd tree<\/code>, peaks olema n\u00e4ha, et serveris, kus t\u00f6\u00f6d tehti, ei ole enam OSD-d, millele \u00fclaltoodud toimingud said teostatud:<\/p>\n<pre><code class=\"bash\">root@hv-1 ~ # ceph osd tree\nID CLASS WEIGHT  TYPE NAME     STATUS REWEIGHT PRI-AFF\n-1       0.46857      root default\n-3       0.15619      host hv-1\n-5       0.15619      host hv-2\n-7       0.15619      host hv-3\n 2   ssd 0.15619      osd.2    up     1.00000  1.00000<\/code><\/pre>\n<p>\nJuhime t\u00e4helepanu, et Ceph klastrite olek muutub <code>HEALTH_WARN<\/code>, lisaks n\u00e4eme OSD-de arvu ja vaba kettaruumi v\u00e4henemist. <\/p>\n<p>Edasi kirjeldatakse toiminguid, mis on vajalikud, kui soovite serveri t\u00e4ielikult peatada ning vastavalt eemaldada selle Ceph-ist. Sellisel juhul on oluline meeles pidada, et <b>enne serveri v\u00e4lja l\u00fclitamist tuleb igal OSD-l<\/b> sellel serveril eemaldada.<\/p>\n<p>Kui sellel serveril ei ole enam OSD-sid, siis nende eemaldamise j\u00e4rel tuleb need OSD kaardilt v\u00e4lja j\u00e4tta. <code>hv-2<\/code>, t\u00e4ites j\u00e4rgmise k\u00e4su:<\/p>\n<pre><code class=\"bash\">ceph osd crush rm hv-2<\/code><\/pre>\n<p>\nKustutame <code>mon<\/code> serverilt <code>hv-2<\/code>, k\u00e4ivitades alltoodud k\u00e4su teises serveris (st antud juhul \u2014 <code>hv-1<\/code>):<\/p>\n<pre><code class=\"bash\">ceph-deploy mon destroy hv-2<\/code><\/pre>\n<p>\nP\u00e4rast seda v\u00f5ib serveri v\u00e4lja l\u00fclitada ja j\u00e4tkata j\u00e4rgmiste toimingutega (uuesti seadistamine jne).<\/p>\n<h2>Juhtum nr 2. Diskiruumi jaotamine juba loodud Ceph-klusteris<\/h2>\n<p>\nTeise loo alustamiseks teen sissejuhatuse PG (<noindex><a rel=\"nofollow\" href=\"https:\/\/docs.ceph.com\/docs\/mimic\/rados\/operations\/placement-groups\/\">Placement Groups<\/a><\/noindex>). PG peamine roll Cephis on peamiselt Ceph-objektide kogumine ja edasine replikatsioon OSD-sse. PG vajaliku arvu arvutamiseks vajalik valem on toodud <noindex><a rel=\"nofollow\" href=\"https:\/\/docs.ceph.com\/docs\/mimic\/rados\/operations\/placement-groups\/#choosing-the-number-of-placement-groups\">vastavas jaotises<\/a><\/noindex> Ceph'i dokumentatsioonis. Seal on sama teema k\u00e4sitletud ka konkreetsete n\u00e4idete abil.<\/p>\n<p>Nii et: \u00fcks levinumaid probleeme Cephi kasutamise ajal on OSD-de ja PG-de tasakaalustamatus Cephis.<\/p>\n<p>Esiteks, v\u00f5ib tekkida olukord, kus v\u00e4ikeses mahus basseinis on m\u00e4\u00e4ratud liiga palju PG-d, mis on oma olemuselt ebaefektiivne kettaruumi kasutamine klastris. Teiseks, praktikas tekib t\u00f5sisem probleem: \u00fchte OSD-d andmete \u00fclevool. See toob kaasa klastrisse esialgu seisundi <code>HEALTH_WARN<\/code>, seej\u00e4rel ka <code>HEALTH_ERR<\/code>. K\u00f5ik see juhtub seet\u00f5ttu, et Ceph tugineb arvutuste tegemisel OSD-s oleva andmehulga suurusele (mida saab teada <code>MAX AVAIL<\/code> k\u00e4skluse tulemuses <code>ceph df<\/code> iga basseini jaoks eraldi), kui arvutatakse andmete saadavust. Kui v\u00e4hemalt \u00fches OSD-s on ruumi ebapiisavalt, ei ole v\u00f5imalik rohkem andmeid salvestada, kuni andmed ei ole korralikult jaotatud k\u00f5igi OSD-de vahel.<\/p>\n<p>Oluline on m\u00e4rkida, et neid probleeme <b>lahendatakse suurel m\u00e4\u00e4ral Ceph-klastri konfiguratsiooni etapis<\/b>. \u00dcks t\u00f6\u00f6riist, millele toetuda, on <noindex><a rel=\"nofollow\" href=\"http:\/\/blog.easter-eggs.org\/index.php\/post\/2013\/09\/27\/%5BLibvirt%5D-Migrating-from-on-disk-raw-images-to-RBD-storage\">Ceph PGCalc<\/a><\/noindex>. Selle abil saab selgelt arvutada vajalike PG-de arvu. Siiski v\u00f5ib sellele tugineda ka olukordades, kus Ceph klaster <i>juba<\/i> on vale vale. Siin tasub m\u00e4rkida, et vigade parandamise k\u00e4igus peate t\u00f5en\u00e4oliselt v\u00e4hendama PG arvu, kuid see v\u00f5imalus ei ole vanades Ceph versioonides saadaval (see ilmus alles versiooniga <noindex><a rel=\"nofollow\" href=\"https:\/\/ceph.com\/rados\/new-in-nautilus-pg-merging-and-autotuning\/\">Nautilus<\/a><\/noindex>).<\/p>\n<p>Kujutame n\u00fc\u00fcd j\u00e4rgmisi stsenaariume: klastri staatus on <code>HEALTH_WARN<\/code> selle t\u00f5ttu, et \u00fche OSD kohta l\u00f5peb ruum. Sellest annab m\u00e4rku viga <code>HEALTH_WARN: 1 near full osd<\/code>. Allpool on esitatud algoritm, kuidas sellisest olukorrast v\u00e4lja p\u00e4\u00e4seda.<\/p>\n<p>Esiteks tuleb olemasolevaid andmeid teiste OSD-de vahel jaotada. Sarnast toimingut oleme juba teinud esimeses juhtumis, kui \u201ekuivasime\u201c s\u00f5lme \u2014 ainus erinevus on see, et n\u00fc\u00fcd tuleb veidi v\u00e4hendada <code>reweight<\/code>. N\u00e4iteks kuni 0.95:<\/p>\n<pre><code class=\"bash\">ceph osd reweight osd.${ID} 0.95<\/code><\/pre>\n<p>\nNii vabastatakse OSD-s diskiruumi ja viga ceph healthis parandatakse. Kuid nagu juba mainitud, tekib see probleem peamiselt Cephi vale seadistamise t\u00f5ttu algstaadiumis: v\u00e4ga oluline on rekonstrueerimine, et see tulevikus ei ilmneks.<\/p>\n<p>Meie konkreetsel juhul seisis see k\u00f5ik:<\/p>\n<ul>\n<li> liialt suur v\u00e4\u00e4rtus <code>replication_count<\/code> \u00fches basseinides,<\/li>\n<li> \u00fche laval on liiga suur PG arv ja teisel liiga v\u00e4ike. <\/li>\n<\/ul>\n<p>\nKasutame juba mainitud kalkulaatorit. Selles on selgelt n\u00e4idatud, mida sisestada, ja \u00fcldiselt pole seal midagi keerulist. Sisestades vajalikud parameetrid, saame j\u00e4rgmised soovitused:<\/p>\n<p><i><b>M\u00e4rkus<\/b>: kui seadistate Ceph-klusterit nullist, on kalkulaatori veel \u00fcheks kasulikuks funktsiooniks k\u00e4skude genereerimine, mis loovad l\u00e4htestatud basseinid tabelis toodud parameetritega.<\/i><\/p>\n<p>Oleneb viimasest veerust \u2014 <i>Suggested PG Count<\/i>. Meie puhul on kasulik ka teine, kus on n\u00e4idatud replikatsiooni parameeter, kuna otsustasime muuta replikatsiooni kordajat.<\/p>\n<p>Nii et k\u00f5igepealt tuleb muuta replikatsiooni parameetreid \u2014 seda tuleks teha k\u00f5igepealt, kuna kordaja v\u00e4hendamine vabastab salvestusruumi. K\u00e4sku t\u00e4itmisel v\u00f5ib m\u00e4rgata, et saadaval oleva salvestusruumi v\u00e4\u00e4rtus suureneb:<\/p>\n<pre><code class=\"bash\">ceph osd pool $pool_name set $replication_size<\/code><\/pre>\n<p>\nJa p\u00e4rast selle l\u00f5petamist muudame parameetrite v\u00e4\u00e4rtused <code>pg_num<\/code> ja <code>pgp_num<\/code> j\u00e4rgmiselt:<\/p>\n<pre><code class=\"bash\">ceph osd pool set $pool_name pg_num $pg_number\nceph osd pool set $pool_name pgp_num $pg_number<\/code><\/pre>\n<p>\n<b>Oluline<\/b>: peame j\u00e4rk-j\u00e4rgult igas rippes muutma PG arvut ja mitte muutma v\u00e4\u00e4rtusi teistes rippes, kuni hoiatused kaovad <i>\u201eDegradeeritud andmete \u00fclekandmine\u201c<\/i> ja <i>\u201en-arvu pgs on degradeeritud\u201c<\/i>.<\/p>\n<p>Kontrollige, et k\u00f5ik on l\u00e4inud edukalt, samuti saab kontrollida k\u00e4skude v\u00e4ljundeid <code>ceph health detail<\/code> ja <code>ceph -s<\/code>.<\/p>\n<h2>Juhtum nr 3. Virtuaalmasina migratsioon LVM-st Ceph RBD-le<\/h2>\n<p>\nKui projektis kasutatakse virtuaalmasinaid, mis on paigaldatud renditud bare-metal-serveritele, siis tekib sageli k\u00fcsimus tagavarakoopia kvaliteetse salvestamise kohta. Ja oleks v\u00e4ga soovitav, et selle salvestuse jaoks oleks piisavalt ruumi\u2026 Teine levinud olukord: on virtuaalmasin, millel on lokaalne salvestusserveris ja on vaja ketast laiendada, kuid ruumi ei ole, kuna serveris ei ole vaba ketaruum.<\/p>\n<p>Probleemi saab lahendada mitmesuguste vahenditega \u2014 n\u00e4iteks migreerimisega teisele serverile (kui see on saadaval) v\u00f5i uute kettaste lisamisega serverisse. Kuid mitte alati ei ole seda v\u00f5imalik teha, seet\u00f5ttu v\u00f5ib migreerimine LVM-ilt Ceph-ile olla suurep\u00e4rane lahendus sellele probleemile. Sellise variandi valides lihtsustame ka edasist migreerimisprotsessi serverite vahel, kuna ei pea kohalikku salvestust \u00fchelt h\u00fcpervisorilt teisele tarnima. Ainuke konks on see, et peate VM-i t\u00f6\u00f6 ajaks peatama.<\/p>\n<p>Nagu allpool toodud retseptis <noindex><a rel=\"nofollow\" href=\"http:\/\/blog.easter-eggs.org\/index.php\/post\/2013\/09\/27\/%5BLibvirt%5D-Migrating-from-on-disk-raw-images-to-RBD-storage\">on see blogi artikli p\u00f5hjal<\/a><\/noindex>, mille juhiseid on praktikas katsetatud. \u00dcldsega, <b>seal on samuti kirjeldatud lihtsustatud migreerimise viisi<\/b>, kuid meie juhtumil ei olnud see lihtsalt vajalik, seega me ei kontrollinud seda. Kui see on teie projekti jaoks kriitiline \u2014 oleksime r\u00f5\u00f5msad, kui kuuleksime teie tulemustest kommentaarides.<\/p>\n<p>Alustame praktilise osaga. N\u00e4ites kasutame virsh'i ja vastavalt ka libvirt'i. Esiteks veenduge, et Ceph'i bassein, kuhu andmed migreeritakse, on libvirt'iga \u00fchendatud:<\/p>\n<pre><code class=\"bash\">virsh pool-dumpxml $ceph_pool<\/code><\/pre>\n<p>\nPuhangus kirjelduses peavad olema \u00fchendusandmed Ceph'iga koos autentimisteabega. <\/p>\n<p>J\u00e4rgmine etapp on see, et LVM-i pildist konverteeritakse Ceph RBD-ks. T\u00e4itmise aeg s\u00f5ltub peamiselt pildi suurusest:<\/p>\n<pre><code class=\"bash\">qemu-img convert -p -O rbd \/dev\/main\/$vm_image_name rbd:$ceph_pool\/$vm_image_name<\/code><\/pre>\n<p>\nP\u00e4rast konverteerimist j\u00e4\u00e4b LVM-i pilt, mis on kasulik, kui VM-i r\u00e4ndamine RBD-sse ei \u00f5nnestu ja tuleb muudatused tagasi v\u00f5tta. Samuti, et v\u00f5imalikult kiiresti muudatusi tagasi v\u00f5tta, teeme varukoopia virtuaalmasina konfiguratsioonifailist:<\/p>\n<pre><code class=\"bash\">virsh dumpxml $vm_name &gt; $vm_name.xml\ncp $vm_name.xml $vm_name_backup.xml<\/code><\/pre>\n<p>\n\u2026 ja muudame originaali (<code>vm_name.xml<\/code>). Otsime v\u00e4lja plaadi kirjelduse ploki (mis algab reaalta: <code>&lt;disk type='file' device='disk'&gt;<\/code> ja l\u00f5petab <code>&lt;\/disk&gt;<\/code>) ja viime selle j\u00e4rgmisesse vormi:<\/p>\n<pre><code class=\"xml\"><address \/><\/code><\/pre>\n<p>\nVaatame m\u00f5ningaid detaile:<\/p>\n<ol>\n<li> Protokoll <code>source<\/code> m\u00e4\u00e4ratakse Ceph RBD salvestuse aadress (see on aadress, kus on n\u00e4idatud Ceph-aluse ja RBD-pildi nimi, mis m\u00e4\u00e4rati esimesel etapil).<\/li>\n<li> Blokis <code>salajane<\/code> m\u00e4\u00e4ratakse t\u00fc\u00fcp <code>ceph<\/code>, samuti salajase \u00fchiku UUID selle \u00fchendamiseks. Selle uuid saab teada j\u00e4rgmise k\u00e4sklusega <code>virsh secret-list<\/code>.<\/li>\n<li> Blokis <code>host<\/code> m\u00e4\u00e4ratakse Ceph-i monitoride aadressid.<\/li>\n<\/ol>\n<p>\nP\u00e4rast konfiguratsioonifaili redigeerimist ja LVM-i konverteerimist RBD-ks saab rakendada muudetud konfiguratsioonifaili ja k\u00e4ivitada virtuaalmasina:<\/p>\n<pre><code class=\"bash\">virsh define $vm_name.xml\nvirsh start $vm_name<\/code><\/pre>\n<p>\nOn \u00f5ige aeg kontrollida, kas virtuaalmasin k\u00e4ivitus korrektselt: seda saab teada n\u00e4iteks SSH kaudu \u00fchendust luues v\u00f5i <code>virsh<\/code>. <\/p>\n<p>Kui virtuaalmasin t\u00f6\u00f6tab korrektselt ja te ei leia muid probleeme, siis saab eemaldada LVM-pildi, mida enam ei kasutata:<\/p>\n<pre><code class=\"bash\">lvremove main\/$vm_image_name<\/code><\/pre>\n<p><\/p>\n<h2>Kokkuv\u00f5te<\/h2>\n<p>\nK\u00f5igi eelnevalt kirjeldatud juhtumitega oleme praktikas kokku puutunud \u2014 loodame, et juhised aitavad ka teisi administraatoreid sarnaste probleemide lahendamisel. Kui teil on m\u00e4rkusi v\u00f5i muid sarnaseid lugusid Ceph-i kasutamisest \u2014 oleksime r\u00f5\u00f5msad neid kommentaarides n\u00e4ha!<\/p>\n<h2>P.S.<\/h2>\n<p>\nLugege ka meie blogist:<\/p>\n<ul>\n<li> \u00ab<noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/flant\/blog\/477680\/\">Meie k\u00e4ed ei ole igavuseks: Rooki klastrite taastamine K8s-is<\/a><\/noindex>\u00bb;<\/li>\n<li> \u00ab<noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/flant\/blog\/451818\/\">Rook v\u00f5i mitte Rook \u2014 see on k\u00fcsimus<\/a><\/noindex>\u00bb;<\/li>\n<li> \u00ab<noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/flant\/blog\/348044\/\">Rook on \u201eise enda teenindav\u201d andmesalvestus Kuberneteses<\/a><\/noindex>\u00bb;<\/li>\n<li> \u00ab<noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/flant\/blog\/329666\/\">Loome p\u00fcsivat salvestust Kuberneteses Cephi p\u00f5hjal<\/a><\/noindex>\u00bb.<\/li>\n<\/ul>\n<p>Allikas: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/flant\/blog\/495870\/\">habr.com<\/a> <\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0418\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044f Ceph \u043a\u0430\u043a \u0441\u0435\u0442\u0435\u0432\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0432 \u0440\u0430\u0437\u043d\u044b\u0445 \u043f\u043e \u043d\u0430\u0433\u0440\u0443\u0436\u0435\u043d\u043d\u043e\u0441\u0442\u0438 \u043f\u0440\u043e\u0435\u043a\u0442\u0430\u0445, \u043c\u044b \u043c\u043e\u0436\u0435\u043c \u0441\u0442\u043e\u043b\u043a\u043d\u0443\u0442\u044c\u0441\u044f \u0441 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0441 \u043f\u0435\u0440\u0432\u043e\u0433\u043e \u0432\u0437\u0433\u043b\u044f\u0434\u0430 \u043d\u0435 \u043a\u0430\u0436\u0443\u0442\u0441\u044f \u043f\u0440\u043e\u0441\u0442\u044b\u043c\u0438 \u0438\u043b\u0438 \u0442\u0440\u0438\u0432\u0438\u0430\u043b\u044c\u043d\u044b\u043c\u0438. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440: \u043c\u0438\u0433\u0440\u0430\u0446\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0441\u0442\u0430\u0440\u043e\u0433\u043e Ceph \u0432 \u043d\u043e\u0432\u044b\u0439 \u0441 \u0447\u0430\u0441\u0442\u0438\u0447\u043d\u044b\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u044b\u0434\u0443\u0449\u0438\u0445 \u0441\u0435\u0440\u0432\u0435\u0440\u043e\u0432 \u0432 \u043d\u043e\u0432\u043e\u043c \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0435; \u0440\u0435\u0448\u0435\u043d\u0438\u0435 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u044b \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0434\u0438\u0441\u043a\u043e\u0432\u043e\u0433\u043e \u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0441\u0442\u0432\u0430 \u0432 Ceph. \u0420\u0430\u0437\u0431\u0438\u0440\u0430\u044f\u0441\u044c \u0441 \u0442\u0430\u043a\u0438\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043c\u044b \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u0435\u043c\u0441\u044f \u0441 [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":77267,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-77266","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.10 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0418\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044f Ceph \u043a\u0430\u043a \u0441\u0435\u0442\u0435\u0432\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0432 \u0440\u0430\u0437\u043d\u044b\u0445 \u043f\u043e \u043d\u0430\u0433\u0440\u0443\u0436\u0435\u043d\u043d\u043e\u0441\u0442\u0438 \u043f\u0440\u043e\u0435\u043a\u0442\u0430\u0445, \u043c\u044b \u043c\u043e\u0436\u0435\u043c \u0441\u0442\u043e\u043b\u043a\u043d\u0443\u0442\u044c\u0441\u044f \u0441 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0441 \u043f\u0435\u0440\u0432\u043e\u0433\u043e \u0432\u0437\u0433\u043b\u044f\u0434\u0430 \u043d\u0435 \u043a\u0430\u0436\u0443\u0442\u0441\u044f \u043f\u0440\u043e\u0441\u0442\u044b\u043c\u0438 \u0438\u043b\u0438 \u0442\u0440\u0438\u0432\u0438\u0430\u043b\u044c\u043d\u044b\u043c\u0438. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440: \u043c\u0438\u0433\u0440\u0430\u0446\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0441\u0442\u0430\u0440\u043e\u0433\u043e Ceph \u0432 \u043d\u043e\u0432\u044b\u0439 \u0441 \u0447\u0430\u0441\u0442\u0438\u0447\u043d\u044b\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u044b\u0434\u0443\u0449\u0438\u0445 \u0441\u0435\u0440\u0432\u0435\u0440\u043e\u0432 \u0432 \u043d\u043e\u0432\u043e\u043c \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0435; \u0440\u0435\u0448\u0435\u043d\u0438\u0435 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u044b \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0434\u0438\u0441\u043a\u043e\u0432\u043e\u0433\u043e \u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0441\u0442\u0432\u0430 \u0432 Ceph. \u0420\u0430\u0437\u0431\u0438\u0440\u0430\u044f\u0441\u044c \u0441 \u0442\u0430\u043a\u0438\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043c\u044b \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u0435\u043c\u0441\u044f \u0441\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.10\" \/>\n\t\t<meta property=\"og:locale\" content=\"et_EE\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47Tips &amp; tricks \u0432 \u0440\u0430\u0431\u043e\u0442\u0435 \u0441 Ceph \u0432 \u043d\u0430\u0433\u0440\u0443\u0436\u0435\u043d\u043d\u044b\u0445 \u043f\u0440\u043e\u0435\u043a\u0442\u0430\u0445 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0418\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044f Ceph \u043a\u0430\u043a \u0441\u0435\u0442\u0435\u0432\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0432 \u0440\u0430\u0437\u043d\u044b\u0445 \u043f\u043e \u043d\u0430\u0433\u0440\u0443\u0436\u0435\u043d\u043d\u043e\u0441\u0442\u0438 \u043f\u0440\u043e\u0435\u043a\u0442\u0430\u0445, \u043c\u044b \u043c\u043e\u0436\u0435\u043c \u0441\u0442\u043e\u043b\u043a\u043d\u0443\u0442\u044c\u0441\u044f \u0441 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0441 \u043f\u0435\u0440\u0432\u043e\u0433\u043e \u0432\u0437\u0433\u043b\u044f\u0434\u0430 \u043d\u0435 \u043a\u0430\u0436\u0443\u0442\u0441\u044f \u043f\u0440\u043e\u0441\u0442\u044b\u043c\u0438 \u0438\u043b\u0438 \u0442\u0440\u0438\u0432\u0438\u0430\u043b\u044c\u043d\u044b\u043c\u0438. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440: \u043c\u0438\u0433\u0440\u0430\u0446\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0441\u0442\u0430\u0440\u043e\u0433\u043e Ceph \u0432 \u043d\u043e\u0432\u044b\u0439 \u0441 \u0447\u0430\u0441\u0442\u0438\u0447\u043d\u044b\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u044b\u0434\u0443\u0449\u0438\u0445 \u0441\u0435\u0440\u0432\u0435\u0440\u043e\u0432 \u0432 \u043d\u043e\u0432\u043e\u043c \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0435; \u0440\u0435\u0448\u0435\u043d\u0438\u0435 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u044b \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0434\u0438\u0441\u043a\u043e\u0432\u043e\u0433\u043e \u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0441\u0442\u0432\u0430 \u0432 Ceph. \u0420\u0430\u0437\u0431\u0438\u0440\u0430\u044f\u0441\u044c \u0441 \u0442\u0430\u043a\u0438\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043c\u044b \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u0435\u043c\u0441\u044f \u0441\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-04-09T11:42:08+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-04-09T11:42:08+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Nipid ja n\u00e4pun\u00e4ited Ceph'i kasutamisel koormatud projektides | ProHoster","description":"Kasutades Ceph'i kui v\u00f5rguh\u00e4irete salvestusruumi erineva koormusega projektides, v\u00f5ime silmitsi seista erinevate \u00fclesannetega, mis esmapilgul ei tundu lihtsad v\u00f5i triviaalsetena. N\u00e4iteks: andmete migreerimine vanast Ceph'ist uude, kus osaliselt kasutatakse varasemaid servereid uues klastris; ketasruumi jaotamise probleemi lahendamine Ceph'is. Selliste \u00fclesannete lahendamisel kohtume","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47Tips &amp; tricks \u0432 \u0440\u0430\u0431\u043e\u0442\u0435 \u0441 Ceph \u0432 \u043d\u0430\u0433\u0440\u0443\u0436\u0435\u043d\u043d\u044b\u0445 \u043f\u0440\u043e\u0435\u043a\u0442\u0430\u0445 | ProHoster","og:description":"\u0418\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044f Ceph \u043a\u0430\u043a \u0441\u0435\u0442\u0435\u0432\u043e\u0435 \u0445\u0440\u0430\u043d\u0438\u043b\u0438\u0449\u0435 \u0432 \u0440\u0430\u0437\u043d\u044b\u0445 \u043f\u043e \u043d\u0430\u0433\u0440\u0443\u0436\u0435\u043d\u043d\u043e\u0441\u0442\u0438 \u043f\u0440\u043e\u0435\u043a\u0442\u0430\u0445, \u043c\u044b \u043c\u043e\u0436\u0435\u043c \u0441\u0442\u043e\u043b\u043a\u043d\u0443\u0442\u044c\u0441\u044f \u0441 \u0440\u0430\u0437\u043b\u0438\u0447\u043d\u044b\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0441 \u043f\u0435\u0440\u0432\u043e\u0433\u043e \u0432\u0437\u0433\u043b\u044f\u0434\u0430 \u043d\u0435 \u043a\u0430\u0436\u0443\u0442\u0441\u044f \u043f\u0440\u043e\u0441\u0442\u044b\u043c\u0438 \u0438\u043b\u0438 \u0442\u0440\u0438\u0432\u0438\u0430\u043b\u044c\u043d\u044b\u043c\u0438. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440: \u043c\u0438\u0433\u0440\u0430\u0446\u0438\u044f \u0434\u0430\u043d\u043d\u044b\u0445 \u0438\u0437 \u0441\u0442\u0430\u0440\u043e\u0433\u043e Ceph \u0432 \u043d\u043e\u0432\u044b\u0439 \u0441 \u0447\u0430\u0441\u0442\u0438\u0447\u043d\u044b\u043c \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u0440\u0435\u0434\u044b\u0434\u0443\u0449\u0438\u0445 \u0441\u0435\u0440\u0432\u0435\u0440\u043e\u0432 \u0432 \u043d\u043e\u0432\u043e\u043c \u043a\u043b\u0430\u0441\u0442\u0435\u0440\u0435; \u0440\u0435\u0448\u0435\u043d\u0438\u0435 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u044b \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0435\u043d\u0438\u044f \u0434\u0438\u0441\u043a\u043e\u0432\u043e\u0433\u043e \u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u0441\u0442\u0432\u0430 \u0432 Ceph. \u0420\u0430\u0437\u0431\u0438\u0440\u0430\u044f\u0441\u044c \u0441 \u0442\u0430\u043a\u0438\u043c\u0438 \u0437\u0430\u0434\u0430\u0447\u0430\u043c\u0438, \u043c\u044b \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u0435\u043c\u0441\u044f \u0441","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/tips-tricks-v-rabote-s-ceph-v-nagruzhennyh-proektah","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-04-09T11:42:08+00:00","article:modified_time":"2020-04-09T11:42:08+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"77266","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 17:20:51","updated":"2022-10-02 10:23:09"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/77266","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=77266"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/77266\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media\/77267"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=77266"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=77266"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=77266"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}