ʻO ka ʻike hana CEPH

Ke nui aku ka ʻikepili ma mua o ka hiki ke hoʻokomo i ka disk hoʻokahi, ʻo ia ka manawa e noʻonoʻo ai e pili ana iā RAID. I koʻu wā kamaliʻi, lohe pinepine au mai koʻu mau mākua: "i kekahi lā e lilo ʻo RAID i mea o ka wā ma mua, e hoʻopiha ka mālama ʻana i nā mea i ka honua, a ʻaʻole ʻoe i ʻike i ka CEPH," no laila ʻo ka mea mua i koʻu ola kūʻokoʻa. ʻo ka hana ʻana i kaʻu puʻupuʻu ponoʻī. ʻO ke kumu o ka hoʻokolohua ʻo ia ka ʻike ʻana i ke ʻano o loko o ka ceph a hoʻomaopopo i ke ʻano o kāna noi. Pehea ka hoʻokō ʻana o ka ceph i nā ʻoihana liʻiliʻi a me nā mea liʻiliʻi? Ma hope o kekahi mau makahiki o ka hana ʻana a me nā nalowale o ka ʻikepili hiki ʻole ke hoʻololi ʻia, ua ʻike ʻia ka ʻike o nā intricacies ʻaʻole maʻalahi nā mea āpau. ʻO nā hiʻohiʻona o ka CEPH ka mea e pale ai i kona hoʻolaha nui ʻana, a ma muli o lākou, ua hōʻea nā hoʻokolohua i kahi hopena make. Ma lalo iho nei ka wehewehe ʻana i nā ʻanuʻu a pau, ka hopena i loaʻa a me nā hopena i huki ʻia. Inā haʻi ka poʻe ʻike i kā lākou ʻike a wehewehe i kekahi mau mea, mahalo wau.

'Ōlelo Aʻo: Ua ʻike ka poʻe ʻōlelo i nā hewa koʻikoʻi ma kekahi o nā manaʻo e pono ai ka hoʻoponopono ʻana i ka ʻatikala holoʻokoʻa.

Hoʻolālā CEPH

Hoʻohui ka pūʻulu CEPH i ka helu ʻokoʻa K o nā disks o ka nui a hoʻopaʻa ʻia i ka ʻikepili ma luna o ia mau mea, e kope kope ana i kēlā me kēia ʻāpana (4 MB ma ka paʻamau) i ka helu i hāʻawi ʻia i nā manawa N.

E noʻonoʻo kākou i ka hihia maʻalahi loa me nā disks like ʻelua. Mai iā lākou hiki iā ʻoe ke hōʻuluʻulu i ka RAID 1 a i ʻole kahi hui me N = 2 - e like ka hopena. Inā ʻekolu mau disks a he ʻokoʻa ka nui o lākou, a laila maʻalahi ke hōʻuluʻulu i kahi hui me N=2: aia kekahi o nā ʻikepili ma nā disks 1 a me 2, aia kekahi ma nā disks 1 a me 3, a ʻo kekahi. ma 2 a me 3, ʻoiai ʻaʻole ʻo RAID (hiki iā ʻoe ke hōʻuluʻulu i kēlā RAID, akā he perversion). Inā ʻoi aku ka nui o nā disks, a laila hiki ke hana i ka RAID 5; He analogue ko CEPH - erasure_code, e kūʻē i nā manaʻo mua o nā mea hoʻomohala, a no laila ʻaʻole i manaʻo ʻia. Manaʻo ʻo RAID 5 he helu liʻiliʻi o nā drive, aia nā mea āpau i ke kūlana maikaʻi. Inā hāʻule kekahi, pono e paʻa nā mea ʻē aʻe a hoʻololi ʻia ka disk a hoʻihoʻi ʻia ka ʻikepili iā ia. ʻO CEPH, me N>=3, paipai i ka hoʻohana ʻana i nā diski kahiko, ʻoiai, inā mālama ʻoe i kekahi mau disks maikaʻi e mālama i hoʻokahi kope o ka ʻikepili, a mālama i nā kope ʻelua a ʻekolu paha i koe ma kahi helu nui o nā disks kahiko, a laila ka ʻike. e palekana, no ka mea, i kēia manawa ke ola nei nā disks hou - ʻaʻohe pilikia, a inā haki kekahi o lākou, a laila ʻo ka hāʻule like ʻole o nā disks ʻekolu me ke ola lawelawe ʻoi aku ma mua o ʻelima mau makahiki, ʻoi aku ka maikaʻi mai nā kikowaena like ʻole, he mea hiki ʻole. hanana.

Aia ka maʻalahi o ka hāʻawi ʻana i nā kope. Ma ka maʻamau, ua manaʻo ʻia ua māhele ʻia ka ʻikepili i nā pūʻulu hoʻolaha PG (~ 100 no kēlā me kēia disk), ua paʻi ʻia kēlā me kēia ma kekahi mau disks. E ʻōlelo kākou K=6, N=2, a laila inā hāʻule kekahi mau diski ʻelua, ʻike ʻia e nalowale ka ʻikepili, no ka mea, e like me ke kumumanaʻo probability, aia ma ka liʻiliʻi o hoʻokahi PG e loaʻa ma kēia mau disks ʻelua. A ʻo ka lilo ʻana o hoʻokahi pūʻulu i loaʻa ʻole nā ​​​​ʻikepili a pau i loko o ka wai. Inā hoʻokaʻawale ʻia nā disks i ʻekolu mau pālua a ʻae ʻia ka ʻikepili e mālama wale ʻia ma nā disks i loko o hoʻokahi pālua, a laila kūʻē ka puʻunaue ʻana i ka hāʻule ʻole o kekahi disk, akā inā hāʻule ʻelua disks, ʻaʻole hiki ke nalowale ka ʻikepili. 100%, akā 3/15 wale nō, a i ka hihia o ka hāʻule ʻole ʻekolu disks - 12/20 wale nō. No laila, ʻaʻole kōkua ka entropy i ka hāʻawi ʻana i ka ʻikepili i ka hoʻomanawanui hewa. E hoʻomaopopo hoʻi no kahi kikowaena faila, hoʻonui nui ka RAM manuahi i ka wikiwiki pane. ʻOi aku ka nui o ka hoʻomanaʻo i kēlā me kēia node, a ʻoi aku ka nui o ka hoʻomanaʻo i nā node a pau, ʻoi aku ka wikiwiki. He mea ʻole kēia he mea maikaʻi o kahi hui ma luna o kahi kikowaena hoʻokahi a, ʻoi aku hoʻi, kahi hāmeʻa NAS, kahi i kūkulu ʻia ai kahi hoʻomanaʻo liʻiliʻi loa.

Ma muli o ka CEPH he ala maikaʻi ia e hana ai i kahi ʻōnaehana mālama ʻikepili hilinaʻi no nā ʻumi o ka TB me ka hiki ke hoʻonui me ka liʻiliʻi o ka hoʻopukapuka ʻana mai nā lako kahiko (eia, ʻoiaʻiʻo, e koi ʻia nā kumukūʻai, akā liʻiliʻi ke hoʻohālikelike ʻia me nā ʻōnaehana mālama kalepa).

Hoʻokō pūʻulu

No ka hoʻokolohua, e lawe mākou i kahi kamepiula decommissioned Intel DQ57TM + Intel core i3 540 + 16 GB o RAM. E hoʻonohonoho mākou i nā disks 2 TB ʻehā i kahi mea e like me RAID10, ma hope o ka hoʻāʻo kūleʻa e hoʻohui mākou i kahi node ʻelua a me ka helu like o nā disks.

Ke hoʻokomo nei i Linux. Pono ka puunaue i ka hiki ke hoʻopilikino a paʻa. Hoʻokō ʻo Debian lāua ʻo Suse i nā koi. Loaʻa iā Suse kahi mea hoʻonohonoho maʻalahi e hiki ai iā ʻoe ke hoʻopau i kekahi pūʻolo; ʻO ka mea pōʻino, ʻaʻole hiki iaʻu ke noʻonoʻo i nā mea e hiki ke hoʻolei ʻia me ka ʻole o ka hōʻino ʻana i ka ʻōnaehana. E hoʻouka iā Debian me ka hoʻohana ʻana i ka debootstrap buster. Hoʻokomo ka koho min-base i kahi ʻōnaehana haʻihaʻi i nele i nā mea hoʻokele. ʻAʻole nui ka ʻokoʻa i ka nui i hoʻohālikelike ʻia i ka mana piha. No ka mea ua hana ʻia ka hana ma kahi mīkini kino, makemake wau e lawe i nā kiʻi, e like me nā mīkini virtual. Hāʻawi ʻia kēia koho e LVM a i ʻole btrfs (a i ʻole xfs, a i ʻole zfs - ʻaʻole nui ka ʻokoʻa). ʻAʻole ikaika nā paʻi kiʻi LVM. E hoʻouka i nā btrfs. A aia ka bootloader i ka MBR. ʻAʻohe kumu o ka hoʻopili ʻana i kahi disk 50 MB me kahi ʻāpana FAT i ka wā e hiki ai iā ʻoe ke kiola iā ia i loko o kahi papa ʻaina ʻāpana 1 MB a hoʻokaʻawale i nā wahi āpau no ka ʻōnaehana. Lawe ʻia ka 700 MB ma ka disk. ʻAʻole wau e hoʻomanaʻo i ka nui o ka hoʻokomo ʻana o SUSE maʻamau, manaʻo wau e pili ana i 1.1 a i ʻole 1.4 GB.

E hoʻokomo iā CEPH. Hoʻokuʻu mākou i ka mana 12 ma ka waihona debian a hoʻopili pololei mai ka pūnaewele 15.2.3. Ke hahai nei mākou i nā ʻōlelo aʻoaʻo mai ka ʻāpana "E hoʻokomo i ka CEPH me ka lima" me nā ʻōlelo hōʻike:

  • Ma mua o ka hoʻopili ʻana i ka waihona, pono ʻoe e hoʻokomo i ka gnupg wget ca-certificates
  • Ma hope o ka hoʻopili ʻana i ka waihona, akā ma mua o ka hoʻokomo ʻana i ka pūpū, ua kāpae ʻia ka hoʻokomo ʻana i nā pūʻolo: apt -y --no-install-recommends install ceph-common ceph-mon ceph-osd ceph-mds ceph-mgr
  • I ka hoʻokomo ʻana iā CEPH, no nā kumu ʻike ʻole, e hoʻāʻo ʻo ia e hoʻokomo i ka lvm2. Ma ke kumu, ʻaʻole ia he mea minamina, akā ua pau ka hoʻonohonoho ʻana, no laila ʻaʻole e hoʻokomo ʻo CEPH.

    Ua kōkua kēia papa:

    cat << EOF >> /var/lib/dpkg/status
    Package: lvm2
    Status: install ok installed
    Priority: important
    Section: admin
    Installed-Size: 0
    Maintainer: Debian Adduser Developers <[email protected]>
    Architecture: all
    Multi-Arch: foreign
    Version: 113.118
    Description: No-install
    EOF
    

Hōʻike pūʻulu

ceph-osd - ke kuleana no ka mālama ʻana i ka ʻikepili ma ka disk. No kēlā me kēia disk, hoʻomaka ʻia kahi lawelawe pūnaewele e ʻae a hoʻokō i nā noi e heluhelu a kākau paha i nā mea. Hana ʻia ʻelua ʻāpana ma ka disk. Aia kekahi o ia mau ʻike e pili ana i ka pūʻulu, ka helu disk, a me nā kī o ka pūʻulu. Hana ʻia kēia ʻike 1KB i hoʻokahi manawa i ka hoʻohui ʻana i kahi disk a ʻaʻole i ʻike ʻia e loli. ʻAʻohe ʻōnaehana faila a mālama i ka ʻikepili binary CEPH. ʻO ka hoʻokomo maʻalahi i nā mana mua i hana i kahi ʻāpana 100MB xfs no ka ʻike lawelawe. Ua hoʻololi au i ka disk i MBR a hāʻawi wale i 16MB - ʻaʻole hoʻopiʻi ka lawelawe. Manaʻo wau hiki ke hoʻololi ʻia ka xfs me ka ext me ka pilikia ʻole. Hoʻokomo ʻia kēia ʻāpana i /var/lib/…, kahi e heluhelu ai ka lawelawe i ka ʻike e pili ana i ka OSD a loaʻa pū i kahi kuhikuhi i ka mea poloka kahi i mālama ʻia ai ka ʻikepili binary. Ma ka manaʻo, hiki iā ʻoe ke kau koke i nā faila kōkua ma /var/lib/…, a hoʻokaʻawale i ka disk holoʻokoʻa no ka ʻikepili. I ka hana ʻana i kahi OSD ma o ka ceph-deploy, hana ʻia kahi lula e kau i ka pā i / var/lib/…, a ua hāʻawi ʻia ka mea hoʻohana ceph i nā kuleana e heluhelu i ka mea poloka i makemake ʻia. Inā hoʻokomo lima ʻoe, pono ʻoe e hana i kēia iā ʻoe iho; ʻaʻole ʻōlelo ka palapala i kēia. He mea pono no hoi e hoakaka i ka osd memory target parameter i lawa ka hoomanao kino.

ceph-mds. Ma kahi haʻahaʻa, ʻo CEPH kahi mālama mea. Hiki i ka hiki ke ālai i ka waiho ʻana i ka mālama ʻana i kēlā me kēia poloka 4MB ma ke ʻano he mea. Hana ʻia ka waihona waihona ma ke kumu like. Hana ʻia ʻelua mau loko: hoʻokahi no ka metadata, ʻo kekahi no ka ʻikepili. Hoʻohui ʻia lākou i kahi ʻōnaehana faila. I kēia manawa, hana ʻia kekahi ʻano moʻolelo, no laila inā e holoi ʻoe i ka ʻōnaehana faila, akā mālama i nā loko ʻelua, ʻaʻole hiki iā ʻoe ke hoʻihoʻi. Aia ke kaʻina hana no ka unuhi ʻana i nā faila ma nā poloka, ʻaʻole au i hoʻāʻo. ʻO ka lawelawe ceph-mds ke kuleana no ke komo ʻana i ka ʻōnaehana faila. Pono kēlā me kēia ʻōnaehana faila i kahi ʻano ʻokoʻa o ka lawelawe. Aia kahi koho "index", e hiki ai iā ʻoe ke hana i ke ʻano o nā ʻōnaehana faila i hoʻokahi - ʻaʻole i hoʻāʻo ʻia.

Ceph-mon - Ke mālama nei kēia lawelawe i kahi palapala 'āina o ka pūpū. Loaʻa ka ʻike e pili ana i nā OSD āpau, kahi algorithm no ka hāʻawi ʻana i nā PG i nā OSD a, ʻo ka mea nui loa, ka ʻike e pili ana i nā mea āpau (ʻaʻole maopopo iaʻu nā kikoʻī o kēia mīkini: aia kahi papa kuhikuhi /var/lib/ceph/mon/…/ store.db, he 26MB ka waihona nui, a ma kahi hui o 105K mau mea, ua lilo ia ma luna o 256 bytes no kēlā me kēia mea - Manaʻo wau e mālama ka monitor i kahi papa inoa o nā mea āpau a me nā PG i loko. aia lākou). ʻO ka pōʻino i kēia papa kuhikuhi ka hopena i ka nalowale o nā ʻikepili āpau i ka pūʻulu. No laila ua huki ʻia ka hopena e hōʻike ana ʻo CRUSH i ke ʻano o nā PG ma ka OSD, a me ke ʻano o nā mea i loaʻa ma nā PG - ua mālama ʻia lākou i loko o ka waihona, ʻaʻohe mea e pale aku ai nā mea hoʻomohala i kēia huaʻōlelo. ʻO ka hopena, ʻo ka mea mua, ʻaʻole hiki iā mākou ke hoʻokomo i ka ʻōnaehana ma kahi flash drive ma ke ʻano RO, no ka mea e hoʻopaʻa mau ʻia ka waihona, pono kahi disk hou no kēia (ʻaʻole ʻoi aku ma mua o 1 GB), ʻo ka lua, pono e loaʻa kahi kope i ka manawa maoli kēia kumu. Inā nui nā mākaʻikaʻi, a laila e hōʻoia ʻia ka hoʻomanawanui hewa, akā i kā mākou hihia hoʻokahi wale nō ka nānā, ʻelua ʻelua. Aia kahi kaʻina hana no ka hoʻihoʻi ʻana i kahi mākaʻikaʻi e pili ana i ka ʻikepili OSD, ua hoʻohana wau iā ia i ʻekolu manawa no nā kumu like ʻole, a ʻekolu mau manawa ʻaʻohe memo hewa, ʻaʻohe ʻikepili. ʻO ka mea pōʻino, ʻaʻole hana kēia mīkini. A i ʻole mākou e hana i kahi pānaʻi liʻiliʻi ma ka OSD a hōʻuluʻulu i kahi RAID e mālama i ka waihona, e loaʻa maoli ka hopena maikaʻi ʻole i ka hana, a i ʻole mākou e hoʻokaʻawale i ʻelua mau mea pono pilikino ponoʻī, ʻoi aku ka USB, i ʻole e noho i nā awa.

rados-gw - hoʻokuʻu aku i kahi waiho mea ma o ka protocol S3 a me nā mea like. Hoʻokumu i nā loko he nui, ʻaʻole maopopo ke kumu. ʻAʻole au i hoʻokolohua nui.

ceph-mgr - Ke kau ʻana i kēia lawelawe, ua hoʻomaka ʻia kekahi mau modula. ʻO kekahi o lākou he autoscale ʻaʻole hiki ke hoʻopau ʻia. Hoʻoikaika ia e mālama i ka nui kūpono o PG/OSD. Inā makemake ʻoe e hoʻomalu i ka ratio me ka lima, hiki iā ʻoe ke hoʻopau i ka scaling no kēlā me kēia kolamu, akā i kēia hihia, hāʻule ka module me ka mahele o 0, a lilo ke kūlana cluster i ERROR. Ua kākau ʻia ka module ma Python, a inā ʻoe e ʻōlelo i ka laina e pono ai i loko, alakaʻi kēia i kona hoʻopau ʻana. Moloā loa e hoʻomanaʻo i nā kikoʻī.

Ka papa inoa o nā kumu i hoʻohana ʻia:

Hoʻokomo i ka CEPH
Hoʻihoʻi mai ka holo ʻole o ka nānā ʻana

Nā papa inoa palapala:

Ke hoʻouka nei i ka ʻōnaehana ma o ka debootstrap

blkdev=sdb1
mkfs.btrfs -f /dev/$blkdev
mount /dev/$blkdev /mnt
cd /mnt
for i in {@,@var,@home}; do btrfs subvolume create $i; done
mkdir snapshot @/{var,home}
for i in {var,home}; do mount -o bind @${i} @/$i; done
debootstrap buster @ http://deb.debian.org/debian; echo $?
for i in {dev,proc,sys}; do mount -o bind /$i @/$i; done
cp /etc/bash.bashrc @/etc/

chroot /mnt/@ /bin/bash
echo rbd1 > /etc/hostname
passwd
uuid=`blkid | grep $blkdev | cut -d """ -f 2`
cat << EOF > /etc/fstab
UUID=$uuid / btrfs noatime,nodiratime,subvol=@ 0 1
UUID=$uuid /var btrfs noatime,nodiratime,subvol=@var 0 2
UUID=$uuid /home btrfs noatime,nodiratime,subvol=@home 0 2
EOF
cat << EOF >> /var/lib/dpkg/status
Package: lvm2
Status: install ok installed
Priority: important
Section: admin
Installed-Size: 0
Maintainer: Debian Adduser Developers <[email protected]>
Architecture: all
Multi-Arch: foreign
Version: 113.118
Description: No-install

Package: sudo
Status: install ok installed
Priority: important
Section: admin
Installed-Size: 0
Maintainer: Debian Adduser Developers <[email protected]>
Architecture: all
Multi-Arch: foreign
Version: 113.118
Description: No-install
EOF

exit
grub-install --boot-directory=@/boot/ /dev/$blkdev
init 6

apt -yq install --no-install-recommends linux-image-amd64 bash-completion ed btrfs-progs grub-pc iproute2 ssh  smartmontools ntfs-3g net-tools man
exit
grub-install --boot-directory=@/boot/ /dev/$blkdev
init 6

E hana i kahi hui

apt -yq install --no-install-recommends gnupg wget ca-certificates
echo 'deb https://download.ceph.com/debian-octopus/ buster main' >> /etc/apt/sources.list
wget -q -O- 'https://download.ceph.com/keys/release.asc' | apt-key add -
apt update
apt -yq install --no-install-recommends ceph-common ceph-mon

echo 192.168.11.11 rbd1 >> /etc/hosts
uuid=`cat /proc/sys/kernel/random/uuid`
cat << EOF > /etc/ceph/ceph.conf
[global]
fsid = $uuid
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon allow pool delete = true
mon host = 192.168.11.11
mon initial members = rbd1
mon max pg per osd = 385
osd crush update on start = false
#osd memory target = 2147483648
osd memory target = 1610612736
osd scrub chunk min = 1
osd scrub chunk max = 2
osd scrub sleep = .2
osd pool default pg autoscale mode = off
osd pool default size = 1
osd pool default min size = 1
osd pool default pg num = 1
osd pool default pgp num = 1
[mon]
mgr initial modules = dashboard
EOF

ceph-authtool --create-keyring ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *'
ceph-authtool --create-keyring ceph.client.admin.keyring --gen-key -n client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *'
cp ceph.client.admin.keyring /etc/ceph/
ceph-authtool --create-keyring bootstrap-osd.ceph.keyring --gen-key -n client.bootstrap-osd --cap mon 'profile bootstrap-osd' --cap mgr 'allow r'
cp bootstrap-osd.ceph.keyring /var/lib/ceph/bootstrap-osd/ceph.keyring
ceph-authtool ceph.mon.keyring --import-keyring /etc/ceph/ceph.client.admin.keyring
ceph-authtool ceph.mon.keyring --import-keyring /var/lib/ceph/bootstrap-osd/ceph.keyring
monmaptool --create --add rbd1 192.168.11.11 --fsid $uuid monmap
rm -R /var/lib/ceph/mon/ceph-rbd1/*
ceph-mon --mkfs -i rbd1 --monmap monmap --keyring ceph.mon.keyring
chown ceph:ceph -R /var/lib/ceph
systemctl enable ceph-mon@rbd1
systemctl start ceph-mon@rbd1
ceph mon enable-msgr2
ceph status

# dashboard

apt -yq install --no-install-recommends ceph-mgr ceph-mgr-dashboard python3-distutils python3-yaml
mkdir /var/lib/ceph/mgr/ceph-rbd1
ceph auth get-or-create mgr.rbd1 mon 'allow profile mgr' osd 'allow *' mds 'allow *' > /var/lib/ceph/mgr/ceph-rbd1/keyring
systemctl enable ceph-mgr@rbd1
systemctl start ceph-mgr@rbd1
ceph config set mgr mgr/dashboard/ssl false
ceph config set mgr mgr/dashboard/server_port 7000
ceph dashboard ac-user-create root 1111115 administrator
systemctl stop ceph-mgr@rbd1
systemctl start ceph-mgr@rbd1

Hoʻohui OSD (mahele)

apt install ceph-osd

osdnum=`ceph osd create`
mkdir -p /var/lib/ceph/osd/ceph-$osdnum
mkfs -t xfs /dev/sda1
mount -t xfs /dev/sda1 /var/lib/ceph/osd/ceph-$osdnum
cd /var/lib/ceph/osd/ceph-$osdnum
ceph auth get-or-create osd.0 mon 'profile osd' mgr 'profile osd' osd 'allow *' > /var/lib/ceph/osd/ceph-$osdnum/keyring
ln -s /dev/disk/by-partuuid/d8cc3da6-02  block
ceph-osd -i $osdnum --mkfs
#chown ceph:ceph /dev/sd?2
chown ceph:ceph -R /var/lib/ceph
systemctl enable ceph-osd@$osdnum
systemctl start ceph-osd@$osdnum

Hōʻuluʻulu

ʻO ka waiwai kūʻai nui o CEPH ʻo CRUSH - kahi algorithm no ka helu ʻana i kahi o ka ʻikepili. Hāʻawi nā mākaʻi i kēia algorithm i nā mea kūʻai aku, a laila noi pololei nā mea kūʻai aku i ka node makemake a me ka OSD makemake. Mālama ʻo CRUSH ʻaʻohe kikowaena. He faila liʻiliʻi hiki iā ʻoe ke paʻi a kau ʻia ma ka paia. Ua hōʻike ka hoʻomaʻamaʻa ʻaʻole ʻo CRUSH kahi palapala ʻāina paʻa. Inā hoʻopau ʻoe a hana hou i nā mākaʻikaʻi, mālama i nā OSD a me CRUSH, a laila ʻaʻole lawa kēia e hoʻihoʻi i ka pūʻulu. Mai kēia ua hoʻoholo ʻia e mālama kēlā me kēia monitor i kekahi mau metadata e pili ana i ka pūʻulu holoʻokoʻa. ʻO ka liʻiliʻi liʻiliʻi o kēia metadata ʻaʻole ia e kau i nā kaohi i ka nui o ka puʻupuʻu, akā pono e hōʻoia i ko lākou palekana, kahi e hoʻopau ai i ka mālama ʻana i ka disk ma o ka hoʻokomo ʻana i ka ʻōnaehana ma kahi flash drive a haʻalele i nā pūpū me ka liʻiliʻi o ʻekolu nodes. ʻO ke kulekele koʻikoʻi o ka mea hoʻomohala e pili ana i nā hiʻohiʻona koho. Ma kahi mamao loa mai ka minimalism. Aia ka palapala ma ke kiʻekiʻe o "mahalo no ka mea i loaʻa iā mākou, akā he mea liʻiliʻi loa ia." Hāʻawi ʻia ka hiki ke kamaʻilio me nā lawelawe ma kahi haʻahaʻa, akā pili ka palapala i kēia kumuhana ma ke ʻano, no laila ʻoi aku ka ʻole ma mua o ka ʻae. ʻAʻohe manawa kūpono e hoʻihoʻi i ka ʻikepili mai kahi kūlana pilikia.

Nā koho no ka hana hou aʻe: haʻalele iā CEPH a hoʻohana i ka banal multi-disk btrfs (a i ʻole xfs, zfs), e ʻike i ka ʻike hou e pili ana i ka CEPH, e hiki ai iā ʻoe ke hana ma lalo o nā kūlana i kuhikuhi ʻia, e hoʻāʻo e kākau i kāu waihona ponoʻī ma ke ʻano he holomua. hoʻonaʻauao.

Source: www.habr.com

Pākuʻi i ka manaʻo hoʻopuka