LINSTOR polokelo le kopanyo ea eona le OpenNebula

Haufinyane tjena, bashanyana ba LINBIT ba hlahisitse tharollo ea bona e ncha ea SDS - Linstor. Ena ke polokelo ea mahala e thehiloeng ho mahlale a netefalitsoeng: DRBD, LVM, ZFS. Linstor e kopanya bonolo le meaho e hlophisitsoeng hantle, e u lumellang ho fihlela botsitso le liphetho tse khahlang haholo.

Kajeno ke rata ho bua ka eona ka botlalo le ho bonts'a hore na e ka kopanngoa habonolo joang le OpenNebula ho sebelisa linstor_un - mokhanni e mocha oo ke o hlahisitseng ka ho khetheha bakeng sa morero ona.

Linstor hammoho le OpenNebula e u lumella ho haha ​​​​leru le potlakileng le le ts'epahalang le ka sebelisoang habonolo lits'ebetsong tsa hau.

Mehaho ea Linstor

Linstor ha se sistimi ea faele kapa polokelo ea "block" ka 'ngoe, Linstor ke sebini se fanang ka sekhahla se u lumellang hore u iketsetse tlhahiso ea li-volumes ho LVM kapa ZFS le ho li pheta u sebelisa DRBD9.

Ho senya maikutlo

Empa ema, DRBD? - Ke hobane'ng ha e iketsetsa 'me e ka sebetsa joang?

Ha re hopoleng tse fetileng, ha DRBD8 e ne e tumme haholo. Tšebeliso ea eona e tloaelehileng e ne e kenyelletsa ho theha sesebelisoa se le seng se seholo sa block le ho se khaola likotoana tse ngata tse nyenyane, ho sebelisa LVM e tšoanang. Mofuta oa mdadm RAID-1 empa o na le phetisetso holim'a marang-rang.

Mokhoa ona ha o na litšitiso, ka hona, ka ho fihla ha DRBD9, melao-motheo ea moralo oa polokelo e fetohile; hona joale ho entsoe sesebelisoa se arohaneng sa DRBD bakeng sa mochini o mong le o mong oa sebele.

Mokhoa o nang le lisebelisoa tse ikemetseng thibela e lumella ho sebelisoa hamolemo ha sebaka sehlopheng, hape e eketsa lintlha tse ling tse eketsehileng. Mohlala, bakeng sa sesebelisoa se seng le se seng u ka tseba palo ea likopi, sebaka sa bona le litlhophiso tsa motho ka mong. Li bonolo ho li etsa / ho li hlakola, ho nka linepe, ho fetola boholo ba tsona, ho nolofalletsa ho ngolla le tse ling tse ngata. Ho bohlokoa ho hlokomela hore DRBD9 e boetse e ts'ehetsa quorum, e u lumellang ho qoba maemo a ho arohana ha boko.

Lisebelisoa le li-backends

Ha o theha sesebelisoa se secha sa block, Linstor o beha palo e hlokahalang ea likopi ho li-node tse fapaneng sehlopheng. Re tla bitsa setšoantšo se seng le se seng se joalo mohloli oa DRBD.

Ho na le mefuta e 'meli ea lisebelisoa:

• Mohloli oa data - ke sesebelisoa sa DRBD se sebakeng sa node letamong la LVM kapa ZFS.
  Hona joale ho na le tšehetso bakeng sa li-backends tse 'maloa' me palo ea tsona e ntse e hōla kamehla. Ho na le tšehetso bakeng sa LVM, ThinLVM le ZFS. Tse peli tsa ho qetela li u lumella ho etsa le ho sebelisa linepe.
• Sesebelisoa sa Diskless - ke sesebelisoa sa DRBD se behiloeng node ntle le mokokotlo, empa se lumella hore se tšoaroe e le sesebelisoa se tloaelehileng sa thibela; mesebetsi eohle ea ho bala / ho ngola e tla fetisetsoa mehloling ea data. Analogue e haufi haholo le lisebelisoa tse se nang disk ke iSCSI LUN.

Sesebelisoa se seng le se seng sa DRBD se ka ba le likopi tse ka bang 8, 'me ke e le' ngoe feela ea tsona e ka sebetsang ka ho sa feleng - ka sehloohong, ba bang kaofela ba tla ba teng sekondari mme ts'ebeliso ea bona e ke ke ea khonahala ha feela ho na le Primary e le 'ngoe, ke hore, ba tla etsa replicate data lipakeng tsa bona.

Ka ho kenya sesebelisoa sa DRBD ka har'a sistimi, e fetoha ka bo eona ka sehloohong, kahoo esita le mohloli oa Diskless, ka mantsoe a DRBD, e ka ba Primary.

Joale ke hobane'ng ha u hloka Linstor?

Ka ho beha mesebetsi eohle e amanang le lisebelisoa ho kernel, Linstor ha e le hantle ke sesebelisoa se tloaelehileng sa Java se u lumellang ho iketsetsa tlhahiso ea lisebelisoa tsa DRBD habonolo.
Ho feta moo, mohloli o mong le o mong o entsoeng ke eena e tla ba sehlopha se ikemetseng sa DRBD se sebetsang ka bolokolohi, ho sa tsotellehe boemo ba sefofane sa taolo le lisebelisoa tse ling tsa DRBD.

Linstor e na le likarolo tse peli feela:

• Molaoli oa Linstor - Molaoli ea ka sehloohong, ea fanang ka API bakeng sa ho theha le ho laola lisebelisoa. E boetse e buisana le li-satellite, e sheba sebaka sa mahala ho tsona, 'me e romela mesebetsi ho theha le ho hlakola lisebelisoa tse ncha. E sebetsa ka lekhetlo le le leng 'me e sebelisa database, e ka bang ka hare (H2) kapa ka ntle (PostgreSQL, MySQL, MariaDB)
• Linstor - sathelaete - E kentsoe litsing tsohle tsa polokelo mme e fa molaoli tlhahisoleseling mabapi le sebaka sa mahala, hape e etsa mesebetsi e amohetsoeng ho tsoa ho molaoli ho theha le ho hlakola meqolo e mecha le lisebelisoa tsa DRBD holim'a tsona.

Linstor e sebetsa ka lintlha tse latelang tsa bohlokoa:

• noute - Seva ea 'mele eo mehloli ea DRBD e tla theoa le ho sebelisoa ho eona.
• Letamo la polokelo - Letamo la LVM kapa la ZFS le thehiloe sebakeng seo lisebelisoa tsa DRBD li tla beng li le teng. Letamo la diskless le lona le ka khoneha - lena ke letamo leo ho lona ho tla ba le lisebelisoa tse se nang disk.
• Tlhaloso ea Mohloli - Tlhaloso ea sesebelisoa ha e le hantle ke mohlala o hlalosang lebitso le thepa eohle ea lona.
• Tlhaloso ea Molumo - Tlhaloso ea molumo. Sesebelisoa se seng le se seng se ka ba le meqolo e mengata, molumo ka mong o tlameha ho ba le boholo.
• Lisebelisoa - Mohlala o entsoeng oa sesebelisoa sa block, mohloli o mong le o mong o tlameha ho behoa node e itseng le letamong le leng la polokelo.

Ho kenya Linstor

Ke khothaletsa ho sebelisa Ubuntu joalo ka sistimi, hobane ... e teng bakeng sa hae e lokile PPA:

add-apt-repository ppa:linbit/linbit-drbd9-stack
apt-get update

Kapa Debian, moo Linstor e ka kenngoa sebakeng sa polokelo ea molao bakeng sa Proxmox:

wget -O- https://packages.linbit.com/package-signing-pubkey.asc | apt-key add -
PVERS=5 && echo "deb http://packages.linbit.com/proxmox/ proxmox-$PVERS drbd-9.0" > 
    /etc/apt/sources.list.d/linbit.list
apt-get update

molaoli eo

Tsohle li bonolo mona:

apt-get install linstor-controller linstor-client
systemctl enable linstor-controller
systemctl start linstor-controller

Li-node tsa polokelo

Linux kernel hajoale e tsamaea le mojule oa kernel ea sefateng DRBD8, ka bomalimabe ha e lumellane le rona mme re hloka ho kenya DRBD9:

apt-get install drbd-dkms

Joalo ka ha boikoetliso bo bontša, mathata a mangata a hlaha hantle hobane module ea DRBD8 e kentsoe sistimi, eseng DRBD9. Ka lehlohonolo, sena se bonolo ho hlahloba ka ho matha:

modprobe drbd
cat /proc/drbd

Haeba u bona mofuta: 9 - ho bolela hore tsohle li lokile haeba mofuta: 8 - ho bolela hore ho na le phoso mme o hloka ho nka mehato e eketsehileng ho fumana mabaka.

Joale ha re kenye linstor-sathelaete и lisebelisoa tsa drbd:

apt-get install linstor-satellite drbd-utils
systemctl enable linstor-satellite
systemctl start linstor-satellite

Etsa sehlopha

Matamo a polokelo le li-node

E le backend re tla nka ThinLVM, hobane ke eona e bonolo ka ho fetisisa ebile e ts'ehetsa linepe.
Beha lvm2, haeba ha u so etse joalo, ha re theheng letamo la ThinLVM libakeng tsohle tsa rona tsa polokelo:

sudo vgcreate drbdpool /dev/sdb
sudo lvcreate -L 800G -T drbdpool/thinpool

Liketso tsohle tse ling li ka etsoa ka ho toba ho molaoli:

Ha re kenye li-node tsa rona:

linstor node create node1 127.0.0.11
linstor node create node2 127.0.0.12
linstor node create node3 127.0.0.13

Ha re theheng matamo a polokelo:

linstor storage-pool create lvmthin node1 data drbdpool/thinpool
linstor storage-pool create lvmthin node2 data drbdpool/thinpool
linstor storage-pool create lvmthin node3 data drbdpool/thinpool

Joale a re hlahlobeng matamo a entsoeng:

linstor storage-pool list

Haeba ntho e 'ngoe le e' ngoe e etsoa hantle, joale re lokela ho bona ntho e kang:

+------------------------------------------------- ------------------------------------------------- ----+ | StoragePool | Node | Mokhanni | Lebitso la Letsha | FreeCapacity | TotalCapacity | E tšehetsaSnapshots | |----------------------------------------------- - ------------------------------------------------ - ---| | data | node1 | LVM_THIN | drbdpool/thinpool | 64 GiB | 64 GiB | 'nete | | data | node2 | LVM_THIN | drbdpool/thinpool | 64 GiB | 64 GiB | 'nete | | data | node3 | LVM_THIN | drbdpool/thinpool | 64 GiB | 64 GiB | 'nete | +------------------------------------------------- ------------------------------------------------- ----+

Lisebelisoa tsa DRBD

Joale ha re lekeng ho theha sesebelisoa sa rona se secha sa DRBD:

linstor resource-definition create myres
linstor volume-definition create myres 1G
linstor resource create myres --auto-place 2

Ha re hlahlobe lisebelisoa tse entsoeng:

linstor resource list 

+------------------------------------------------- ------------------------------------------------- ---+ | Node | Mohloli | StoragePool | BolumoNr | MinorNr | DeviceName | E abetsoe | Sebelisa | Naha | |----------------------------------------------- - ------------------------------------------------ - --| | node1 | mero | data | 0 | 1084 | /dev/drbd1084 | 52KiB | E sa sebelisoeng | UpToDate | | node2 | mero | data | 0 | 1084 | /dev/drbd1084 | 52KiB | E sa sebelisoeng | UpToDate | +------------------------------------------------- ------------------------------------------------- ---+

E kholo! - rea bona hore sesebelisoa se entsoe ka li-node tse peli tsa pele, re ka boela ra leka ho theha sesebelisoa sa diskless ho la boraro:

linstor resource create --diskless node3 myres

Ka nodes u tla lula u fumana sesebelisoa sena e le /dev/drbd1084 kapa /dev/drbd/by-res/myres/0

Ena ke tsela eo Linstor e sebetsang ka eona, o ka fumana lintlha tse ling ho tsoa ho litokomane tsa molao.

Joale ke tla u bolella mokhoa oa ho e kopanya le OpenNebula

Ho theha OpenNebula

Ha ke na ho teba haholo ts'ebetsong ea ho seta ea OpenNebula, hobane ... mehato eohle e hlalosoa ka ho qaqileng ka litokomane tsa molao, eo ke u khothalletsang hore u ikopanye le eona, ke tla u bolella feela ka ho kopanngoa ha OpenNebula le Linstor.

linstor_un

Ho rarolla bothata bona, ke ngotse mokhanni oa ka - linstor_un, hajoale e fumaneha joalo ka plugin mme e tlameha ho kengoa ka thoko.

Kenyelletso eohle e etsoa ho li-node tsa OpenNebula tse ka pele mme ha e hloke liketso tse ling ho li-compute node.

Pele ho tsohle, re lokela ho etsa bonnete ba hore re na le jq и linstor-client:

apt-get install jq linstor-client

sehlopha linstor node list e lokela ho hlahisa lenane la li-node. Li-compute node tsohle tsa OpenNebula li tlameha ho kenyelletsoa sehlopheng sa Linstor.

Khoasolla le ho kenya plugin:

curl -L https://github.com/OpenNebula/addon-linstor_un/archive/master.tar.gz | tar -xzvf - -C /tmp

mv /tmp/addon-linstor_un-master/vmm/kvm/* /var/lib/one/remotes/vmm/kvm/

mkdir -p /var/lib/one/remotes/etc/datastore/linstor_un
mv /tmp/addon-linstor_un-master/datastore/linstor_un/linstor_un.conf /var/lib/one/remotes/etc/datastore/linstor_un/linstor_un.conf

mv /tmp/addon-linstor_un-master/datastore/linstor_un /var/lib/one/remotes/datastore/linstor_un
mv /tmp/addon-linstor_un-master/tm/linstor_un /var/lib/one/remotes/tm/linstor_un

rm -rf /tmp/addon-linstor_un-master

Joale re hloka ho e kenyelletsa ho OpenNebula config, ho etsa sena re latela mehato e bonolo e hlalositsoeng mona.

Ebe o qala OpenNebula hape:

systemctl restart opennebula

'Me eketsa polokelo ea rona ea data, sistimi:

cat > system-ds.conf <<EOT
NAME="linstor-system"
TYPE="SYSTEM_DS"
STORAGE_POOL="data"
AUTO_PLACE="2"
CLONE_MODE="snapshot"
CHECKPOINT_AUTO_PLACE="1"
BRIDGE_LIST="node1 node2 node3"
TM_MAD="linstor_un"
EOT

onedatastore create system-ds.conf

Le lebenkele la litšoantšo:

cat > images-ds.conf <<EOT
NAME="linstor-images"
TYPE="IMAGE_DS"
STORAGE_POOL="data"
AUTO_PLACE="2"
BRIDGE_LIST="node1 node2 node3"
DISK_TYPE="BLOCK"
DS_MAD="linstor_un"
TM_MAD="linstor_un"
EOT

onedatastore create images-ds.conf

• Parameter AUTO_PLACE e bonts'a palo ea likopi tsa data tse tla etsoa bakeng sa setšoantšo se seng le se seng se secha ho OpenNebula.
• Parameter CLONE_MODE e bonts'a hantle hore na litšoantšo li tla etsoa joang ha ho etsoa mechini e mecha, snapshot - e tla theha senepe sa setšoantšo ebe e sebelisa mochini o hlakileng ho tsoa ho snapshot, copy - e tla etsa kopi e felletseng ea setšoantšo bakeng sa mochini o mong le o mong oa nnete.
• В BRIDGE_LIST Ho khothalletsoa ho hlakisa li-node tsohle tse tla sebelisoa ho etsa ts'ebetso ea cloning ea setšoantšo.

Bakeng sa lenane le felletseng la li-parameter tse tšehetsoeng, bona README morero.

Sena se phethela ho seta, joale o ka khoasolla lisebelisoa tse ling ho tsoa ho ofisiri Sebaka sa Maraka sa OpenNebula le ho theha mechine ea sebele ho tsoa ho eona.

Sehokelo sa morero:
https://github.com/OpenNebula/addon-linstor_un

Source: www.habr.com