ืืืึธืก ืืืจ ืืืขืื ืจืขืื ืืืขืื:
ืืื ืฆื ืืขืฉืืืื ื ืฆืขืืืืงืืขื ืฉืขืจื ืกืืึธืจืืืืฉ ืคึฟืึทืจ ืฆืืืื ืกืขืจืืืขืจืก ืืืืืจื ืืืืฃ drbd + ocfs2 ืกืึทืืืฉืึทื ื.
ืืืึธืก ืืืขื ืืึธืก ืืืื ื ืืฆืืง ืคึฟืึทืจ:
ืืขืจ ืืืืึธืจืืึทื ืืืขื ืืืื ื ืืฆืืง ืคึฟืึทืจ ืกืืกืืขื ืึทืืืื ืืกืืจืึทืืึธืจืก ืืื ืืืขืจ ืขืก ืื ืืืึธืก ืืฉืืืื ืึท ืกืืึธืจืืืืฉ ืืืคึผืืึทืืขื ืืืืฉืึทื ืืืคึฟื ืึธืืขืจ ืืืื ืฆื ืคึผืจืืืืจื ืื ืืืืืื ื.
ืืืึธืก ืืืกืืืฉืึทื ื ืืึธืื ืืืจ ืึธืคึผืืึธืื ืืื ืืืึธืก?
ืึธืคื ืืืจ ืืขื ืขื ืคืืืกื ืืื ืึท ืกืืืืึทืฆืืข ืืื ืืืจ ืืึทืจืคึฟื ืฆื ืื ืกืืจืืืขื ื ืฉืขืจื ืกืืึธืจืืืืฉ ืืื ืืื ืืืืขื ืขื-ืฉืจืืึทืื ืคืึธืจืฉืืขืืื ื ืืืืฃ ืึท ืงืืืื ืืืขื ืงื ืืื. ืืืจ ืืขืคืจืืืื ืคืึทืจืฉืืื ืึธืคึผืฆืืขืก ืคึฟืึทืจ ืืืคึผืืึทืืขื ืื ื ืฉืขืจื ืกืืึธืจืืืืฉ ืคึฟืึทืจ ืืื ืืืขืจ ืคึผืจืึทืืืฉืขืงืก, ืึธืืขืจ ืืืืื ืืง ืืขื ืขื ืืืืืืช ืฆื ืืึทืคืจืืืืงื ืืื ืื ืืืืฃ ืขืืืขืืข ืื ืืึทืงืืืืขืจื ืืื ืึทืืึธื. ืืืฆื ืืืจ ืืืขื ืืึธืื ืืืจ ืืืึธืก.
- ืืืืกืืขืจืคืก ืืื ื ืืฉื ืืึทืคืจืืืืงื ืืื ืื ืืื ืืืืขื ืขื ืืื ืฉืจืืืื ืคืึธืจืฉืืขืืื ื ืขืก ืืขื ืขื ืืขืืืขื ืคึผืจืึธืืืขืืก ืืื ืกืืืืึทืืืืื ืืึทืก ืืืืขื ืขื ืคืื ืึท ืืจืืืก ื ืืืขืจ ืคืื ืืขืงืขืก, ืืื ืขืก ืืื ืืขืืืขื ืึท ืืืื ืืึทืกืข ืืืืฃ ืื ืงืคึผื. ืืขืจ ืคึผืจืึธืืืขื ืืื ืืืืขื ืขื ืืขืงืขืก ืงืขื ืืืื ืกืึทืืืื ืืืจื ืึทืงืกืขืก ืืื ืืืืึทื ืคึฟืื ืฆืืื, ืึธืืขืจ ืืึธืก ืืื ื ืื ืฉืืขื ืืืง ืึธื ืืืขื ืืืขื ืืื ืืื ืืืื ืคืึทืืฉ.
- Ceph ืืื ื ืืฉื ืืื ืื ืืืขืจืืง ืงืึทืืคึผืืขืงืกืืื, ืืืึธืก ืงืขื ืืืื ืฉืขืืืขื ืืืืฃ ืคึผืจืึทืืืฉืขืงืก ืืื 2-4 ืกืขืจืืืขืจืก, ืกืคึผืขืฆืืขื ืืืื ืื ืคึผืจืืืขืงื ืืื ืืขืจื ืึธื ืืืื ืืืื ื. ืืืืืขืจ, ืขืก ืืขื ืขื ืขืจื ืกื ืคืึธืจืฉืืขืืื ื ืืืืืืืืฉืึทื ื ืืืึธืก ืฆืืืื ืืขื ืืื ืื ืฆื ืืืืขื ืืึทืืื ืืขืจ ืกืืึธืจืืืืฉ ืงืืึทืกืืขืจื, ืืื ืืื ืืืืกืืขืจืคืก.
- ื ืืฆื ืืืื NFS ืกืขืจืืืขืจ ืฆื ืื ืกืืจืืืขื ื ืฉืขืจื ืกืืึธืจืืืืฉ ืจืืืืึทื ืคึฟืจืืื ืืื ืืขืจืืื ืขื ืคืื ืฉืืื ืืึธืืขืจืึทื ืฅ.
- s3 ืืื ืึท ืืืกืืขืฆืืืื ื ืคืึธืืงืก ืืืืืื ื ืคึฟืึทืจ ืึท ืืืืขืจ ืงืืื ืคืื ืืึทืกืงืก, ืึธืืขืจ ืขืก ืืื ื ืืฉื ืึท ืืขืงืข ืกืืกืืขื ืืืึธืก ื ืขืจืึธืื ืืืื ืคืึทืจื ืขื.
- lsyncd. ืืืื ืืืจ ืืึธืื ืฉืืื ืกืืึทืจืืขื ืืขืจืขืื ืืืขืื "ื ืื-ืืขืงืข ืกืืกืืขืืขื," ืขืก ืืื ืืืขืจื ืฆื ืืืื ืืืืขืจ ืืขื ืคืึธืืงืก ืืืืืื ื. ื ืื ืืืืื ืืื ืขืก ื ืืฉื ืคึผืึทืกืืง ืคึฟืึทืจ ืฆืืืื-ืืืขื ืืืขืงืกื (ืึธืืขืจ ืืืื ืืืจ ืืึทืงืข ืืืืื ืฆื, ืืืจ ืงืขื ืขื), ืขืก ืืืื ืึทืจืืขื ื ืืฉื ืกืืึทืืื ืืืืฃ ืึท ืืจืืืก ื ืืืขืจ ืคืื ืืขืงืขืก. ื ืคืืึทื ืืขืจืฆื ืฆื ืึทืืฅ ืืื ืึทื ืขืก ืืื ืืืื-ืคืึธืืขื. ืื ืกืืื ืืื ืืื ืื ืึทืจืงืึทืืขืงืืฉืขืจ ืคืื ืื ืคึผืจืึธืืจืึทื: ืขืก ื ืืฆื ืื ืึธืืืคื ืฆื ืืึธื ืืืึธืจ ืึทืจืืขื ืึทืืืืฉืขืงืฅ ืืืึธืก ืขืก ืึทืกืืื ื ืืื ืกืืึทืจืืึทืคึผ ืืื ืืขืฉืึทืก ืจืขืกืงืึทื ืื ื. rsync ืืื ืืขื ืืฆื ืืื ืื ืึทืจืืืขืจืคืืจื ืืืื.
ืืืืึธืจืืึทื: ืืื ืฆื ืฆืขืืืืงืืขื ืฉืขืจื ืกืืึธืจืืืืฉ ืืืืืจื ืืืืฃ drbd + ocfs2
ืืืื ืขืจ ืคืื ืื ืืขืจืกื ืืึทืงืืืขื ืกืึทืืืฉืึทื ื ืคึฟืึทืจ ืืื ืื ืืื ืืขืืืขื ืื ืืื ืง ocfs2+drbd. ืืืฆื ืืืจ ืืืขื ืืึธืื ืืืจ ืืื ืืืจ ืงืขื ืขื ืืขืฉืืืื ื ืฆืขืืืืงืืขื ืฉืขืจื ืกืืึธืจืืืืฉ ืคึฟืึทืจ ืฆืืืื ืกืขืจืืืขืจืก ืืืืืจื ืืืืฃ ืึท ืืืืืื ื ืืึทืืึทืืืืก. ืืืขืจ ืขืจืฉืืขืจ, ืึท ืืืกื ืืืขืื ืื ืงืึทืืคึผืึธืื ืึทื ืฅ:
ืืจืื - ืึท ืกืืึธืจืืืืฉ ืกืืกืืขื ืคึฟืื ืืขืจ ื ืึธืจืืึทื ืืื ืืงืก ืคืึทืจืฉืคึผืจืืืืื ื ืืืึธืก ืึทืืึทืื ืืืจ ืฆื ืจืขืคึผืืึทืงืืื ืืึทืื ืฆืืืืฉื ืกืขืจืืืขืจืก ืืื ืืืึทืงืก. ืื ืืืืคึผื ืึทืคึผืืึทืงืืืฉืึทื ืืื ืฆื ืืืืขื ืฉืืื-ืืึธืืขืจืึทื ื ืกืืึธืจืืืืฉ.
OCFS2 - ืึท ืืขืงืข ืกืืกืืขื ืืืึธืก ืืื ืฉืขืจื ื ืืฆื ืคืื ืืขืจ ืืขืืืืงืขืจ ืกืืึธืจืืืืฉ ืืืจื ืขืืืขืืข ืกืืกืืขืืขื. ืึทืจืืึทื ืืขืจืขืื ื ืืื ืื ืืื ืืงืก ืคืึทืจืฉืคึผืจืืืืื ื ืืื ืืื ืึท ืงืขืจื ืืึธืืืืข ืืื ืืึทื ืืฆืขืจ ืคึผืืึทืฅ ืืืฉืืจืื ืคึฟืึทืจ ืืจืืขืื ืืื ืื FS. OCFS2 ืงืขื ืขื ืืืื ืืขืืืืื ื ื ืื ืืืืื ืืืืขืจ DRBD, ืึธืืขืจ ืืืื ืืืืขืจ iSCSI ืืื ืงืืืคื ืงืึทื ืขืงืฉืึทื ื. ืืื ืืื ืืืขืจ ืืืึทืฉืคึผืื ืืืจ ื ืืฆื DRBD.
ืื ืึทืงืฉืึทื ื ืืขื ืขื ืืืจืืืขืงืึธืื ืืืืฃ ืืืื ืื ืกืขืจืืืขืจ 18.04 ืืื ืึท ืืื ืืืึทื ืงืึทื ืคืืืืขืจืืืฉืึทื.
ืฉืจืื 1. ืงืึทื ืคืืืืขืจ ืืจืื:
ืืื ืืขืจ ืืขืงืข /etc/drbd.d/drbd0.res ืืืจ ืืึทืฉืจืืึทืื ืืื ืืืขืจ ืืืืจืืืึทื ืืืึธืง ืืืื /dev/drbd0:
resource drbd0 {
syncer { rate 1000M; }
net {
allow-two-primaries;
after-sb-0pri discard-zero-changes;
after-sb-1pri discard-secondary;
after-sb-2pri disconnect;
}
startup { become-primary-on both; }
on drbd1 {
meta-disk internal;
device /dev/drbd0;
disk /dev/vdb1;
address 10.10.10.192:7789;
}
on drbd2 {
meta-disk internal;
device /dev/drbd0;
disk /dev/vdb1;
address 10.10.10.193:7789;
}
}
ืื ืขืจืืขื ืืขืืึท-ืืืกืง - ื ืืฆื ืื ืืขืืืข ืืืึธืง ืืขืืืืกืขืก ืฆื ืงืจืึธื ืืขืืึทืืึทืืึท
ืืืื /dev/drbd0 - ื ืืฆื /dev/drbd0 ืืื ืืขืจ ืืจื ืฆื ืื ืืจbd ืืึทื ื.
ืืืกืง /dev/vdb1 - ื ืืฆื /dev/vdb1
ืกืื ืกืขืจ { ืงืืจืก 1000 ื; } - ื ืืฆื ืืืืืืืื ืงืึทื ืึทื ืืึทื ืืืืืื
ืืึธืื-ืฆืืืื-ืคึผืจืืืขืจืื - ืึท ืืืืืืืง ืึธืคึผืฆืืข ืึทื ืึทืืึทืื ืขื ืืขืจืื ืืขื ืฆื ืืืื ืื ืืขื ืืืขื ืืืืฃ ืฆืืืื ืขืจืฉืืืง ืกืขืจืืืขืจืก
ื ืึธื-ืกื-0ืคึผืจื, ื ืึธื-ืกื-1ืคึผืจื, ื ืึธื-ืกื-2ืคึผืจื - ืึธืคึผืฆืืขืก ืคืึทืจืึทื ืืืืึธืจืืืขื ืคึฟืึทืจ ืื ืึทืงืฉืึทื ื ืคืื ืื ื ืึธืืข ืืืขื ืกืคึผืืืืืจืึทืื ืืื ืืืืขืงืืึทื. ืืขืจ ืืขืืึทืืืก ืงืขื ืขื ืืืื ืืขืคึฟืื ืขื ืืื ืื ืืึทืงืืืืขื ืืืืฉืึทื.
ืืืขืจื-ืขืจืฉืืืง-ืืืืฃ ืืืืืข - ืฉืืขืื ืืืืืข ื ืึธืืื ืฆื ืขืจืฉืืืง.
ืืื ืืื ืืืขืจ ืคืึทื, ืืืจ ืืึธืื ืฆืืืื ืืขืืึทืืจืข ืืืืขื ืืงืึทื VMs, ืืื ืึท ืืขืืึทืงืืืืึทื ืืืืจืืืึทื ื ืขืฅ ืืื ืึท ืืจืืคึผืื ืคืื 10 ืืืืืืืื.
ืืื ืืื ืืืขืจ ืืืึทืฉืคึผืื, ืื ื ืขืฅ ื ืขืืขื ืคืื ืฆืืืื ืงื ืืื ื ืึธืืื ืืขื ืขื drbd1 ืืื drbd2. ืคึฟืึทืจ ืืขืืขืจืืง ืึธืคึผืขืจืึทืฆืืข, ืืืจ ืืึทืจืคึฟื ืฆื ืืืืึทืื ืื ื ืขืืขื ืืื IP ืึทืืจืขืกืขืก ืคืื ืืื ืืช ืืื /etc/hosts.
10.10.10.192 drbd1
10.10.10.193 drbd2ืฉืจืื 2. ืฉืืขืื ืึทืจืืืฃ ื ืึธืืื:
ืืืืฃ ืืืืืข ืกืขืจืืืขืจืก ืืืจ ืืืืคื:
drbdadm create-md drbd0
modprobe drbd
drbdadm up drbd0
cat /proc/drbdืืืจ ืืึทืงืืืขื ืื ืคืืืืขื ืืข:
ืืืจ ืงืขื ืขื ืึธื ืืืืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื. ืืืืฃ ืืขืจ ืขืจืฉืืขืจ ื ืึธืืข ืืืจ ืืึทืจืคึฟื ืฆื ืืืกืคืืจื:
drbdadm primary --force drbd0ืืื ืก ืงืืง ืืื ืื ืกืืึทืืืก:
cat /proc/drbd
ืืจืืืก, ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืืื ืกืืึทืจืืขื. ืืืจ ืืืึทืจืื ืืื ืืขื ืกืืฃ ืืื ืืขื ืื ืืืื:
ืฉืจืื 3. ืึธื ืืืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืืืืฃ ืื ืจืืข ื ืึธืืข:
drbdadm primary --force drbd0
ืืืจ ืืึทืงืืืขื ืื ืคืืืืขื ืืข:
ืืืฆื ืืืจ ืงืขื ืขื ืฉืจืืึทืื ืฆื ืืจืื ืคึฟืื ืฆืืืื ืกืขืจืืืขืจืก.
ืฉืจืื 4. ืื ืกืืึทืืืจื ืืื ืงืึทื ืคืืืืขืจ ocfs2.
ืืืจ ืืืขืื ื ืืฆื ืึท ืืึทื ืฅ ื ืืฉืืืง ืงืึทื ืคืืืืขืจืืืฉืึทื:
cluster:
node_count = 2
name = ocfs2cluster
node:
number = 1
cluster = ocfs2cluster
ip_port = 7777
ip_address = 10.10.10.192
name = drbd1
node:
number = 2
cluster = ocfs2cluster
ip_port = 7777
ip_address = 10.10.10.193
name = drbd2
ืขืก ืืึทืจืฃ ืืืื ืืขืฉืจืืื ืืื /etc/ocfs2/cluster.conf ืืืืฃ ืืืืืข ื ืึธืืื.
ืืืจ ืืึทืื ืึท FS ืืืืฃ drbd0 ืืืืฃ ืงืืื ื ืึธืืข:
mkfs.ocfs2 -L "testVol" /dev/drbd0
ืืึธ ืืืจ ืืืฉืืคื ืึท ืืขืงืข ืกืืกืืขื ืืื ืื ืคืืจืืข testVol ืืืืฃ drbd0, ื ืืฆื ืื ืคืขืืืงืืึทื ืคึผืึทืจืึทืืขืืขืจืก.
ืืื /etc/default/o2cb ืืืจ ืืึทืจืคึฟื ืฆื ืฉืืขืื (ืืื ืืื ืืื ืืืขืจ ืงืึทื ืคืืืืขืจืืืฉืึทื ืืขืงืข)
O2CB_ENABLED=true
O2CB_BOOTCLUSTER=ocfs2cluster ืืื ืืืกืคืืจื ืืืืฃ ืืขืืขืจ ื ืึธืืข:
o2cb register-cluster ocfs2clusterืืขืจื ืึธื ืืืจ ืงืขืจ ืืืืฃ ืืื ืืืืื ืึทืืข ืื ืื ืืฅ ืืืึธืก ืืืจ ืืึทืจืคึฟื ืฆื ืึทืืืึธืจืื:
systemctl enable drbd o2cb ocfs2
systemctl start drbd o2cb ocfs2ืขืืืขืืข ืคืื โโโโืืขื ืืืขื ืฉืืื ืืืืคื ืืขืฉืึทืก ืื ืกืขืืึทืคึผ ืคึผืจืึธืฆืขืก.
ืฉืจืื 5. ืืืื ืืืจื ืืืืืื ืฆื fstab ืืืืฃ ืืืืืข ื ืึธืืื:
/dev/drbd0 /media/shared ocfs2 defaults,noauto,heartbeat=local 0 0Directory / ืืขืืืข / ืฉืขืจื ืขืก ืืืื ืืืื ืืืฉืืคื ืืื ืฉืืืึทืื.
ืืึธ ืืืจ ื ืืฆื ืื ื ืึธืึทืืืึธ ืึธืคึผืฆืืขืก, ืืืึธืก ืืืื ืึทื ืื ืืขืงืข ืืืขื ื ืืฉื ืืืื ืืึธืื ืืขื ืืื ืกืืึทืจืืึทืคึผ (ืืื ืืขืกืขืจ ืฆื ืึธื ืงืืึทืคึผื ื ืขืฅ ืืขืงืขืก ืืืจื ืกืืกืืขื) ืืื ืืขืึทืจืืืขืึทื = ืืืืข, ืืืึธืก ืืืื ื ืืฆื ืื ืืขืึทืจืืืื ืืื ืกื ืืืืฃ ืืขืืขืจ ื ืึธืืข. ืขืก ืืื ืืืื ืืืืืืืข ืืึทืจืืืื, ืืืึธืก ืืื ืืขืจ ืคึผืึทืกืืง ืคึฟืึทืจ ืืจืืืก ืงืืึทืกืืขืจื.
ืืืืึทืืขืจ ืืืจ ืงืขื ืขื ืึธื ืงืืึทืคึผื / ืืขืืืข / ืฉืขืจื ืืื ืงืึธื ืืจืึธืืืจื ืืื ืืึทืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื.
ืืขืืื! ืืื ืึท ืจืขืืืืืึทื, ืืืจ ืืึทืงืืืขื ืืขืจ ืึธืืขืจ ืืืืื ืืงืขืจ ืฉืืื-ืืึธืืขืจืึทื ื ืกืืึธืจืืืืฉ ืืื ืกืงืึทืืึทืืืืืื ืืื ืืืึทืืืฉ ืคืึธืจืฉืืขืืื ื.
ืืงืืจ: www.habr.com