ืืื ืืึธื.
ืืื ืืืึธืื ืืื ืฆื ืืืืื ืืื ืื ืงืื ืืืื ืคึผืจืึทืงืืืฉ ืืขืจืคืึทืจืื ื ืคืื ืืืืขื ืึท ืืึทืื ืกืืึธืจืืืืฉ ืกืืกืืขื ืคึฟืึทืจ KVM ื ืืฆื md RAID + LVM.
ืืขืจ ืคึผืจืึธืืจืึทื ืืืขื ืึทืจืืึทื ื ืขืืขื:
- ืื ืื md RAID 1 ืคึฟืื NVMe SSD.
- ืึทืกืขืืืึทื md RAID 6 ืคึฟืื SATA SSD ืืื ืจืขืืืืขืจ ืืจืืืืื.
- ืคึฟืขืึดืงืืืื ืคืื TRIM / DISCARD ืึธืคึผืขืจืึทืฆืืข ืืืืฃ SSD RAID 1/6.
- ืฉืึทืคึฟื ืึท ืืึธืึธืืึทืืืข MD RAID 1/6 ืืขื ืืข ืืืืฃ ืึท ืคึผืจืึธืกื ืืึทื ื ืคืื ืืืกืงืก.
- ืื ืกืืึธืืื ื ืื ืกืืกืืขื ืืืืฃ NVMe RAID 1 ืืืขื ืขืก ืืื ืงืืื NVMe ืฉืืืฆื ืืื ืื ืืืืึธืืก.
- ื ืืฆื LVM ืงืึทืฉ ืืื LVM ืืื.
- ื ืืฆื BTRFS ืกื ืึทืคึผืฉืึทืฅ ืืื ืฉืืงื / ืืึทืงืืืขื ืคึฟืึทืจ ืืึทืงืึทืคึผ.
- ื ืืฆื LVM ืืื ืกื ืึทืคึผืฉืึทืฅ ืืื thin_delta ืคึฟืึทืจ BTRFS ืกืืื ืืึทืงืึทืคึผืก.
ืืืื ืืืจ ืืขื ื ืืื ืืขืจืขืกืืจื, ืืืืข ืืขื ืงืึทืฅ.
ืืืกืืึธืืื ื
ืืขืจ ืืืืจ ืืื ื ืืฉื ืืจืึธืื ืงืืื ืคึฟืึทืจืึทื ืืืืึธืจืืืขืืงืืื ืคึฟืึทืจ ืื ืงืึทื ืกืึทืงืืืขื ืกืึทื ืคืื ื ืืฆื ืึธืืขืจ ื ืื ื ืืฆื ืืึทืืขืจืืึทืืก / ืืืืฉืคืืื / ืงืึธื / ืขืฆืืช / ืืึทืื ืคืื ืืขื ืึทืจืืืงื. ืืืจื ืืืืขื ืขื ืึธืืขืจ ื ืืฆื ืืขื ืืึทืืขืจืืึทื ืืื ืงืืื ืืืขื, ืืืจ ื ืขืืขื ืคึฟืึทืจืึทื ืืืืึธืจืืืขืืงืืื ืคึฟืึทืจ ืึทืืข ืงืึทื ืกืึทืงืืืขื ืกืึทื ืคืื ืื ืึทืงืฉืึทื ื. ืืขืืืขื ืงืึทื ืกืึทืงืืืขื ืกืึทื ืึทืจืืึทื ื ืขืืขื:
- ืงืจืืืืข ืืขืคึผืจืขืืื NVMe SSDs.
- ืืึธืจ ืืขืืืืื ื ืจืขืงืึธืจืืื ื ืืืื ืืื ืืืจืืคืึทื ืคืื SSD ืืจืืืืื.
- ืืึทื ืฅ ืึธื ืืืขืจ ืคืื ืึทืืข ืืึทืื ืืืืฃ ืึทืืข ืืจืืืืื, ืึทืจืืึทื ืืขืจืขืื ื ืืึทืงืึทืคึผ ืงืืคืืขืก.
- ืคืึธืืื ืงืึธืืคึผืืืืขืจ ืืึทืื ืืืึทืจื.
- ืืืืกื ืฆืืื, ื ืขืจืืืขืก ืืื ืืขืื.
- ืงืืื ืื ืืขืจืข ืคืืืื ืืืึธืก ืืขื ืขื ื ืืฉื ืืืกืืขื ืืืืื.
ืืืึทืื
ืื ืืืฆื ืืขื ืขื ืืขืืืขื:
ืืึธืืืขืจืืึธืึทืจื ืคืื ืึทืจืื 2013 ืืื Z87 ืืฉืืคึผืกืขื, ืืึทื ืฅ ืืื Intel Core i7 / Haswell.
- ืคึผืจืึทืกืขืกืขืจ 4 ืงืึธืจืขืก, 8 ืคึฟืขืืขื
- 32 GB DDR3 ืืึทืจืึทื
- 1 x 16 ืึธืืขืจ 2 x 8 PCIe 3.0
- 1 ืจืขื ืืืขื 4 + 1 ืจืขื ืืืขื 1 ืคึผืกืืข 2.0
- 6 ืจืขื ืืืขื 6 ืืืืืืืื ืกืึทืืึท 3 ืงืึทื ืขืงืืขืจื
SAS ืึทืืึทืคึผืืขืจ LSI SAS9211-8I ืคืืึทืฉื ืฆื IT / HBA ืืึธืืข. RAID-ืขื ืืืืึทืื ืคืืจืืืืึทืจืข ืืื ืืขืงืืืื ืจืืคึผืืืืกื ืืื HBA ืคืืจืืืืึทืจืข ืฆื:
- ืืืจ ืงืขื ืขื ืืืึทืจืคื ืืืืก ืืขื ืึทืืึทืคึผืืขืจ ืืื ืงืืื ืฆืืื ืืื ืคืึทืจืืืึทืื ืขืก ืืื ืงืืื ืื ืืขืจืข ืืืึธืก ืืืจ ืืึธื ืืขืคึฟืื ืขื.
- TRIM / Discard ืืขืืจืืขื ื ืึธืจืืึทืื ืืืืฃ ืืืกืงืก, ืืืืึทื ... ืืื RAID ืคืืจืืืืึทืจืข ืื ืงืึทืืึทื ืื ืืขื ืขื ื ืืฉื ืืขืฉืืืฆื ืืื ืึทืืข, ืืื ืื HBA, ืืื ืึทืืืขืืืื, ืืื ื ืืฉื ืืึธืจืื ืืืึธืก ืงืึทืืึทื ืื ืืขื ืขื ืืจืึทื ืกืืืืืขื ืืืืขืจ ืื ืืืืึธืืืก.
ืฉืืืขืจ ืืจืืืืื - 8 ืืจืขืงืืขื ืคืื HGST Travelstar 7K1000 ืืื ืึท ืงืึทืคึผืึทืฆืืืขื ืคืื 1 ืื ืืื ืึท 2.5 ืคืึธืจืขื ืคืึทืงืืึธืจ, ืืื ืคึฟืึทืจ ืืึทืคึผืืึทืคึผืก. ืื ืืจืืืืื ืืขื ืขื ืคืจืืขืจ ืืื ืึท RAID 6 ืืขื ืืข. ืืื ืืืขืื ืืืื ื ืืฆื ืื ื ืืึทืข ืกืืกืืขื. ืฆื ืงืจืึธื ืืืืข ืืึทืงืึทืคึผืก.
ืืขืจืฆื ืฆืืืขืืืืื:
6 ืกืึทืืึท ืกืกื ืืึธืืขื ืกืึทืืกืื ื 860 ืงืืืึธ 2 ืื. ืื SSDs ืคืืจืืื ืื ืึท ืืจืืืก ืืึทื ื, ืื ืืืึทืืืึทื ืคืื ืึท SLC ืงืึทืฉ, ืจืืืืืึทืืืืึทืื ืืื ืึท ื ืืืขืจืืง ืคึผืจืืึทื ืืขื ืขื ืืขืืืืื. ืฉืืืฆื ืคึฟืึทืจ ืึทืืืขืงืืืึทืจืคื / ื ืื ืืื ืคืืจืืื ืื, ืืืึธืก ืืื ืึธืคึผืืขืฉืืขืื ืืืจื ืื ืฉืืจื ืืื dmesg:
kernel: ata1.00: Enabling discard_zeroes_data
2 NVMe SSD ืืึธืืขื ืกืึทืืกืื ื ืกืกื 970 ืขืืืึธ 500 ืืืืืืืื.
ืคึฟืึทืจ ืื SSDs, ืืจืึทืค - ืืืืขื ืขื / ืฉืจืืึทืื ืืืืงืืึทื ืืื ืืืื ืงืึทืคึผืึทืฆืืืขื ืคึฟืึทืจ ืืืื ืืืืขืจืคืขื ืืฉื ืืขื ืขื ืืืืืืืง. ืจืึทืืืึทืืึธืจ ืคึฟืึทืจ ืืื. ืืึทืืืงืข. ืืขืืึทืืจืข. ืึทื ืืขืจืฉ, ืคึผืจืขืืืขื ืืื ืืื ืงืจืืกืคึผื ืืขืฉืึทืก ืืขืจ ืขืจืฉืืขืจ RAID ืกืื ืืงืจืึทื ืึทืืืืฉืึทื.
StarTech PEX8M2E2 ืึทืืึทืคึผืืขืจ ืคึฟืึทืจ 2 X NVMe SSD ืืื ืกืืึทืืืจื ืืื PCIe 3.0 8x ืฉืคึผืขืืื. ืืึธืก, ืืืืืขืจ, ืืื ื ืึธืจ ืึทื HBA, ืึธืืขืจ ืคึฟืึทืจ NVMe. ืขืก ืืื ืึทื ืืขืจืฉ ืคืื ืืืืืง ืึทืืึทืคึผืืขืจื ืืื ืึทื ืขืก ืืื ื ืืฉื ืืึทืจืคื PCIe ืืืคืืจืงืึทืืืึธื ืฉืืืฆื ืคืื ืื ืืึธืืืขืจืืึธืึทืจื ืจืขืื ืฆื ืืขื ืืืึทืืืึทื ืคืื ืึท ืืขืืืื-ืืื PCIe ืืึทืฉืืืืขื. ืขืก ืืืขื ืึทืจืืขืื ืืคืืื ืืื ืื ืืขืจืกื ืืืืข ืกืืกืืขื ืืื PCIe, ืืคืืื ืืืื ืขืก ืืื ืึทื X1 PCIe 1.0 ืฉืคึผืขืืื. ืืขืืืืื ืืืขื, ืืื ืื ืฆืื ืขืืขื ืืืืงืืึทื. ืขืก ืืขื ืขื ืงืืื RAIDs ืืึธืจื. ืขืก ืืื ืงืืื ืืขืืืื-ืืื ืืืืึธืืก ืืืืฃ ืืจืขื. ืึทืืื, ืืืื ืกืืกืืขื ืืืขื ื ืืฉื ืืึทืืืฉืืงืึทืื ืืขืจื ืขื ืฆื ืฉืืืืื ืืื NVMe, ืคืื ืืืืื ืืงืขืจ ืืึธื NVMe RAID ืืึทื ืง ืฆื ืืขื ืืืื.
ืืขืจ ืงืึธืืคึผืึธื ืขื ื ืืื ืืขืืืขื ืืืืื ืจืขืื ืฆื ืืขื ืืืึทืืืึทื ืคืื ืืืืื ืืืื ืคืจืื 8 ืงืก PCIe 3.0 ืืื ืื ืกืืกืืขื, ืืื ืืืื ืขืก ืืขื ืขื 2 ืคืจืื ืกืืึธืฅ, ืขืก ืงืขื ืขื ืืืื ืจืืคึผืืืืกื ืืื ืฆืืืื ืคึผืขื ื PEX4M2E1 ืึธืืขืจ ืึทื ืึทืืึธืืืขืก, ืืืึธืก ืงืขื ืขื ืืืื ืืขืงืืืคื ืขืจืืขืฅ ืฆื ืึท ืคึผืจืืึทื ืคืื 600. ืจืืื.
ืื ืจืืืืฉืขืงืฉืึทื ืคืื ืึทืืข ืืื ืื ืคืื ืืึทืื ืืืึทืจื ืึธืืขืจ ืืขืืืื-ืืื ืืฉืืคึผืกืขื / ืืืึธืก RAIDs ืืื ืืขืืืื ืืืืืืจืึทืืื, ืฆื ืงืขื ืขื ืืึธืจ ืคืึทืจืืืึทืื ืื ืืื ืฆืข ืกืืกืืขื, ืืื ืื ืืืกื ืขื ืคืื ืื SSD / HDD ืืื, ืืฉืขืช ืคึผืจืึทืืขืจืืืื ื ืึทืืข ืื ืืึทืื. ืืืขืึทืืื, ืึทืืื ืืืจ ืงืขื ืขื ืจืึทืืขืืืขื ืืคืืื ืื ืืื ืกืืึทืืืจื ืึธืคึผืขืจืืืืื ื ืกืืกืืขื ืืืขื ืืืจ ืืึทื ืฆื ืืึธืจ ื ืืึท / ืึทื ืืขืจืฉ ืืึทืื ืืืึทืจื. ืื ืืืืคึผื ืืึทื ืืื ืึทื ืขืก ืืขื ืขื SATA ืืื PCIe ืคึผืึธืจืฅ. ืขืก ืืื ืืื ืึท ืืขืื ืงืึธืืคึผืึทืงืืืืกืง ืึธืืขืจ ืืึธืึธืืึทืืืข ืืืืฅ ืคืึธืจ, ื ืึธืจ ืืืืขืจ ืฉื ืขื ืืื ืึท ืืืกื ืืึทืืงื.
ืืืืึธืจืึทื ืืขืจืฉ, ืืืจ ืืืืกื ืืืึธืก ืืึทืคึผืึทื ื - ืืื ืืืจ ืขืจืืืฉืึทื ืืื ืืึทืจืคึฟื ืฆื ื ืขืืขื ืื ืืื ืฆืข ืืขื ืืข ืืื ืืืจ ืฆื ื ืขืืขื ืึทืืืขืง. ืึธืืขืจ ืืื ืืึธื ื ืืฉื ืืืขืื ืฆื ืคืึทืจืืืจื ืืึทืื. ืฆื ืืึธื ืืึธืก, ืึทืืข ืื ืืขืจืืื ื ืืืืืึท ืืขื ืขื ืงืึทื ืืืื ืืึทื ืืื ืืืื ืืืืฃ ืื ืกืืืืื ืืื ืื 5.25 ืืืืก ืคืื ืื ื ืึธืจืืึทื ืคืึทื.
ื ื, ืืื, ืคืื ืงืืจืก, ืคึฟืึทืจ ืขืงืกืคึผืขืจืืืขื ืืื ื ืืื ืคืึทืจืฉืืืขื ืข ืืขืืืึธืืก ืคืื ืกืกื ืงืึทืืฉืื ื ืืื ืืื ืืงืก.
ืืึทืื ืืืึทืจื ืจืืืื ืืขื ืขื ื ืืื ืข. ืงืขืจ ืขืก ืืืืฃ. ืขืก ืึทืจืืขื ืึธืืขืจ ื ืืฉื. ืืื ืืื ืืืื ืขืก ืืขื ืขื ืฉืืขื ืืืง ืึธืคึผืฆืืขืก.
ืืืืื
ืืื ืึทืืขืจ, Debian 8 Jessie ืืื ืืขืืืขื ืืื ืกืืึทืืืจื ืืืืฃ ืื ืืึทืื ืืืึทืจื, ืืืึธืก ืืื ื ืึธืขื ื ืฆื EOL. RAID 6 ืืื ืืขืืืขื ืคืืจืืืืื ืคืื ืื ืืืืื ืืขืจืืื ื ืืื ืก ืคึผืขืจื ืืื LVM. ืขืก ืืืืคื ืืืืจืืืึทื ืืืฉืื ืขื ืืื kvm/libvirt.
ืืืืึทื ืืขืจ ืืืืจ ืืื ืคึผืึทืกืืง ืืขืจืคืึทืจืื ื ืืื ืงืจืืืืืื ื ืคึผืึธืจืืึทืืืื ืืึธืึธืืึทืืืข SATA / NVMe ืืืืฅ ืืจืืืืื, ืืื ืืืื, ืืื ืกืืจ ื ืืฉื ืฆื ืืจืขืื ืื ืืขืืืืื ืืืขื ืคืืืืง ืืขืืคึผืืึทืืข, Ubuntu 18.04 ืืื ืืืืกืืขืจืืืืืื ืืื ืื ืฆืื ืกืืกืืขื, ืืืึธืก ืืื ืฉืืื ืืขื ืื ืกืืืืืึทืืืืื, ืึธืืขืจ ื ืึธื 3 ืืึธืจ ืคืื ืฉืืืฆื ืืื ืืขืจ ืฆืืงืื ืคึฟื.
ืื ืืขืจืืื ื ืกืืกืืขื ืึผืืื ืึทืืข ืื ืืึทืื ืืืึทืจื ืืจืืืืขืจืก ืืืึธืก ืืืจ ืืึทืจืคึฟื ืืืืก ืคืื ืื ืงืขืกืื. ืืืจ ืืึธื ื ืื ืืึทืจืคึฟื ืงืืื ืืจืื-ืคึผืึทืจืืื ืืืืืืืืืจื ืึธืืขืจ ืืจืืืืขืจืก.
ืคึผืจืขืคึผืึทืจืื ื ืคึฟืึทืจ ืื ืกืืึทืืืจืื ื
ืฆื ืื ืกืืึทืืืจื ืื ืกืืกืืขื ืืืจ ืืึทืจืคึฟื Ubuntu ืืขืกืงืืึธืคึผ ืืืื. ืืขืจ ืกืขืจืืืขืจ ืกืืกืืขื ืืื ืึท ืงืจืึทืคืืืง ืื ืกืืึทืืืขืจ, ืืืึธืก ืืืืึทืื ืืืขืจืืง ืืขืืืกืืฉืืขื ืืืงืืึทื ืืืึธืก ืงืขื ืขื ื ืื ืืืื ืคืึทืจืงืจืืคึผืื ืืืจื ืฉืึทืืืื ื ืื UEFI ืกืืกืืขื ืฆืขืืืืืื ื ืืืืฃ ืืืื ืขืจ ืคืื ืื ืืืกืงืก, ืืื ืกืคึผืืืืื ื ืึทืืข ืื ืฉืืื ืงืืื. ืึทืงืงืึธืจืืื ืืื, ืขืก ืืื ืืื ืกืืึทืืืจื ืืืืื ืืื UEFI ืืึธืืข. ืขืก ืึธืคืคืขืจืก ืงืืื ืึธืคึผืฆืืขืก.
ืืืจ ืืขื ืขื ื ืืฉื ืฆืืคืจืืื ืืื ืืขื.
ืืืึธืก?ืฆืื ืืึทืืืืขืจื, UEFI ืฉืืืืื ืืื ืืึธืจ ืฉืืืึทื ืงืึทืืคึผืึทืืึทืืึทื ืืื ืฉืืืืื ืืืืืืืืืจื RAID, ืืืืึทื ... ืงืืื ืขืจ ืึธืคืคืขืจืก ืืื ืื ืจืขืืขืจืืืืืฉืึทื ื ืคึฟืึทืจ ืื UEFI ESP ืฆืขืืืืืื ื. ืขืก ืืขื ืขื ืึธื ืืืื ืจืขืกืึทืคึผืื ืืืึธืก ืคึฟืึธืจืฉืืึธืื ืคึผืืืืกืื ื ืื ESP ืฆืขืืืืืื ื ืืืืฃ ืึท ืืืืฅ ืคืึธืจ ืืื ืึท ืืกื ืคึผืึธืจื, ืึธืืขืจ ืืึธืก ืืื ืึท ืคืื ื ืคืื ืืืจืืคืึทื. ืขืก ืืขื ืขื ืจืขืกืึทืคึผืื ื ืืฆื ืืืืืืืืืจื mdadm RAID 1 ืืื ืืขืืึทืืึทืืึท ืืืขืจืกืืข 0.9 ืืืึธืก ืืึธื ื ืื ืคืึทืจืืืึทืื ืื UEFI BIOS ืฆื ืืขื ืืขื ืฆืขืืืืืื ื, ืึธืืขืจ ืืึธืก ืืขืื ืืื ืื ืืืืงืืขื ืืึธืืขื ื ืืืขื ืื ืืืืึธืืก ืึธืืขืจ ืื ืื ืืขืจ ืืึทืื ืืืึทืจื ืึทืก ืฉืจืืืื ืขืคึผืขืก ืฆื ืื ESP ืืื ืคืืจืืขืกื ืฆื ืกืื ืืงืจืึทื ืืื ืขืก ืฆื ืื ืืขืจืข. ืืืจืขืจื.
ืืื ืึทืืืฉืึทื, UEFI ืฉืืืืื ืืขืคึผืขื ืืก ืืืืฃ NVRAM, ืืืึธืก ืืืขื ื ืืฉื ืืึทื ืฆืืืืืขื ืืื ืื ืืืกืงืก ืฆื ืื ื ืืึทืข ืกืืกืืขื, ืืืืึทื ืืื ืืืื ืคืื ืื ืืึธืืืขืจืืึธืึทืจื.
ืึทืืื, ืืืจ ืืืขืื ื ืืฉื ืจืืื ืืืขื ื ืึท ื ืืึท ืจืึธื. ืืืจ ืืึธืื ืฉืืื ืึท ืืจืืื-ืืขืืืื, ืฆืืื-ืืขืกืืขื ืืืืืข ืก ืืืืง, ืืืฆื ืืขืจืืคึฟื ืืขืืึทืกื / ืืืึธืก ืฉืืืืื, ืืื ืื ืฉืืึธืืฅ ื ืึธืืขื ืคืื CSM ืืืืฃ UEFI-ืงืึทืืคึผืึทืืึทืืึทื ืกืืกืืขืืขื. ืืืจ ืืืขืื ืขืก ื ืึธืจ ื ืขืืขื ืึทืืืขืง ืื ืคึผืึธืืืฆืข, ืฉืืืจื ืขืก, ืคึผืึธืืคึผืข ืึทืจืืืฃ ืื ืืืจืขืก ืืื ืืืืฉื ืขืก ืืื ืึท ืคืืึทืื ืฉืืึธืฃ.
ืื ืืขืกืงืืึทืคึผ ืืืขืจืกืืข ืคืื โโืืืื ืื ืงืขื ืขื ืืืื ื ืื ืืืื ืืื ืกืืึทืืืจื ืจืขืื ืืื ืื ืืขืืึทืกื ืืึธืึธืืืึธืึทืืขืจ, ืึธืืขืจ ืืึธ, ืืื ืืื ืืึธืื, ืืื ืืื ืืกืืขืจ ืขืก ืืขื ืขื ืึธืคึผืฆืืขืก.
ืืื ืึทืืื, ืืืจ ืงืืืึทืื ืื ืืึทืื ืืืึทืจื ืืื ืืึธืื ืื ืกืืกืืขื ืคึฟืื ืื Ubuntu Live ืืึธืึธืืึทืืืข ืืืืฅ ืคืึธืจ. ืืืจ ืืึทืจืคึฟื ืฆื ืึธืคึผืืึธืืืจื ืคึผืึทืงืึทืืืฉืึทื, ืึทืืื ืืืจ ืฉืืขืื ืื ื ืขืฅ ืืืึธืก ืึทืจืืขื ืคึฟืึทืจ ืืืจ. ืืืื ืขืก ืืื ื ืืฉื ืึทืจืืขืื, ืืืจ ืงืขื ืขื ืืึธืื ืื ื ืืืืืง ืคึผืึทืงืึทืืืฉืึทื ืืืืฃ ืึท ืืืืฅ ืคืึธืจ ืืื ืฉืืืึทืื.
ืืืจ ืืืื ืืื ืื ืืขืกืงืืึธืคึผ ืกืืืืืืข, ืงืึทืืขืจ ืื ืืืึธืงืืึทื ืขืืืืึทืืึธืจ, ืืื ืืืจ ืืืื:
#sudo bash
ืืืโฆ?ืื ืฉืืจื ืืืืื ืืื ืื ืงืึทื ืึทื ืึทืงืึทื ืฆืื ืื ืคึฟืึทืจ ืืึธืืืืืึทืจืก ืืืขืื ืกืืืึธ. ื ืะพืืจืขืกืขืจืข ืึทืคึผืขืจืืื ืึทืืื ืงืืืขื ืืืะพืืจืขืกืขืจืข ืคึฟืึทืจืึทื ืืืืึธืจืืืขืืงืืื. ืื ืงืฉืื ืืื ืฆื ืืืจ ืงืขื ืขื ื ืขืืขื ืขืก ืืืืฃ ืืื. ืคืืืข ืืขื ืืฉื ืืจืึทืืื ืึทื ื ืืฆื ืกืืืึธ ืืื ืืขื ืืืขื ืืื ืืคึผืืืช ื ืื ืึธืคึผืืขืืื. ืึธืืขืจ:
#apt-get install mdadm lvm2 thin-provisioning-tools btrfs-tools util-linux lsscsi nvme-cli mc
ืคืืจืืืืก ื ืืฉื ZFS...?ืืืขื ืืืจ ืื ืกืืึทืืืจื ืืืืืืืืืจื ืืืืฃ ืืื ืืืขืจ ืงืึธืืคึผืืืืขืจ, ืืืจ ืืกืขื ืฉืึทืื ืืืึทืขื ืืื ืืืขืจ ืืึทืื ืืืึทืจื ืฆื ืื ืืขืืืขืืึธืคึผืขืจืก ืคืื ืืขื ืืืืืืืืืจื ืฆื ืคืึธืจ.
ืืืขื ืืืจ ืฆืืืจืื ืืขื ืืืืืืืืืจื ืืื ืื ืืืืขืจืงืืึทื ืคืื ืืื ืืืขืจ ืืึทืื, ืืืจ ื ืขืืขื ืึท ืึทื ืืืืึทืขื ืืืืึทื ืฆื ืื ืคึผืจืืึทื ืคืื ืจืืกืืึธืจืื ื ืื ืืึทืื, ืืืึธืก ืืืจ ืืืขืื ืืึธืื ืฆื ืืึทืฆืึธืื ืึทืืืขืง ืึทืืึธื.
ืคึฟืื ืืขื ืคืื ื ืคืื ืืืื ืื ื, ZFS ืืื ืึท ืคืขืจืจืึทืจื, ืืื ืืืื+ืืื ืืื ืืขืจ ืืื ืึท ืืืขืืึธืกืืคึผืขื.
ืกืึทืืืืฉืขืงืืืืืื, ืืขืจ ืืืืจ ืคึผืจืึทืคืขืจื ืฆื ืึทื ืืืืึทืขื ืึท ืืืืง ืืืืฃ ืงืจืขืืื ืฆื ืืืืืึทืงืึทื ื ืืขื ืืฉื ืึทื ืฉืืึธื ืคืื ืึท Ferrari. ืืึธืจื, ืื ืคึผืจืืึทื ืคืื ืื ืึทืจืืืกืืขืื ืืื ื ืืฉื ืืืื. ื ืื ืืึทืจืคึฟื ืคึฟืึทืจ ืจืขืื. ืกืืืคึผืืขืจ ืืื ืคืึทืจืงืขืจ ืึผืืืื. ืคึผืึทืจืงืื ื ืืื ืคืจืื. ืงืจืืึทื-ืืึทื ื ืคืืืืงืืื ืืื ืืขืกืขืจ. ืืืจ ืงืขื ืขื ืฉืืขื ืืืง ืฆืืืฉืขืคึผืขื ืคืืก ืฆื ืึท ืืืขืืึธืกืืคึผืขื, ืืื ืืืจ ืงืขื ืขื ืคืึทืจืจืืืื ืึท ืืืขืืึธืกืืคึผืขื ืืื ืืืื ืืืืื ืืขื ื.
ืคืืจืืืืก ืืขื BTRFS...?ืืื ืกืืจ ืฆื ืฉืืืืื ืื ืึธืคึผืขืจืืืืื ื ืกืืกืืขื, ืืืจ ืืึทืจืคึฟื ืึท ืืขืงืข ืกืืกืืขื ืืืึธืก ืืื ืืขืฉืืืฆื ืืื Legacy / BIOS GRUB ืืืืก ืคืื ืื ืงืขืกืื, ืืื ืืื ืืขืจ ืืขืืืืงืขืจ ืฆืืื ืฉืืืฆื ืืขืื ืกื ืึทืคึผืฉืึทืฅ. ืืืจ ืืืขืื ื ืืฆื ืขืก ืคึฟืึทืจ ืื /boot ืฆืขืืืืืื ื. ืืื ืึทืืืฉืึทื, ืืขืจ ืืืืจ ืคึผืจืึทืคืขืจื ืฆื ื ืืฆื ืืขื FS ืคึฟืึทืจ / (ืืืึธืจืฆื), ื ืื ืคืึทืจืืขืกื ืฆื ืืึธื ืึทื ืคึฟืึทืจ ืงืืื ืื ืืขืจืข ืืืืืืืืืจื ืืืจ ืงืขื ืขื ืืึทืื ืืึทืืื ืืขืจ ืคึผืึทืจืืืฉืึทื ื ืืืืฃ LVM ืืื ืึธื ืงืืึทืคึผื ืืื ืืื ืื ื ืืืืืง ืืืืจืขืงืืขืจืื.
ืืืจ ืืืขืื ื ืืฉื ืงืจืึธื ืงืืื ืืืืืขืจ ืคืื ืืืืจืืืึทื ืืืฉืื ืขื ืึธืืขืจ ืืึทืืึทืืืืกืื ืืืืฃ ืืขื FS.
ืืขืจ FS ืืืขื ืืืื ืืขืืืืื ื ืืืืื ืฆื ืฉืึทืคึฟื ืกื ืึทืคึผืฉืึทืฅ ืคืื ืื ืกืืกืืขื ืึธื ืงืขืจื ืขืก ืึทืืืขืง ืืื ืืขืจื ืึธื ืึทืจืืืขืจืคืืจื ืื ืกื ืึทืคึผืฉืึทืฅ ืฆื ืึท ืืึทืงืึทืคึผ ืืืกืง ืืื ืฉืืงื / ืืึทืงืืืขื.
ืืื ืึทืืืฉืึทื, ืืขืจ ืืืืจ ืืืื ืคึผืจืึทืคืขืจื ืฆื ืืึทืืื ืึท ืืื ืืืื ืคืื ืืืืืืืืืจื ืืืืึทื ืืืืฃ ืื ืืึทืื ืืืึทืจื ืืื ืืืืคื ืึทืืข ืื ืื ืืขืจืข ืืืืืืืืืจื ืืื ืืืืจืืืึทื ืืืฉืื ืขื ื ืืฆื ืืื ืื ืืื ืคืึธืจืืืขืจืืื ื ืืคึผืืก ืืื ืคึผืกื-ืืกื ืืึธืกื ืงืึทื ืืจืึธืืืขืจื ืฆื KVM ืืืจื IOMMU.
ืื ืืืืื ืืืื ืืื ืงืก ืืืืฃ ืื ืืึทืื ืืืึทืจื ืืขื ืขื ืืึทืื ืกืืึธืจืืืืฉ, ืืืืจืืืึทืืืืึทืืืึธื ืืื ืืึทืงืึทืคึผ.
ืืืื ืืืจ ืฆืืืจืื ZFS ืืขืจ, ืืื ืคึผืจืื ืฆืืคึผ, ืืื ืืขื ืขื ืื ืืขืจืืฉืืื ืืืฉืึทืืึทื ืคึฟืึทืจ ืื ืกืคึผืขืกืืคืืขื ืึทืคึผืืึทืงืืืฉืึทื.
ืึธืืขืจ, ืืขืจ ืืืืจ ืืืืืืจืึทืืื ืืื ืึธืจื ืื ืืขืืืื-ืืื ืืืจืขืจืื ื / RAID ืืื ืืืขืจืืงืืึทื ืคึฟืขืึดืงืืืื ืืืึธืก ZFS, BRTFS ืืื LVM ืืึธืื.
ืืื ืึทื ื ืึธื ืึทืจืืืืขื ื, BTRFS ืืื ืื ืคืืืืงืืื ืฆื ืืืขื ืื ืืจืึทืค - ืฉืจืืืื ืืื ืกืึทืงืืืขื ืืฉืึทื ืึธื ืขืก, ืืืึธืก ืืื ืึท ืืึธืจ positive ืืืืจืงืื ื ืืืืฃ ืื ืืืืงืืึทื ืคืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืคืื ืกื ืึทืคึผืฉืึทืฅ / ืืึทืงืึทืคึผืก ืืืืฃ ืื ืืื.
ืืึธืืืจ ืืืขืจืงืืงื ืึทืืข ืืขืืืืกืขืก:
#udevadm control --reload-rules && udevadm trigger
ืืึธืืืจ ื ืขืืขื ืึท ืงืืง ืึทืจืื:
#lsscsi && nvme list
[0:0:0:0] disk ATA Samsung SSD 860 2B6Q /dev/sda
[1:0:0:0] disk ATA Samsung SSD 860 2B6Q /dev/sdb
[2:0:0:0] disk ATA Samsung SSD 860 2B6Q /dev/sdc
[3:0:0:0] disk ATA Samsung SSD 860 2B6Q /dev/sdd
[4:0:0:0] disk ATA Samsung SSD 860 2B6Q /dev/sde
[5:0:0:0] disk ATA Samsung SSD 860 2B6Q /dev/sdf
[6:0:0:0] disk ATA HGST HTS721010A9 A3J0 /dev/sdg
[6:0:1:0] disk ATA HGST HTS721010A9 A3J0 /dev/sdh
[6:0:2:0] disk ATA HGST HTS721010A9 A3J0 /dev/sdi
[6:0:3:0] disk ATA HGST HTS721010A9 A3B0 /dev/sdj
[6:0:4:0] disk ATA HGST HTS721010A9 A3B0 /dev/sdk
[6:0:5:0] disk ATA HGST HTS721010A9 A3B0 /dev/sdl
[6:0:6:0] disk ATA HGST HTS721010A9 A3J0 /dev/sdm
[6:0:7:0] disk ATA HGST HTS721010A9 A3J0 /dev/sdn
Node SN Model Namespace Usage Format FW Rev
---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------
/dev/nvme0n1 S466NXXXXXXX15L Samsung SSD 970 EVO 500GB 1 0,00 GB / 500,11 GB 512 B + 0 B 2B2QEXE7
/dev/nvme1n1 S5H7NXXXXXXX48N Samsung SSD 970 EVO 500GB 1 0,00 GB / 500,11 GB 512 B + 0 B 2B2QEXE7
ืืืกืง ืืืืกืืืื
NVMe SSD
ืึธืืขืจ ืืืจ ืืืขืื ื ืืฉื ืฆืืืื ืืื ืืื ืงืืื ืืืขื. ืึทืืข ืื ืืขืืืข, ืืื ืืืขืจ ืืืืึธืืก ืงืขื ื ืืฉื ืืขื ืื ืืจืืืืื. ืึทืืื, ืืื ืืืขืื ืืืื ืืขืืึทืืจืข ืฆื ืืืืืืืืืจื RAID. ืืืจ ืืืขืื ื ืืฉื ืืคืืื ืืึทืื ืกืขืงืฉืึทื ื ืืึธืจื. ืืืื ืืืจ ืืืืื ืฆื ื ืึธืืคืึธืืื ืื "ืงืึทื ืึธื" ืึธืืขืจ "ืคึผืจืื ืกืืงืื", ืฉืึทืคึฟื ืืืื ืืจืืืก ืฆืขืืืืืื ื, ืืื ืึท ืืื.
SATA HDD
ืขืก ืืื ื ืื ืืึทืจืคึฟื ืฆื ืืืืกืืจืึทืืื ืขืคึผืขืก ืกืคึผืขืฆืืขื ืืึธ. ืืืจ ืืืขืื ืืึทืื ืืืื ืึธืคึผืืืืืื ื ืคึฟืึทืจ ืึทืืฅ. ืืืจ ืืืขืื ืืึทืื ืึท ืฆืขืืืืืื ื ืืืืึทื ืื ืืืืึธืืก ืืขื ืื ืืืกืงืก ืืื ืงืขื ืืคืืื ืคึผืจืืืืจื ืฆื ืฉืืืืื ืคึฟืื ืืื. ืืืจ ืืืขืื ืืคืืื ืื ืกืืึทืืืจื GRUB ืืืืฃ ืื ืืืกืงืก ืฉืคึผืขืืขืจ ืึทืืื ืึทื ืื ืกืืกืืขื ืงืขื ืคึผืืืฆืืื ื ืืึธื ืืึธืก.
#cat >hdd.part << EOF
label: dos
label-id: 0x00000000
device: /dev/sdg
unit: sectors
/dev/sdg1 : start= 2048, size= 1953523120, type=fd, bootable
EOF
#sfdisk /dev/sdg < hdd.part
#sfdisk /dev/sdh < hdd.part
#sfdisk /dev/sdi < hdd.part
#sfdisk /dev/sdj < hdd.part
#sfdisk /dev/sdk < hdd.part
#sfdisk /dev/sdl < hdd.part
#sfdisk /dev/sdm < hdd.part
#sfdisk /dev/sdn < hdd.part
SATA SSD
ืืึธืก ืืื ืืื ืื ืืืื ืืืขืจื ืืฉืืงืึทืืืข ืคึฟืึทืจ ืืื ืื.
ืขืจืฉืืขืจ, ืืื ืืืขืจ ืืจืืืืื ืืขื ืขื 2 ืื ืืื ืืจืืืก. ืืึธืก ืืื ืืื ืื ืคึผืึทืกืืง ืงืืื ืคึฟืึทืจ MBR, ืืืึธืก ืืื ืืืึธืก ืืืจ ืืืขืื ื ืืฆื. ืืืื ื ืืืืืง, ืงืขื ืขื ืืืื ืจืืคึผืืืืกื ืืื GPT. ืืคึผื ืืืกืงืก ืืึธืื ืึท ืงืึทืืคึผืึทืืึทืืืืึทืื ืฉืืืืข ืืืึธืก ืึทืืึทืื MBR-ืงืึทืืคึผืึทืืึทืืึทื ืกืืกืืขืืขื ืฆื ืืขื ืื ืขืจืฉืืขืจ 4 ืคึผืึทืจืืืฉืึทื ื ืืืื ืืื ืืขื ืขื ืืืื ืืื ืืขืจ ืขืจืฉืืขืจ 2 ืืขืจืึทืืืืขืก. ืื ืืืืคึผื ืืึทื ืืื ืึทื ืื ืฉืืืืื ืฆืขืืืืืื ื ืืื bios_grub ืฆืขืืืืืื ื ืืืืฃ ืื ืืืกืงืก ืืึธื ืืืื ืืื ืื ืึธื ืืืื. ืืึธืก ืืคืืื ืึทืืึทืื ืืืจ ืฆื ืฉืืืืื ืคึฟืื GPT Legacy / BIOS ืืจืืืืื.
ืึธืืขืจ ืืึธืก ืืื ื ืืฉื ืืื ืืืขืจ ืคืึทื.
ืืึธ ืืืจ ืืืขืื ืืึทืื ืฆืืืื ืกืขืงืฉืึทื ื. ืืขืจ ืขืจืฉืืขืจ ืืืขื ืืืื 1 ืืืืืืืื ืืื ืืจืืืก ืืื ืืขืืืืื ื ืคึฟืึทืจ RAID 1 / ืฉืืืืื.
ืืขืจ ืฆืืืืืืขืจ ืืืขื ืืืื ืืขืืืืื ื ืคึฟืึทืจ RAID 6 ืืื ืืืขื ื ืขืืขื ืึทืืข ืื ืจืืขื ืคืจืื ืคึผืืึทืฅ ืึทืืืฅ ืคึฟืึทืจ ืึท ืงืืืื ืึทื ืึทืืึทืงืืืืื ืืขืื ื ืืื ืื ืกืืฃ ืคืื ืื ืคืึธืจ.
ืืืึธืก ืืื ืืึธืก ืึทื ืืึทืจืงื ืืขืื ื?ืืืื ืงืืืืื ืืืืฃ ืืขืจ ื ืขืฅ, ืืื ืืืขืจ SATA SSDs ืืึธืื ืืืืฃ ืืจืขื ืึท ืืื ืึทืืืงืึทืืื ืืงืกืคึผืึทื ืืึทืืึทื SLC ืงืึทืฉ ืจืืื ืืืฉืื ื ืืื ืืจืืืก ืคืื 6 ืฆื 78 ืืืืืืืื. ืืืจ ืืึทืงืืืขื 6 ืืืืืืืื "ืคืจืื" ืจืขืื ืฆื ืืขืจ ืืืืืง ืฆืืืืฉื "ืืืืืืืื" ืืื "ืืืืืืืื" ืืื ืื ืืึทืื ืืืึทื ืคืื ืื ืคืึธืจ. ืื ืจืืขื 72 ืืืืืืืื ืืขื ืขื ืึทืืึทืงืืืืื ืคืื ืึทื ืืืื ืคึผืืึทืฅ.
ืืึธ ืขืก ืืึธื ืืืื ืื ืืขืืืืื ืึทื ืืืจ ืืึธืื ืึท SLC ืงืึทืฉ, ืืื ืื ืคึผืืึทืฅ ืืื ืคืึทืจื ืืืขื ืืื 4 ืืืกื MLC ืืึธืืข. ืืืึธืก ืคึฟืึทืจ ืืื ืื ืืคืขืงืืืืืื ืืืื ืึทื ืคึฟืึทืจ ืืขืืขืจ 4 ืืืืืืืื ืคืื ืคืจืื ืคึผืืึทืฅ ืืืจ ืืึทืงืืืขื ืืืืื 1 ืืืืืืืื ืคืื SLC ืงืึทืฉ.
ืืืืืืคึผืื 72 ืืืืืืืื ืืืจื 4 ืืื ืืึทืงืืืขื 288 ืืืืืืืื. ืืึธืก ืืื ืืขืจ ืคืจืื ืคึผืืึทืฅ ืืืึธืก ืืืจ ืืืขืื ื ืืฉื ืฆืืืื ืืืืก ืฆื ืืึธืื ืื ืืจืืืืื ืฆื ื ืืฆื ืื SLC ืงืึทืฉ ืคืื.
ืืืื, ืืืจ ืืืขืื ืืคืขืงืืืืืื ืืึทืงืืืขื ืึทืจืืืฃ ืฆื 312 ืืืืืืืื ืคืื SLC ืงืึทืฉ ืคึฟืื ืึท ืืึทื ืฅ ืคืื ืืขืงืก ืืจืืืืื. ืคืื ืึทืืข ืื ืืจืืืืื, 2 ืืืขื ืืืื ืืขื ืืฆื ืืื RAID ืคึฟืึทืจ ืืืขืจืืงืืึทื.
ืืขืจ ืกืืืข ืคืื โโืงืึทืฉ ืืืขื ืืึธืื ืืื ืื ืืึธืจ ืจืึทืจืขืื ืืื ืคืึทืงืืืฉ ืืขืื ืืจืขืคื ืึท ืกืืืืึทืฆืืข ืืื ืึท ืฉืจืืึทืื ืืื ื ืืฉื ืืืื ืฆื ืื ืงืึทืฉ. ืืึธืก ืืึธืจ ืงืึทืืคึผืึทื ืกืืืฅ ืคึฟืึทืจ ืื ืกืึทืืึทืกื ืฉืืขืจืื ื ืคืื QLC ืืึผืจืื - ืื ืืึธืจ ื ืืืขืจืืง ืฉืจืืึทืื ืืืืงืืึทื ืืืขื ืืึทืื ืืขื ืขื ืืขืฉืจืืื ืืืืคึผืึทืกืื ื ืื ืงืึทืฉ. ืืืื ืืืื ืืึธืืื ืืึธื ื ืื ืฉืืืืขื ืฆื ืืขื, ืืื ืจืขืงืึธืืขื ืืืจื ืึทื ืืืจ ืืจืึทืืื ืฉืืืขืจ ืืืขืื ืืื ืืึทื ื ืืืื SSD ืืืขื ืืขืฆืืข ืืื ืืขืจ ืึทืืึท ืึท ืืึทืกืข, ืืขื ืืืขื ืืื ืืฉืืื ืื TBW ืคืื ืื ืืึทืื ืืืึทื.
#cat >ssd.part << EOF
label: dos
label-id: 0x00000000
device: /dev/sda
unit: sectors
/dev/sda1 : start= 2048, size= 2097152, type=fd, bootable
/dev/sda2 : start= 2099200, size= 3300950016, type=fd
EOF
#sfdisk /dev/sda < ssd.part
#sfdisk /dev/sdb < ssd.part
#sfdisk /dev/sdc < ssd.part
#sfdisk /dev/sdd < ssd.part
#sfdisk /dev/sde < ssd.part
#sfdisk /dev/sdf < ssd.part
ืงืจืืืืืื ื ืึทืจืจืืึทืก
ืขืจืฉืืขืจ, ืืืจ ืืึทืจืคึฟื ืฆื ืจืขื ืึทืืข ืื ืืึทืฉืื. ืืึธืก ืืื ื ืืืืืง ืืืืึทื ืืขืจ ืืึทืืขืืึธืก ื ืึธืืขื ืืื ืืืื ืคืื ืื ืืขื ืืข ื ืึธืืขื ืขืจืืขืฅ ืื ืืืื ืืื ืึทืคืขืงืฅ ืขืคึผืขืก ืขืจืืขืฅ. ืคืื ืงืืจืก, ืขืจืืืืึทื ืงืขื ืขื ืืืื ืจืื ืืืื ืฉืคึผืขืืขืจ, ืึธืืขืจ ืืึธืก ืืื ืึทื ืืื ืืืืืง ืฉืจืื.
#mcedit /etc/hostname
#mcedit /etc/hosts
#hostname
vdesk0
NVMe SSD
#mdadm --create --verbose --assume-clean /dev/md0 --level=1 --raid-devices=2 /dev/nvme[0-1]n1
ืคืืจืืืืก -ืืืืกื ืขืืขื-ืจืืื...?ืฆื ืืืกืืืืื ืื ืืืืึทืืืืืื ื ืขืจืืื. ืคึฟืึทืจ ืืืืืข RAID ืืขืืืขืืก 1 ืืื 6 ืืึธืก ืืื ืืืืืืง. ืึทืืฅ ืงืขื ืขื ืึทืจืืขืื ืึธื ืื ืืืืึทืืืืืืฉืึทื ืืืื ืขืก ืืื ืึท ื ืืึทืข ืืขื ืืข. ืืขืจืฆื, ืื ืืืืึทืืืืื ื ืื SSD ืืขื ืืข ืืื ืฉืึทืคืื ื ืืื ืึท ืืืืกื ืคืื TBW ืืืื. ืืืจ ื ืืฆื TRIM / DISCARD ืืื ืืขืืืขื ืืืืฃ ืึทืกืขืืืึทืื ืกืกื ืขืจืืื ืฆื "ืื ืืฉืืึทืืืืืจื" ืืื.
ืคึฟืึทืจ SSD ืขืจืืื, RAID 1 DISCARD ืืื ืืขืฉืืืฆื ืืืืก ืคืื ืื ืงืขืกืื.
ืคึฟืึทืจ SSD RAID 6 DISCARD ืขืจืืื, ืืืจ ืืืื ืืขืื ืขืก ืืื ืื ืงืขืจื ืืึธืืืืข ืคึผืึทืจืึทืืขืืขืจืก.
ืืึธืก ืืึธื ืืืื ืืขืืื ืืืืื ืืืื ืึทืืข ืกืกืืก ืืขื ืืฆื ืืื ืืืจืื 4/5/6 ืขืจืืื ืืื ืืขื ืกืืกืืขื ืืึธืื ืืจืืขืื ืฉืืืฆื ืคึฟืึทืจ ืืืกืงืึทืจื_ืืขืจืึธืขืก_ืืึทืืึท. ืืื ืืืจ ืงืืืขื ืึทืจืืืขืจ ืืึธืื ืข ืืจืืืืื ืืืึธืก ืืึธืื ืื ืงืขืจื ืึทื ืื ืคึฟืื ืงืฆืืข ืืื ืืขืฉืืืฆื, ืึธืืขืจ ืืื ืคืึทืงื ืขืก ืืื ื ืืฉื ืืึธืจื, ืึธืืขืจ ืื ืคึฟืื ืงืฆืืข ืืื ื ืืฉื ืฉืืขื ืืืง ืึทืจืืขื. ืืื ืืขืจ ืืึธืืขื ื, ืฉืืืฆื ืืื ืื ืืืฆื ืึผืืขื ืืืืขืืื, ืึธืืขืจ, ืขืก ืืขื ืขื ืึทืื ืืจืืืืื ืืื ืคืืจืืืืึทืจืข ืืื ืขืจืจืึธืจืก. ืคึฟืึทืจ ืืขื ืกืืื, DISCARD ืฉืืืฆื ืืื ืคืึทืจืงืจืืคึผืื ืืืจื ืคืขืืืงืืึทื ืคึฟืึทืจ RAID 6.
ืืคืืขืจืงืืึทืืงืืื, ืื ืคืืืืขื ืืข ืืึทืคึฟืขื ืืืขื ืฆืขืฉืืขืจื ืึทืืข ืืึทืื ืืืืฃ NVMe ืืจืืืืื ืืืจื "ืื ืืฉืืึทืืืืืื ื" ืื ืืขื ืืข ืืื "ืืขืจืึธืก".
#blkdiscard /dev/md0
ืืืื ืขืคึผืขืก ืืืื ืคืึทืืฉ, ืคึผืจืืืืจื ืฆื ืกืคึผืขืฆืืคืืฆืืจื ืึท ืฉืจืื.
#blkdiscard --step 65536 /dev/md0
SATA SSD
#mdadm --create --verbose --assume-clean /dev/md1 --level=1 --raid-devices=6 /dev/sd[a-f]1
#blkdiscard /dev/md1
#mdadm --create --verbose --assume-clean /dev/md2 --chunk-size=512 --level=6 --raid-devices=6 /dev/sd[a-f]2
ืคืืจืืืืก ืึทืืื ืืจืืืก ...?ืคืึทืจืืจืขืกืขืจื ืื ืฉืืืง-ืืจืืืก ืืื ืึท positive ืืืืจืงืื ื ืืืืฃ ืื ืืืืงืืึทื ืคืื ืืจืึทืค - ืืืืขื ืขื ืืื ืืืึทืงืก ืึทืจืืืฃ ืฆื ืฉืืืง-ืืจืืืก ืื ืงืืืกืืื. ืืึธืก ืืึทืคึผืึทื ื ืืืืึทื ืืืื ืึธืคึผืขืจืึทืฆืืข ืคืื โโืื ืฆืื ืขืืขื ืืจืืืก ืึธืืขืจ ืงืืขื ืขืจืขืจ ืงืขื ืขื ืืืื ืืขืขื ืืืงื ืืขืืึทืืจืข ืืืืฃ ืึท ืืืื ืืืื. ืืขืจืืืขืจ, ืื IOPS ืคืื ืึทืืข ืืขืืืืกืขืก ืืื ืกืึทืื ืึทืจืืืฃ. ืืืื ืกืืึทืืืกืืืง, 99% ืคืื IO ืืื ื ืืฉื ืืงืกืื 512K.
RAID 6 IOPS ืคึผืขืจ ืฉืจืืึทืื ืฉืืขื ืืืง ืืืืื ืืงืขืจ ืืื ืึธืืขืจ ืืืืึทื ืฆื ืื IOPS ืคืื ืืืื ืคืึธืจ. ืืืขื, ืืื ืึท ืืจืึทืค - ืืืืขื ืขื, IOPS ืงืขื ืขื ืืืื ืขืืืขืืข ืืึธื ืืจืขืกืขืจ ืืื ืึทื ืคืื ืืืื ืคืึธืจ, ืืื ืืึธ ืื ืืืึธืง ืืจืืืก ืืื ืืืืืืืง.
ืืขืจ ืืืืจ ืงืขื ื ืืฉื ืืขื ืื ืคืื ื ืืื ืืจืืื ื ืฆื ืึทืคึผืืึทืืืื ืึท ืคึผืึทืจืึทืืขืืขืจ ืืืึธืก ืืื ืฉืืขืื ืืื RAID 6 ืืื-ืืืืืื ืืื ืึทื ืฉืืึธื ืึธืคึผืืืืืืขืก ืืืึธืก RAID 6 ืืื ืืื ืืื.
ืืืจ ืืืขืื ืคืึทืจืืืืืงื ืคึฟืึทืจ ืื ื ืขืืขื ืจืึทื ืืึธื ืฉืจืืึทืื ืคืื RAID 6 ืืื ืึท NVMe ืงืึทืฉ ืืื ืืื ืคึผืจืึทืืืืืฉืึทื ืืจืืงืก.
ืืืจ ืืึธืื ื ืึธื ื ืืฉื ืขื ืืืืึทืื DISCARD ืคึฟืึทืจ RAID 6. ืึทืืื ืืืจ ืืืขืื ื ืืฉื "ืื ืืฉืืึทืืืืืจื" ืืขื ืืขื ืืข ืคึฟืึทืจ ืืืฆื. ืืืจ ืืืขืื ืืึธื ืืึธืก ืฉืคึผืขืืขืจ ื ืึธื ืื ืกืืึธืืื ื ืื ืึทืก.
SATA HDD
#mdadm --create --verbose --assume-clean /dev/md3 --chunk-size=512 --level=6 --raid-devices=8 /dev/sd[g-n]1
LVM ืืืืฃ NVMe RAID
ืคึฟืึทืจ ืืืืงืืึทื, ืืืจ ืืืืื ืฆื ืฉืืขืื ืื ืืืึธืจืฆื ืืขืงืข ืกืืกืืขื ืืืืฃ NVMe RAID 1 ืืืึธืก ืืื /dev/md0.
ืึธืืขืจ, ืืืจ ืืืขืื ื ืึธื ืืึทืจืคึฟื ืืขื ืฉื ืขื ืืขื ืืข ืคึฟืึทืจ ืื ืืขืจืข ืืืืขืจืคืขื ืืฉื, ืึทืืึท ืืื ืืืกืืืึทืื, ืืขืืึทืืึทืืึท ืืื LVM-cache ืืื LVM-ืืื ืืขืืึทืืึทืืึท, ืึทืืื ืืืจ ืืืขืื ืืึทืื ืึท LVM VG ืืืืฃ ืืขื ืืขื ืืข.
#pvcreate /dev/md0
#vgcreate root /dev/md0
ืืื ืก ืืึทืื ืึท ืฆืขืืืืืื ื ืคึฟืึทืจ ืื ืืืึธืจืฆื ืืขืงืข ืกืืกืืขื.
#lvcreate -L 128G --name root root
ืืึธืืืจ ืืึทืื ืึท ืฆืขืืืืืื ื ืคึฟืึทืจ ืกืืืึทืคึผืื ื ืืืื ืื ืืจืืืก ืคืื ืืขื ืืึทืจืึทื.
#lvcreate -L 32G --name swap root
ืึทืก ืื ืกืืึทืืืจืื ื
ืืื ืืึทื ืฅ, ืืืจ ืืึธืื ืึทืืฅ ื ืืืืืง ืฆื ืื ืกืืึทืืืจื ืื ืกืืกืืขื.
ืงืึทืืขืจ ืื ืกืืกืืขื ืื ืกืืึทืืืจืื ื ืืึทืืขืง ืคึฟืื ืื Ubuntu Live ืกืืืืืืข. ื ืึธืจืืึทื ืื ืกืืึทืืืจืื ื. ืืืืื ืืื ืืขืจ ืืื ืข ืคืื โโืกืึทืืขืงืืื ื ืืืกืงืก ืคึฟืึทืจ ืื ืกืืึทืืืจืื ื, ืืืจ ืืึทืจืคึฟื ืฆื ืกืคึผืขืฆืืคืืฆืืจื ืื ืคืืืืขื ืืข:
- /dev/md1, - mount point /boot, FS - BTRFS
- /dev/root/root (aka /dev/mapper/root-root), - ืืืจื ืคืื ื / (ืืืึธืจืฆื), FS - BTRFS
- /dev/root/swap (aka /dev/mapper/root-swap), - ื ืืฆื ืืื ืืืกืืืึทืื ืฆืขืืืืืื ื
- ืื ืกืืึทืืืจื ืื ืืึธืึธืืืึธืึทืืขืจ ืืืืฃ /dev/sda
ืืืขื ืืืจ ืกืขืืขืงืืืจื BTRFS ืืื ืืขืจ ืืืึธืจืฆื ืืขืงืข ืกืืกืืขื, ืื ืื ืกืืึทืืืขืจ ืืืขื ืืืืืึธืืึทืืืฉ ืฉืึทืคึฟื ืฆืืืื BTRFS ืืืึทืืืืื ืืื ืื ื ืึธืืขื "@" ืคึฟืึทืจ / (ืืืึธืจืฆื), ืืื "@home" ืคึฟืึทืจ / ืืืื.
ืืื ืก ืึธื ืืืืื ืื ืื ืกืืึทืืืจืื ื ...
ืื ืื ืกืืึทืืืจืื ื ืืืขื ืกืืฃ ืืื ืึท ืืึธืืึทื ืืืึทืืึธื ืงืขืกืื ืืืึธืก ืื ืืืงืืืฅ ืึท ืืขืืช ืืื ืื ืกืืึธืืื ื ืื ืืึธืึธืืืึธืึทืืขืจ. ืฆืื ืืึทืืืืขืจื, ืืืจ ืืืขื ื ืืฉื ืงืขื ืขื ืฆื ืึทืจืืืกืืึทื ื ืืขื ืืืึทืืึธื ืืื ื ืึธืจืืึทื ืืืื ืืื ืคืึธืจืืขืฆื ืื ืื ืกืืึทืืืจืื ื. ืืืจ ืงืืึธืฅ ืืืืก ืคืื ืื ืกืืกืืขื ืืื ืงืืึธืฅ ืืื ืืืืืขืจ, ืขื ืืืงื ืืื ืึท ืจืืื Ubuntu Live ืืขืกืงืืึทืคึผ. ืขืคึฟืขื ืขื ืืขื ืืืึธืงืืึทื ืืื ืืืืืขืจ:
#sudo bash
ืฉืึทืคึฟื ืึท ืืฉืจืึธืึธื ืกืืืืืืข ืฆื ืคืึธืจืืขืฆื ืื ืื ืกืืึทืืืจืื ื:
#mkdir /mnt/chroot
#mount -o defaults,space_cache,noatime,nodiratime,discard,subvol=@ /dev/mapper/root-root /mnt/chroot
#mount -o defaults,space_cache,noatime,nodiratime,discard,subvol=@home /dev/mapper/root-root /mnt/chroot/home
#mount -o defaults,space_cache,noatime,nodiratime,discard /dev/md1 /mnt/chroot/boot
#mount --bind /proc /mnt/chroot/proc
#mount --bind /sys /mnt/chroot/sys
#mount --bind /dev /mnt/chroot/dev
ืืึธืืืจ ืงืึทื ืคืืืืขืจ ืื ื ืขืฅ ืืื ืืึธืกืื ืึทืืข ืืื chroot:
#cat /etc/hostname >/mnt/chroot/etc/hostname
#cat /etc/hosts >/mnt/chroot/etc/hosts
#cat /etc/resolv.conf >/mnt/chroot/etc/resolv.conf
ืืึธืืืจ ืืืื ืืื ืื ืืฉืจืึธืึธื ืกืืืืืืข:
#chroot /mnt/chroot
ืขืจืฉืืขืจ ืคืื ืึทืืข, ืืืจ ืฆืืฉืืขืื ืื ืคึผืึทืงืึทืืืฉืึทื:
apt-get install --reinstall mdadm lvm2 thin-provisioning-tools btrfs-tools util-linux lsscsi nvme-cli mc debsums hdparm
ืืึธืืืจ ืงืึธื ืืจืึธืืืจื ืืื ืคืึทืจืจืืืื ืึทืืข ืคึผืึทืงืึทืืืฉืึทื ืืืึธืก ืืขื ืขื ืงืจืื ืืื ืกืืึทืืืจื ืจืขืื ืฆื ืืขืจืขื ืืืงื ืกืืกืืขื ืื ืกืืึทืืืจืื ื:
#CORRUPTED_PACKAGES=$(debsums -s 2>&1 | awk '{print $6}' | uniq)
#apt-get install --reinstall $CORRUPTED_PACKAGES
ืืืื ืขืคึผืขืก ืืื ื ืืฉื ืึทืจืืขืื, ืืืจ ืงืขื ืืึทืจืคึฟื ืฆื ืจืขืืึทืืืจื /etc/apt/sources.list ืขืจืฉืืขืจ
ืืึธืืืจ ืกืืจืืืขืจื ืื ืคึผืึทืจืึทืืขืืขืจืก ืคึฟืึทืจ ืื RAID 6 ืืึธืืืืข ืฆื ืืขืื TRIM / DISCARD:
#cat >/etc/modprobe.d/raid456.conf << EOF
options raid456 devices_handle_discard_safely=1
EOF
ืืื ืก ืืืืืง ืืื ืืืขืจ ืขืจืืื ืึท ืืืกื:
#cat >/etc/udev/rules.d/60-md.rules << EOF
SUBSYSTEM=="block", KERNEL=="md*", ACTION=="change", TEST=="md/stripe_cache_size", ATTR{md/stripe_cache_size}="32768"
SUBSYSTEM=="block", KERNEL=="md*", ACTION=="change", TEST=="md/sync_speed_min", ATTR{md/sync_speed_min}="48000"
SUBSYSTEM=="block", KERNEL=="md*", ACTION=="change", TEST=="md/sync_speed_max", ATTR{md/sync_speed_max}="300000"
EOF
#cat >/etc/udev/rules.d/62-hdparm.rules << EOF
SUBSYSTEM=="block", ACTION=="add|change", KERNEL=="sd[a-z]", ATTR{queue/rotational}=="1", RUN+="/sbin/hdparm -B 254 /dev/%k"
EOF
#cat >/etc/udev/rules.d/63-blockdev.rules << EOF
SUBSYSTEM=="block", ACTION=="add|change", KERNEL=="sd[a-z]", ATTR{queue/rotational}=="1", RUN+="/sbin/blockdev --setra 1024 /dev/%k"
SUBSYSTEM=="block", ACTION=="add|change", KERNEL=="md*", RUN+="/sbin/blockdev --setra 0 /dev/%k"
EOF
ืืืืก ืืื ืขืก ืืขืืืขื..?ืืืจ ืืึธืื ืืืฉืืคื ืึท ืกืืื ืคืื ืืืขืื ืึผืืืื ืืืึธืก ืืืขื ืืึธื ืื ืคืืืืขื ืืข:
- ืฉืืขืื ืื ืืืึธืง ืงืึทืฉ ืืจืืืก ืคึฟืึทืจ RAID 2020 ืฆื ืืืื ืืืืื ืคึฟืึทืจ 6. ืื ืคืขืืืงืืึทื ืืืขืจื, ืขืก ืืืื ื, ืืื ื ืืฉื ืคืืจืขื ืืขืจื ืืื ื ืื ืฉืึทืคืื ื ืคืื ืืื ืืงืก, ืืื ืืื ื ืืฉื ืืืืื ืคึฟืึทืจ ืึท ืืึทื ื ืฆืืึทื.
- ืจืขืืขืจืืืืจื ืึท ืืื ืืืื ืคืื IO ืคึฟืึทืจ ืื ืืขืืืืขืจ ืคืื ืืขื ืืข ืืฉืขืงืก / ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ื. ืืึธืก ืืื ืฆื ืคืึทืจืืืึทืื ืืืื ืขืจืืื ืคืื ืกืืึทืง ืืื ืึท ืฉืืึทื ืคืื ืืืืืืง ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืืื ืืขืจ ืืึทืกืข.
- ืืึทืืจืขื ืขืฆื ืื ืืึทืงืกืืืื IO ืืขืฉืึทืก ืืฉืขืงืก / ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืคืื ืขืจืืื. ืืึธืก ืืื ื ืืืืืง ืึทืืื ืึทื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื / ืงืึธื ืืจืึธืืืจืื ื SSD RAIDs ืืืขื ื ืืฉื ืคึผืจืขืืืขื ืืืื ืืจืืืืื ืฆื ืึท ืงืจืืืืข. ืืึธืก ืืื ืกืคึผืขืฆืืขื ืืืช ืคึฟืึทืจ NVMe. (ืืขืืขื ืง ื ืื ื ืฐืขื ื ืืข ืจ ืงืืืืืืข ? ืื ื ืื ื ื ืืฉ ื ืืขืืฒื ื .)
- ืคืึทืจืืืขืจื ืืืกืงืก ืคืื ืกืืึธืคึผืคึผืื ื ืฉืคึผืื ืื ืจืึธืืืืืฉืึทื (ืืื) ืืืจื APM ืืื ืฉืืขืื ืื ืฉืืึธืคื ืืืืืึทืื ืคึฟืึทืจ ืืืกืง ืงืึทื ืืจืึธืืืขืจื ืฆื 7 ืฉืขื. ืืืจ ืงืขื ืขื ืืึธืจ ืืืกืืืืึทื APM ืืืื ืืืื ืืจืืืืื ืงืขื ืขื ืืึธื ืืึธืก (-B 255). ืืื ืื ืคืขืืืงืืึทื ืืืขืจื, ืื ืืจืืืืื ืืืขื ืืึทืืื ื ืึธื ืคืื ืฃ ืกืขืงืื ืืขืก. ืืขืจื ืึธื ืื ืึทืก ืืืื ืฆื ืืึทืฉืืขืืืง ืื ืืืกืง ืงืึทืฉ, ืื ืืืกืงืก ืืืขื ืืืืจืื ืึทืจืืืฃ ืืืืืขืจ, ืืื ืึทืืฅ ืืืขื ืึธื ืืืืื ืืืืืขืจ. ืืืกืงืก ืืึธืื ืึท ืืืืืืขื ืืึทืงืกืืืื ื ืืืขืจ ืคืื ืฉืคึผืื ืื ืจืึธืืืืืฉืึทื ื. ืึทืืึท ืึท ืคึผืฉืื ืคืขืืืงืืึทื ืฆืืงื ืงืขื ืขื ืืืืื ืืืืื ืืืื ืืืกืงืก ืืื ืึท ืคึผืึธืจ ืคืื ืืึธืจื. ื ืื ืึทืืข ืืืกืงืก ืืืืื ืคืื ืืขื, ืึธืืขืจ ืืื ืืืขืจ ืืขื ืขื "ืืึทืคึผืืึทืคึผ" ืึธื ืขืก, ืืื ืื ืฆืื ืขืืขื ืคืขืืืงืืึทื ืกืขืืืื ืืก, ืืืึธืก ืืึทืื ืื RAID ืงืืง ืืื ืึท ืืื ื-ืืึทืื.
- ืื ืกืืึทืืืจื ืืืืขื ืขื ืืืืฃ ืืืกืงืก (ืจืึธืืืืืืื ื) 1 ืืขืืืืืื - ืฆืืืื ืงืึธื ืกืขืงืืืืืืข ืืืึทืงืก / ืืฉืึทื ื RAID 6
- ืืืกืืืืึทื ืืืืขื ืขื ืคืึธืจืืืก ืืืืฃ ืื ืขืจืืื ืืื.
ืืึธืืืจ ืจืขืืึทืืืจื /etc/fstab:
#cat >/etc/fstab << EOF
# /etc/fstab: static file system information.
#
# Use 'blkid' to print the universally unique identifier for a
# device; this may be used with UUID= as a more robust way to name devices
# that works even if disks are added and removed. See fstab(5).
# file-system mount-point type options dump pass
/dev/mapper/root-root / btrfs defaults,space_cache,noatime,nodiratime,discard,subvol=@ 0 1
UUID=$(blkid -o value -s UUID /dev/md1) /boot btrfs defaults,space_cache,noatime,nodiratime,discard 0 2
/dev/mapper/root-root /home btrfs defaults,space_cache,noatime,nodiratime,discard,subvol=@home 0 2
/dev/mapper/root-swap none swap sw 0 0
EOF
ืคืืจืืืืก ืืื ืืึธืก..?ืืืจ ืืืขืื ืืืื ืคึฟืึทืจ ืื / ืฉืืืืื ืฆืขืืืืืื ื ืืืจื UUID. ืืขื ืืข ื ืึทืืื ื ืงืขื ืืขืึธืจืขืืืฉ ืืืืฉื.
ืืืจ ืืืขืื ืืืื ืคึฟืึทืจ ืื ืจืืขื ืกืขืงืฉืึทื ื ืืืจื LVM ื ืขืืขื ืืื ืื /dev/mapper/vg-lv ื ืึธืืืืืฉืึทื, ืืืืึทื ืืื ืืืขื ืืืคืืฆืืจื ืคึผืึทืจืืืฉืึทื ื ืืึทื ืฅ ืืื ืฆืืง.
ืืืจ ืืึธื ื ืื ื ืืฆื UUID ืคึฟืึทืจ LVM ืืืืึทื ืื UUID ืคืื LVM ืืืึทืืืืื ืืื ืืืืขืจ ืกื ืึทืคึผืฉืึทืฅ ืงืขื ืขื ืืืื ืื ืืขืืืข.Mount /dev/mapper/root-root.. ืฆืืืื ืืึธื?ืื. ืคึผืื ืงื. ืฉืืจืื ืคืื BTRFS. ืืขื ืืขืงืข ืกืืกืืขื ืงืขื ืขื ืืืื ืืึธืื ืืขื ืขืืืขืืข ืืึธื ืืื ืคืึทืจืฉืืืขื ืข ืกืืืืืึธืืก.
ืจืขืื ืฆื ืืขืจ ืืขืืืืงืขืจ ืฉืืจืื, ืืื ืจืขืงืึธืืขื ืืืจื ืงืืื ืืึธื ืงืจืืืืืื ื LVM ืกื ืึทืคึผืฉืึทืฅ ืคืื ืึทืงืืืื BTRFS ืืืึทืืืืื. ืืืจ ืงืขื ืืึทืงืืืขื ืึท ืืืขืจืจืึทืฉื ืืืขื ืืืจ ืจืขืืึธืึธื.
ืืึธืืืจ ืจืขืืขื ืขืจืืจื ืื mdadm ืงืึทื ืคืืืืขืจืืืฉืึทื:
#/usr/share/mdadm/mkconf | sed 's/#DEVICE/DEVICE/g' >/etc/mdadm/mdadm.conf
ืืึธืืืจ ืกืืจืืืขืจื ืื LVM ืกืขืืืื ืืก:
#cat >>/etc/lvm/lvmlocal.conf << EOF
activation {
thin_pool_autoextend_threshold=90
thin_pool_autoextend_percent=5
}
allocation {
cache_pool_max_chunks=2097152
}
devices {
global_filter=["r|^/dev/.*_corig$|","r|^/dev/.*_cdata$|","r|^/dev/.*_cmeta$|","r|^/dev/.*gpv$|","r|^/dev/images/.*$|","r|^/dev/mapper/images.*$|","r|^/dev/backup/.*$|","r|^/dev/mapper/backup.*$|"]
issue_discards=1
}
EOF
ืืืืก ืืื ืขืก ืืขืืืขื..?ืืืจ ืืึธืื ืขื ืืืืึทืื ืึธืืึทืืึทืืืง ืืงืกืคึผืึทื ืฉืึทื ืคืื LVM ืืื ืคึผืึธืึธืืก ืืืขื ืจืืืฉื 90% ืคืื ืื ืคืึทืจื ืืืขื ืคึผืืึทืฅ ืืื 5% ืคืื ืื ืืึทื ื.
ืืืจ ืืึธืื ืืขืืืืงืกื ืื ืืึทืงืกืืืื ื ืืืขืจ ืคืื ืงืึทืฉ ืืืึทืงืก ืคึฟืึทืจ LVM ืงืึทืฉ.
ืืืจ ืืึธืื ืคึผืจืืืืขื ืืื LVM ืคืื ืืืื ืคึฟืึทืจ LVM ืืืึทืืืืื (PV) ืืืืฃ:
- ืืขืืืืกืขืก ืืื LVM ืงืึทืฉ (cdata)
- ืืขืืืืกืขืก ืงืึทืฉื ื ืืฆื LVM ืงืึทืฉ, ืืืืคึผืึทืกืื ื ืื ืงืึทืฉ ( _ืงืึธืจืื). ืืื ืืขื ืคืึทื, ืื ืงืึทืฉื ืืืื ืืื ืืืขื ื ืึธื ืืืื ืกืงืึทื ื ืืืจื ืื ืงืึทืฉ (ื ืึธืจ ).
- ืืขืืืืกืขืก ืืื LVM ืงืึทืฉ ืืขืืึทืืึทืืึท (ืงืืขืืึท)
- ืึทืืข ืืขืืืืกืขืก ืืื VG ืืื ืื ื ืึธืืขื ืืืืืขืจ. ืืึธ ืืืจ ืืืขืื ืืึธืื ืืืกืง ืืืืืขืจ ืคืื ืืืืจืืืึทื ืืืฉืื ืขื, ืืื ืืืจ ืืึธื ื ืื ืืืขืื LVM ืืืืฃ ืืขืจ ืืึทืืขืืึธืก ืฆื ืึทืงืืึทืืืืื ืืืึทืืืืื ืืืึธืก ืืขืืขืจื ืฆื ืื ืืึทืกื ืึทืก.
- ืึทืืข ืืขืืืืกืขืก ืืื VG ืืื ืื ื ืึธืืขื ืืึทืงืึทืคึผ. ืืึธ ืืืจ ืืืขืื ืืึธืื ืืึทืงืึทืคึผ ืงืืคืืขืก ืคืื ืืืืจืืืึทื ืืึทืฉืื ืืืืืขืจ.
- ืึทืืข ืืขืืืืกืขืก ืืืขืืขื ืก ื ืึธืืขื ืขื ืืก ืืื "ืืคึผืื" (ืืึทืกื ืืฉืืืืช ืืึทื ื)
ืืืจ ืืึธืื ืขื ืืืืึทืื DISCARD ืฉืืืฆื ืืืขื ืคืจืื ืคืจืื ืคึผืืึทืฅ ืืืืฃ LVM VG. ืืื ืืืืื ื. ืืึธืก ืืืขื ืืึทืื ืืืืืืื ื LVs ืืืืฃ ืื SSD ืืึทื ืฅ ืฆืืื ืงืึทื ืกืืืื ื. ืืึธืก ืืื ืกืคึผืขืฆืืขื ืึทืคึผืืืื ืฆื SSD RAID 6. ืึธืืขืจ, ืืืื ืืขื ืคึผืืึทื, ืืืจ ืืืขืื ื ืืฆื ืืื ืคึผืจืึทืืืืืฉืึทื ื, ืึทืืื ืืึธืก ืืืขื ื ืืฉื ืฉืืขืจื ืืื ืื ืืื ืึทืืข.
ืืึธืืืจ ืืขืจืืืึทื ืืืงื ืื initramfs ืืืื:
#update-initramfs -u -k all
ืื ืกืืึทืืืจื ืืื ืงืึทื ืคืืืืขืจ ืืจืื:
#apt-get install grub-pc
#apt-get purge os-prober
#dpkg-reconfigure grub-pc
ืืืึธืก ืืืกืงืก ืืึธื ืืืจ ืงืืืึทืื?ืืืข ืืืืก ืืขื ืขื ืกื*. ืื ืกืืกืืขื ืืืื ืืืื ืืืืืืช ืฆื ืฉืืืืื ืคึฟืื ืงืืื ืืจืืขืื SATA ืคืึธืจ ืึธืืขืจ SSD.
ืคืืจืืืืก ืืืื ืืื ืฆืืืขืืืืื ืึธืก-ืคึผืจืึธืืขืจ..?ืคึฟืึทืจ ืืืขืจืืง ืืขืืืกืืฉืืขื ืืืงืืึทื ืืื ืฉืืืคืขืจืืฉ ืืขื ื.
ืขืก ืึทืจืืขื ื ืืฉื ืจืืืืืง ืืืื ืืืื ืขืจ ืคืื ืื RAIDs ืืื ืืื ืึท ืืืืจืืืืื ืฉืืึทื. ืขืก ืคืจืืืื ืฆื ืืืื ืคึฟืึทืจ ืื ืึทืก ืืืืฃ ืคึผืึทืจืืืฉืึทื ื ืืืึธืก ืืขื ืขื ืืขื ืืฆื ืืื ืืืืจืืืึทื ืืืฉืื ืขื ืคืืืกื ืืืง ืืืืฃ ืืขื ืืึทืื ืืืึทืจื.
ืืืื ืืืจ ืืึทืจืคึฟื ืขืก, ืืืจ ืงืขื ืขื ืืึธืื ืขืก, ืึธืืขืจ ืืึทืืื ืืื ืืื ืขื ืึทืืข ืื ืืืืื. ืืื ืจืขืงืึธืืขื ืืืจื ืืืจ ืืืื ืคึฟืึทืจ ืจืขืกืึทืคึผืื ืคึฟืึทืจ ืืึทืงืืืขื ืืึทืคืจืืึทืขื ืคืื ืฉืืืคืขืจืืฉ ืืขื ื ืึธื ืืืื.
ืืื ืืขื ืืืจ ืืึธืื ืืขืขื ืืืงื ืื ืขืจืฉื ืื ืกืืึทืืืจืื ื. ืขืก ืืื ืฆืืื ืฆื ืจืขืืึธืึธื ืืื ืื ื ืื ืืื ืกืืึทืืืจื ืึทืก. ืื ืืืืกื ื ืืฉื ืคืึทืจืืขืกื ืฆื ืืึทืืืึทืืืงื ืื ืืึธืึธืืึทืืืข ืืืืื ืงืึธืืคึผืึทืงืืืืกืง / ืืกื.
#exit
#reboot
ืกืขืืขืงืืืจื ืงืืื ืคืื ืื SATA SSDs ืืื ืื ืฉืืืืื ืืืื.
LVM ืืืืฃ SATA SSD
ืืื ืืขื ืคืื ื, ืืืจ ืืึธืื ืฉืืื ืืืืื ืืื ืื ื ืืึทืข ืึทืก, ืงืึทื ืคืืืืขืจื ืื ื ืขืฅ, ืคืืืืง, ืืขืขืคื ื ืื ืืืึธืงืืึทื ืขืืืืึทืืึธืจ ืืื ืืึธื ืืฉื:
#sudo bash
ืืึธืืืจ ืคืึธืจืืขืฆื.
"ืื ืืืืึทืืืืข" ืื ืืขื ืืข ืคึฟืื SATA SSD:
#blkdiscard /dev/md2
ืืืื ืขืก ืืื ื ืืฉื ืึทืจืืขืื, ืคึผืจืืืืจื:
#blkdiscard --step 65536 /dev/md2
ืฉืึทืคึฟื LVM VG ืืืืฃ SATA SSD:
#pvcreate /dev/md2
#vgcreate data /dev/md2
ืคืืจืืืืก ืื ืื ืืขืจ VG..?ืืื ืคืึทืงื, ืืืจ ืืึธืื ืฉืืื ืึท VG ืืขืืืืกื ืืืึธืจืฆื. ืคืืจืืืืก ืืึธื ื ืื ืืืืื ืึทืืฅ ืืื ืืืื VG?
ืืืื ืขืก ืืขื ืขื ืขืืืขืืข ืคึผืืืก ืืื ืึท VG, ืคึฟืึทืจ ืื VG ืฆื ืืืื ืึทืงืืืืืืืืื ืจืืืืืง, ืึทืืข ืคึผืื ืืืื ืืืื ืคืึธืจืฉืืขืื (ืึธื ืืืื). ืื ืืืกื ืขื ืืื LVM RAID, ืืืึธืก ืืืจ ืืืืืืจืึทืืื ืืึธื ื ืื ื ืืฆื.
ืืืจ ืืึทืงืข ืืืืื ืึทื ืืืื ืขืก ืืื ืึท ืืืจืืคืึทื (ืืืืขื ืขื ืืึทืื ืึธื ืืืขืจ) ืืืืฃ ืงืืื ืคืื ืื RAID 6 ืขืจืืื, ืื ืึธืคึผืขืจืืืืื ื ืกืืกืืขื ืืืขื ืฉืืืืื ื ืึธืจืืึทืื ืืื ืืขืื ืืื ืื ืื ืืขืืขืื ืืืื ืฆื ืกืึธืืืืข ืืขื ืคึผืจืึธืืืขื.
ืฆื ืืึธื ืืึธืก, ืืื ืืขืจ ืขืจืฉืืขืจ ืืืจืื ืคืื ืึทืืกืืจืึทืงืฆืืข, ืืืจ ืืืึธืืืจื ืืขืืขืจ ืืืคึผ ืคืื ืืฉืืืืช "ืืขืืืข" ืืื ืึท ืืึทืืื ืืขืจ VG.
ืกืืืึทื ืืืคืืงืื ืืขืจืขืื, ืคืึทืจืฉืืืขื ืข RAID ืขืจืืื ืืขืืขืจื ืฆื ืคืึทืจืฉืืืขื ืข "ืคืึทืจืืึธืืืขื ืืึธืืืืื ื". ืืืจ ืืึธื ื ืืฉื ืืึทืื ืึทื ื ืึธื ืคึผืจืึธืกื ืคืื ื ืคืื ืืืจืืคืึทื ืคึฟืึทืจ ืืื ืืืจื ืงืจืึทืืื ื ืืื ืืื ืืืื VG.
ืื ืืืึทืืืึทื ืคืื LVM ืืืืฃ ืื "hardware" ืืืจืื ืืืขื ืืึธืื ืืื ืื ืฆื ืึทืจืืืืจืขืจืึทืื ืฉื ืืึทืื ืืจืขืงืืขื ืคืื ืคืึทืจืฉืืืขื ืข RAID ืขืจืืื ืืืจื ืงืึทืืืืื ืื ื ืืื ืืื ืคืึทืจืฉืืืขื ืข ืืืขืื. ืคึฟืึทืจ ืืืึทืฉืคึผืื - ืืืืคื ืกืืืืึทืืืืื ืืึทืกืื bcache + LVM ืืื, bcache + BTRFS, LVM cache + LVM ืืื, ืึท ืงืึธืืคึผืืขืงืก ZFS ืงืึทื ืคืืืืขืจืืืฉืึทื ืืื ืงืึทืืฉืขืก, ืึธืืขืจ ืงืืื ืื ืืขืจืข ืืขืืืฉ ืืขืืืฉ ืฆื ืคึผืจืืืืจื ืืื ืคืึทืจืืืืึทืื ืขืก ืึทืืข.
ืืืืฃ ืื "ืืึทืจืืืืึทืจืข" ืืืจืื, ืืืจ ืืืขืื ื ืืฉื ื ืืฆื ืขืคึผืขืก ืึทื ืืขืจืฉ ืืื ืืื ืึทืื "ืืืง" LVM ืืืึทืืืืื. ืื ืืืกื ืขื ืฆื ืืขื ืืขืจืฉื ืงืขื ืืืื ืื ืืึทืงืึทืคึผ ืฆืขืืืืืื ื.
ืืื ืืืื ืึทื ืืื ืืขื ืืึธืืขื ื, ืคืืืข ืืืืขื ืขืจ ืืึธืื ืฉืืื ืื ืืขืืืืื ืฆื ืืึธืฉืขื ืขืคึผืขืก ืืืขืื ืื ื ืขืกืืื ื ืืืึทืืงืข.
LVM ืืืืฃ SATA HDD
#pvcreate /dev/md3
#vgcreate backup /dev/md3
ื ืืึท VG ืืืืืขืจ..?ืืืจ ืืึทืงืข ืืืืื ืึทื ืืืื ืื ืืืกืง ืืขื ืืข ืืืึธืก ืืืจ ืืืขืื ื ืืฆื ืคึฟืึทืจ ืืึทืื ืืึทืงืึทืคึผ ืคืืืื, ืืื ืืืขืจ ืึทืคึผืขืจืืืืื ื ืกืืกืืขื ืืืขื ืคืึธืจืืขืฆื ืฆื ืึทืจืืขืื ื ืึธืจืืึทืื, ืืื ืืึทืืื ืึทืงืกืขืก ืฆื ื ืื-ืืึทืงืึทืคึผ ืืึทืื ืืื ืืขืืืืื ืืืขื. ืืขืจืืืขืจ, ืฆื ืืืกืืืืื VG ืึทืงืืึทืืืืืฉืึทื ืคึผืจืึธืืืขืืก, ืืืจ ืืึทืื ืึท ืืึทืืื ืืขืจ VG.
ืืึทืฉืืขืืืงื LVM ืงืึทืฉ
ืืึธืืืจ ืฉืึทืคึฟื ืึท LV ืืืืฃ NVMe RAID 1 ืฆื ื ืืฆื ืขืก ืืื ืึท ืงืึทืืฉืื ื ืืืื.
#lvcreate -L 70871154688B --name cache root
ืคืืจืืืืก ืืื ืขืก ืึทืืื ืงืืืื ...?ืืขืจ ืคืึทืงื ืืื ืึทื ืืื ืืืขืจ NVMe SSDs ืืืื ืืึธืื ืึท SLC ืงืึทืฉ. 4 ืืืืืืืื ืคืื "ืคืจืื" ืืื 18 ืืืืืืืื ืคืื ืืื ืึทืืืฉ ืจืขืื ืฆื ืืขืจ ืคืจืื ืคึผืืึทืฅ ืคืึทืจื ืืืขื ืืื ืื 3-ืืืกื MLC. ืึทืืึธื ืืขื ืงืึทืฉ ืืื ืืืกืืขืืึทืืขืจื, NVMe SSDs ืืืขื ื ืืฉื ืืืื ืคืื ืคืึทืกืืขืจ ืืื ืืื ืืืขืจ SATA SSD ืืื ืงืึทืฉ. ืึทืงืืืึทืืื, ืคึฟืึทืจ ืืขื ืกืืื, ืขืก ืืื ืงืืื ืืื ืขื ืคึฟืึทืจ ืืื ืื ืฆื ืืึทืื ืื LVM ืงืึทืฉ ืฆืขืืืืืื ื ืคืื ืืจืขืกืขืจืข ืืื ืฆืืืื ืืึธื ืื ืืจืืืก ืคืื ืื SLC ืงืึทืฉ ืคืื ืื NVMe ืคืึธืจ. ืคึฟืึทืจ ืื NVMe ืืจืืืืื ืืขื ืืฆื, ืืขืจ ืืืืจ ืืืื ืขืก ืืืืึทื ืฆื ืืึทืื 32-64 ืืืืืืืื ืงืึทืฉ.
ืื ืืขืืขืื ืฆืขืืืืืื ื ืืจืืืก ืืื ืคืืจืืื ืื ืฆื ืึธืจืืึทื ืืืืจื 64 ืืืืืืืื ืงืึทืฉ, ืงืึทืฉ ืืขืืึทืืึทืืึท ืืื ืืขืืึทืืึทืืึท ืืึทืงืึทืคึผ.
ืึทืืืืืืึธื ืึทืืื, ืืื ืืึธื ืึทื ื ืึธื ืึท ืืจืึธื ืกืืกืืขื ืฉืึทืืืึทืื, LVM ืืืขื ืฆืืืื ืื ืืื ืฆืข ืงืึทืฉ ืืื ืืจืึธื ืืื ืืืขื ืกืื ืืงืจืึทื ืืื ืืืืืขืจ. ืืขืจืฆื, ืืึธืก ืืืขื ืืืื ืจืืคึผืืืื ืืขืืขืจ ืืึธื ืืืขื lvchange ืืื ืืขื ืืฆื ืืืืฃ ืืขื ืืืื ืืื ืื ืกืืกืืขื ืืื ืจืขืืึธืึธืืขื ืืืืืขืจ. ืืขืจืืืขืจ, ืืื ืจืขืงืึธืืขื ืืืจื ืืืืื ืจืืงืจืืืืืื ื ืื ืงืึทืฉ ืืื ืื ืฆืื ืขืืขื ืฉืจืืคื.
ืืึธืืืจ ืืึทืื ืึท LV ืืืืฃ SATA RAID 6 ืฆื ื ืืฆื ืขืก ืืื ืึท ืงืึทืฉื ืืืื.
#lvcreate -L 3298543271936B --name cache data
ืคืืจืืืืก ื ืืจ ืืจืื ืืขืจืืืืืืก..?ืืืื ื ืืืืืง, ืืืจ ืงืขื ืขื ื ืืฆื SATA SSD RAID 6 ืคึฟืึทืจ ืขืืืขืืข ืื ืืขืจืข ืืืืขืจืคืขื ืืฉื. ืื ืืจืืืก ืคืื ืื ืงืึทืฉื ืคึผืืึทืฅ ืงืขื ืขื ืืืื ืืขืืืืงืกื ืืื ืึทืืืงืึทืืื, ืืืืฃ ืื ืคืืืขื, ืึธื ืกืืึธืคึผืคึผืื ื ืื ืกืืกืืขื. ืฆื ืืึธื ืืึธืก, ืืืจ ืืึทืจืคึฟื ืฆื ืืขืืคึผืขืจืขืจืึทืื ืืึทืืื ืืื ืืขืื ืื ืงืึทืฉ ืืืืืขืจ, ืึธืืขืจ ืื ืึธืคึผืฉืืืื ืืืง ืืืึทืืข ืคืื โโLVM-cache ืืืืขืจ, ืืืฉื, bcache ืืื ืึทื ืืึธืก ืงืขื ืขื ืืืื ืืขืืื ืืืืฃ ืื ืคืืืขื.
ืืึธืืืจ ืฉืึทืคึฟื ืึท ื ืืึทืข VG ืคึฟืึทืจ ืงืึทืืฉืื ื.
#pvcreate /dev/root/cache
#pvcreate /dev/data/cache
#vgcreate cache /dev/root/cache /dev/data/cache
ืืื ืก ืืึทืื ืึท LV ืืืืฃ ืื ืงืึทืฉื ืืืื.
#lvcreate -L 3298539077632B --name cachedata cache /dev/data/cache
ืืึธ ืืืจ ืืื ืืขื ืืืขื ืึทืืข ืื ืคืจืื ืคึผืืึทืฅ ืืืืฃ /dev/data/cache ืึทืืื ืึทื ืึทืืข ืื ืืขืจืข ื ืืืืืง ืคึผืึทืจืืืฉืึทื ื ืืขื ืขื ืืืฉืืคื ืืืืื ืืืืฃ /dev/root/cache. ืืืื ืืืจ ืืึธื ืืืฉืืคื ืขืคึผืขืก ืืื ืืขื ืืืืจืขืื ืึธืจื, ืืืจ ืงืขื ืขื ืืึทื ืขืก ืืื pvmove.
ืืึธืืืจ ืืึทืื ืืื ืืขืื ืืขื ืงืึทืฉ:
#lvcreate -y -L 64G -n cache cache /dev/root/cache
#lvcreate -y -L 1G -n cachemeta cache /dev/root/cache
#lvconvert -y --type cache-pool --cachemode writeback --chunksize 64k --poolmetadata cache/cachemeta cache/cache
#lvconvert -y --type cache --cachepool cache/cache cache/cachedata
ืคืืจืืืืก ืึทืืึท ืฉืืืง ืืจืืืก..?ืืืจื ืคึผืจืึทืงืืืฉ ืืงืกืคึผืขืจืึทืืึทื ืฅ, ืืขืจ ืืืืจ ืืื ืืืืืืช ืฆื ืืขืคึฟืื ืขื ืึทื ืืขืจ ืืขืกืืขืจ ืจืขืืืืืึทื ืืื ืึทืืฉืืืื ืืืื ืื ืืจืืืก ืคืื ืื LVM ืงืึทืฉ ืืืึธืง ืงืึธืืื ืกืืืื ืืื ืื ืืจืืืก ืคืื ืื LVM ืืื ืืืึธืง. ืืขืจืฆื, ืื ืงืืขื ืขืจืขืจ ืื ืืจืืืก, ืื ืืขืกืขืจ ืื ืงืึทื ืคืืืืขืจืืืฉืึทื ืคึผืขืจืคืึธืจืื ืืื ืึท ืืจืึทืค ืจืขืงืึธืจืืื ื.
64 ืง ืืื ืื ืืื ืืืื ืืืึธืง ืืจืืืก ืขืจืืืืื ืคึฟืึทืจ LVM ืืื.
ืืืื ืึธืคึผืืขืืื ืฉืจืืืืืืึทืงืง..!ืื. ืืขื ืืืคึผ ืคืื ืงืึทืฉ ืืืคืขืจื ืฉืจืืึทืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืฆื ืื ืงืึทืฉื ืืืื. ืืขื ืืืื ืึทื ืืืื ืื ืงืึทืฉ ืืื ืคืึทืจืคืึทืื, ืืืจ ืงืขื ืคืึทืจืืืจื ืืึทืื ืืืืฃ ืื ืงืึทืฉื ืืืื. ืฉืคึผืขืืขืจ, ืืขืจ ืืืืจ ืืืขื ืืึธืื ืืืจ ืืืึธืก ืืืืืขื, ืืื ืึทืืืฉืึทื ืฆื NVMe RAID 1, ืงืขื ืขื ืืืื ืืขื ืืืขื ืฆื ืคืึทืจืืืืืงื ืคึฟืึทืจ ืืขื ืจืืืืงืืจื.
ืืขืจ ืงืึทืฉ ืืืคึผ ืืื ืืืืกืืขืจืืืืืื ืืขืงืืืื ืฆื ืคืึทืจืืืืืงื ืคึฟืึทืจ ืื ื ืขืืขื ืจืึทื ืืึธื ืฉืจืืึทืื ืคืึธืจืฉืืขืืื ื ืคืื RAID 6.
ืืึธืืืจ ืงืึธื ืืจืึธืืืจื ืืืึธืก ืืืจ ืืึธืื:
#lvs -a -o lv_name,lv_size,devices --units B cache
LV LSize Devices
[cache] 68719476736B cache_cdata(0)
[cache_cdata] 68719476736B /dev/root/cache(0)
[cache_cmeta] 1073741824B /dev/root/cache(16384)
cachedata 3298539077632B cachedata_corig(0)
[cachedata_corig] 3298539077632B /dev/data/cache(0)
[lvol0_pmspare] 1073741824B /dev/root/cache(16640)
ืืืืื [cachedata_corig] ืืึธื ืืืื ืืืื ืืืืฃ /dev/data/cache. ืืืื ืขืคึผืขืก ืืื ืคืึทืืฉ, ื ืืฆื pvmove.
ืืืจ ืงืขื ืขื ืืืกืืืืึทื ืื ืงืึทืฉ ืืืื ื ืืืืืง ืืื ืืืื ืืึทืคึฟืขื:
#lvconvert -y --uncache cache/cachedata
ืืึธืก ืืื ืืขืืื ืึธื ืืืื. LVM ืืืขื ืคืฉืื ืกืื ืง ืื ืงืึทืฉ ืฆื ืืืกืง, ืึทืจืึธืคึผื ืขืืขื ืขืก ืืื ืจืขื ืึทืืข cachedata_corig ืฆืืจืืง ืฆื ืงืึทืืฉืขืืึทืืึท.
ืืึทืฉืืขืืืงื LVM ืืื
ืืื ืก ืืขืขืจืขื ืึธืคึผืฉืึทืฆื ืืื ืคืื ืคึผืืึทืฅ ืืืจ ืืึทืจืคึฟื ืคึฟืึทืจ LVM ืืื ืืขืืึทืืึทืืึท:
#thin_metadata_size --block-size=64k --pool-size=6terabytes --max-thins=100000 -u bytes
thin_metadata_size - 3385794560 bytes estimated metadata area size for "--block-size=64kibibytes --pool-size=6terabytes --max-thins=100000"
ืงืืึทืืขืืืง ืึทืจืืืฃ ืฆื 4 ืืืืืืืื: 4294967296 ื
ืืืืืืคึผืื ืืื ืฆืืืื ืืื ืืืืื 4194304B ืคึฟืึทืจ LVM PV ืืขืืึทืืึทืืึท: 8594128896B
ืืึธืืืจ ืืึทืื ืึท ืืึทืืื ืืขืจ ืฆืขืืืืืื ื ืืืืฃ NVMe RAID 1 ืฆื ืฉืืขืื LVM ืืื ืืขืืึทืืึทืืึท ืืื ืืืืขืจ ืืึทืงืึทืคึผ ืงืึธืคึผืืข ืืืืฃ ืขืก:
#lvcreate -L 8594128896B --name images root
ืฆื ืืืืก..?ืืึธ ืงืขื ืืืื ืื ืงืฉืื: ืคืืจืืืืก ืฉืืขืื LVM ืืื ืืขืืึทืืึทืืึท ืกืขืคึผืขืจืึทืืื ืืืื ืขืก ืืืขื ื ืึธื ืืืื ืงืึทืฉื ืืืืฃ NVMe ืืื ืืืขื ืึทืจืืขืื ืืขืฉืืืื ื.
ืืึธืืฉ ืืืืงืืึทื ืืื ืืืืืืืง ืืึธ, ืขืก ืืื ืืืืึทื ืคืื ืื ืืืืคึผื ืกืืื. ืื ืืึทื ืืื ืึทื ืืขืจ ืงืึทืฉ ืืื ืึท ืคืื ื ืคืื ืืืจืืคืึทื. ืขืคึผืขืก ืงืขื ืคึผืึทืกืืจื ืืื ืืื, ืืื ืืืื ืื LVM ืืื ืืขืืึทืืึทืืึท ืืื ืงืึทืฉื, ืืึธืก ืืืขื ืืึทืื ืึทืืฅ ืืึธืจ ืคืึทืจืคืึทืื. ืึธื ืืึทื ืฅ ืืขืืึทืืึทืืึท, ืขืก ืืืขื ืืืื ืึผืืขื ืืืืืขืืืขื ืฆื ืึทืกืขืืืึทื ืืื ืืืึทืืืืื.
ืืืจื ืืึธืืืื ื ืื ืืขืืึทืืึทืืึท ืฆื ืึท ืืึทืืื ืืขืจ ื ืื-ืงืึทืฉื, ืึธืืขืจ ืฉื ืขื, ืืึทื ื, ืืืจ ืืึทืจืึทื ืืืจื ืื ืืืืขืจืงืืึทื ืคืื ืื ืืขืืึทืืึทืืึท ืืื ืคืึทื ืคืื ืงืึทืฉ ืึธื ืืืขืจ ืึธืืขืจ ืงืึธืจืืคึผืฆืืข. ืืื ืืขื ืคืึทื, ืึทืืข ืฉืขืืืงื ืืขืคึฟืืจื ืืืจื ืงืึทืฉ ืึธื ืืืขืจ ืืืขื ืืืื ืืึธืืงืึทืืืืื ืื ืืื ืืืึทืืืืื, ืืืึธืก ืืืขื ืคืึทืจืคึผืึธืฉืขืืขืจื ืื ืึธืคึผืืื ืคึผืจืึธืฆืขืืืจ ืืืื ืึธืจืืขืจืก ืคืื ืืึทืื ืึทืืื. ืืื ืึท ืืืื ืืึทืฉืืึธืขืก, ืื ืืึทืืืืืฉืื ืืืขื ืืืื ืืขืืื ื ืืื FS ืืึธืืก.
ืืขืจืฆื, ืืืื ืึท ืืึธืืขื ืืืืื ืคืื ืึท ืืื ืืึทื ื ืืื ืคืจืืขืจ ืืขื ืืืขื, ืืื ื ืึธื ืืขื ืื ืงืึทืฉ ืืื ืืึธืจ ืกืื ืืงืจืึทื ืืืื ืืืึท ืืื ืืกืืขืจ ืึทืืึธื, ืืขืจืืืขืจ, ืจืขืื ืฆื ืืขืจ ืื ืขืจืืขื ืคึผืืึทื ืคืื LVM ืืื, ืื ืึธืจื ืืืขืืงืืึทื ืคืื ืื ืืึธืืขื ืืืืื ืืืขื ืืืื ืืขืจืึทื ืืื ืืื ืคืึทื ืคืื ืงืึทืฉ ืึธื ืืืขืจ. .
ืืึธืืืจ ืฉืึทืคึฟื ืึท ื ืืึทืข VG ืืืึธืก ืืืขื ืืืื ืคืึทืจืึทื ืืืืึธืจืืืขื ืคึฟืึทืจ ืืื ืคึผืจืึทืืืืืฉืึทื ื:
#pvcreate /dev/root/images
#pvcreate /dev/cache/cachedata
#vgcreate images /dev/root/images /dev/cache/cachedata
ืืึธืืืจ ืืึทืื ืึท ืืขืงื:
#lvcreate -L 274877906944B --poolmetadataspare y --poolmetadatasize 4294967296B --chunksize 64k -Z y -T images/thin-pool
ืคืืจืืืืก -ื ืืืื ืึทืืืฉืึทื ืฆื ืืืึธืก ืืขืจ ืืึธืืข ืืื ืึทืงืืฉืึทืืืึทืื ืืืขื ืคึฟืึทืจ - ืฆื ืคืึทืจืืืึทืื ืืึทืื ืคืื ืืืื ืืืืจืืืึทื ืืึทืฉืื ืคืื ืืืงืื ื ืฆื ืื ืื ืืขืจ ืืืืจืืืึทื ืืึทืฉืื ืืืขื ืจืืืืกืืจืืืืืืื ื ืคึผืืึทืฅ - ื ืืืืื ื ืืื ืึทืืืฉื ืึทืื ืืขื ืืฆื ืฆื ืคืึทืจืืจืขืกืขืจื ืื ืืืืงืืึทื ืคืื ืืจืึทืค - ืฉืจืืืื ืืื ืืืึทืงืก ืงืืขื ืขืจืขืจ ืืื 64 ืง. ืืขืืขืจ ืฉืจืืึทืื ืืืืื ืืงืขืจ ืืื 64 ืง ืฆื ืึท ืืื ืึทืืขืจ ืึทื ืึทืืึทืงืืืืื ืืขืื ื ืคืื ืื ืืื ืืึทื ื ืืืขื ืืืขืจื 64 ืง ืืจืขื-ืึทืืืื ื ืืื ืื ืงืึทืฉ. ืืึธืก ืืืขื ืืึธืื ืื ืึธืคึผืขืจืึทืฆืืข ืฆื ืืืื ืืืจืืืขืงืึธืื ืืขืืึทืืจืข ืืืจื ืื ืงืึทืฉ, ืืืืคึผืึทืกืื ื ืื ืงืึทืฉื ืืืื.
ืืึธืืืจ ืืึทื ืื ืืืืก ืฆื ืื ืงืึธืจืึทืกืคึผืึทื ืืื ื ืคึผืืืืก:
#pvmove -n images/thin-pool_tdata /dev/root/images /dev/cache/cachedata
#pvmove -n images/lvol0_pmspare /dev/cache/cachedata /dev/root/images
#pvmove -n images/thin-pool_tmeta /dev/cache/cachedata /dev/root/images
ืืืืืจ ืืฉืขืงื:
#lvs -a -o lv_name,lv_size,devices --units B images
LV LSize Devices
[lvol0_pmspare] 4294967296B /dev/root/images(0)
thin-pool 274877906944B thin-pool_tdata(0)
[thin-pool_tdata] 274877906944B /dev/cache/cachedata(0)
[thin-pool_tmeta] 4294967296B /dev/root/images(1024)
ืืื ืก ืืึทืื ืึท ืืื ืืึทื ื ืคึฟืึทืจ ืืขืกืฅ:
#lvcreate -V 64G --thin-pool thin-pool --name test images
ืืืจ ืืืขืื ืื ืกืืึทืืืจื ืคึผืึทืงืึทืืืฉืึทื ืคึฟืึทืจ ืืขืกืฅ ืืื ืืึธื ืืืึธืจืื ื:
#apt-get install sysstat fio
ืึทืืื ืืืจ ืงืขื ืขื ืึธืืกืขืจืืืืจื ืื ื ืึทืืืจ ืคืื ืืื ืืืขืจ ืกืืึธืจืืืืฉ ืงืึทื ืคืืืืขืจืืืฉืึทื ืืื ืคืึทืงืืืฉ ืฆืืื:
#watch 'lvs --rows --reportformat basic --quiet -ocache_dirty_blocks,cache_settings cache/cachedata && (lvdisplay cache/cachedata | grep Cache) && (sar -p -d 2 1 | grep -E "sd|nvme|DEV|md1|md2|md3|md0" | grep -v Average | sort)'
ืืึธืก ืืื ืืื ืืืจ ืงืขื ืขื ืคึผืจืืืืจื ืืื ืืืขืจ ืงืึทื ืคืืืืขืจืืืฉืึทื:
#fio --loops=1 --size=64G --runtime=4 --filename=/dev/images/test --stonewall --ioengine=libaio --direct=1
--name=4kQD32read --bs=4k --iodepth=32 --rw=randread
--name=8kQD32read --bs=8k --iodepth=32 --rw=randread
--name=16kQD32read --bs=16k --iodepth=32 --rw=randread
--name=32KQD32read --bs=32k --iodepth=32 --rw=randread
--name=64KQD32read --bs=64k --iodepth=32 --rw=randread
--name=128KQD32read --bs=128k --iodepth=32 --rw=randread
--name=256KQD32read --bs=256k --iodepth=32 --rw=randread
--name=512KQD32read --bs=512k --iodepth=32 --rw=randread
--name=4Kread --bs=4k --rw=read
--name=8Kread --bs=8k --rw=read
--name=16Kread --bs=16k --rw=read
--name=32Kread --bs=32k --rw=read
--name=64Kread --bs=64k --rw=read
--name=128Kread --bs=128k --rw=read
--name=256Kread --bs=256k --rw=read
--name=512Kread --bs=512k --rw=read
--name=Seqread --bs=1m --rw=read
--name=Longread --bs=8m --rw=read
--name=Longwrite --bs=8m --rw=write
--name=Seqwrite --bs=1m --rw=write
--name=512Kwrite --bs=512k --rw=write
--name=256write --bs=256k --rw=write
--name=128write --bs=128k --rw=write
--name=64write --bs=64k --rw=write
--name=32write --bs=32k --rw=write
--name=16write --bs=16k --rw=write
--name=8write --bs=8k --rw=write
--name=4write --bs=4k --rw=write
--name=512KQD32write --bs=512k --iodepth=32 --rw=randwrite
--name=256KQD32write --bs=256k --iodepth=32 --rw=randwrite
--name=128KQD32write --bs=128k --iodepth=32 --rw=randwrite
--name=64KQD32write --bs=64k --iodepth=32 --rw=randwrite
--name=32KQD32write --bs=32k --iodepth=32 --rw=randwrite
--name=16KQD32write --bs=16k --iodepth=32 --rw=randwrite
--name=8KQD32write --bs=8k --iodepth=32 --rw=randwrite
--name=4kQD32write --bs=4k --iodepth=32 --rw=randwrite
| grep -E 'read|write|test' | grep -v ioengine
ืงืขืจืคืึทืื! ืืืื!ืืขืจ ืงืึธื ืืืขื ืืืืคื 36 ืคืึทืจืฉืืืขื ืข ืืขืกืฅ, ืืขืืขืจ ืคืืืกื ืืืง ืคึฟืึทืจ 4 ืกืขืงืื ืืขืก. ืืขืืคื ืคืื ืื ืืขืกืฅ ืืขื ืขื ืคึฟืึทืจ ืจืขืงืึธืจืืื ื. ืืืจ ืงืขื ืขื ืจืขืงืึธืจืืืจื ืึท ืคึผืืึทืฅ ืืืืฃ NVMe ืืื 4 ืกืขืงืื ืืขืก. ืึทืจืืืฃ ืฆื 3 ืืืืืืืื ืคึผืขืจ ืกืขืงืื ืืข. ืึทืืื, ืืขืืขืจ ืืืืคื ืคืื ืฉืจืืืื ืืขืกืฅ ืงืขื ืขื ืขืกื ืึทืจืืืฃ ืฆื 216 ืืืืืืืื ืคืื ืกืกื ืืืื ืคืื ืืืจ.
ืืืืขื ืขื ืืื ืฉืจืืืื ืืขืืืฉื?ืื. ืขืก ืืืื ืืื ืขื ืฆื ืืืืคื ืื ืืืืขื ืขื ืืื ืฉืจืืึทืื ืืขืกืฅ ืกืขืคึผืขืจืึทืืื. ืืขืจืฆื, ืขืก ืืื ืืื ืขื ืฆื ืขื ืฉืืจ ืึทื ืึทืืข ืงืึทืืฉืขืก ืืขื ืขื ืกืื ืืงืจืึทื ืืืื ืึทืืื ืึทื ืึท ืคืจืืขืจ ืืขืืืื ืฉืจืืึทืื ืืื ื ืืฉื ืืืืจืงื ืื ืืืืขื ืขื.
ืื ืจืขืืืืืืื ืืืขืื ืืืื ืืืืขืจ ืึทื ืืขืจืฉ ืืขืฉืึทืก ืืขืจ ืขืจืฉืืขืจ ืงืึทืืขืจ ืืื ืืขืจื ืึธื ืืืขื ืื ืงืึทืฉ ืืื ืืื ืืึทื ื ืคึผืืึธืืืืจื ืืื, ืืื ืืืื ืืืคึผืขื ืืื ื ืืืืฃ ืฆื ืื ืกืืกืืขื ืืื ืืขืจืืื ืฆื ืกืื ืืงืจืึทื ืืื ืื ืงืึทืืฉืขืก ืึธื ืืขืคืืื ืืขืฉืึทืก ืื ืืขืฆืืข ืงืึทืืขืจ.
ืฆืืืืฉื ืื ืืขืจืข ืืืื, ืืื ืจืขืงืึธืืขื ืืืจื ืืขืกืื ืื ืืืืงืืึทื ืืืืฃ ืึท ืฉืืื ืคืื ืืื ืืึทื ื ืคืื ืืืึธืก ืึท ืืึธืืขื ืืืืื ืืื ืคึผืื ืงื ืืขื ืืืขื. ืืขืจ ืืืืจ ืืื ืื ืืขืืขืื ืืืื ืฆื ืึธืืกืขืจืืืืจื ืืื ืืจืึทืค - ืฉืจืืืื ืคืึทืจืืืืขืจื ืฉืืจืฃ ืืื ื ืึธื ืงืจืืืืืื ื ืื ืขืจืฉืืขืจ ืืึธืืขื ืืืืื, ืกืคึผืขืฆืืขื ืืืขื ืื ืงืึทืฉ ืืื ื ืึธื ื ืืฉื ืืึธืจ ืคืื. ืืึธืก ืืึทืคึผืึทื ื ืจืขืื ืฆื ืงืึธืคึผืืข-ืืืืฃ-ืฉืจืืื ืฉืจืืึทืื ืกืขืืึทื ืืืงืก, ืึทืืืื ืืึทื ื ืคืื ืงืึทืฉ ืืื ืืื ืืึทื ื ืืืึทืงืก, ืืื ืืขืจ ืคืึทืงื ืึทื ืึท ืืจืึทืค - ืฉืจืืึทืื ืฆื RAID 6 ืืืจื ืก ืืื ืึท ืืจืึทืค - ืืืืขื ืขื ืคึฟืื RAID 6 ื ืืืืขืืื ืืขื ืืืจื ืึท ืฉืจืืึทืื ืฆื ืื ืงืึทืฉ. ืืื ืืื ืืืขืจ ืงืึทื ืคืืืืขืจืืืฉืึทื, ืืจืึทืค - ืืืืขื ืขื ืคืื RAID 6 ืืื ืึทืจืืืฃ ืฆื 6 ืืื (ืื ื ืืืขืจ ืคืื SATA SSDs ืืื ืื ืืขื ืืข) ืคืึทืกืืขืจ ืืื ืฉืจืืืื. ืืืืึทื ืืืึทืงืก ืคึฟืึทืจ ืงืึธืื ืืขื ืขื ืึทืืึทืงืืืืื ืกืึทืงืืืขื ืืฉืึทืื ืคึฟืื ืึท ืืื ืืขืงื, ืืื ืื ืจืขืงืึธืจืืื ื, ืคึฟืึทืจ ืื ืจืืึฟ ืืืื, ืืืื ืืืจื ืก ืืื ืกืึทืงืืืขื ืืฉืึทื.
ืืืืืข ืคืื โโืื ืคึฟืขืึดืงืืืื ืงืขื ืขื ืืืื ืืขืืืืื ื ืฆื ืืืื ืืืึทืืข.
ืงืึทืฉ "ืงืึธืืขืจืึทื ื" ืกื ืึทืคึผืฉืึทืฅ
ืฆื ืจืขืืืฆืืจื ืื ืจืืืืงืืจื ืคืื ืืึทืื ืึธื ืืืขืจ ืืื ืคืึทื ืคืื ืงืึทืฉ ืฉืขืืืงื / ืึธื ืืืขืจ, ืืขืจ ืืืืจ ืืืืื ืฆื ืืึทืงืขื ืขื ืื ืคืืจ ืคืื ืจืึธืืืืืืื ื ืกื ืึทืคึผืฉืึทืฅ ืฆื ืืึทืจืึทื ืืืจื ืืืืขืจ ืึธืจื ืืืขืืงืืึทื ืืื ืืขื ืคืึทื.
ืขืจืฉืืขืจ, ืืืืึทื ืืื ืืึทื ื ืืขืืึทืืึทืืึท ืจืืืืืื ืืืืฃ ืึท ืึทื ืงืึทืืฉืขื ืืืื, ืื ืืขืืึทืืึทืืึท ืืืขื ืืืื ืงืึธื ืกืืกืืขื ื ืืื ืืขืืืขื ืืึธืกืกืขืก ืืืขื ืืืื ืืคืืขืืื ืืขืจื ืืื ืืึทืื ืืืึทืงืก.
ืื ืคืืืืขื ืืข ืืึธืืขื ืืืืื ืจืึธืืืืืฉืึทื ืฆืืงื ืืขืจืึทื ืืื ืื ืึธืจื ืืืขืืงืืึทื ืคืื ืื ืืึทืื ืื ืื ืกื ืึทืคึผืฉืึทืฅ ืืื ืคืึทื ืคืื ืงืึทืฉ ืึธื ืืืขืจ:
- ืคึฟืึทืจ ืืขืืขืจ ืืื ืืึทื ื ืืื ืื ื ืึธืืขื <ื ืึธืืขื>, ืืึทืื ืึท ืืึธืืขื ืืืืื ืืื ืื ื ืึธืืขื <ื ืึธืืขื>.ืงืึทืืฉืขื
- ืืึธืืืจ ืฉืืขืื ืื ืืืืจืึทืืืึธื ืฉืืืขื ืฆื ืึท ืืืืึทื ืืืื ืืืขืจื:
#lvchange --quiet --cachesettings "migration_threshold=16384" cache/cachedata - ืืื ืื ืฉืืืืฃ ืืืจ ืงืึธื ืืจืึธืืืจื ืื ื ืืืขืจ ืคืื ืืจืึธื ืืืึทืงืก ืืื ืื ืงืึทืฉ:
#lvs --rows --reportformat basic --quiet -ocache_dirty_blocks cache/cachedata | awk '{print $2}'ืืื ืืืจ ืืึทืงืืืขื ื ืื. ืืืื ืื ื ืื ืืื ืคืขืื ืืืง ืคึฟืึทืจ ืฆื ืืึทื ื, ืขืก ืงืขื ืขื ืืืื ืืืฉืืคื ืืืจื ืืขืืคึผืขืจืขืจืึทืื ืืึทืฉืืืืขื ืื ืงืึทืฉ ืฆื ืฉืจืืืื ืืึธืืข. ืึธืืขืจ, ืืื ืื ืืืืงืืึทื ืงืขืจืึทืงืืขืจืืกืืืงืก ืคืื ืืื ืืืขืจ SATA ืืื NVMe SSD ืขืจืืื, ืืื ืืขืืื ื ืืื ืืืืขืจ TBW ืืืื, ืืืจ ืงืขื ืขื ืืขืฉืืืื ื ืืึทืคึผื ืืขื ืืึธืืขื ื ืึธื ืืฉืึทื ืืื ื ืื ืงืึทืฉ ืืึธืืข, ืึธืืขืจ ืืืื ืืึทืื ืืืึทืจื ืืืขื ืืึธืจ ืขืกื ืื ืืื ืฆืข ืืืื ืืื ืขืืืขืืข ืืขื. ืจืขืื ืฆื ืืืื ืืืืืืืืฉืึทื ื, ืื ืกืืกืืขื ืืื, ืืื ืคึผืจืื ืฆืืคึผ, ื ืื ืืืืืืช ืฆื ืืืื ืืื ืืขืจ 100% ืฉืจืืึทืื ืืึทืกืข ืึทืืข ืื ืฆืืื. ืืื ืืืขืจ NVMe SSDs ืืื ืืขืจ 100% ืฉืจืืึทืื ืืึทืกืข ืืืขื ืืึธืจ ืืืกืืึทืืขืจื ืื ืืืื ืืื 3-4 ืืขื. SATA SSDs ืืืขื ืืืืขืจื ืืืืื ืฆืืืื ืืึธื ืืื ืืึทื ื. ืืขืจืืืขืจ, ืืืจ ืืืขืื ืืืขืจื ืขืืขื ืึทื ืจืืึฟ ืคืื ืื ืืึทืกืข ืืืื ืฆื ืืืืขื ืขื, ืืื ืืืจ ืืึธืื ืืขืคืืขืจืขื ืงืืจืฅ-ืืขืจืืื ืคึผืืึทืฆื ืคืื ืืึธืจ ืืืื ืืขืืืงืืื ืงืึทืืืืื ื ืืื ืึท ื ืืืขืจืืง ืืึทืกืข ืืื ืืืจืืฉื ืืืืขื ืคึฟืึทืจ ืฉืจืืืื. - ืืื ืืึทืื ืืื ืืืจ ืืขืืืคื (ืึธืืขืจ ืืขืืืื) ืึท ื ืื, ืืืจ ืจืขื ืึทืืข <ื ืึธืืขื>.ืงืึทืืฉืขื ืฆื <ื ืึธืืขื>.ืงืึทืืืืืืขื. ืืขืจ ืึทืื <ื ืึธืืขื>.ืงืึทืืืืืขื ืืื ืืืืกืืขืืขืงื.
- ืึธืคึผืืืึธื ืึทืืื, ืืืื ืืขืจ ืงืึทืฉ ืืื 100% ืคืื, ืขืก ืงืขื ืขื ืืืื ืจืืงืจืืืืืื ืืืจื ืึท ืฉืจืืคื, ืึทืืื ืงืืึธืจ ืขืก. ืืื ืึท ืืึทืื-ืืืืืืง ืงืึทืฉ, ืื ืกืืกืืขื ืึทืจืืขื ืคืื ืคืึทืกืืขืจ ืืืขื ืฉืจืืืื.
- ืฉืืขืื ืื ืืืืืจืืืฉืึทื ืฉืืืขื ืฆื ื ืื:
#lvchange --quiet --cachesettings "migration_threshold=0" cache/cachedataืืึธืก ืืืขื ืืขืืคึผืขืจืขืจืึทืื ืคืึทืจืืืึทืื ืื ืงืึทืฉ ืคืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืฆื ืื ืืืืคึผื ืืืืืึท. - ืืืจ ืืืึทืจืื ืืื ืืึทื ืฅ ืึท ืคึผืืึทืฅ ืคืื ืขื ืืขืจืื ืืขื ืึทืงืืืืืึทืืืื ืืื ืื ืงืึทืฉ
#lvs --rows --reportformat basic --quiet -ocache_dirty_blocks cache/cachedata | awk '{print $2}'ืึธืืขืจ ืื ืืืึทืืขืจ ืืืขื ืืืื ืึทืืืขืง. - ืืืจ ืืืืขืจืืืจื ืืืืืขืจ.
ืคืืจืืืืก ืฉืืืขืจืืงืืืื ืืื ืืืืืจืืืฉืึทื ืฉืืืขื ...?ืื ืืึทื ืืื ืึทื ืืื ืคืึทืงืืืฉ ืคืืจ, ืึท "ืจืึทื ืืึธื" ืจืขืงืึธืจืืื ื ืืื ืคืืงืืืฉ ื ืืฉื ืืึธืจ ืืจืึทืค. ืืืื ืืืจ ืืขืฉืจืืื ืขืคึผืขืก ืฆื ืึท ืกืขืงืืึธืจ ืคืื 4 ืงืืืืืืื ืืื ืืจืืืก, ืขืก ืืื ืึท ืืืื ืืึทืฉืืึธืขืก ืึทื ืืื ืื ืืืืึทืืขืจ ืคึผืึธืจ ืคืื ืืื ืื ืึท ืจืขืงืึธืจื ืืืขื ืืืื ืืขืืืื ืฆื ืืขืจ ืืขืืืืงืขืจ ืึธืืขืจ ืืืื ืขืจ ืคืื ืื ืืจืืืืงืข (+- 32 ืง) ืกืขืงืืึธืจืก.
ืืืจื ืืึทืฉืืขืืืงื ืื ืืืืืจืืืฉืึทื ืฉืืืขื ืฆื ื ืื, ืืืจ ืึธืคึผืืืืื ืฉืจืืืื ืกืื ืืงืจืึทื ืึทืืืืฉืึทื ืืืืฃ ืื SATA SSD ืืื ืฆืื ืืืคืืืกื ืขืืืขืืข ืขื ืืขืจืื ืืขื ืฆื ืืืื 64K ืืืึธืง ืืื ืื ืงืึทืฉ. ืืึธืก ืกืึทืืืขืก ืืืืืืืืง ืื ืืืื ืคืื SATA SSD.
ืืื ืืื ืื ืงืึธื..?ืฆืื ืืึทืืืืขืจื, ืืขืจ ืืืืจ ืืืื ืืื ื ืื ืืขื ืืืืง ืงืึธืืคึผืขืืขื ื ืืื ืืขืจ ืึทื ืืืืืงืืื ื ืคืื ืืึทืฉ ืกืงืจืืคึผืก ืืืืึทื ืขืจ ืืื 100% ืืขืืืกื-ืืขืืขืจื ื ืืื ืคึผืจืึทืงืืืกืื "ืืืื"-ืืขืืจืืื ืึทื ืืืืืงืืื ื, ืืขืจืืืขืจ ืขืจ ืืืืืื ืึทื ืื ืฉืจืขืงืืขื ืงืึธื ืืืึธืก ืงืืื ืืืืก ืคืื ืืืื ืืขื ื ืืึธื ื ืืฉื ืืืื ืืขืืืืื ื ืืืจื ืืืขืจ ืขืก ืื. ืึทื ืืขืจืฉ.
ืืื ืืจืึทืืื ืึทื ืคึผืจืึธืคืขืกืกืืึธื ืึทืืก ืืื ืืขื ืคืขืื ืงืขื ืขื ืื ืืืคึผืขื ืืึทื ืืื ืืืกืืึธืื ืึทืืข ืื ืืืืื ืืืกืงืจืืืื ืืึธืืืง, ืืืื ื ืืืืืง, ืืื, ืืึธืืขืจ, ืืคืืื ืืืืืึทืคืื ืคึผืืึทื ืขืก ืืื ืึท ืกืืกืืขื ืืื ืกื, ืืื ืืขืจ ืืืืจ ืืขืคืจืืืื ืฆื ืืึธื.
ืึทืืึท ืึท ืคึผืฉืื ืืึธืืขื ืืืืื ืจืึธืืืืืฉืึทื ืกืืขืืข ืืืขื ืืึธืื ืืื ืื ื ืื ืืืืื ืงืขืกืืืืขืจ ืืึธืื ืืืื ืืึธืืขื ืืืืื ืืึธืจ ืกืื ืืงืจืึทื ืืืื ืืืืฃ ืื SATA SSD, ืึธืืขืจ ืืืื ืืึธืื ืืื ืื, ื ืืฆื ืื Thin_delta ื ืืฆื, ืฆื ืืขืคึฟืื ืขื ืืืืก ืืืึธืก ืืืึทืงืก ืืขื ืขื ืืฉืืื ืืืฉื ื ืึธื ืืืื ืฉืึทืคืื ื, ืืื ืึทืืื ืืึธืงืึทืืืืืจื ืฉืขืืืงื ืืืืฃ. ืื ืืืืคึผื ืืืึทืืืืื, ืืืืขืจ ืกืืืคึผืืึทืคืืืื ื ืึธืคึผืืื.
TRIM / DISCARD ืืื libvirt / KVM
ืืืืึทื ืื ืืึทืื ืกืืึธืจืืืืฉ ืืืขื ืืืื ืืขื ืืฆื ืคึฟืึทืจ KVM ืคืืืกื ืืืง ืืืืืืืจื, ืขืก ืืืึธืื ืืืื ืึท ืืืืข ืืขืืึทื ืง ืฆื ืืขืจื ืขื ืืื ืืืขืจ VMs ื ืื ืืืืื ืฆื ื ืขืืขื ืคืจืื ืคึผืืึทืฅ, ืึธืืขืจ ืืืื ืฆื ืืึทืคืจืืึทืขื ืืืึธืก ืืื ื ืื ืืขืจ ืืืจืฃ.
ืืขื ืืื ืืขืฉืขื ืืืจื ืขืืืึทืืืืืื ื TRIM / DISCARD ืฉืืืฆื ืืืืฃ ืืืืจืืืึทื ืืืกืงืก. ืฆื ืืึธื ืืึธืก, ืืืจ ืืึทืจืคึฟื ืฆื ืืืืฉื ืื ืงืึธื ืืจืึธืืืขืจ ืืืคึผ ืฆื virtio-scsi ืืื ืจืขืืึทืืืจื ืื xml.
#virsh edit vmname
<disk type='block' device='disk'>
<driver name='qemu' type='raw' cache='writethrough' io='threads' discard='unmap'/>
<source dev='/dev/images/vmname'/>
<backingStore/>
<target dev='sda' bus='scsi'/>
<alias name='scsi0-0-0-0'/>
<address type='drive' controller='0' bus='0' target='0' unit='0'/>
</disk>
<controller type='scsi' index='0' model='virtio-scsi'>
<alias name='scsi0'/>
<address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
</controller>
ืึทืืึท ืืืกืงืึทืจืืก ืคืื ืืึทืกื ืึธืกืขืก ืืขื ืขื ืจืืืืืง ืคึผืจืึทืกืขืกื ืืืจื LVM, ืืื ืืืึทืงืก ืืขื ืขื ืคืจืื ืจืืืืืง ืืืืืข ืืื ืื ืงืึทืฉ ืืื ืืื ืื ืืื ืืขืงื. ืืื ืืื ืืืขืจ ืคืึทื, ืืึธืก ืืึทืคึผืึทื ื ืืขืจ ืืืืคึผื ืืื ืึท ืืืืืื ืฉืืืืืขืจ, ืืืขื ืืืืืืื ื ืื ืืืืึทืืขืจ ืืึธืืขื ืืืืื.
BTRFS ืืึทืงืงืืคึผ
ื ืืฆื ืคืึทืจืืืง ืกืงืจืืคึผืก ืืื ืขืงืกืืจืขื ืืืึธืจืขื ืขื ืืื ืืืืฃ ืื ืืืืืขื ืข ืจืืืืงืืจื. ืืขืจ ืืืืจ ืืื ืืขืฉืจืืื ืืขื ืงืึธื ืืื ืืื ืืืืกืฉืืืกืืขื ืคึฟืึทืจ ืืื. ืืื ืืื ืืืืขืจ ืึทื ืคืืืข ืืงืกืคึผืืจืืึทื ืกื ืืื ืืงืก ืืืืขืจื ืืึธืื ืขื ืืขื ืืืฉืืจืื, ืืื ืขืก ืืื ื ืื ืืึทืจืคึฟื ืฆื ื ืึธืืืึทืื ืขืืขืฆืขืจ ืึทื ืืขืจืฉ.
ืืื ืก ืืึทืื ืึท ืืึทื ื ืืืืฃ ืื ืืึทืงืึทืคึผ ืืืื:
#lvcreate -L 256G --name backup backup
ืืื ืก ืคึฟืึธืจืืึทื ืขืก ืืื BTRFS:
#mkfs.btrfs /dev/backup/backup
ืืึธืืืจ ืืึทืื ืืืจื ืคืื ืงืื ืืื ืึธื ืงืืึทืคึผื ืื ืืืึธืจืฆื ืกืึทืืกืขืงืฉืึทื ื ืคืื ืื ืืขืงืข ืกืืกืืขื:
#mkdir /backup
#mkdir /backup/btrfs
#mkdir /backup/btrfs/root
#mkdir /backup/btrfs/back
#ln -s /boot /backup/btrfs
# cat >>/etc/fstab << EOF
/dev/mapper/root-root /backup/btrfs/root btrfs defaults,space_cache,noatime,nodiratime 0 2
/dev/mapper/backup-backup /backup/btrfs/back btrfs defaults,space_cache,noatime,nodiratime 0 2
EOF
#mount -a
#update-initramfs -u
#update-grub
ืืึธืืืจ ืืึทืื ืืืืจืขืงืืขืจืื ืคึฟืึทืจ ืืึทืงืึทืคึผืก:
#mkdir /backup/btrfs/back/remote
#mkdir /backup/btrfs/back/remote/root
#mkdir /backup/btrfs/back/remote/boot
ืืึธืืืจ ืืึทืื ืึท ืืืขืืืืืึทืืขืจ ืคึฟืึทืจ ืืึทืงืึทืคึผ ืกืงืจืืคึผืก:
#mkdir /root/btrfs-backup
ืืึธืืืจ ื ืึธืืืึทืื ืืขื ืฉืจืืคื:
ืคืืืข ืกืงืขืจื ืืึทืฉ ืงืึธื. ื ืืฆื ืืื ืืืื ืืืืื ืจืืืืงืืจื. ืฉืจืืื ื ืืฉื ืืืื ืืจืืื ืฆื ืืขื ืืืืจ ...#cat >/root/btrfs-backup/btrfs-backup.sh << EOF
#!/bin/bash
PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
SCRIPT_FILE="$(realpath $0)"
SCRIPT_DIR="$(dirname $SCRIPT_FILE)"
SCRIPT_NAME="$(basename -s .sh $SCRIPT_FILE)"
LOCK_FILE="/dev/shm/$SCRIPT_NAME.lock"
DATE_PREFIX='%Y-%m-%d'
DATE_FORMAT=$DATE_PREFIX'-%H-%M-%S'
DATE_REGEX='[0-9][0-9][0-9][0-9]-[0-9][0-9]-[0-9][0-9]-[0-9][0-9]-[0-9][0-9]-[0-9][0-9]'
BASE_SUFFIX=".@base"
PEND_SUFFIX=".@pend"
SNAP_SUFFIX=".@snap"
MOUNTS="/backup/btrfs/"
BACKUPS="/backup/btrfs/back/remote/"
function terminate ()
{
echo "$1" >&2
exit 1
}
function wait_lock()
{
flock 98
}
function wait_lock_or_terminate()
{
echo "Wating for lock..."
wait_lock || terminate "Failed to get lock. Exiting..."
echo "Got lock..."
}
function suffix()
{
FORMATTED_DATE=$(date +"$DATE_FORMAT")
echo "$SNAP_SUFFIX.$FORMATTED_DATE"
}
function filter()
{
FORMATTED_DATE=$(date --date="$1" +"$DATE_PREFIX")
echo "$SNAP_SUFFIX.$FORMATTED_DATE"
}
function backup()
{
SOURCE_PATH="$MOUNTS$1"
TARGET_PATH="$BACKUPS$1"
SOURCE_BASE_PATH="$MOUNTS$1$BASE_SUFFIX"
TARGET_BASE_PATH="$BACKUPS$1$BASE_SUFFIX"
TARGET_BASE_DIR="$(dirname $TARGET_BASE_PATH)"
SOURCE_PEND_PATH="$MOUNTS$1$PEND_SUFFIX"
TARGET_PEND_PATH="$BACKUPS$1$PEND_SUFFIX"
if [ -d "$SOURCE_BASE_PATH" ]
then
echo "$SOURCE_BASE_PATH found"
else
echo "$SOURCE_BASE_PATH File not found creating snapshot of $SOURCE_PATH to $SOURCE_BASE_PATH"
btrfs subvolume snapshot -r $SOURCE_PATH $SOURCE_BASE_PATH
sync
if [ -d "$TARGET_BASE_PATH" ]
then
echo "$TARGET_BASE_PATH found out of sync with source... removing..."
btrfs subvolume delete -c $TARGET_BASE_PATH
sync
fi
fi
if [ -d "$TARGET_BASE_PATH" ]
then
echo "$TARGET_BASE_PATH found"
else
echo "$TARGET_BASE_PATH not found. Synching to $TARGET_BASE_DIR"
btrfs send $SOURCE_BASE_PATH | btrfs receive $TARGET_BASE_DIR
sync
fi
if [ -d "$SOURCE_PEND_PATH" ]
then
echo "$SOURCE_PEND_PATH found removing..."
btrfs subvolume delete -c $SOURCE_PEND_PATH
sync
fi
btrfs subvolume snapshot -r $SOURCE_PATH $SOURCE_PEND_PATH
sync
if [ -d "$TARGET_PEND_PATH" ]
then
echo "$TARGET_PEND_PATH found removing..."
btrfs subvolume delete -c $TARGET_PEND_PATH
sync
fi
echo "Sending $SOURCE_PEND_PATH to $TARGET_PEND_PATH"
btrfs send -p $SOURCE_BASE_PATH $SOURCE_PEND_PATH | btrfs receive $TARGET_BASE_DIR
sync
TARGET_DATE_SUFFIX=$(suffix)
btrfs subvolume snapshot -r $TARGET_PEND_PATH "$TARGET_PATH$TARGET_DATE_SUFFIX"
sync
btrfs subvolume delete -c $SOURCE_BASE_PATH
sync
btrfs subvolume delete -c $TARGET_BASE_PATH
sync
mv $SOURCE_PEND_PATH $SOURCE_BASE_PATH
mv $TARGET_PEND_PATH $TARGET_BASE_PATH
sync
}
function list()
{
LIST_TARGET_BASE_PATH="$BACKUPS$1$BASE_SUFFIX"
LIST_TARGET_BASE_DIR="$(dirname $LIST_TARGET_BASE_PATH)"
LIST_TARGET_BASE_NAME="$(basename -s .$BASE_SUFFIX $LIST_TARGET_BASE_PATH)"
find "$LIST_TARGET_BASE_DIR" -maxdepth 1 -mindepth 1 -type d -printf "%fn" | grep "${LIST_TARGET_BASE_NAME/$BASE_SUFFIX/$SNAP_SUFFIX}.$DATE_REGEX"
}
function remove()
{
REMOVE_TARGET_BASE_PATH="$BACKUPS$1$BASE_SUFFIX"
REMOVE_TARGET_BASE_DIR="$(dirname $REMOVE_TARGET_BASE_PATH)"
btrfs subvolume delete -c $REMOVE_TARGET_BASE_DIR/$2
sync
}
function removeall()
{
DATE_OFFSET="$2"
FILTER="$(filter "$DATE_OFFSET")"
while read -r SNAPSHOT ; do
remove "$1" "$SNAPSHOT"
done < <(list "$1" | grep "$FILTER")
}
(
COMMAND="$1"
shift
case "$COMMAND" in
"--help")
echo "Help"
;;
"suffix")
suffix
;;
"filter")
filter "$1"
;;
"backup")
wait_lock_or_terminate
backup "$1"
;;
"list")
list "$1"
;;
"remove")
wait_lock_or_terminate
remove "$1" "$2"
;;
"removeall")
wait_lock_or_terminate
removeall "$1" "$2"
;;
*)
echo "None.."
;;
esac
) 98>$LOCK_FILE
EOF
ืืืืก ืืื ืขืก ืืคืืื..?ืึผืืื ืึท ืกืืื ืคืื ืคึผืฉืื ืงืึทืืึทื ืื ืคึฟืึทืจ ืงืจืืืืืื ื BTRFS ืกื ืึทืคึผืฉืึทืฅ ืืื ืงืึทืคึผืืื ื ืืื ืฆื ืื ืื ืืขืจ FS ื ืืฆื BTRFS ืฉืืงื / ืืึทืงืืืขื.
ืืขืจ ืขืจืฉืืขืจ ืงืึทืืขืจ ืงืขื ืืืื ืืขืคืืขืจืขื ืืึทื ื, ืืืืึทื ... ืืื ืื ืึธื ืืืื, ืึทืืข ืืึทืื ืืืขื ืืืื ืงืึทืคึผืื. ืืืืึทืืขืจ ืืึธื ืืฉืื ืืืขื ืืืื ืืืืขืจ ืฉื ืขื, ืืืืึทื ... ืืืืื ืขื ืืขืจืื ืืขื ืืืขืื ืืืื ืงืึทืคึผืื.
ืื ืื ืืขืจ ืฉืจืืคื ืืืึธืก ืืืจ ืฉืืขืื ืืื Cron:
ืขืืืขืืข ืืขืจ ืืึทืฉ ืงืึธื#cat >/root/btrfs-backup/cron-daily.sh << EOF
#!/bin/bash
PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
SCRIPT_FILE="$(realpath $0)"
SCRIPT_DIR="$(dirname $SCRIPT_FILE)"
SCRIPT_NAME="$(basename -s .sh $SCRIPT_FILE)"
BACKUP_SCRIPT="$SCRIPT_DIR/btrfs-backup.sh"
RETENTION="-60 day"
$BACKUP_SCRIPT backup root/@
$BACKUP_SCRIPT removeall root/@ "$RETENTION"
$BACKUP_SCRIPT backup root/@home
$BACKUP_SCRIPT removeall root/@home "$RETENTION"
$BACKUP_SCRIPT backup boot/
$BACKUP_SCRIPT removeall boot/ "$RETENTION"
EOF
ืืืืก ืืื ืขืก..?ืงืจืืืืฅ ืืื ืกืื ืืงืจืึทื ืืื ืื ืงืจืึทืืขื ืืึทื ืกื ืึทืคึผืฉืึทืฅ ืคืื ืื ืืืกืืขื BTRFS ืืืึทืืืืื ืืืืฃ ืื ืืึทืงืึทืคึผ FS. ื ืึธื ืืขื, ืขืก ืืืืืฅ ืึทืืข ืืืืืขืจ ืืืฉืืคื 60 ืืขื ืฆืืจืืง. ื ืึธื ืงืึทืืขืจ, ืืึทืืขื ืกื ืึทืคึผืฉืึทืฅ ืคืื ืื ืืืกืืขื ืืืึทืืืืื ืืืขื ืืขืจืฉืืึทื ืขื ืืื ืื /backup/btrfs/back/remote/ ืกืืืืืจืขืงืืึธืจืืขืก.
ืืื ืก ืืขืื ืื ืงืึธื ืืืจืืคืืจืื ื ืจืขืื:
#chmod +x /root/btrfs-backup/cron-daily.sh
#chmod +x /root/btrfs-backup/btrfs-backup.sh
ืืื ืก ืืฉืขืง ืขืก ืืื ืฉืืขืื ืขืก ืืื ืื ืงืจืึทื:
#/usr/bin/nice -n 19 /usr/bin/ionice -c 3 /root/btrfs-backup/cron-daily.sh 2>&1 | /usr/bin/logger -t btrfs-backup
#cat /var/log/syslog | grep btrfs-backup
#crontab -e
0 2 * * * /usr/bin/nice -n 19 /usr/bin/ionice -c 3 /root/btrfs-backup/cron-daily.sh 2>&1 | /usr/bin/logger -t btrfs-backup
LVM ืืื ืืึทืงืึทืคึผ
ืืื ืก ืืึทืื ืึท ืืื ืืขืงื ืืืืฃ ืื ืืึทืงืึทืคึผ ืืืื:
#lvcreate -L 274877906944B --poolmetadataspare y --poolmetadatasize 4294967296B --chunksize 64k -Z y -T backup/thin-pool
ืืึธืืืจ ืื ืกืืึทืืืจื ddrescue, ืืืืึทื ... ืกืงืจืืคึผืก ืืืขื ื ืืฆื ืืขื ืืขืฆืืึทื:
#apt-get install gddrescue
ืืึธืืืจ ืืึทืื ืึท ืืืขืืืืืึทืืขืจ ืคึฟืึทืจ ืกืงืจืืคึผืก:
#mkdir /root/lvm-thin-backup
ืืึธืืืจ ื ืึธืืืึทืื ืื ืกืงืจืืคึผืก:
ืืกืื ืืืฉื ืืื ืขืืืืื ืื...#cat >/root/lvm-thin-backup/lvm-thin-backup.sh << EOF
#!/bin/bash
PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
SCRIPT_FILE="$(realpath $0)"
SCRIPT_DIR="$(dirname $SCRIPT_FILE)"
SCRIPT_NAME="$(basename -s .sh $SCRIPT_FILE)"
LOCK_FILE="/dev/shm/$SCRIPT_NAME.lock"
DATE_PREFIX='%Y-%m-%d'
DATE_FORMAT=$DATE_PREFIX'-%H-%M-%S'
DATE_REGEX='[0-9][0-9][0-9][0-9]-[0-9][0-9]-[0-9][0-9]-[0-9][0-9]-[0-9][0-9]-[0-9][0-9]'
BASE_SUFFIX=".base"
PEND_SUFFIX=".pend"
SNAP_SUFFIX=".snap"
BACKUPS="backup"
BACKUPS_POOL="thin-pool"
export LVM_SUPPRESS_FD_WARNINGS=1
function terminate ()
{
echo "$1" >&2
exit 1
}
function wait_lock()
{
flock 98
}
function wait_lock_or_terminate()
{
echo "Wating for lock..."
wait_lock || terminate "Failed to get lock. Exiting..."
echo "Got lock..."
}
function suffix()
{
FORMATTED_DATE=$(date +"$DATE_FORMAT")
echo "$SNAP_SUFFIX.$FORMATTED_DATE"
}
function filter()
{
FORMATTED_DATE=$(date --date="$1" +"$DATE_PREFIX")
echo "$SNAP_SUFFIX.$FORMATTED_DATE"
}
function read_thin_id {
lvs --rows --reportformat basic --quiet -othin_id "$1/$2" | awk '{print $2}'
}
function read_pool_lv {
lvs --rows --reportformat basic --quiet -opool_lv "$1/$2" | awk '{print $2}'
}
function read_lv_dm_path {
lvs --rows --reportformat basic --quiet -olv_dm_path "$1/$2" | awk '{print $2}'
}
function read_lv_active {
lvs --rows --reportformat basic --quiet -olv_active "$1/$2" | awk '{print $2}'
}
function read_lv_chunk_size {
lvs --rows --reportformat basic --quiet --units b --nosuffix -ochunk_size "$1/$2" | awk '{print $2}'
}
function read_lv_size {
lvs --rows --reportformat basic --quiet --units b --nosuffix -olv_size "$1/$2" | awk '{print $2}'
}
function activate_volume {
lvchange -ay -Ky "$1/$2"
}
function deactivate_volume {
lvchange -an "$1/$2"
}
function read_thin_metadata_snap {
dmsetup status "$1" | awk '{print $7}'
}
function thindiff()
{
DIFF_VG="$1"
DIFF_SOURCE="$2"
DIFF_TARGET="$3"
DIFF_SOURCE_POOL=$(read_pool_lv $DIFF_VG $DIFF_SOURCE)
DIFF_TARGET_POOL=$(read_pool_lv $DIFF_VG $DIFF_TARGET)
if [ "$DIFF_SOURCE_POOL" == "" ]
then
(>&2 echo "Source LV is not thin.")
exit 1
fi
if [ "$DIFF_TARGET_POOL" == "" ]
then
(>&2 echo "Target LV is not thin.")
exit 1
fi
if [ "$DIFF_SOURCE_POOL" != "$DIFF_TARGET_POOL" ]
then
(>&2 echo "Source and target LVs belong to different thin pools.")
exit 1
fi
DIFF_POOL_PATH=$(read_lv_dm_path $DIFF_VG $DIFF_SOURCE_POOL)
DIFF_SOURCE_ID=$(read_thin_id $DIFF_VG $DIFF_SOURCE)
DIFF_TARGET_ID=$(read_thin_id $DIFF_VG $DIFF_TARGET)
DIFF_POOL_PATH_TPOOL="$DIFF_POOL_PATH-tpool"
DIFF_POOL_PATH_TMETA="$DIFF_POOL_PATH"_tmeta
DIFF_POOL_METADATA_SNAP=$(read_thin_metadata_snap $DIFF_POOL_PATH_TPOOL)
if [ "$DIFF_POOL_METADATA_SNAP" != "-" ]
then
(>&2 echo "Thin pool metadata snapshot already exist. Assuming stale one. Will release metadata snapshot in 5 seconds.")
sleep 5
dmsetup message $DIFF_POOL_PATH_TPOOL 0 release_metadata_snap
fi
dmsetup message $DIFF_POOL_PATH_TPOOL 0 reserve_metadata_snap
DIFF_POOL_METADATA_SNAP=$(read_thin_metadata_snap $DIFF_POOL_PATH_TPOOL)
if [ "$DIFF_POOL_METADATA_SNAP" == "-" ]
then
(>&2 echo "Failed to create thin pool metadata snapshot.")
exit 1
fi
#We keep output in variable because metadata snapshot need to be released early.
DIFF_DATA=$(thin_delta -m$DIFF_POOL_METADATA_SNAP --snap1 $DIFF_SOURCE_ID --snap2 $DIFF_TARGET_ID $DIFF_POOL_PATH_TMETA)
dmsetup message $DIFF_POOL_PATH_TPOOL 0 release_metadata_snap
echo $"$DIFF_DATA" | grep -E 'different|left_only|right_only' | sed 's/</"/g' | sed 's/ /"/g' | awk -F'"' '{print $6 "t" $8 "t" $11}' | sed 's/different/copy/g' | sed 's/left_only/copy/g' | sed 's/right_only/discard/g'
}
function thinsync()
{
SYNC_VG="$1"
SYNC_PEND="$2"
SYNC_BASE="$3"
SYNC_TARGET="$4"
SYNC_PEND_POOL=$(read_pool_lv $SYNC_VG $SYNC_PEND)
SYNC_BLOCK_SIZE=$(read_lv_chunk_size $SYNC_VG $SYNC_PEND_POOL)
SYNC_PEND_PATH=$(read_lv_dm_path $SYNC_VG $SYNC_PEND)
activate_volume $SYNC_VG $SYNC_PEND
while read -r SYNC_ACTION SYNC_OFFSET SYNC_LENGTH ; do
SYNC_OFFSET_BYTES=$((SYNC_OFFSET * SYNC_BLOCK_SIZE))
SYNC_LENGTH_BYTES=$((SYNC_LENGTH * SYNC_BLOCK_SIZE))
if [ "$SYNC_ACTION" == "copy" ]
then
ddrescue --quiet --force --input-position=$SYNC_OFFSET_BYTES --output-position=$SYNC_OFFSET_BYTES --size=$SYNC_LENGTH_BYTES "$SYNC_PEND_PATH" "$SYNC_TARGET"
fi
if [ "$SYNC_ACTION" == "discard" ]
then
blkdiscard -o $SYNC_OFFSET_BYTES -l $SYNC_LENGTH_BYTES "$SYNC_TARGET"
fi
done < <(thindiff "$SYNC_VG" "$SYNC_PEND" "$SYNC_BASE")
}
function discard_volume()
{
DISCARD_VG="$1"
DISCARD_LV="$2"
DISCARD_LV_PATH=$(read_lv_dm_path "$DISCARD_VG" "$DISCARD_LV")
if [ "$DISCARD_LV_PATH" != "" ]
then
echo "$DISCARD_LV_PATH found"
else
echo "$DISCARD_LV not found in $DISCARD_VG"
exit 1
fi
DISCARD_LV_POOL=$(read_pool_lv $DISCARD_VG $DISCARD_LV)
DISCARD_LV_SIZE=$(read_lv_size "$DISCARD_VG" "$DISCARD_LV")
lvremove -y --quiet "$DISCARD_LV_PATH" || exit 1
lvcreate --thin-pool "$DISCARD_LV_POOL" -V "$DISCARD_LV_SIZE"B --name "$DISCARD_LV" "$DISCARD_VG" || exit 1
}
function backup()
{
SOURCE_VG="$1"
SOURCE_LV="$2"
TARGET_VG="$BACKUPS"
TARGET_LV="$SOURCE_VG-$SOURCE_LV"
SOURCE_BASE_LV="$SOURCE_LV$BASE_SUFFIX"
TARGET_BASE_LV="$TARGET_LV$BASE_SUFFIX"
SOURCE_PEND_LV="$SOURCE_LV$PEND_SUFFIX"
TARGET_PEND_LV="$TARGET_LV$PEND_SUFFIX"
SOURCE_BASE_LV_PATH=$(read_lv_dm_path "$SOURCE_VG" "$SOURCE_BASE_LV")
SOURCE_PEND_LV_PATH=$(read_lv_dm_path "$SOURCE_VG" "$SOURCE_PEND_LV")
TARGET_BASE_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_BASE_LV")
TARGET_PEND_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_PEND_LV")
if [ "$SOURCE_BASE_LV_PATH" != "" ]
then
echo "$SOURCE_BASE_LV_PATH found"
else
echo "Source base not found creating snapshot of $SOURCE_VG/$SOURCE_LV to $SOURCE_VG/$SOURCE_BASE_LV"
lvcreate --quiet --snapshot --name "$SOURCE_BASE_LV" "$SOURCE_VG/$SOURCE_LV" || exit 1
SOURCE_BASE_LV_PATH=$(read_lv_dm_path "$SOURCE_VG" "$SOURCE_BASE_LV")
activate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
echo "Discarding $SOURCE_BASE_LV_PATH as we need to bootstrap."
SOURCE_BASE_POOL=$(read_pool_lv $SOURCE_VG $SOURCE_BASE_LV)
SOURCE_BASE_CHUNK_SIZE=$(read_lv_chunk_size $SOURCE_VG $SOURCE_BASE_POOL)
discard_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
sync
if [ "$TARGET_BASE_LV_PATH" != "" ]
then
echo "$TARGET_BASE_LV_PATH found out of sync with source... removing..."
lvremove -y --quiet $TARGET_BASE_LV_PATH || exit 1
TARGET_BASE_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_BASE_LV")
sync
fi
fi
SOURCE_BASE_SIZE=$(read_lv_size "$SOURCE_VG" "$SOURCE_BASE_LV")
if [ "$TARGET_BASE_LV_PATH" != "" ]
then
echo "$TARGET_BASE_LV_PATH found"
else
echo "$TARGET_VG/$TARGET_LV not found. Creating empty volume."
lvcreate --thin-pool "$BACKUPS_POOL" -V "$SOURCE_BASE_SIZE"B --name "$TARGET_BASE_LV" "$TARGET_VG" || exit 1
echo "Have to rebootstrap. Discarding source at $SOURCE_BASE_LV_PATH"
activate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
SOURCE_BASE_POOL=$(read_pool_lv $SOURCE_VG $SOURCE_BASE_LV)
SOURCE_BASE_CHUNK_SIZE=$(read_lv_chunk_size $SOURCE_VG $SOURCE_BASE_POOL)
discard_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
TARGET_BASE_POOL=$(read_pool_lv $TARGET_VG $TARGET_BASE_LV)
TARGET_BASE_CHUNK_SIZE=$(read_lv_chunk_size $TARGET_VG $TARGET_BASE_POOL)
TARGET_BASE_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_BASE_LV")
echo "Discarding target at $TARGET_BASE_LV_PATH"
discard_volume "$TARGET_VG" "$TARGET_BASE_LV"
sync
fi
if [ "$SOURCE_PEND_LV_PATH" != "" ]
then
echo "$SOURCE_PEND_LV_PATH found removing..."
lvremove -y --quiet "$SOURCE_PEND_LV_PATH" || exit 1
sync
fi
lvcreate --quiet --snapshot --name "$SOURCE_PEND_LV" "$SOURCE_VG/$SOURCE_LV" || exit 1
SOURCE_PEND_LV_PATH=$(read_lv_dm_path "$SOURCE_VG" "$SOURCE_PEND_LV")
sync
if [ "$TARGET_PEND_LV_PATH" != "" ]
then
echo "$TARGET_PEND_LV_PATH found removing..."
lvremove -y --quiet $TARGET_PEND_LV_PATH
sync
fi
lvcreate --quiet --snapshot --name "$TARGET_PEND_LV" "$TARGET_VG/$TARGET_BASE_LV" || exit 1
TARGET_PEND_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_PEND_LV")
SOURCE_PEND_LV_SIZE=$(read_lv_size "$SOURCE_VG" "$SOURCE_PEND_LV")
lvresize -L "$SOURCE_PEND_LV_SIZE"B "$TARGET_PEND_LV_PATH"
activate_volume "$TARGET_VG" "$TARGET_PEND_LV"
echo "Synching $SOURCE_PEND_LV_PATH to $TARGET_PEND_LV_PATH"
thinsync "$SOURCE_VG" "$SOURCE_PEND_LV" "$SOURCE_BASE_LV" "$TARGET_PEND_LV_PATH" || exit 1
sync
TARGET_DATE_SUFFIX=$(suffix)
lvcreate --quiet --snapshot --name "$TARGET_LV$TARGET_DATE_SUFFIX" "$TARGET_VG/$TARGET_PEND_LV" || exit 1
sync
lvremove --quiet -y "$SOURCE_BASE_LV_PATH" || exit 1
sync
lvremove --quiet -y "$TARGET_BASE_LV_PATH" || exit 1
sync
lvrename -y "$SOURCE_VG/$SOURCE_PEND_LV" "$SOURCE_BASE_LV" || exit 1
lvrename -y "$TARGET_VG/$TARGET_PEND_LV" "$TARGET_BASE_LV" || exit 1
sync
deactivate_volume "$TARGET_VG" "$TARGET_BASE_LV"
deactivate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
}
function verify()
{
SOURCE_VG="$1"
SOURCE_LV="$2"
TARGET_VG="$BACKUPS"
TARGET_LV="$SOURCE_VG-$SOURCE_LV"
SOURCE_BASE_LV="$SOURCE_LV$BASE_SUFFIX"
TARGET_BASE_LV="$TARGET_LV$BASE_SUFFIX"
TARGET_BASE_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_BASE_LV")
SOURCE_BASE_LV_PATH=$(read_lv_dm_path "$SOURCE_VG" "$SOURCE_BASE_LV")
if [ "$SOURCE_BASE_LV_PATH" != "" ]
then
echo "$SOURCE_BASE_LV_PATH found"
else
echo "$SOURCE_BASE_LV_PATH not found"
exit 1
fi
if [ "$TARGET_BASE_LV_PATH" != "" ]
then
echo "$TARGET_BASE_LV_PATH found"
else
echo "$TARGET_BASE_LV_PATH not found"
exit 1
fi
activate_volume "$TARGET_VG" "$TARGET_BASE_LV"
activate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
echo Comparing "$SOURCE_BASE_LV_PATH" with "$TARGET_BASE_LV_PATH"
cmp "$SOURCE_BASE_LV_PATH" "$TARGET_BASE_LV_PATH"
echo Done...
deactivate_volume "$TARGET_VG" "$TARGET_BASE_LV"
deactivate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
}
function resync()
{
SOURCE_VG="$1"
SOURCE_LV="$2"
TARGET_VG="$BACKUPS"
TARGET_LV="$SOURCE_VG-$SOURCE_LV"
SOURCE_BASE_LV="$SOURCE_LV$BASE_SUFFIX"
TARGET_BASE_LV="$TARGET_LV$BASE_SUFFIX"
TARGET_BASE_LV_PATH=$(read_lv_dm_path "$TARGET_VG" "$TARGET_BASE_LV")
SOURCE_BASE_LV_PATH=$(read_lv_dm_path "$SOURCE_VG" "$SOURCE_BASE_LV")
if [ "$SOURCE_BASE_LV_PATH" != "" ]
then
echo "$SOURCE_BASE_LV_PATH found"
else
echo "$SOURCE_BASE_LV_PATH not found"
exit 1
fi
if [ "$TARGET_BASE_LV_PATH" != "" ]
then
echo "$TARGET_BASE_LV_PATH found"
else
echo "$TARGET_BASE_LV_PATH not found"
exit 1
fi
activate_volume "$TARGET_VG" "$TARGET_BASE_LV"
activate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
SOURCE_BASE_POOL=$(read_pool_lv $SOURCE_VG $SOURCE_BASE_LV)
SYNC_BLOCK_SIZE=$(read_lv_chunk_size $SOURCE_VG $SOURCE_BASE_POOL)
echo Syncronizing "$SOURCE_BASE_LV_PATH" to "$TARGET_BASE_LV_PATH"
CMP_OFFSET=0
while [[ "$CMP_OFFSET" != "" ]] ; do
CMP_MISMATCH=$(cmp -i "$CMP_OFFSET" "$SOURCE_BASE_LV_PATH" "$TARGET_BASE_LV_PATH" | grep differ | awk '{print $5}' | sed 's/,//g' )
if [[ "$CMP_MISMATCH" != "" ]] ; then
CMP_OFFSET=$(( CMP_MISMATCH + CMP_OFFSET ))
SYNC_OFFSET_BYTES=$(( ( CMP_OFFSET / SYNC_BLOCK_SIZE ) * SYNC_BLOCK_SIZE ))
SYNC_LENGTH_BYTES=$(( SYNC_BLOCK_SIZE ))
echo "Synching $SYNC_LENGTH_BYTES bytes at $SYNC_OFFSET_BYTES from $SOURCE_BASE_LV_PATH to $TARGET_BASE_LV_PATH"
ddrescue --quiet --force --input-position=$SYNC_OFFSET_BYTES --output-position=$SYNC_OFFSET_BYTES --size=$SYNC_LENGTH_BYTES "$SOURCE_BASE_LV_PATH" "$TARGET_BASE_LV_PATH"
else
CMP_OFFSET=""
fi
done
echo Done...
deactivate_volume "$TARGET_VG" "$TARGET_BASE_LV"
deactivate_volume "$SOURCE_VG" "$SOURCE_BASE_LV"
}
function list()
{
LIST_SOURCE_VG="$1"
LIST_SOURCE_LV="$2"
LIST_TARGET_VG="$BACKUPS"
LIST_TARGET_LV="$LIST_SOURCE_VG-$LIST_SOURCE_LV"
LIST_TARGET_BASE_LV="$LIST_TARGET_LV$SNAP_SUFFIX"
lvs -olv_name | grep "$LIST_TARGET_BASE_LV.$DATE_REGEX"
}
function remove()
{
REMOVE_TARGET_VG="$BACKUPS"
REMOVE_TARGET_LV="$1"
lvremove -y "$REMOVE_TARGET_VG/$REMOVE_TARGET_LV"
sync
}
function removeall()
{
DATE_OFFSET="$3"
FILTER="$(filter "$DATE_OFFSET")"
while read -r SNAPSHOT ; do
remove "$SNAPSHOT"
done < <(list "$1" "$2" | grep "$FILTER")
}
(
COMMAND="$1"
shift
case "$COMMAND" in
"--help")
echo "Help"
;;
"suffix")
suffix
;;
"filter")
filter "$1"
;;
"backup")
wait_lock_or_terminate
backup "$1" "$2"
;;
"list")
list "$1" "$2"
;;
"thindiff")
thindiff "$1" "$2" "$3"
;;
"thinsync")
thinsync "$1" "$2" "$3" "$4"
;;
"verify")
wait_lock_or_terminate
verify "$1" "$2"
;;
"resync")
wait_lock_or_terminate
resync "$1" "$2"
;;
"remove")
wait_lock_or_terminate
remove "$1"
;;
"removeall")
wait_lock_or_terminate
removeall "$1" "$2" "$3"
;;
*)
echo "None.."
;;
esac
) 98>$LOCK_FILE
EOF
ืืืึธืก ืืื ืขืก ...?ืึผืืื ืึท ืกืืื ืคืื ืงืึทืืึทื ืื ืคึฟืึทืจ ืืึทื ืืคึผืืึทืืืืืื ื ืืื ืกื ืึทืคึผืฉืึทืฅ ืืื ืกืื ืืงืจืึทื ืืื ืื ืืืืืง ืฆืืืืฉื ืฆืืืื ืืื ืกื ืึทืคึผืฉืึทืฅ ืืืงืืืขื ืืืจื thin_delta ืฆื ืื ืื ืืขืจ ืืืึธืง ืืืื ื ืืฆื ddrescue ืืื blkdiscard.
ืื ืื ืืขืจ ืฉืจืืคื ืืืึธืก ืืืจ ืืืขืื ืฉืืขืื ืืื Cron:
ืึท ืืืกื ืืขืจ ืืึทืฉ#cat >/root/lvm-thin-backup/cron-daily.sh << EOF
#!/bin/bash
PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
SCRIPT_FILE="$(realpath $0)"
SCRIPT_DIR="$(dirname $SCRIPT_FILE)"
SCRIPT_NAME="$(basename -s .sh $SCRIPT_FILE)"
BACKUP_SCRIPT="$SCRIPT_DIR/lvm-thin-backup.sh"
RETENTION="-60 days"
$BACKUP_SCRIPT backup images linux-dev
$BACKUP_SCRIPT backup images win8
$BACKUP_SCRIPT backup images win8-data
#etc
$BACKUP_SCRIPT removeall images linux-dev "$RETENTION"
$BACKUP_SCRIPT removeall images win8 "$RETENTION"
$BACKUP_SCRIPT removeall images win8-data "$RETENTION"
#etc
EOF
ืืืึธืก ืืื ืขืก ...?ื ืืฆื ืื ืคืจืืขืจืืืงืข ืฉืจืืคื ืฆื ืฉืึทืคึฟื ืืื ืกืื ืืงืจืึทื ืืื ืืึทืงืึทืคึผืก ืคืื ืื ืืืกืืขื ืืื ืืืึทืืืืื. ืืขืจ ืฉืจืืคื ืืืขื ืืึธืื ืื ืึทืงืืืื ืกื ืึทืคึผืฉืึทืฅ ืคืื ืื ืืืกืืขื ืืืึทืืืืื, ืืืึธืก ืืขื ืขื ืืืจืฃ ืฆื ืฉืคึผืืจ ืขื ืืขืจืื ืืขื ืืื ื ืื ืืขืฆืืข ืกืื ืืงืจืึทื ืึทืืืืฉืึทื.
ืืขืจ ืฉืจืืคื ืืืื ืืืื ืขืืืืื, ืกืคึผืขืฆืืคืืฆืืจื ืื ืจืฉืืื ืคืื ืืื ืืืึทืืืืื ืคึฟืึทืจ ืืืึธืก ืืึทืงืึทืคึผ ืงืืคืืขืก ืืึธื ืืืื ืืขืืืื. ืื ืืขืืขืื ื ืขืืขื ืืขื ืขื ืืืืื ืคึฟืึทืจ ืืืึทืกืืจืึทืืืื ืฆืืืขืงื. ืืืื ืืืจ ืืืืื, ืืืจ ืงืขื ืขื ืฉืจืืึทืื ืึท ืฉืจืืคื ืืืึธืก ืืืขื ืกืื ืืงืจืึทื ืืื ืึทืืข ืืืึทืืืืื.
ืืืืืจ ืืขืื ืื ืจืขืื:
#chmod +x /root/lvm-thin-backup/cron-daily.sh
#chmod +x /root/lvm-thin-backup/lvm-thin-backup.sh
ืืื ืก ืืฉืขืง ืขืก ืืื ืฉืืขืื ืขืก ืืื ืื ืงืจืึทื:
#/usr/bin/nice -n 19 /usr/bin/ionice -c 3 /root/lvm-thin-backup/cron-daily.sh 2>&1 | /usr/bin/logger -t lvm-thin-backup
#cat /var/log/syslog | grep lvm-thin-backup
#crontab -e
0 3 * * * /usr/bin/nice -n 19 /usr/bin/ionice -c 3 /root/lvm-thin-backup/cron-daily.sh 2>&1 | /usr/bin/logger -t lvm-thin-backup
ืืขืจ ืขืจืฉืืขืจ ืงืึทืืขืจ ืืืขื ืืืื ืืึทื ื, ืืืืึทื ... ืืื ืืืึทืืืืื ืืืขื ืืืื ืืึธืจ ืกืื ืืงืจืึทื ืืืื ืืืจื ืงืึทืคึผืืื ื ืึทืืข ืืขืืืืื ื ืคึผืืึทืฅ. ืืึทื ืง ืฆื LVM ืืื ืืขืืึทืืึทืืึท, ืืืจ ืืืืกื ืืืึธืก ืืืึทืงืก ืืขื ืขื ืคืืงืืืฉ ืืื ื ืืฆื, ืึทืืื ืืืืื ืึทืงืฉืื ืืขืืืืื ื ืืื ืืึทื ื ืืืึทืงืก ืืืขื ืืืื ืงืึทืคึผืื.
ืกืึทืืกืึทืงืืืึทื ื ืจืึทื ื ืืืขื ื ืึธืืืึทืื ืื ืืึทืื ืื ืงืจืึทืืขื ืืึทืื ืืึทื ืง ืฆื ืืืืฉื ืืจืึทืงืื ื ืืืจื LVM ืืื ืืขืืึทืืึทืืึท.
ืืืืืจ ืืขื ืืืืก ืืื ืืขืฉืขื:
#time /root/btrfs-backup/cron-daily.sh
real 0m2,967s
user 0m0,225s
sys 0m0,353s
#time /root/lvm-thin-backup/cron-daily.sh
real 1m2,710s
user 0m12,721s
sys 0m6,671s
#ls -al /backup/btrfs/back/remote/*
/backup/btrfs/back/remote/boot:
total 0
drwxr-xr-x 1 root root 1260 ะผะฐั 26 09:11 .
drwxr-xr-x 1 root root 16 ะผะฐั 6 09:30 ..
drwxr-xr-x 1 root root 322 ะผะฐั 26 02:00 .@base
drwxr-xr-x 1 root root 516 ะผะฐั 6 09:39 [email protected]
drwxr-xr-x 1 root root 516 ะผะฐั 6 09:39 [email protected]
...
/backup/btrfs/back/remote/root:
total 0
drwxr-xr-x 1 root root 2820 ะผะฐั 26 09:11 .
drwxr-xr-x 1 root root 16 ะผะฐั 6 09:30 ..
drwxr-xr-x 1 root root 240 ะผะฐั 26 09:11 @.@base
drwxr-xr-x 1 root root 22 ะผะฐั 26 09:11 @home.@base
drwxr-xr-x 1 root root 22 ะผะฐั 6 09:39 @[email protected]
drwxr-xr-x 1 root root 22 ะผะฐั 6 09:39 @[email protected]
...
drwxr-xr-x 1 root root 240 ะผะฐั 6 09:39 @[email protected]
drwxr-xr-x 1 root root 240 ะผะฐั 6 09:39 @[email protected]
...
#lvs -olv_name,lv_size images && lvs -olv_name,lv_size backup
LV LSize
linux-dev 128,00g
linux-dev.base 128,00g
thin-pool 1,38t
win8 128,00g
win8-data 2,00t
win8-data.base 2,00t
win8.base 128,00g
LV LSize
backup 256,00g
images-linux-dev.base 128,00g
images-linux-dev.snap.2020-03-08-10-09-11 128,00g
images-linux-dev.snap.2020-03-08-10-09-25 128,00g
...
images-win8-data.base 2,00t
images-win8-data.snap.2020-03-16-14-11-55 2,00t
images-win8-data.snap.2020-03-16-14-19-50 2,00t
...
images-win8.base 128,00g
images-win8.snap.2020-03-17-04-51-46 128,00g
images-win8.snap.2020-03-18-03-02-49 128,00g
...
thin-pool <2,09t
ืืืึธืก ืืื ืืึธืก ืืึธืื ืฆื ืืึธื ืืื ื ืขืกืืื ื ืืึทืื?
ืจืืึฟ ืืกืชึผืื, ืืืืึทื LVM LV ืืึทืืืฉืืงืึทื ืืืึทืืืืื ืงืขื ืขื ืืืื LVM PV ืืฉืืืืช ืืืึทืืืืื ืคึฟืึทืจ ืื ืืขืจืข VGs. LVM ืงืขื ืขื ืืืื ืจืขืงืืจืกืืื, ืืื ื ืขืกืืื ื ืืึทืื. ืืึธืก ืืื LVM ืขืงืกืืจืขื ืืืืืืงืืื.
ืคึผืก
ืืื ืืขืจ ืืืืึทืืขืจ ืึทืจืืืงื, ืืืจ ืืืขืื ืคึผืจืืืืจื ืฆื ื ืืฆื ืขืืืขืืข ืขื ืืขื ืจืืจืขืืืืืง ืกืืึธืจืืืืฉ ืกืืกืืขืืขื / KVM ืืื ืื ืืงืขืจ ืคึฟืึทืจ ืงืจืืืืืื ื ืึท ืืขืึธ-ืคืึทืจืฉืคึผืจืืืื ืกืืึธืจืืืืฉ / ืืื ืงื ืืื ืืื ืืืขืจืืงืืึทื ืืืืฃ ืขืืืขืืข ืงืึธื ืืื ืขื ืฅ ื ืืฆื ืืืื ืืขืกืงืืึทืคึผืก, ืื ืืืื ืืื ืืขืจื ืขื ืืื P2P ื ืขืืืืึธืจืงืก.
ืืงืืจ: www.habr.com