Hauv tsab xov xwm no peb yuav tham txog ntau txoj hauv kev los npaj RAID arrays, thiab tseem qhia ib qho ntawm thawj cov khoom siv RAID controllers nrog NVMe kev txhawb nqa.
Txhua yam kev siv ntawm RAID thev naus laus zis muaj nyob hauv ntu server. Hauv cov neeg siv khoom, tsuas yog software RAID0 lossis RAID1 ntawm ob lub disk feem ntau siv.
Kab lus no yuav muab cov ntsiab lus luv luv ntawm RAID thev naus laus zis, kev qhia luv luv ntawm yuav ua li cas los tsim RAID arrays siv peb lub cuab yeej sib txawv, thiab kev sib piv ntawm kev ua haujlwm virtual disk siv txhua txoj kev.
RAID yog dab tsi?
muab lub ntsiab txhais ntawm RAID technology:
RAID (khej. Kev Txwv Tsis Yuam Kev ntawm cov Tsis Txaus Ntseeg - redundant array ntawm ywj siab (ywj siab) disks) - cov ntaub ntawv virtualization technology rau combining ob peb lub cev disk pab kiag li lawm rau hauv ib tug logical module kom ua txhaum cai thiab kev ua tau zoo.
Kev teeb tsa ntawm disk arrays thiab cov thev naus laus zis siv nyob ntawm qhov xaiv RAID theem. RAID theem yog tus qauv hauv cov lus qhia . Nws piav txog ntau theem ntawm RAID, tab sis feem ntau yog RAID0, RAID1, RAID5, thiab RAID6.
RAID0, lossis Kab txaij, yog qib RAID uas sib txuas ob lossis ntau lub cev tsav mus rau hauv ib qho kev xav tau. Qhov ntim ntawm cov logical disk yog sib npaug rau cov lej ntawm cov ntim ntawm lub cev disks suav nrog hauv cov array. Tsis muaj qhov rov ua dua ntawm qib RAID no, thiab tsis ua haujlwm ntawm ib lub tsav tuaj yeem ua rau poob ntawm tag nrho cov ntaub ntawv hauv virtual disk.
Qib RAID1, lossis Daim iav, tsim cov ntawv luam zoo tib yam ntawm cov ntaub ntawv ntawm ob lossis ntau dua disks. Lub ntim ntawm lub virtual disk tsis tshaj qhov ntim ntawm qhov tsawg kawg nkaus ntawm lub cev disks. Cov ntaub ntawv ntawm RAID1 virtual disk yuav muaj yog tias tsawg kawg ib lub cev disk hauv array ua haujlwm. Siv RAID1 ntxiv redundancy, tab sis yog kim heev, txij li thaum nyob rau hauv arrays ntawm ob los yog ntau tshaj disks, tsuas yog ib tug muaj.
Qib RAID5 daws qhov teeb meem ntawm tus nqi siab. Txhawm rau tsim ib qho array nrog RAID5 qib, koj xav tau tsawg kawg 3 disks, thiab cov array tiv taus qhov tsis ua haujlwm ntawm ib lub disk. Cov ntaub ntawv hauv RAID5 yog khaws cia hauv blocks nrog checksums. Tsis muaj kev sib faib nruj ntawm cov ntaub ntawv disks thiab checksum disks. Checksums hauv RAID5 yog qhov tshwm sim ntawm kev ua haujlwm XOR siv rau N-1 blocks, txhua tus coj los ntawm ib qho disk sib txawv.
Txawm hais tias RAID arrays nce redundancy thiab muab redundancy, lawv tsis haum rau khaws cia thaub qab.
Tom qab kev ncig xyuas luv luv ntawm hom RAID arrays, koj tuaj yeem txav mus rau cov khoom siv thiab cov kev pab cuam uas tso cai rau koj los sib sau thiab siv disk arrays.
Hom RAID controllers
Muaj ob txoj hauv kev los tsim thiab siv RAID arrays: kho vajtse thiab software. Peb yuav xav txog cov kev daws teeb meem hauv qab no:
- Linux Software RAID.
- Intel® Virtual RAID Ntawm CPU.
- LSI MegaRAID 9460-8i.
Nco ntsoov tias Intel® kev daws teeb meem khiav ntawm lub chipset, uas ua rau cov lus nug ntawm seb nws puas yog kho vajtse lossis software daws teeb meem. Piv txwv li, VMWare ESXi hypervisor txiav txim siab VROC software thiab tsis lees paub nws.
Linux Software RAID
Software RAID arrays hauv Linux OS tsev neeg yog ib qho kev daws teeb meem zoo hauv ob qho tib si tus neeg siv khoom thiab cov neeg rau zaub mov. Txhua yam koj xav tau los tsim ib qho array yog cov khoom siv mdadm thiab ob peb cov khoom siv thaiv. Qhov tsuas yog qhov yuav tsum tau ua uas Linux Software RAID yuam rau cov tsav siv yog los ua ib qho khoom thaiv kev nkag mus rau lub kaw lus.
Qhov tsis muaj nqi rau cov khoom siv thiab software yog qhov zoo dua ntawm txoj kev no. Linux Software RAID teeb tsa disk arrays ntawm tus nqi CPU sijhawm. Cov npe ntawm cov qib RAID txhawb nqa thiab cov xwm txheej ntawm cov disk arrays tam sim no tuaj yeem pom hauv mdstat cov ntaub ntawv, uas nyob hauv lub hauv paus procfs:
root@grindelwald:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid10]
unused devices: <none>
Kev them nyiaj yug rau qib RAID yog ntxiv los ntawm kev sib txuas cov kernel tsim nyog, piv txwv li:
root@grindelwald:~# modprobe raid456
root@grindelwald:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
unused devices: <none>Tag nrho cov haujlwm nrog disk arrays yog ua los ntawm mdadm hais kom ua kab hluav taws xob. Lub disk array tau sib sau ua ke hauv ib qho lus txib:
mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/nvme1n1 /dev/nvme2n1Tom qab ua tiav cov lus txib no, /dev/md0 thaiv ntaus ntawv yuav tshwm sim hauv lub kaw lus, uas sawv cev rau lub disk virtual.
Intel® Virtual RAID Ntawm CPU
Intel® VROC Standard Hardware Key
Intel® Virtual RAID On CPU (VROC) yog cov cuab yeej siv kho vajtse thiab software tsim los tsim RAID arrays raws li Intel® chipsets. Cov thev naus laus zis no muaj feem ntau rau cov motherboards uas txhawb nqa Intel® Xeon® Scalable processors. Los ntawm lub neej ntawd, VROC tsis muaj. Txhawm rau qhib nws, koj yuav tsum nruab VROC hardware daim ntawv tso cai yuam sij.
Tus qauv VROC daim ntawv tso cai tso cai rau koj los tsim cov disk arrays nrog 0, 1 thiab 10 RAID qib. Tus hwm version nthuav cov npe no nrog kev txhawb nqa RAID5.
Intel® VROC thev naus laus zis ntawm cov niam tsev niaj hnub ua haujlwm ua ke nrog Intel® Volume Management Device (VMD), uas muaj peev xwm sib pauv kub rau NVMe drives.
Intel® VROC Standard License Arrays tau teeb tsa los ntawm Kev Teeb Khoom Siv thaum lub server khau raj. Hauv tab Advanced Intel® Virtual RAID ntawm CPU yam tshwm sim, qhov uas koj tuaj yeem teeb tsa disk arrays.
Tsim ib qho RAID1 array ntawm ob lub drives
Intel® VROC thev naus laus zis muaj nws tus kheej aces txog nws lub tes tsho. Disk arrays tsim siv VROC yog sib xws nrog Linux Software RAID. Qhov no txhais tau hais tias lub xeev ntawm cov arrays tuaj yeem saib xyuas hauv /proc/mdstat thiab tswj hwm los ntawm mdadm. Qhov "feature" no tau txais kev txhawb nqa los ntawm Intel. Tom qab sib sau ua ke RAID1 hauv Teeb Utility, koj tuaj yeem soj ntsuam cov synchronization ntawm drives hauv OS:
root@grindelwald:~# cat /proc/mdstat
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10]
md126 : active raid1 nvme2n1[1] nvme1n1[0]
1855832064 blocks super external:/md127/0 [2/2] [UU]
[>....................] resync = 1.3% (24207232/1855832064) finish=148.2min speed=205933K/sec
md127 : inactive nvme1n1[1](S) nvme2n1[0](S)
10402 blocks super external:imsm
unused devices: <none>Nco ntsoov tias koj tsis tuaj yeem sib sau arrays ntawm VROC siv mdadm (cov arrays sib sau ua ke yuav yog Linux SW RAID), tab sis koj tuaj yeem hloov disks hauv lawv thiab disassemble cov arrays.
LSI MegaRAID 9460-8i
Qhov tshwm sim ntawm LSI MegaRAID 9460-8i maub los
RAID maub los yog ib qho kev daws teeb meem ntawm ib leeg. Tus maub los tsuas yog ua haujlwm nrog cov tsav txuas ncaj qha rau nws. RAID maub los no txhawb nqa txog 24 NVMe tsav. Nws yog NVMe kev txhawb nqa uas teeb tsa tus tswj hwm no sib nrug ntawm ntau lwm tus.
Cov ntawv qhia zaub mov tseem ceeb ntawm cov khoom siv kho vajtse
Thaum siv UEFI hom, cov kev teeb tsa tswj tau muab tso rau hauv Kev Teeb Khoom Siv. Piv rau VROC, cov ntawv qhia zaub mov kho vajtse zoo li nyuaj dua.
Tsim RAID1 ntawm ob lub disks
Piav qhia yuav ua li cas rau configure disk arrays ntawm ib tug hardware maub los yog ib lub ntsiab lus ilv thiab yuav yog vim li cas rau ib tug tag nrho-fledged tsab xov xwm. Ntawm no peb yuav tsuas txwv peb tus kheej los tsim RAID0 thiab RAID1 nrog rau qhov chaw pib.
Disks txuas nrog lub hardware maub los tsis pom rau lub operating system. Hloov chaw, tus maub los "qhov ncauj qhov ntswg" tag nrho RAID arrays li SAS tsav. Cov tsav tsheb txuas nrog tus maub los, tab sis tsis yog ib feem ntawm cov disk array, yuav tsis siv tau los ntawm OS.
root@grindelwald:~# smartctl -i /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-48-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Vendor: AVAGO
Product: MR9460-8i
Revision: 5.14
Compliance: SPC-3
User Capacity: 1,999,844,147,200 bytes [1.99 TB]
Logical block size: 512 bytes
Rotation Rate: Solid State Device
Logical Unit id: 0x000000000000000000000000000000
Serial number: 00000000000000000000000000000000
Device type: disk
Local Time is: Sun Oct 11 16:27:59 2020 MSK
SMART support is: Unavailable - device lacks SMART capability.Txawm hais tias tsis yog SAS drives, NVMe arrays yuav ua haujlwm ntawm PCIe ceev. Txawm li cas los xij, qhov no tso cai rau koj khau raj los ntawm NVMe hauv Txoj Cai.
Test sawv
Txhua txoj hauv kev ntawm kev teeb tsa disk arrays muaj nws tus kheej qhov zoo thiab qhov tsis zoo. Tab sis puas muaj qhov sib txawv ua haujlwm thaum ua haujlwm nrog disk arrays?
Txhawm rau kom ua tiav qhov ncaj ncees siab tshaj plaws, txhua qhov kev ntsuam xyuas yuav ua rau tib lub server. Nws configuration:
- 2x Intel® Xeon® 6240;
- 12x DDR4-2666 16GB;
- LSI MegaRAID 9460-8i;
- Intel® VROC Standard Hardware Key;
- 4x Intel® SSD DC P4510 U.2 2TB;
- 1 x Samsung 970 EVO Plus M.2 500GB.
Cov chav ntsuas yog P4510, ib nrab ntawm cov uas txuas nrog lub motherboard, thiab lwm ib nrab rau RAID maub los. Lub M.2 tab tom khiav Ubuntu 20.04 thiab cov kev ntsuam xyuas yuav khiav siv fio version 3.16.
Kev Ntsuam Xyuas
Ua ntej tshaj plaws, cia peb tshawb xyuas qhov qeeb thaum ua haujlwm nrog lub disk. Qhov kev ntsuam xyuas tau ua tiav hauv ib txoj xov, qhov thaiv qhov loj yog 4 KB. Txhua qhov kev xeem yuav siv sijhawm 5 feeb. Ua ntej pib, cov cuab yeej thaiv tau raug teeb tsa rau tsis muaj raws li I / O teem caij. Cov lus txib fio zoo li no:
fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio --iodepth=1 --loops=1000 --runtime=300 --rw=<mode> --filename=<blkdev>Los ntawm cov txiaj ntsig fio peb coj clat 99.00%. Cov txiaj ntsig tau tshwm sim hauv cov lus hauv qab no.
Random nyeem ntawv, μs
Random cov ntaub ntawv, μs
disk
112
78
Linux SW RAID, RAID0
113
45
VROC, RAID 0
112
46
LSI, RAID 0
122
63
Linux SW RAID, RAID1
113
48
VROC, RAID 1
113
45
LSI, RAID 1
128
89
Ntxiv nrog rau kev ncua sijhawm thaum nkag mus rau cov ntaub ntawv, kuv xav pom qhov ua tau zoo ntawm virtual drives thiab muab piv nrog kev ua haujlwm ntawm lub cev disk. Hais kom khiav fio:
fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio --loops=1000 --runtime=300 --iodepth=<threads> --rw=<mode> --filename=<blkdev>Kev ua tau zoo yog ntsuas raws li kev ua haujlwm ntawm I / O. Cov txiaj ntsig tau nthuav tawm hauv cov lus hauv qab no.
Random nyeem 1 xov, IOPS
Random sau 1 xov, IOPS
Random nyeem 128 xov, IOPS
Random sau 128 xov, IOPS
disk
11300
40700
453000
105000
Linux SW RAID, RAID0
11200
52000
429000
232000
VROC, RAID 0
11200
52300
441000
162000
LSI, RAID 0
10900
44200
311000
160000
Linux SW RAID, RAID1
10000
48600
395000
147000
VROC, RAID 1
10000
54400
378000
244000
LSI, RAID 1
11000
34300
229000
248000
Nws yog ib qho yooj yim kom pom tias kev siv cov cuab yeej kho vajtse ua rau muaj kev nce latency thiab kev ua tau zoo dua piv rau cov kev daws teeb meem software.
xaus
Siv cov kev daws teeb meem kho vajtse los tsim disk arrays los ntawm ob lub disks zoo li irrational. Txawm li cas los xij, muaj cov haujlwm uas siv RAID controllers yog qhov ncaj ncees. Nrog rau qhov tshwm sim ntawm cov tswj hwm uas txhawb nqa NVMe interface, cov neeg siv muaj lub sijhawm los siv SSDs sai dua hauv lawv cov haujlwm.
Tsuas yog cov neeg siv sau npe tuaj yeem koom nrog hauv daim ntawv ntsuam xyuas. thov.
Koj puas siv RAID kev daws teeb meem?
-
29,6%Yog, hardware solutions32
-
50,0%Yog lawm, software solutions54
-
16,7%Nr 18
-
3,7%Tsis xav tau RAID 4
108 cov neeg siv pov npav. 14 cov neeg siv txwv tsis pub siv.
Tau qhov twg los: www.hab.com