🥇 RAID waxay diyaarisay NVMe

Maqaalkan waxaan ka hadli doonaa siyaabo kala duwan oo loo abaabulo RAID arys, sidoo kale waxaan muujin doonaa mid ka mid ah kontaroolayaasha RAID ee ugu horreeya ee leh taageerada NVMe.

Dhammaan codsiyada kala duwan ee tignoolajiyada RAID waxaa laga helaa qaybta server-ka. Qaybta macmiilka, kaliya software RAID0 ama RAID1 ee laba saxan ayaa inta badan la isticmaalaa.

Maqaalkani wuxuu bixin doonaa dulmar kooban oo ku saabsan tignoolajiyada RAID, tabo gaaban oo ku saabsan sida loo abuuro arrays RAID iyadoo la adeegsanayo saddex qalab oo kala duwan, iyo isbarbardhigga waxqabadka diskka farsamada iyadoo la adeegsanayo hab kasta.

Waa maxay RAID?

Wikipedia waxay ku siinaysaa qeexid dhamaystiran tignoolajiyada RAID:

weerar (Eng. Soo-saaris aan badnayn oo ka mid ah diskiyada madaxa-bannaan saxannada madax-bannaan ee aan caadiga ahayn) - tignoolajiyada xog-ururinta xogta ee isku-darka aaladaha diskooga ee dhowrka ah oo loo geliyo module macquul ah si loo kordhiyo dulqaadka iyo waxqabadka qaladka.

Habaynta qalabaynta diskka iyo teknoolajiyada la isticmaalay waxay ku xidhan yihiin kuwa la doortay heerka RAID. Heerarka RAID ayaa lagu jaangooyay qeexitaanka Qaabka Xogta Disk ee RAID-ga caadiga ah. Waxay qeexaysaa heerar badan oo RAID ah, laakiin kuwa ugu caansan waa RAID0, RAID1, RAID5 iyo RAID6.

RAID0, ama karbaashkuna, waa heer RAID ah oo isku dara laba ama in ka badan oo wadis jireed oo isku daraya hal wado macquul ah. Mugga saxanka macquulka ah wuxuu la mid yahay wadarta mugga saxannada jireed ee ku jira shaxanka. Ma jiro dib u celin heerkan RAID, iyo guul darada ku timaada hal drive waxay keeni kartaa luminta dhammaan xogta ku jirta saxanka casriga ah.

Heerka RAID1, ama Mirror, waxay ku abuurtaa nuqullo isku mid ah xogta laba ama in ka badan. Baaxadda saxanka farsamada kama badna cabbirka ugu yar ee saxannada jireed. Xogta ku jirta RAID1 diskka farsamada gacanta ayaa la heli doonaa ilaa iyo inta uu shaqaynayo ugu yaraan hal saxan oo ka mid ah saxanka. Isticmaalka RAID1 wuxuu ku darayaa dib-u-celin, laakiin waa xal aad qaali u ah, maadaama ay ku jiraan laba ama in ka badan awoodda hal kaliya ayaa la heli karaa.

Heerka RAID5 wuxuu xalliyaa dhibaatada kharashka badan. Si aad u abuurto array leh heerka RAID5, waxaad u baahan tahay ugu yaraan 3 saxan, oo shaxdu waxay u adkaysanaysaa fashilka hal disk. Xogta ku jirta RAID5 waxa lagu kaydiyaa baloogyo leh xisaab hubin. Ma jiro kala qaybsanaan adag oo u dhaxaysa saxannada xogta iyo saxanka hubinta. Jeegaga ku jira RAID5 waa natiijada hawlgalka XOR ee lagu dabaqay baloogyada N-1, oo mid walba laga soo qaaday saxan kale.

In kasta oo habab RAID ay kordhiyaan shaqo-ka-noqoshada oo ay bixiyaan dib-u-celin, kuma habboona kaydinta kaydinta.

Ka dib safar gaaban oo ku saabsan noocyada RAID-ga, waxaad u gudbi kartaa aaladaha iyo barnaamijyada kuu oggolaanaya inaad urursato oo aad isticmaasho qalabyada diskooga.

Noocyada kontaroolayaasha RAID

Waxaa jira laba siyaabood oo loo abuuro oo loo isticmaalo arrays RAID: hardware iyo software. Waxaan tixgelin doonaa xalalka soo socda:

Linux Software-ka RAID.
Intel® Virtual RAID On CPU.
LSI MegaRAID 9460-8i.

Ogsoonow in xalka Intel® uu ku shaqeeyo Chipset-ka, kaas oo keenaya su'aasha ah in uu yahay xal hardware ama software. Tusaale ahaan, VMWare ESXi hypervisor waxa uu tixgaliyaa barnaamijka VROC oo si rasmi ah uma taageero.

Linux Software-ka RAID

Barnaamijyada RAID ee ku jira qoyska OS-ka Linux — xal caadi ah oo ku jira labada qaybood ee macmiilka iyo server-ka. Waxa kaliya ee loo baahan yahay si loo abuuro array waa utility mdadm iyo dhowr qalab oo baloog ah. Shuruudaha kaliya ayaa ah Linux Software RAID ee darawallada la isticmaalay - noqo qalab xannibaad ah oo laga heli karo nidaamka.

Maqnaanshaha kharashyada qalabka iyo software-ka waa faa'iido cad oo habkan ah. Linux Software RAID wuxuu abaabulaa taxane disk ah iyadoo ku kacaysa waqtiga CPU-ga. Liiska heerarka RAID ee la taageerayo iyo xaaladda taxane disk ah oo hadda jira waxaa laga arki karaa faylka mdstat, kaas oo ku yaal asalka procfs:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] 
unused devices: <none>

Taageerada heerarka RAID waxaa lagu daraa iyadoo la isku xirayo cutubka kernel-ka ku habboon, tusaale ahaan:

root@grindelwald:~# modprobe raid456
root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] 
unused devices: <none>

Dhammaan hawlgallada leh arraysyada diskooga waxa lagu sameeyaa utility line-ka mdadm. Diyaarinta saxanka waxa lagu soo ururiyay hal amar:

mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/nvme1n1 /dev/nvme2n1

Kadib fulinta amarkan, qalabka xannibaadda / dev/md0 ayaa ka soo muuqan doona nidaamka, kaas oo kuu metelaya sida disk-ga casriga ah.

Intel® Virtual RAID On CPU

Furaha Hardware ee Intel® VROC
Intel® Virtual RAID On CPU (VROC) waa qalab iyo teknooloojiyada software ee abuurista hannaan RAID oo ku salaysan Intel® chipsets. Farsamadan waxaa ugu horrayn loogu talagalay Motherboard-yada taageera Intel® Xeon® Scalable processors. Sida caadiga ah, VROC lama heli karo. Si aad u dhaqaajiso, waa inaad ku rakibtaa furaha shatiga qalabka VROC.

Shatiga caadiga ah ee VROC wuxuu kuu ogolaanayaa inaad abuurto arrays disk oo leh 0, 1 iyo 10 RAID. Nooca premium-ka ayaa liiskan ku balaadhinaya taageerada RAID5.

Tignoolajiyada Intel® VROC ee Motherboard-yada casriga ah waxay la shaqeysaa Intel® Aaladda Maareynta Mugga (VMD), kaas oo siiya awoodda isdhaafsiga kulul ee darawallada NVMe.

Shatiga caadiga ah ee Intel® VROC Arraysyada waxaa lagu habeeyaa Utility Setup marka serferku kabaha galo. On tab Advanced RAID-ka Intel® Virtual RAID ee shayga CPU ayaa soo muuqda, halkaas oo aad ku habayn karto arraysyada saxanka.

Abuuritaanka RAID1 array laba darawal
Tiknoolajiyadda Intel® VROC waxay leedahay aces u gaar ah. Qalabka disk-ga ee la isku keenay iyadoo la adeegsanayo VROC ayaa la jaan qaadaya. Linux Software RAID. Taas macnaheedu waa in xaaladda array-ga lagu kormeeri karo /proc/mdstat oo lagu maamuli karo mdadm. Sifadan waxaa si rasmi ah u taageera Intel. Ka dib markaad dhisto RAID1, waxaad arki kartaa darawallada oo ku dhex milmay OS-ka Setup Utility:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10] 
md126 : active raid1 nvme2n1[1] nvme1n1[0]
      1855832064 blocks super external:/md127/0 [2/2] [UU]
      [>....................]  resync =  1.3% (24207232/1855832064) finish=148.2min speed=205933K/sec
      
md127 : inactive nvme1n1[1](S) nvme2n1[0](S)
      10402 blocks super external:imsm
       
unused devices: <none>

Ogsoonow inaadan isku soo ururin karin arraysyada VROC iyada oo loo marayo mdadm (arraysyada la isku daray waxay noqon doonaan Linux SW RAID), laakiin waad beddeli kartaa diskyada ku jira oo waad kala furfuri kartaa arraysyada.

LSI MegaRAID 9460-8i

Muuqashada LSI MegaRAID 9460-8i xakamaynta
Xakamaynta RAID waa xal qalab kaligiis taagan. Koontarooluhu wuxuu kaliya ku shaqeeyaa darawallada si toos ah ugu xiran. Xakamaynta RAID-kan waxa ay taageertaa ilaa 24 NVMe wadoyinka. Waa taageerada NVMe tan ka dhigaysa kantaroolahan kuwa kale oo badan.

Liiska ugu muhiimsan ee maamulaha qalabka
Markaad isticmaalayso qaabka UEFI, dejinta kontaroolaha ayaa lagu dhex daray Utility Setup. Marka la barbar dhigo VROC, liiska koontaroolaha qalabku wuxuu u muuqdaa mid aad u adag.

Abuuritaanka RAID1 laba saxan
Sharaxaada sida loo habeeyo arraysyada saxanka ee kontaroolaha qalabka waa mawduuc aad u jilicsan oo waxay noqon kartaa sababta maqaal buuxa. Halkan waxaan si fudud ku xaddidi doonaa nafteena si aan u abuurno RAID0 iyo RAID1 oo leh goobaha caadiga ah.

Disks-yada ku xidhan kontaroolaha qalabka looma arko nidaamka hawlgalka. Taa baddalkeeda, koontarooluhu wuxuu "mask" u dhigayaa dhammaan RAID-ka sida SAS u wado. Dareewalada ku xidhan kontaroolaha, laakiin aan qayb ka ahayn saxanka, ma heli doono OS.

root@grindelwald:~# smartctl -i /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-48-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               AVAGO
Product:              MR9460-8i
Revision:             5.14
Compliance:           SPC-3
User Capacity:        1,999,844,147,200 bytes [1.99 TB]
Logical block size:   512 bytes
Rotation Rate:        Solid State Device
Logical Unit id:      0x000000000000000000000000000000
Serial number:        00000000000000000000000000000000
Device type:          disk
Local Time is:        Sun Oct 11 16:27:59 2020 MSK
SMART support is:     Unavailable - device lacks SMART capability.

In kasta oo loo ekeysiiyay SAS wadista, NVMe arrays waxay ku shaqayn doonaan xawaare PCIe. Si kastaba ha ahaatee, qaabkani wuxuu kuu ogolaanayaa inaad ka soo qaadato NVMe ee Legacy.

Tijaabi istaag

Hab kasta oo loo habeeyo arraysyada diskooga waxa ay leedahay faa'iidooyin iyo khasaare jireed oo u gaar ah. Laakiin ma jiraa farqi wax qabad marka la shaqeynayo arrays disk?

Si loo gaaro cadaalada ugu sareysa, dhammaan imtixaanada waxaa lagu qaadi doonaa isla serverka. Habaynteeda:

2x Intel® Xeon® 6240;
12x DDR4-2666 16 GB;
LSI MegaRAID 9460-8i;
Furaha Hardware ee Intel® VROC;
4x Intel® SSD DC P4510 U.2 2TB;
1x Samsung 970 EVO Plus M.2 500GB.

Cutubyada tijaabada ah waa P4510, iyadoo badhkood ay ku xiran yihiin motherboard-ka halka kan kalena uu ku xiran yahay RAID controller. Nidaamka hawlgalka waxaa lagu rakibay darawalka M.2. Ubuntu 20.04, imtixaannadana waxaa lagu sameyn doonaa iyadoo la adeegsanayo nooca fio 3.16.

Imtixaanka

Marka hore, aynu eegno dib u dhacyada marka la shaqaynayo saxanka. Tijaabada waxaa lagu fuliyay hal dun, cabbirka block waa 4 KB. Imtixaan kastaa wuxuu qaadanayaa 5 daqiiqo. Kahor intaadan bilaabin, aaladda xannibaadda u dhiganta ayaa loo dejiyay midna sidii jadwalka I/O. Amarka fio wuxuu u eg yahay sidan:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --iodepth=1 --loops=1000 --runtime=300  --rw=<mode> --filename=<blkdev>

Natiijooyinka fio waxaan ka qaadannaa clat 99.00%. Natiijooyinka waxaa lagu muujiyey shaxda hoose.

Akhriska random, μs
Duubista random, μs

disk
112
78

Linux SW RAID, RAID0
113
45

VROC, RAID0
112
46

LSI, RAID0
122
63

Linux SW RAID, RAID1
113
48

VROC, RAID1
113
45

LSI, RAID1
128
89

Marka laga soo tago dib u dhacyada marka la gelayo xogta, waxaan jeclaan lahaa inaan arko waxqabadka darawallada farsamada gacanta oo aan barbar dhigo waxqabadka diskka jirka. Amarka si loo socodsiiyo fio:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --loops=1000 --runtime=300  --iodepth=<threads> --rw=<mode> --filename=<blkdev>

Waxqabadka waxaa lagu cabbiraa dhinaca hawlgallada I/O. Natiijooyinka waxaa lagu soo bandhigay shaxda hoose.

Akhrinta random 1 thread, IOPS
Qor random 1 dun, IOPS
Akhriso random 128 taxane, IOPS
Qor random 128 threads, IOPS

disk
11300
40700
453000
105000

Linux SW RAID, RAID0
11200
52000
429000
232000

VROC, RAID0
11200
52300
441000
162000

LSI, RAID0
10900
44200
311000
160000

Linux SW RAID, RAID1
10000
48600
395000
147000

VROC, RAID1
10000
54400
378000
244000

LSI, RAID1
11000
34300
229000
248000

Way fududahay in la arko in isticmaalka koontaroolaha qalabka ay keenayso daahitaanka korodhka iyo waxqabadka waxqabadka marka la barbar dhigo xalalka software.

gunaanad

Isticmaalka xalalka qalabka si aad u abuurto arrays disk ka laba saxan ayaa u muuqda mid aan caqli-gal ahayn. Si kastaba ha ahaatee, waxaa jira hawlo isticmaalka kontaroolayaasha RAID ay xaq u leeyihiin. Imaanshiyaha kontaroolayaasha taageera interface NVMe, isticmaalayaashu waxay fursad u leeyihiin inay u isticmaalaan SSD-yada degdega ah mashruucyadooda.