Usoro RAID na NVMe

Usoro RAID na NVMe
N'isiokwu a, anyị ga-ekwu maka ụzọ dị iche iche isi hazie usoro RAID, ma gosikwa otu n'ime ndị na-ahụ maka RAID ngwaike mbụ nwere nkwado NVMe.

Ngwa niile dị iche iche nke teknụzụ RAID dị na ngalaba nkesa. Na ngalaba ndị ahịa, naanị software RAID0 ma ọ bụ RAID1 na diski abụọ ka a na-ejikarị.

Isiokwu a ga-enye nkọwa dị nkenke nke teknụzụ RAID, nkuzi dị mkpirikpi maka otu esi emepụta RAID arrays site na iji ngwaọrụ atọ dị iche iche, yana ntụnyere arụmọrụ diski mebere site na iji usoro ọ bụla.

Kedu ihe bụ RAID?

Wikipedia na-enye nkọwa zuru oke nke teknụzụ RAID:

wakporo (eng. Ejighi oru n'usoro nke Independent Disks - ọtụtụ diski nwere onwe (nke nọọrọ onwe ya) - teknụzụ mebere data maka ijikọ ọtụtụ ngwaọrụ diski anụ ahụ n'ime modul ezi uche dị na ya iji bulie nnabata na arụmọrụ dị njọ.

Nhazi nke diski diski na teknụzụ eji eme ihe dabere na ahọpụtara Ọkwa RAID. A haziri ọkwa RAID na nkọwapụta Ụdị data diski RAID nkịtị. Ọ na-akọwa ọtụtụ ọkwa RAID, mana nke a na-ahụkarị bụ RAID0, RAID1, RAID5 na RAID6.

Wakporo0, ma ọ bụ Nwepu, bụ ọkwa RAID na-ejikọta draịva abụọ ma ọ bụ karịa n'ime otu draịva ezi uche dị na ya. Olu diski ezi uche dị ka nchikota mpịakọta nke diski anụ ahụ gụnyere n'usoro. Enweghị nrụgharị n'ọkwa RAID a, na ọdịda nke otu mbanye nwere ike ibute ọnwụ nke data niile dị na diski mebere.

larịị Wakporo1, ma ọ bụ mirror, na-emepụta otu data na diski abụọ ma ọ bụ karịa. Ogo nke diski mebere anaghị agafe opekempe nke diski anụ ahụ. Data dị na diski mebere RAID1 ga-adị ma ọ dịkarịa ala otu diski anụ ahụ sitere na n'usoro na-arụ ọrụ. Iji RAID1 na-agbakwụnye redundancy, mana ọ bụ ihe ngwọta dị oke ọnụ, ebe ọ bụ na n'ụdị diski abụọ ma ọ bụ karịa, ikike nke naanị otu dị.

larịị Wakporo5 na-edozi nsogbu nke ọnụ ahịa dị elu. Iji mepụta ọkwa nwere ọkwa RAID5, ịchọrọ opekata mpe diski 3, usoro ahụ na-eguzogide ọdịda nke otu diski. A na-echekwa data dị na RAID5 na ngọngọ nwere ego nlele. Enweghị nkewa siri ike n'etiti diski data na diski checksum. Nyochaa na RAID5 bụ nsonaazụ nke ọrụ XOR etinyere na ngọngọ N-1, nke ọ bụla ewepụtara na diski dị iche.

Ọ bụ ezie na RAID arrays na-abawanye redundancy ma na-enye redundancy, ha adịghị mma maka ịchekwa ndabere.

Mgbe obere oge gachara njem nlegharị anya n'ụdị arrays RAID, ị nwere ike ịga n'ihu na ngwaọrụ na mmemme na-enye gị ohere ikpokọta na iji usoro diski.

Ụdị ndị na-ahụ maka RAID

Enwere ụzọ abụọ ịmepụta na iji usoro RAID: ngwaike na ngwanrọ. Anyị ga-atụle ihe ngwọta ndị a:

  • Linux Software RAID.
  • Intel® Virtual RAID Na CPU.
  • LSI MegaRAID 9460-8i.

Rịba ama na ngwọta Intel® na-agba ọsọ na chipset, nke na-ewelite ajụjụ ma ọ bụ ngwaike ma ọ bụ ngwanrọ ngwanrọ. Dịka ọmụmaatụ, VMWare ESXi hypervisor na-atụle sọftụwia VROC na anaghị akwado ya na eze.

Linux Software RAID

Ngwanrọ RAID n'usoro n'ime ezinụlọ Linux OS bụ ihe ngwọta a na-ahụkarị na ma ndị ahịa na ngalaba nkesa. Naanị ihe ị ga-eme ka ịmepụta usoro bụ mdadm utility na ngwaọrụ ngọngọ ole na ole. Naanị ihe achọrọ Linux Software RAID ebe na draịva ọ na-eji bụ ka ọ bụrụ ngwaọrụ mgbochi ịnweta sistemụ.

Enweghị ụgwọ maka akụrụngwa na ngwanrọ bụ uru doro anya nke usoro a. Linux Software RAID na-ahazi usoro diski na ọnụ ahịa oge CPU. Enwere ike ịhụ ndepụta nke ọkwa RAID akwadoro yana ọkwa nke ụdị diski dị ugbu a na faịlụ mdstat, nke dị na mgbọrọgwụ procfs:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] 
unused devices: <none>

A na-agbakwunye nkwado maka ọkwa RAID site na ijikọ modul kernel kwesịrị ekwesị, dịka ọmụmaatụ:

root@grindelwald:~# modprobe raid456
root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] 
unused devices: <none>

A na-arụ ọrụ niile nwere usoro diski site na ngwa ahịrị iwu mdadm. A na-agbakọta usoro diski ahụ n'otu iwu:

mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/nvme1n1 /dev/nvme2n1

Mgbe emechara iwu a, ngwaọrụ mgbochi / dev/md0 ga-apụta na sistemụ, nke na-anọchite anya diski mebere.

Intel® Virtual RAID Na CPU

Usoro RAID na NVMeIgodo ngwaike ọkọlọtọ Intel® VROC
Intel® Virtual RAID On CPU (VROC) bụ ngwaike na teknụzụ ngwanrọ maka ịmepụta usoro RAID dabere na chipsets Intel®. Teknụzụ a dị maka nne na nna na-akwado Intel® Xeon® Scalable processors. Site na ndabara, VROC adịghị. Iji mee ya, ị ga-etinyerịrị igodo ikike ngwaike VROC.

Akwụkwọ ikike VROC ọkọlọtọ na-enye gị ohere ịmepụta arrays diski nwere ọkwa 0, 1 na 10 RAID. Ụdị adịchaghị mma na-eji nkwado RAID5 gbasaa ndepụta a.

Teknụzụ Intel® VROC na motherboards ọgbara ọhụrụ na-arụkọ ọrụ yana Intel® Volume Management Device (VMD), nke na-enye ike mgbanwe ọkụ maka draịva NVMe.

Usoro RAID na NVMeIkikere ọkọlọtọ Intel® VROC A na-ahazi usoro nhazi site na ntọala Utility mgbe ihe nkesa na-agbanye. Na taabụ Advanced Ihe Intel® Virtual RAID dị na ihe CPU na-apụta, ebe ị nwere ike hazie nhazi diski.

Usoro RAID na NVMeỊmepụta usoro RAID1 na draịva abụọ
Teknụzụ Intel® VROC nwere ikike nke aka ya. Ngwa diski arụnyere site na iji VROC dakọtara na Linux Software RAID. Nke a pụtara na enwere ike nyochaa ọnọdụ nke arrays na /proc/mdstat wee mee ya site na mdadm. Nke a "njirimara" bụ nke Intel na-akwado ọchịchị. Mgbe ị gbakọtara RAID1 na Setup Utility, ị nwere ike ịhụ mmekọrịta nke draịva na OS:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10] 
md126 : active raid1 nvme2n1[1] nvme1n1[0]
      1855832064 blocks super external:/md127/0 [2/2] [UU]
      [>....................]  resync =  1.3% (24207232/1855832064) finish=148.2min speed=205933K/sec
      
md127 : inactive nvme1n1[1](S) nvme2n1[0](S)
      10402 blocks super external:imsm
       
unused devices: <none>

Rịba ama na ị nweghị ike iji mdadm chịkọta arrays na VROC (usoro ndị a na-agbakọta ga-abụ Linux SW RAID), mana ị nwere ike ịgbanwe diski n'ime ha wee kwasaa arrays.

LSI MegaRAID 9460-8i

Usoro RAID na NVMeỌdịdị nke LSI MegaRAID 9460-8i njikwa
Onye na-ahụ maka RAID bụ ngwọta ngwaike kwụụrụ onwe ya. Onye njikwa na-arụ ọrụ naanị na draịva ejikọrọ na ya ozugbo. Onye njikwa RAID a na-akwado draịva 24 NVMe. Ọ bụ nkwado NVMe na-eme ka njikwa a dị iche na ọtụtụ ndị ọzọ.

Usoro RAID na NVMeIsi menu nke njikwa ngwaike
Mgbe ị na-eji ọnọdụ UEFI, etinyere ntọala njikwa n'ime Utility Setup. Tụnyere VROC, menu njikwa ngwaike dị mgbagwoju anya karịa.

Usoro RAID na NVMeỊmepụta RAID1 na diski abụọ
Ịkọwa otu esi ahazi diski diski na njikwa ngwaike bụ isiokwu siri ike ma nwee ike ịbụ ihe kpatara akụkọ zuru oke. N'ebe a, anyị ga-ejedebe onwe anyị naanị ịmepụta RAID0 na RAID1 na ntọala ndabara.

Diski ejikọrọ na njikwa ngwaike anaghị ahụ sistemu arụ ọrụ. Kama, onye na-ahụ maka “mask” niile RAID arrays ka SAS na-anya. Ụgbọ ala ejikọrọ na njikwa, mana ọbụghị akụkụ nke nhazi diski, OS agaghị enweta ya.

root@grindelwald:~# smartctl -i /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-48-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               AVAGO
Product:              MR9460-8i
Revision:             5.14
Compliance:           SPC-3
User Capacity:        1,999,844,147,200 bytes [1.99 TB]
Logical block size:   512 bytes
Rotation Rate:        Solid State Device
Logical Unit id:      0x000000000000000000000000000000
Serial number:        00000000000000000000000000000000
Device type:          disk
Local Time is:        Sun Oct 11 16:27:59 2020 MSK
SMART support is:     Unavailable - device lacks SMART capability.

N'agbanyeghị na a gbanwere ya dị ka draịva SAS, NVMe arrays ga-arụ ọrụ na ọsọ PCIe. Agbanyeghị, njirimara a na-enye gị ohere ịbute na NVMe na Legacy.

Nwale oche

Usoro ọ bụla nke ịhazi nhazi diski nwere uru na ọghọm anụ ahụ nke ya. Mana enwere ọdịiche arụmọrụ mgbe ị na-arụ ọrụ na diski diski?

Iji nweta oke ziri ezi, a ga-eme ule niile n'otu ihe nkesa. Nhazi ya:

  • 2x Intel® Xeon® 6240;
  • 12x DDR4-2666 16 GB;
  • LSI MegaRAID 9460-8i;
  • Igodo ngwaike ọkọlọtọ Intel® VROC;
  • 4x Intel® SSD DC P4510 U.2 2TB;
  • 1x Samsung 970 EVO Plus M.2 500GB.

Nkeji ule bụ P4510, otu ọkara nke ejikọrọ na motherboard, na ọkara nke ọzọ na njikwa RAID. M.2 na-agba ọsọ Ubuntu 20.04 na a ga-eji ụdị fio 3.16 mee ule ndị ahụ.

Ule

Nke mbụ, ka anyị lelee igbu oge mgbe ị na-arụ ọrụ na diski ahụ. A na-eme ule ahụ n'otu eriri, nha ngọngọ bụ 4 KB. Nnwale ọ bụla na-ewe nkeji ise. Tupu ịmalite, ngwaọrụ ngọngọ kwekọrọ ekwekọghị ka onye nhazi oge I/O. Iwu fio dị ka nke a:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --iodepth=1 --loops=1000 --runtime=300  --rw=<mode> --filename=<blkdev>

Site na nsonaazụ fio anyị na-ewere clat 99.00%. E gosipụtara nsonaazụ ya na tebụl dị n'okpuru.

Ọgụgụ enweghị usoro, μs
Ndekọ enweghị usoro, μs

disk
112
78

Linux SW RAID, RAID0
113
45

VROC, RAID0
112
46

LSI, RAID0
122
63

Linux SW RAID, RAID1
113
48

VROC, RAID1
113
45

LSI, RAID1
128
89

Na mgbakwunye na igbu oge mgbe ị na-enweta data, ọ ga-amasị m ịhụ arụmọrụ nke draịva mebere ma jiri ya tụnyere arụmọrụ nke diski anụ ahụ. Iwu iji mee fio:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --loops=1000 --runtime=300  --iodepth=<threads> --rw=<mode> --filename=<blkdev>

A na-atụle arụmọrụ n'usoro ọrụ I/O. E gosipụtara nsonaazụ ya na tebụl n'okpuru.

eri 1 na-agụghị usoro, IOPS
Edere eri 1 random, IOPS
eri 128 na-agụghị usoro, IOPS
Edere eriri 128 random, IOPS

disk
11300
40700
453000
105000

Linux SW RAID, RAID0
11200
52000
429000
232000

VROC, RAID0
11200
52300
441000
162000

LSI, RAID0
10900
44200
311000
160000

Linux SW RAID, RAID1
10000
48600
395000
147000

VROC, RAID1
10000
54400
378000
244000

LSI, RAID1
11000
34300
229000
248000

Ọ dị mfe ịhụ na iji onye na-ahụ maka ngwaike na-ebute mmụba na-abawanye na arụmọrụ arụ ọrụ ma e jiri ya tụnyere ngwọta ngwanrọ.

nkwubi

Iji ngwọta ngwaike mepụta usoro diski site na diski abụọ yiri ihe na-enweghị isi. Agbanyeghị, enwere ọrụ ebe ejiri njikwa RAID ziri ezi. Site na ọbịbịa nke ndị njikwa na-akwado interface NVMe, ndị ọrụ nwere ohere iji SSD ngwa ngwa na ọrụ ha.

Usoro RAID na NVMe

Naanị ndị ọrụ edebanyere aha nwere ike isonye na nyocha a. banye, Biko.

Ị na-eji ngwọta RAID?

  • 29,6%Ee, ngwaike ngwọta32

  • 50,0%Ee, ngwanrọ ngwanrọ54

  • 16,7%Mba18

  • 3,7%Enweghị RAID achọrọ4

Ndị ọrụ 108 tụrụ vootu. Ndị ọrụ 14 anabataghị.

isi: www.habr.com

Tinye a comment