RAID arrays ma NVMe

RAID arrays ma NVMe
Ma kēia ʻatikala e kamaʻilio mākou e pili ana i nā ʻano like ʻole e hoʻonohonoho ai i nā array RAID, a hōʻike pū kekahi i kekahi o nā mea hoʻokele RAID lako mua me ke kākoʻo NVMe.

Loaʻa nā ʻano noi āpau o ka ʻenehana RAID i ka ʻāpana kikowaena. Ma ka māhele o ka mea kūʻai aku, hoʻohana pinepine ʻia ka polokalamu RAID0 a i ʻole RAID1 ma nā disks ʻelua.

E hāʻawi kēia ʻatikala i kahi ʻike pōkole o ka ʻenehana RAID, kahi aʻoaʻo pōkole e pili ana i ka hana ʻana i nā array RAID me ka hoʻohana ʻana i ʻekolu mau mea hana like ʻole, a me ka hoʻohālikelike ʻana i ka hana disk virtual me kēlā me kēia ʻano.

He aha ka RAID?

ʻO Wikipedia hāʻawi i kahi wehewehe piha o ka ʻenehana RAID:

kaua (Eng. Kahi huina o nā disk kuokoa - ka nui o nā disks kūʻokoʻa (kūʻokoʻa) - ʻenehana virtualization data no ka hoʻohui ʻana i kekahi mau polokalamu disk kino i loko o kahi module kūpono e hoʻonui ai i ka hoʻomanawanui a me ka hana.

ʻO ka hoʻonohonoho ʻana o nā ʻāpana disk a me nā ʻenehana i hoʻohana ʻia ma muli o ka mea i koho ʻia pae RAID. Hoʻonohonoho ʻia nā pae RAID i ka kikoʻī Hōʻike ʻike disk RAID maʻamau. Hōʻike ia i nā pae RAID he nui, akā ʻo ka mea maʻamau ʻo RAID0, RAID1, RAID5 a me RAID6.

RAID0ole Nā'ōwili, he pae RAID e hoʻohui i ʻelua a ʻoi aku ka hoʻokele kino i hoʻokahi kaʻa loiloi. Ua like ka leo o ka diski logical me ka huina o na puolo o na diski kino i komo iloko o ka papa. ʻAʻohe redundancy ma kēia pae RAID, a ʻo ka hiki ʻole o ka hoʻokahi kaʻa ke hopena i ka nalowale o nā ʻikepili āpau i ka disk virtual.

ilikai RAID1ole aniani, hana i nā kope like o ka ʻikepili ma nā diski ʻelua a ʻoi aku paha. ʻAʻole ʻoi aku ka nui o ka disk virtual ma mua o ka liʻiliʻi o nā disks kino. E loa'a ana ka 'ikepili ma ka RAID1 virtual disk i ka wā e ho'ohana 'ia ana ma kahi o ho'okahi diski kino mai ka array. ʻO ka hoʻohana ʻana iā RAID1 e hoʻohui i ka redundancy, akā ʻoi aku ka maikaʻi o ka hopena, no ka mea ma nā papa o ʻelua a ʻoi aʻe paha nā disks i loaʻa ka mana o hoʻokahi wale nō.

ilikai RAID5 hoʻoponopono i ka pilikia o ke kumukūʻai kiʻekiʻe. No ka hana ʻana i kahi ʻano me ka pae RAID5, pono ʻoe ma kahi o 3 mau disks, a ʻo ka array ke kū i ka hemahema o hoʻokahi disk. Mālama ʻia ka ʻikepili ma RAID5 i nā poloka me nā checksums. ʻAʻohe māhele koʻikoʻi ma waena o nā disks data a me nā disks checksum. ʻO nā Checksums ma RAID5 ka hopena o kahi hana XOR i hoʻohana ʻia i nā poloka N-1, lawe ʻia kēlā me kēia mai kahi disk ʻokoʻa.

ʻOiai e hoʻonui ana nā papa RAID i ka redundancy a hāʻawi i ka redundancy, ʻaʻole kūpono lākou no ka mālama ʻana i nā backup.

Ma hope o kahi huakaʻi pōkole i nā ʻano RAID arrays, hiki iā ʻoe ke neʻe i nā polokalamu a me nā polokalamu e ʻae iā ʻoe e ʻākoakoa a hoʻohana i nā array disk.

Nā ʻano mea hoʻokele RAID

ʻElua ala e hana ai a hoʻohana i ka RAID arrays: hardware a me ka lako polokalamu. E noʻonoʻo mākou i kēia mau hopena:

  • Linux lako polokalamu RAID.
  • Intel® Virtual RAID ma ka CPU.
  • LSI MegaRAID 9460-8i.

E hoʻomaopopo i ka holo ʻana o ka hoʻonā Intel® ma kahi chipset, kahi e hāpai ai i ka nīnau inā he hāmeʻa a lako polokalamu paha. No ka laʻana, noʻonoʻo ka hypervisor VMWare ESXi i ka polokalamu VROC a ʻaʻole kākoʻo ʻia ia.

RAID lako polokalamu Linux

ʻO nā polokalamu RAID arrays i ka ʻohana Linux OS he hopena maʻamau i ka mea kūʻai aku a me nā ʻāpana kikowaena. ʻO nā mea a pau e pono ai ʻoe e hana i kahi array ʻo ka pono mdadm a me kekahi mau mea poloka. ʻO ka mea pono wale nō Linux Software RAID e hoʻonoho ai ma nā kaʻa e hoʻohana ai ʻo ia he mea poloka i hiki ke loaʻa i ka ʻōnaehana.

ʻO ka nele o nā kumukūʻai no nā lako a me nā lako polokalamu he mea maikaʻi loa ia o kēia ʻano. Hoʻonohonoho ʻo Linux Software RAID i nā array disk ma ke kumu kūʻai o ka manawa CPU. Hiki ke ʻike ʻia ka papa inoa o nā pae RAID i kākoʻo ʻia a me ke kūlana o nā ʻāpana disk i kēia manawa ma ka faila mdstat, aia ma ke kumu procfs:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] 
unused devices: <none>

Hoʻohui ʻia ke kākoʻo no nā pae RAID ma ka hoʻopili ʻana i ka module kernel kūpono, no ka laʻana:

root@grindelwald:~# modprobe raid456
root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] 
unused devices: <none>

Hana ʻia nā hana āpau me nā ʻāpana disk ma o ka laina kauoha mdadm. Hoʻohui ʻia ka papa disk i hoʻokahi kauoha:

mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/nvme1n1 /dev/nvme2n1

Ma hope o ka hoʻokō ʻana i kēia kauoha, e ʻike ʻia ka /dev/md0 block device i loko o ka ʻōnaehana, e hōʻike ana iā ʻoe he disk virtual.

Intel® Virtual RAID ma ka CPU

RAID arrays ma NVMeIntel® VROC Kiʻi Lako Paʻa
ʻO Intel® Virtual RAID On CPU (VROC) he ʻenehana lako a me ka lako polokalamu no ka hana ʻana i nā pūʻulu RAID e pili ana i nā chipsets Intel®. Loaʻa kēia ʻenehana no nā motherboards e kākoʻo ana i nā kaʻina hana Intel® Xeon® Scalable. Ma ka paʻamau, ʻaʻole loaʻa ʻo VROC. No ka ho'ā ʻana, pono ʻoe e hoʻokomo i kahi kī laikini hardware VROC.

Hāʻawi ka laikini VROC maʻamau iā ʻoe e hana i nā array disk me 0, 1 a me 10 RAID pae. Hoʻonui ka mana premium i kēia papa inoa me ke kākoʻo RAID5.

Hana pū ka ʻenehana Intel® VROC ma nā motherboards hou me ka Intel® Volume Management Device (VMD), e hāʻawi ana i ka hiki wela-swap no nā drive NVMe.

RAID arrays ma NVMeLaikini maʻamau o Intel® VROC Hoʻonohonoho ʻia nā Arrays ma o ka Setup Utility i ka wā e hoʻomaka ai ke kikowaena. Ma ka pā i hoʻomaka me Hōʻike ʻia ka Intel® Virtual RAID ma ka mea CPU, kahi e hiki ai iā ʻoe ke hoʻonohonoho i nā hoʻonohonoho disk.

RAID arrays ma NVMeKe hana ʻana i kahi pūʻulu RAID1 ma nā pahu ʻelua
Loaʻa i ka ʻenehana Intel® VROC kāna aces ponoʻī ma luna o kona lima. Ua kūpono nā ʻāpana disk i kūkulu ʻia me VROC me Linux Software RAID. ʻO ia ke ʻano o ka mokuʻāina o nā arrays hiki ke nānā ʻia i /proc/mdstat a lawelawe ʻia ma o mdadm. Kākoʻo ʻia kēia "ʻano" e Intel. Ma hope o ka hōʻuluʻulu ʻana iā RAID1 ma Setup Utility, hiki iā ʻoe ke nānā i ka hoʻonohonoho ʻana o nā drive i ka OS:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10] 
md126 : active raid1 nvme2n1[1] nvme1n1[0]
      1855832064 blocks super external:/md127/0 [2/2] [UU]
      [>....................]  resync =  1.3% (24207232/1855832064) finish=148.2min speed=205933K/sec
      
md127 : inactive nvme1n1[1](S) nvme2n1[0](S)
      10402 blocks super external:imsm
       
unused devices: <none>

E hoʻomanaʻo ʻaʻole hiki iā ʻoe ke hōʻuluʻulu i nā arrays ma VROC me ka hoʻohana ʻana i ka mdadm (ʻo Linux SW RAID nā hui i hui ʻia), akā hiki iā ʻoe ke hoʻololi i nā disks i loko o lākou a wehe i nā arrays.

LSI MegaRAID 9460-8i

RAID arrays ma NVMeʻO ka hiʻohiʻona o ka mea hoʻokele LSI MegaRAID 9460-8i
ʻO ka mea hoʻoponopono RAID kahi hoʻonā ʻenehana kū hoʻokahi. Hoʻohana wale ka mea hoʻoponopono me nā drive pili pono iā ia. Kākoʻo kēia mea hoʻoponopono RAID a hiki i ka 24 NVMe drive. ʻO ia ke kākoʻo NVMe e hoʻokaʻawale i kēia kaohi mai nā mea ʻē aʻe.

RAID arrays ma NVMePapa kuhikuhi nui o ka lako lako
Ke hoʻohana nei i ke ʻano UEFI, ua hoʻohui ʻia nā hoʻonohonoho hoʻonohonoho i loko o ka Setup Utility. Hoʻohālikelike ʻia me VROC, ʻoi aku ka paʻakikī o ka papa kuhikuhi mea hoʻokele.

RAID arrays ma NVMeKe hana ʻana iā RAID1 ma ʻelua disks
ʻO ka wehewehe ʻana i ke ʻano o ka hoʻonohonoho ʻana i nā array disk ma luna o kahi mea hoʻoponopono hāmeʻa he kumuhana maʻalahi a hiki ke kumu no kahi ʻatikala piha. Maanei mākou e kaupalena iā mākou iho i ka hana ʻana iā RAID0 a me RAID1 me nā hoʻonohonoho paʻamau.

ʻAʻole ʻike ʻia nā disks i hoʻopili ʻia i ka mea hoʻoponopono hāmeʻa i ka ʻōnaehana hana. Ma kahi o ka mea hoʻokele "māka" i nā array RAID āpau e like me ka hoʻokele SAS. ʻAʻole hiki ke ʻike ʻia e ka OS nā drive i pili i ka mea hoʻoponopono, akā ʻaʻole ʻāpana o ka pā disk.

root@grindelwald:~# smartctl -i /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-48-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               AVAGO
Product:              MR9460-8i
Revision:             5.14
Compliance:           SPC-3
User Capacity:        1,999,844,147,200 bytes [1.99 TB]
Logical block size:   512 bytes
Rotation Rate:        Solid State Device
Logical Unit id:      0x000000000000000000000000000000
Serial number:        00000000000000000000000000000000
Device type:          disk
Local Time is:        Sun Oct 11 16:27:59 2020 MSK
SMART support is:     Unavailable - device lacks SMART capability.

ʻOiai ke hoʻokaʻawale ʻia ʻana e like me ka SAS drives, e hana ʻo NVMe arrays i nā wikiwiki PCIe. Eia nō naʻe, ʻae kēia hiʻohiʻona iā ʻoe e kāʻei mai NVMe i Legacy.

Kū hoʻāʻo

Loaʻa i kēlā me kēia ʻano hana o ka hoʻonohonoho ʻana i nā disk arrays kona pono kino a me nā pōʻino. Akā aia kahi ʻokoʻa hana i ka wā e hana ai me nā arrays disk?

No ka loaʻa ʻana o ka pono kūpono, e mālama ʻia nā hoʻāʻo a pau ma ke kikowaena like. ʻO kāna hoʻonohonoho:

  • 2x Intel® Xeon® 6240;
  • 12x DDR4-2666 16 GB;
  • LSI MegaRAID 9460-8i;
  • Intel® VROC Kiʻi Lako Paʻa;
  • 4x Intel® SSD DC P4510 U.2 2TB;
  • 1x Samsung 970 EVO Plus M.2 500GB.

ʻO nā ʻāpana hoʻāʻo ʻo P4510, hoʻokahi hapalua o ia mea i pili i ka motherboard, a ʻo ka hapa ʻē aʻe i ka mana RAID. Ke holo nei ka M.2 i ka Ubuntu 20.04 a e holo nā hoʻokolohua me ka hoʻohana ʻana i ka mana fio 3.16.

Hoʻoponopono

ʻO ka mea mua, e nānā kāua i nā lohi i ka wā e hana ai me ka disk. Hoʻokō ʻia ka hoʻāʻo ma hoʻokahi kaula, ʻo ka nui o ka poloka he 4 KB. He 5 mau minuke kēlā me kēia hoʻokolohua. Ma mua o ka hoʻomaka ʻana, ʻaʻole i hoʻonohonoho ʻia ka mea poloka e like me ka mea hoʻonohonoho I/O. Penei ke ano o ke kauoha fio:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --iodepth=1 --loops=1000 --runtime=300  --rw=<mode> --filename=<blkdev>

Mai nā hopena fio lawe mākou i ka clat 99.00%. Hōʻike ʻia nā hopena ma ka papa ma lalo.

Heluhelu lauwili, μs
Hoʻopaʻa paʻa wale, μs

pā hōkū
112
78

Linux SW RAID, RAID0
113
45

VROC, RAID0
112
46

LSI, RAID0
122
63

Linux SW RAID, RAID1
113
48

VROC, RAID1
113
45

LSI, RAID1
128
89

Ma waho aʻe o ka lohi i ke komo ʻana i ka ʻikepili, makemake wau e ʻike i ka hana o nā drive virtual a hoʻohālikelike iā lākou me ka hana o kahi disk kino. Kauoha e holo fio:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --loops=1000 --runtime=300  --iodepth=<threads> --rw=<mode> --filename=<blkdev>

Ana ʻia ka hana ma ke ʻano o nā hana I/O. Hōʻike ʻia nā hopena ma ka papa ma lalo.

Heluhelu maalea 1 pae, IOPS
Kākau maʻamau i 1 pae, IOPS
Heluhelu maalea 128 mau loina, IOPS
Kākau maʻamau i 128 mau kaula, IOPS

pā hōkū
11300
40700
453000
105000

Linux SW RAID, RAID0
11200
52000
429000
232000

VROC, RAID0
11200
52300
441000
162000

LSI, RAID0
10900
44200
311000
160000

Linux SW RAID, RAID1
10000
48600
395000
147000

VROC, RAID1
10000
54400
378000
244000

LSI, RAID1
11000
34300
229000
248000

He mea maʻalahi ka ʻike ʻana i ka hoʻohana ʻana i ka mea hoʻoponopono hāmeʻa e hoʻonui i ka latency a me ka hoʻokō ʻana i ka hoʻohālikelike ʻana i nā hāmeʻa polokalamu.

hopena

ʻO ka hoʻohana ʻana i nā hāmeʻa hāmeʻa no ka hana ʻana i nā ʻāpana disk mai nā disks ʻelua he mea hewa ʻole. Eia nō naʻe, aia nā hana kahi i kūpono ai ka hoʻohana ʻana i nā mea hoʻokele RAID. Me ka hiki ʻana mai o nā mea hoʻokele e kākoʻo ana i ka interface NVMe, loaʻa i nā mea hoʻohana ka manawa e hoʻohana ai i nā SSD wikiwiki i kā lākou papahana.

RAID arrays ma NVMe

Hiki i nā mea hoʻohana i hoʻopaʻa inoa ʻia ke komo i ka noiʻi. Eʻe, e 'oluʻolu.

Ke hoʻohana nei ʻoe i nā hoʻonā RAID?

  • 29,6%ʻAe, nā hāmeʻa hāmeʻa32

  • 50,0%ʻAe, software solutions54

  • 16,7%ʻAʻole18

  • 3,7%ʻAʻole pono RAID4

108 mea hoʻohana i koho. Ua hōʻole nā ​​mea hoʻohana 14.

Source: www.habr.com

Pākuʻi i ka manaʻo hoʻopuka