Qaababka RAID ee NVMe

Qaababka RAID ee NVMe
Maqaalkan waxaan ka hadli doonaa siyaabo kala duwan oo loo abaabulo RAID arys, sidoo kale waxaan muujin doonaa mid ka mid ah kontaroolayaasha RAID ee ugu horreeya ee leh taageerada NVMe.

Dhammaan codsiyada kala duwan ee tignoolajiyada RAID waxaa laga helaa qaybta server-ka. Qaybta macmiilka, kaliya software RAID0 ama RAID1 ee laba saxan ayaa inta badan la isticmaalaa.

Maqaalkani wuxuu bixin doonaa dulmar kooban oo ku saabsan tignoolajiyada RAID, tabo gaaban oo ku saabsan sida loo abuuro arrays RAID iyadoo la adeegsanayo saddex qalab oo kala duwan, iyo isbarbardhigga waxqabadka diskka farsamada iyadoo la adeegsanayo hab kasta.

Waa maxay RAID?

Wikipedia waxay ku siinaysaa qeexid dhamaystiran tignoolajiyada RAID:

weerar (Eng. Soo-saaris aan badnayn oo ka mid ah diskiyada madaxa-bannaan saxannada madax-bannaan ee aan caadiga ahayn) - tignoolajiyada xog-ururinta xogta ee isku-darka aaladaha diskooga ee dhowrka ah oo loo geliyo module macquul ah si loo kordhiyo dulqaadka iyo waxqabadka qaladka.

Habaynta qalabaynta diskka iyo teknoolajiyada la isticmaalay waxay ku xidhan yihiin kuwa la doortay heerka RAID. Heerarka RAID ayaa lagu jaangooyay qeexitaanka Qaabka Xogta Disk ee RAID-ga caadiga ah. Waxay qeexaysaa heerar badan oo RAID ah, laakiin kuwa ugu caansan waa RAID0, RAID1, RAID5 iyo RAID6.

RAID0, ama karbaashkuna, waa heer RAID ah oo isku dara laba ama in ka badan oo wadis jireed oo isku daraya hal wado macquul ah. Mugga saxanka macquulka ah wuxuu la mid yahay wadarta mugga saxannada jireed ee ku jira shaxanka. Ma jiro dib u celin heerkan RAID, iyo guul darada ku timaada hal drive waxay keeni kartaa luminta dhammaan xogta ku jirta saxanka casriga ah.

Heerka RAID1, ama Mirror, waxay ku abuurtaa nuqullo isku mid ah xogta laba ama in ka badan. Baaxadda saxanka farsamada kama badna cabbirka ugu yar ee saxannada jireed. Xogta ku jirta RAID1 diskka farsamada gacanta ayaa la heli doonaa ilaa iyo inta uu shaqaynayo ugu yaraan hal saxan oo ka mid ah saxanka. Isticmaalka RAID1 wuxuu ku darayaa dib-u-celin, laakiin waa xal aad qaali u ah, maadaama ay ku jiraan laba ama in ka badan awoodda hal kaliya ayaa la heli karaa.

Heerka RAID5 wuxuu xalliyaa dhibaatada kharashka badan. Si aad u abuurto array leh heerka RAID5, waxaad u baahan tahay ugu yaraan 3 saxan, oo shaxdu waxay u adkaysanaysaa fashilka hal disk. Xogta ku jirta RAID5 waxa lagu kaydiyaa baloogyo leh xisaab hubin. Ma jiro kala qaybsanaan adag oo u dhaxaysa saxannada xogta iyo saxanka hubinta. Jeegaga ku jira RAID5 waa natiijada hawlgalka XOR ee lagu dabaqay baloogyada N-1, oo mid walba laga soo qaaday saxan kale.

In kasta oo habab RAID ay kordhiyaan shaqo-ka-noqoshada oo ay bixiyaan dib-u-celin, kuma habboona kaydinta kaydinta.

Ka dib safar gaaban oo ku saabsan noocyada RAID-ga, waxaad u gudbi kartaa aaladaha iyo barnaamijyada kuu oggolaanaya inaad urursato oo aad isticmaasho qalabyada diskooga.

Noocyada kontaroolayaasha RAID

Waxaa jira laba siyaabood oo loo abuuro oo loo isticmaalo arrays RAID: hardware iyo software. Waxaan tixgelin doonaa xalalka soo socda:

  • Linux Software RAID.
  • Intel® Virtual RAID On CPU.
  • LSI MegaRAID 9460-8i.

Ogsoonow in xalka Intel® uu ku shaqeeyo Chipset-ka, kaas oo keenaya su'aasha ah in uu yahay xal hardware ama software. Tusaale ahaan, VMWare ESXi hypervisor waxa uu tixgaliyaa barnaamijka VROC oo si rasmi ah uma taageero.

Linux Software RAID

Nidaamyada RAID software ee qoyska Linux OS waa xal caadil ah oo caadi ah qaybaha macmiilka iyo server-ka labadaba. Waxa kaliya ee aad u baahan tahay si aad u abuurto array waa utility mdadm iyo dhowr qalab oo xannibaya. Waxa kaliya ee looga baahan yahay Linux Software RAID ee darawalada ay isticmaasho waa inay noqoto qalab xannibaya oo la heli karo nidaamka.

Maqnaanshaha kharashka qalabka iyo software waa faa'iido cad oo habkan ah. Linux Software RAID waxay abaabushaa habab diskooga iyadoo ku kacaysa wakhtiga CPU. Liistada heerarka RAID ee la taageeray iyo heerka habab disk-ga hadda jira waxaa lagu arki karaa faylka mdstat, kaas oo ku yaal xididka procfs:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] 
unused devices: <none>

Taageerada heerarka RAID waxaa lagu daraa iyadoo la isku xirayo cutubka kernel-ka ku habboon, tusaale ahaan:

root@grindelwald:~# modprobe raid456
root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] 
unused devices: <none>

Dhammaan hawlgallada leh arraysyada diskooga waxa lagu sameeyaa utility line-ka mdadm. Diyaarinta saxanka waxa lagu soo ururiyay hal amar:

mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/nvme1n1 /dev/nvme2n1

Kadib fulinta amarkan, qalabka xannibaadda / dev/md0 ayaa ka soo muuqan doona nidaamka, kaas oo kuu metelaya sida disk-ga casriga ah.

Intel® Virtual RAID On CPU

Qaababka RAID ee NVMeFuraha Hardware ee Intel® VROC
Intel® Virtual RAID On CPU (VROC) waa qalab iyo teknooloojiyada software ee abuurista hannaan RAID oo ku salaysan Intel® chipsets. Farsamadan waxaa ugu horrayn loogu talagalay Motherboard-yada taageera Intel® Xeon® Scalable processors. Sida caadiga ah, VROC lama heli karo. Si aad u dhaqaajiso, waa inaad ku rakibtaa furaha shatiga qalabka VROC.

Shatiga caadiga ah ee VROC wuxuu kuu ogolaanayaa inaad abuurto arrays disk oo leh 0, 1 iyo 10 RAID. Nooca premium-ka ayaa liiskan ku balaadhinaya taageerada RAID5.

Tignoolajiyada Intel® VROC ee Motherboard-yada casriga ah waxay la shaqeysaa Intel® Aaladda Maareynta Mugga (VMD), kaas oo siiya awoodda isdhaafsiga kulul ee darawallada NVMe.

Qaababka RAID ee NVMeShatiga caadiga ah ee Intel® VROC Arraysyada waxaa lagu habeeyaa Utility Setup marka serferku kabaha galo. On tab Advanced RAID-ka Intel® Virtual RAID ee shayga CPU ayaa soo muuqda, halkaas oo aad ku habayn karto arraysyada saxanka.

Qaababka RAID ee NVMeAbuuritaanka RAID1 array laba darawal
Tiknoolajiyada Intel® VROC waxay leedahay awood u gaar ah oo ay gacanta ku hayso. Qalabka Disk-yada lagu dhisay iyadoo la adeegsanayo VROC waxay la jaan qaadayaan Linux Software RAID. Tani waxay ka dhigan tahay in xaaladda arrays-ka lagala socon karo gudaha /proc/mdstat oo lagu maamuli karo iyada oo loo marayo mdadm. Tani "sifada" waxaa si rasmi ah u taageera Intel. Ka dib marka la isku keeno RAID1 gudaha Utility Setup, waxaad arki kartaa is-waafajinta darawalada OS-ka:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10] 
md126 : active raid1 nvme2n1[1] nvme1n1[0]
      1855832064 blocks super external:/md127/0 [2/2] [UU]
      [>....................]  resync =  1.3% (24207232/1855832064) finish=148.2min speed=205933K/sec
      
md127 : inactive nvme1n1[1](S) nvme2n1[0](S)
      10402 blocks super external:imsm
       
unused devices: <none>

Ogsoonow inaadan ku ururin karin arrays VROC adiga oo isticmaalaya mdadm (hababka la soo ururiyey waxay noqon doonaan Linux SW RAID), laakiin waxaad ku beddeli kartaa saxanadaha dhexdooda oo aad kala diri kartaa arraysyada.

LSI MegaRAID 9460-8i

Qaababka RAID ee NVMeMuuqashada LSI MegaRAID 9460-8i xakamaynta
Xakamaynta RAID waa xal qalab kaligiis taagan. Koontarooluhu wuxuu kaliya ku shaqeeyaa darawallada si toos ah ugu xiran. Xakamaynta RAID-kan waxa ay taageertaa ilaa 24 NVMe wadoyinka. Waa taageerada NVMe tan ka dhigaysa kantaroolahan kuwa kale oo badan.

Qaababka RAID ee NVMeLiiska ugu muhiimsan ee maamulaha qalabka
Markaad isticmaalayso qaabka UEFI, dejinta kontaroolaha ayaa lagu dhex daray Utility Setup. Marka la barbar dhigo VROC, liiska koontaroolaha qalabku wuxuu u muuqdaa mid aad u adag.

Qaababka RAID ee NVMeAbuuritaanka RAID1 laba saxan
Sharaxaada sida loo habeeyo arraysyada saxanka ee kontaroolaha qalabka waa mawduuc aad u jilicsan oo waxay noqon kartaa sababta maqaal buuxa. Halkan waxaan si fudud ku xaddidi doonaa nafteena si aan u abuurno RAID0 iyo RAID1 oo leh goobaha caadiga ah.

Disks-yada ku xidhan kontaroolaha qalabka looma arko nidaamka hawlgalka. Taa baddalkeeda, koontarooluhu wuxuu "mask" u dhigayaa dhammaan RAID-ka sida SAS u wado. Dareewalada ku xidhan kontaroolaha, laakiin aan qayb ka ahayn saxanka, ma heli doono OS.

root@grindelwald:~# smartctl -i /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-48-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               AVAGO
Product:              MR9460-8i
Revision:             5.14
Compliance:           SPC-3
User Capacity:        1,999,844,147,200 bytes [1.99 TB]
Logical block size:   512 bytes
Rotation Rate:        Solid State Device
Logical Unit id:      0x000000000000000000000000000000
Serial number:        00000000000000000000000000000000
Device type:          disk
Local Time is:        Sun Oct 11 16:27:59 2020 MSK
SMART support is:     Unavailable - device lacks SMART capability.

In kasta oo loo ekeysiiyay SAS wadista, NVMe arrays waxay ku shaqayn doonaan xawaare PCIe. Si kastaba ha ahaatee, qaabkani wuxuu kuu ogolaanayaa inaad ka soo qaadato NVMe ee Legacy.

Tijaabi istaag

Hab kasta oo loo habeeyo arraysyada diskooga waxa ay leedahay faa'iidooyin iyo khasaare jireed oo u gaar ah. Laakiin ma jiraa farqi wax qabad marka la shaqeynayo arrays disk?

Si loo gaaro cadaalada ugu sareysa, dhammaan imtixaanada waxaa lagu qaadi doonaa isla serverka. Habaynteeda:

  • 2x Intel® Xeon® 6240;
  • 12x DDR4-2666 16 GB;
  • LSI MegaRAID 9460-8i;
  • Furaha Hardware ee Intel® VROC;
  • 4x Intel® SSD DC P4510 U.2 2TB;
  • 1x Samsung 970 EVO Plus M.2 500GB.

Unugyada imtixaanku waa P4510, kala badh ka mid ah waxay ku xidhan yihiin Motherboard-ka, badh kalena waxay ku xidhan yihiin kontaroolaha RAID. M.2 waxa uu wadaa Ubuntu 20.04 imtixaanada waxa lagu wadi doonaa fio nooca 3.16.

Imtixaanka

Marka hore, aynu eegno dib u dhacyada marka la shaqaynayo saxanka. Tijaabada waxaa lagu fuliyay hal dun, cabbirka block waa 4 KB. Imtixaan kastaa wuxuu qaadanayaa 5 daqiiqo. Kahor intaadan bilaabin, aaladda xannibaadda u dhiganta ayaa loo dejiyay midna sidii jadwalka I/O. Amarka fio wuxuu u eg yahay sidan:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --iodepth=1 --loops=1000 --runtime=300  --rw=<mode> --filename=<blkdev>

Natiijooyinka fio waxaan ka qaadannaa clat 99.00%. Natiijooyinka waxaa lagu muujiyey shaxda hoose.

Akhriska random, μs
Duubista random, μs

disk
112
78

Linux SW RAID, RAID0
113
45

VROC, RAID0
112
46

LSI, RAID0
122
63

Linux SW RAID, RAID1
113
48

VROC, RAID1
113
45

LSI, RAID1
128
89

Marka laga soo tago dib u dhacyada marka la gelayo xogta, waxaan jeclaan lahaa inaan arko waxqabadka darawallada farsamada gacanta oo aan barbar dhigo waxqabadka diskka jirka. Amarka si loo socodsiiyo fio:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --loops=1000 --runtime=300  --iodepth=<threads> --rw=<mode> --filename=<blkdev>

Waxqabadka waxaa lagu cabbiraa dhinaca hawlgallada I/O. Natiijooyinka waxaa lagu soo bandhigay shaxda hoose.

Akhrinta random 1 thread, IOPS
Qor random 1 dun, IOPS
Akhriso random 128 taxane, IOPS
Qor random 128 threads, IOPS

disk
11300
40700
453000
105000

Linux SW RAID, RAID0
11200
52000
429000
232000

VROC, RAID0
11200
52300
441000
162000

LSI, RAID0
10900
44200
311000
160000

Linux SW RAID, RAID1
10000
48600
395000
147000

VROC, RAID1
10000
54400
378000
244000

LSI, RAID1
11000
34300
229000
248000

Way fududahay in la arko in isticmaalka koontaroolaha qalabka ay keenayso daahitaanka korodhka iyo waxqabadka waxqabadka marka la barbar dhigo xalalka software.

gunaanad

Isticmaalka xalalka qalabka si aad u abuurto arrays disk ka laba saxan ayaa u muuqda mid aan caqli-gal ahayn. Si kastaba ha ahaatee, waxaa jira hawlo isticmaalka kontaroolayaasha RAID ay xaq u leeyihiin. Imaanshiyaha kontaroolayaasha taageera interface NVMe, isticmaalayaashu waxay fursad u leeyihiin inay u isticmaalaan SSD-yada degdega ah mashruucyadooda.

Qaababka RAID ee NVMe

Isticmaalayaasha diiwaangashan oo keliya ayaa ka qaybqaadan kara sahanka. Soo gal, soo dhawoow.

Ma isticmaashaa xalalka RAID?

  • 29,6%Haa, xalalka hardware32

  • 50,0%Haa, xalalka software54

  • 16,7%No18

  • 3,7%Looma baahna RAID4

108 isticmaale ayaa u codeeyay. 14 isticmaale ayaa ka aamusay.

Source: www.habr.com

Add a comment