Lisebelisoa tsa RAID ho NVMe

Lisebelisoa tsa RAID ho NVMe
Sehloohong sena re tla bua ka mekhoa e fapaneng ea ho hlophisa lihlopha tsa RAID, hape re bonts'a e 'ngoe ea balaoli ba pele ba RAID ba nang le tšehetso ea NVMe.

Mefuta eohle ea ts'ebeliso ea theknoloji ea RAID e fumaneha karolong ea seva. Karolong ea bareki, ke software ea RAID0 kapa RAID1 feela e sebelisoang li-disk tse peli.

Sengoliloeng sena se tla fana ka kakaretso e khuts'oane ea theknoloji ea RAID, thuto e khuts'oane ea ho theha li-array tsa RAID ho sebelisa lisebelisoa tse tharo tse fapaneng, le papiso ea ts'ebetso ea disk e sebetsang ka mokhoa o mong le o mong.

RAID ke eng?

Wikipedia e fana ka tlhaloso e felletseng ea theknoloji ea RAID:

futuheloa (Eng. Lethathamo le sa Lekaneng la Disks Tse Ikemetseng - mefuta e mengata ea li-disks tse ikemetseng (tse ikemetseng) - theknoloji ea virtualization ea data bakeng sa ho kopanya lisebelisoa tse 'maloa tsa disk ea' mele hore e be module e utloahalang ho eketsa mamello ea liphoso le ts'ebetso.

Tlhophiso ea li-disk arrays le mahlale a sebelisitsoeng a ipapisitse le khetho e khethiloeng Boemo ba RAID. Maemo a RAID a hlophisitsoe ho latela maemo Sebopeho se tloaelehileng sa RAID Disk Data. E hlalosa maemo a mangata a RAID, empa a tloaelehileng haholo ke RAID0, RAID1, RAID5 le RAID6.

RAID0kapa Mathata, ke boemo ba RAID bo kopanyang li-drive tse peli kapa ho feta tsa 'mele hore e be koloi e le 'ngoe e utloahalang. Bophahamo ba disk e utloahalang bo lekana le kakaretso ea li-volumes tsa li-disks tsa 'mele tse kenyelelitsoeng ka har'a sehlopha. Ha ho na redundancy boemong bona ba RAID, 'me ho hlōleha ha koloi e le' ngoe ho ka fella ka tahlehelo ea data eohle ho disk ea sebele.

ho bophahamo ba RAID1kapa seiponeng, e etsa likopi tse tšoanang tsa data ho li-disk tse peli kapa ho feta. Boholo ba "virtual disk" ha bo fete bonyane boholo ba li-disk tsa 'mele. Lintlha tse ho RAID1 virtual disk li tla ba teng hafeela bonyane disk e le 'ngoe e tsoang ho sehlopha e ntse e sebetsa. Ho sebelisa RAID1 ho eketsa bofokoli, empa ke tharollo e theko e boima, kaha ka har'a li-disk tse peli kapa ho feta ho na le bokhoni ba e le 'ngoe feela.

ho bophahamo ba RAID5 e rarolla bothata ba theko e phahameng. Ho theha sehlopha se nang le boemo ba RAID5, o hloka bonyane li-disk tse 3, 'me sehlopha se hanyetsana le ho hlōleha ha disk e le' ngoe. Lintlha tse ho RAID5 li bolokiloe ka li-blocks tse nang le li-checksums. Ha ho na karohano e tiileng lipakeng tsa li-disk tsa data le li-checksum disks. Lichelete ho RAID5 ke phello ea ts'ebetso ea XOR e sebelisitsoeng ho li-blocks tsa N-1, e 'ngoe le e' ngoe e nkiloeng ho disk e fapaneng.

Leha li-array tsa RAID li eketsa bohlasoa le ho fana ka bohlasoa, ha li loketse ho boloka likopi.

Ka mor'a leeto le lekhutšoanyane la ho kena mefuteng ea lihlopha tsa RAID, u ka fetela lisebelisoa le mananeo a u lumellang ho bokella le ho sebelisa li-disk arrays.

Mefuta ea balaoli ba RAID

Ho na le mekhoa e 'meli ea ho theha le ho sebelisa lihlopha tsa RAID: hardware le software. Re tla nahana ka litharollo tse latelang:

  • Linux Software RAID.
  • Intel® Virtual RAID Ho CPU.
  • LSI MegaRAID 9460-8i.

Hlokomela hore tharollo ea Intel® e sebetsa ho chipset, e hlahisang potso ea hore na ke sesebelisoa sa hardware kapa software. Mohlala, VMWare ESXi hypervisor e nka software ea VROC mme ha e e tšehetse ka molao.

Linux Software RAID

Lisebelisoa tsa Software RAID lelapeng la Linux OS ke tharollo e tloaelehileng haholo likarolong tse peli tsa bareki le seva. Sohle seo u se hlokang ho theha sehlopha ke ts'ebeliso ea mdadm le lisebelisoa tse 'maloa tsa block. Ntho feela e hlokahalang Linux Software RAID e beha li-drive tseo e li sebelisang ke ho ba sesebelisoa sa block se fumanehang ho sistimi.

Ho ba sieo ha litšenyehelo bakeng sa lisebelisoa le software ke molemo o totobetseng oa mokhoa ona. Linux Software RAID e hlophisa li-disk arrays ka theko ea nako ea CPU. Lethathamo la maemo a RAID a tšehetsoeng le boemo ba li-disk tsa hajoale li ka bonoa faeleng ea mdstat, e fumanehang motsong oa procfs:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] 
unused devices: <none>

Ts'ehetso ea maemo a RAID e eketsoa ka ho hokela mojule o nepahetseng oa kernel, mohlala:

root@grindelwald:~# modprobe raid456
root@grindelwald:~# cat /proc/mdstat 
Personalities : [linear] [multipath] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4] 
unused devices: <none>

Lits'ebetso tsohle tse nang le li-disk arrays li etsoa ka mohala oa taelo oa mdadm. Sehlopha sa disk se bokelloa ka taelo e le 'ngoe:

mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/nvme1n1 /dev/nvme2n1

Ka mor'a ho phethahatsa taelo ena, sesebelisoa sa thibela /dev/md0 se tla hlaha tsamaisong, e emelang disk e tloaelehileng.

Intel® Virtual RAID Ho CPU

Lisebelisoa tsa RAID ho NVMeIntel® VROC Standard Hardware Key
Intel® Virtual RAID On CPU (VROC) ke hardware le thekenoloji ea software bakeng sa ho etsa lihlopha tsa RAID tse thehiloeng ho Intel® chipsets. Theknoloji ena e fumaneha haholo bakeng sa liboto tsa bo-mme tse tšehetsang li-processor tsa Intel® Xeon® Scalable. Ka kamehla, VROC ha e fumanehe. Ho e kenya tshebetsong, o tlameha ho kenya senotlolo sa laesense ya hardware ya VROC.

Laesense e tloaelehileng ea VROC e u lumella ho etsa li-disk arrays tse nang le maemo a 0, 1 le 10 RAID. Mofuta oa premium o holisa lenane lena ka tšehetso ea RAID5.

Theknoloji ea Intel® VROC ho liboto tsa bo-mme tsa sejoale-joale e sebetsa 'moho le Intel® Volume Management Device (VMD), e fanang ka bokhoni ba ho fapanyetsana ho hot bakeng sa li-drive tsa NVMe.

Lisebelisoa tsa RAID ho NVMeLaesense e Tloaelehileng ea Intel® VROC Li-arrays li hlophisitsoe ka Setup Utility ha seva se qala. Ho tab e tsoetseng pele Intel® Virtual RAID holim'a ntho ea CPU ea hlaha, moo o ka hlophisang li-array tsa disk.

Lisebelisoa tsa RAID ho NVMeHo theha sehlopha sa RAID1 ho li-drive tse peli
Theknoloji ea Intel® VROC e na le li-aces tsa eona holimo. Lisebelisoa tsa Disk tse hahiloeng ho sebelisoa VROC li tsamaisana le Linux Software RAID. Sena se bolela hore boemo ba li-arrays bo ka behoa leihlo ho /proc/mdstat le ho tsamaisoa ka mdadm. "Tsobotsi" ena e tšehetsoa ka molao ke Intel. Kamora ho bokella RAID1 ho Setup Utility, o ka bona khokahano ea li-drive ho OS:

root@grindelwald:~# cat /proc/mdstat 
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] [raid10] 
md126 : active raid1 nvme2n1[1] nvme1n1[0]
      1855832064 blocks super external:/md127/0 [2/2] [UU]
      [>....................]  resync =  1.3% (24207232/1855832064) finish=148.2min speed=205933K/sec
      
md127 : inactive nvme1n1[1](S) nvme2n1[0](S)
      10402 blocks super external:imsm
       
unused devices: <none>

Hlokomela hore u ke ke ua kopanya li-arrays ho VROC u sebelisa mdadm (li-arrays tse kopaneng e tla ba Linux SW RAID), empa u ka fetola li-disk ho tsona le ho arola lihlopha.

LSI MegaRAID 9460-8i

Lisebelisoa tsa RAID ho NVMePonahalo ea molaoli oa LSI MegaRAID 9460-8i
Molaoli oa RAID ke tharollo ea hardware e ikemetseng. Taolo e sebetsa feela ka li-drive tse hokahaneng ka kotloloho ho eona. Taolo ena ea RAID e tšehetsa li-drive tse fihlang ho tse 24 tsa NVMe. Ke tšehetso ea NVMe e khethollang molaoli enoa ho ba bang ba bangata.

Lisebelisoa tsa RAID ho NVMeMenu ea mantlha ea taolo ea lisebelisoa
Ha o sebelisa mokhoa oa UEFI, litlhophiso tsa taolo li kopantsoe ho Setup Utility. Ha ho bapisoa le VROC, menu ea "hardware controller" e shebahala e rarahane haholo.

Lisebelisoa tsa RAID ho NVMeHo theha RAID1 ho li-disk tse peli
Ho hlalosa mokhoa oa ho hlophisa li-disk arrays ho "hardware controller" ke taba e bonolo ebile e ka ba lebaka la sengoloa se felletseng. Mona re tla ipehela meeli ea ho theha RAID0 le RAID1 ka li-setting tsa kamehla.

Li-disk tse amanang le "hardware controller" ha li bonahale ho sistimi e sebetsang. Sebakeng seo, molaoli o "masa" lihlopha tsohle tsa RAID ha SAS e khanna. Lits'oants'o tse hokahantsoeng le molaoli, empa eseng karolo ea sehlopha sa disk, li ke ke tsa fumaneha ke OS.

root@grindelwald:~# smartctl -i /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-48-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               AVAGO
Product:              MR9460-8i
Revision:             5.14
Compliance:           SPC-3
User Capacity:        1,999,844,147,200 bytes [1.99 TB]
Logical block size:   512 bytes
Rotation Rate:        Solid State Device
Logical Unit id:      0x000000000000000000000000000000
Serial number:        00000000000000000000000000000000
Device type:          disk
Local Time is:        Sun Oct 11 16:27:59 2020 MSK
SMART support is:     Unavailable - device lacks SMART capability.

Leha e patiloe joalo ka li-drive tsa SAS, NVMe arrays e tla sebetsa ka lebelo la PCIe. Leha ho le joalo, tšobotsi ena e u lumella ho qala ho tloha NVMe ho Lefa.

teko ea teko

Mokhoa o mong le o mong oa ho hlophisa li-disk arrays o na le melemo le likotsi tsa ona. Empa na ho na le phapang ea ts'ebetso ha u sebetsa le li-disk arrays?

Ho fihlela toka e phahameng, liteko tsohle li tla etsoa ho seva se le seng. Tlhophiso ea eona:

  • 2x Intel® Xeon® 6240;
  • 12x DDR4-2666 16 GB;
  • LSI MegaRAID 9460-8i;
  • Intel® VROC Standard Hardware Key;
  • 4x Intel® SSD DC P4510 U.2 2TB;
  • 1x Samsung 970 EVO Plus M.2 500GB.

Likarolo tsa liteko ke P4510, halofo ea eona e hokahane le boardboard, 'me halofo e' ngoe e hokahane le molaoli oa RAID. M.2 e sebelisa Ubuntu 20.04 'me liteko li tla etsoa ho sebelisoa fio version 3.16.

Teko

Pele ho tsohle, a re hlahlobeng ho lieha ha ho sebetsa le disk. Teko e etsoa ka khoele e le 'ngoe, boholo ba block ke 4 KB. Teko ka 'ngoe e nka metsotso e 5. Pele o qala, sesebelisoa sa block se tsamaisanang se behiloe ho se seng joalo ka kemiso ea I / O. Taelo ea fio e shebahala tjena:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --iodepth=1 --loops=1000 --runtime=300  --rw=<mode> --filename=<blkdev>

Ho tsoa ho liphetho tsa fio re nka clat 99.00%. Liphetho li bonts'itsoe lethathamong le ka tlase.

Ho bala ka tšohanyetso, μs
Ho rekota ka tšohanyetso, μs

tiske
112
78

Linux SW RAID, RAID0
113
45

VROC, RAID0
112
46

LSI, RAID0
122
63

Linux SW RAID, RAID1
113
48

VROC, RAID1
113
45

LSI, RAID1
128
89

Ntle le tieho ha u fumana data, ke kopa ho bona ts'ebetso ea li-drive tsa sebele le ho li bapisa le ts'ebetso ea disk ea 'mele. Taelo ea ho tsamaisa fio:

fio --name=test --blocksize=4k --direct=1 --buffered=0 --ioengine=libaio  --loops=1000 --runtime=300  --iodepth=<threads> --rw=<mode> --filename=<blkdev>

Ts'ebetso e lekantsoe ho latela ts'ebetso ea I/O. Liphetho li hlahisoa lethathamong le ka tlase.

Bala ka mokhoa o sa reroang khoele e 1, IOPS
Ngola ka mokhoa o sa reroang khoele e 1, IOPS
Bala ka mokhoa o sa reroang likhoele tse 128, IOPS
Ngola ka mokhoa o sa reroang likhoele tse 128, IOPS

tiske
11300
40700
453000
105000

Linux SW RAID, RAID0
11200
52000
429000
232000

VROC, RAID0
11200
52300
441000
162000

LSI, RAID0
10900
44200
311000
160000

Linux SW RAID, RAID1
10000
48600
395000
147000

VROC, RAID1
10000
54400
378000
244000

LSI, RAID1
11000
34300
229000
248000

Ho bonolo ho bona hore ho sebelisa molaoli oa hardware ho fella ka ho eketseha ha latency le ho otla ha tshebetso ha ho bapisoa le tharollo ea software.

fihlela qeto e

Ho sebelisa litharollo tsa Hardware ho theha li-disk tse tsoang ho li-disk tse peli ho shebahala ho sa utloahale. Leha ho le joalo, ho na le mesebetsi moo tšebeliso ea balaoli ba RAID e loketseng. Ka ho fihla ha balaoli ba tšehetsang sebopeho sa NVMe, basebelisi ba na le monyetla oa ho sebelisa li-SSD tse potlakileng mererong ea bona.

Lisebelisoa tsa RAID ho NVMe

Ke basebelisi ba ngolisitsoeng feela ba ka kenyang letsoho phuputsong. kenaka kopo.

Na u sebelisa litharollo tsa RAID?

  • 29,6%Ee, litharollo tsa hardware32

  • 50,0%Ee, tharollo ea software54

  • 16,7%No18

  • 3,7%Ha ho RAID e hlokahalang4

Basebelisi ba 108 ba ile ba khetha. Basebelisi ba 14 ba ile ba hana.

Source: www.habr.com

Eketsa ka tlhaloso