XCOPY yordamida Linux serveri orqali hajmlarni saqlash tizimlariga nusxalash

Shunday bo'ladiki, siz bitta ma'lumotlarni saqlash tizimi (DSS) ichida oniy rasm, klon emas, balki to'liq hajmdagi hajmning to'liq nusxasini olishingiz kerak bo'ladi. Ammo saqlash tizimi har doim o'z vositalaridan foydalangan holda buni ichki ravishda amalga oshirishga imkon bermaydi. Ko'rinishidan, yagona variant - server orqali nusxa ko'chirish, ammo bu holda ma'lumotlarning butun hajmi serverning o'zi, tarmoq orqali saqlash tizimi va saqlash portlari orqali ushbu komponentlarning barchasini yuklaydi. Ammo SCSI buyruqlari mavjud bo'lib, ular sizga hamma narsani saqlash tizimining o'zida bajarishga imkon beradi va agar sizning tizimingiz VMware-dan VAAI-ni qo'llab-quvvatlasa, XCOPY (KENAYITLANGAN NUSHIYA) buyrug'i deyarli 100% qo'llab-quvvatlanadi, bu massivga nima va nima ekanligini aytadi. jarayon serveri va tarmoqni jalb qilmasdan nusxa ko'chirish.

Hamma narsa oddiy bo'lishi kerakdek tuyuladi, lekin men darhol tayyor skriptlarni topa olmadim, shuning uchun g'ildirakni qayta kashf qilishim kerak edi. Server OS uchun Linux tanlandi va nusxa ko'chirish vositasi sifatida ddpt buyrug'i (http://sg.danny.cz/sg/ddpt.html) tanlangan. Ushbu kombinatsiyadan foydalanib, istalgan jildni istalgan OTdan nusxalashingiz mumkin, chunki nusxalash saqlash tizimi tomonida blokma-blok amalga oshiriladi. Blokdan blokdan nusxa ko'chirish zarurligi va bloklar sonini hisoblash kerakligi sababli, bunday takrorlashlar sonini hisoblash uchun blockdev buyrug'i ishlatilgan. Maksimal blok hajmi eksperimental ravishda olingan; ddpt aslida katta blok bilan ishlamagan. Natijada quyidagi juda oddiy skript paydo bo'ldi:

#!/bin/bash
# first parameter = input device
# second parameter = output device
# device size must be the same
# changing bs variable can reduce speed, max speed should be at bs=32768. 32768 is max setting, lower settings should be calculated dividing by 2

set -o nounset
bs=32768
s=`blockdev --getsz $1`
i=0
while [ $i -le $s ]
do
ddpt of=$2 bs=512 oflag=xcopy,direct if=$1 iflag=xcopy,direct count=$bs verbose=-1 skip=$i seek=$i
i=$(( $i+$bs ))
done

Keling, biroz tekshirib ko'raylik! Xo'sh, kichik fayl sifatida, 1TB fayl tezda yaratilmadi va md5sum tomonidan tekshirilmadi :)

root@sales-demo-05:/home/vasilyk# blockdev --getsz /dev/mapper/mpathfs
2516582400
root@sales-demo-05:/home/vasilyk# blockdev --getsz /dev/mapper/mpathfr
2516582400
root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfs /xcopy_source/
mount: /xcopy_source: wrong fs type, bad option, bad superblock on /dev/mapper/mpathfs, missing codepage or helper program, or other error.
root@sales-demo-05:/home/vasilyk# mkfs /dev/mapper/mpathfs
mke2fs 1.44.1 (24-Mar-2018)
Discarding device blocks: done
Creating filesystem with 314572800 4k blocks and 78643200 inodes
Filesystem UUID: bed3ea00-c181-4b4e-b52e-d9bb498be756
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
        102400000, 214990848

Allocating group tables: done
Writing inode tables: done
Writing superblocks and filesystem accounting information: done

root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfs /xcopy_source/
root@sales-demo-05:/home/vasilyk# ls -l /xcopy_source/
total 16
drwx------ 2 root root 16384 Aug 19 15:35 lost+found
root@sales-demo-05:/home/vasilyk# head -c 1T </dev/urandom > /xcopy_source/1TB_file
root@sales-demo-05:/home/vasilyk# ls -l /xcopy_source/
total 1074791444
-rw-r--r-- 1 root root 1099511627776 Aug 19 17:25 1TB_file
drwx------ 2 root root         16384 Aug 19 15:35 lost+found
root@sales-demo-05:/home/vasilyk# umount /xcopy_source
root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfr /xcopy_dest/
mount: /xcopy_dest: wrong fs type, bad option, bad superblock on /dev/mapper/mpathfr, missing codepage or helper program, or other error.
root@sales-demo-05:/home/vasilyk# cat xcopy.sh
#!/bin/bash
# first parameter = input device
# second parameter = output device
# device size must be the same
# changing bs variable can reduce speed, max speed should be at bs=32768. 32768 is max setting, lower settings should be calculated dividing by 2

bs=32768
s=`blockdev --getsz $1`
i=0
while [ $i -le $s ]
do
ddpt of=$2 bs=512 oflag=xcopy,direct if=$1 iflag=xcopy,direct count=$bs verbose=-1 skip=$i seek=$i
i=$(( $i+$bs ))
done
root@sales-demo-05:/home/vasilyk# time ./xcopy.sh /dev/mapper/mpathfs /dev/mapper/mpathfr
real    11m30.878s
user    2m3.000s
sys     1m11.657s

O'sha paytda saqlash tizimida nima sodir bo'ldi:

Keling, Linux bilan davom etaylik.

root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfr /xcopy_dest/
root@sales-demo-05:/home/vasilyk# ls -l /xcopy_dest/
total 1074791444
-rw-r--r-- 1 root root 1099511627776 Aug 19 17:25 1TB_file
drwx------ 2 root root         16384 Aug 19 15:35 lost+found
root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfs /xcopy_source/
root@sales-demo-05:/home/vasilyk# md5sum /xcopy_source/1TB_file
53dc6dfdfc89f099c0d5177c652b5764  /xcopy_source/1TB_file
root@sales-demo-05:/home/vasilyk# md5sum /xcopy_dest/1TB_file
53dc6dfdfc89f099c0d5177c652b5764  /xcopy_dest/1TB_file
root@sales-demo-05:/home/vasilyk#

Hammasi muvaffaqiyatli bo'ldi, lekin sinovdan o'tkazing va o'zingizning xavf-xataringiz ostida foydalaning! Manba hajmi sifatida yangi boshlanuvchilar uchun suratga olish yaxshiroqdir.

Manba: www.habr.com