Didaakọ awọn iwọn didun si awọn eto ibi ipamọ nipasẹ olupin Linux kan nipa lilo XCOPY

O ṣẹlẹ pe o nilo lati gba ẹda kikun ti iwọn didun laarin eto ibi ipamọ data kan (DSS), kii ṣe aworan aworan, ẹda oniye, ṣugbọn iwọn didun ni kikun. Ṣugbọn eto ipamọ ko gba laaye nigbagbogbo lati ṣe eyi ni lilo awọn ọna tirẹ. O dabi pe aṣayan nikan ni lati daakọ nipasẹ olupin naa, ṣugbọn ninu idi eyi gbogbo iwọn didun data yoo wa nipasẹ olupin naa funrararẹ, nẹtiwọki si eto ipamọ ati awọn ibudo ipamọ, ikojọpọ gbogbo awọn irinše wọnyi. Ṣugbọn awọn aṣẹ SCSI wa ti o le gba ọ laaye lati ṣe ohun gbogbo laarin eto ibi ipamọ funrararẹ, ati pe ti eto rẹ ba ṣe atilẹyin VAAI lati VMware, lẹhinna o fẹrẹ to 100% ti aṣẹ XCOPY (EXTENDED COPY) ni atilẹyin, eyiti o sọ fun titobi kini ati ibi ti lati da, lai okiki ilana olupin ati nẹtiwọki.

O dabi pe ohun gbogbo yẹ ki o rọrun, ṣugbọn Emi ko le rii eyikeyi awọn iwe afọwọkọ ti a ti ṣetan lẹsẹkẹsẹ, nitorinaa Mo ni lati tun kẹkẹ naa pada. A yan Linux fun OS olupin naa, ati pe aṣẹ ddpt (http://sg.danny.cz/sg/ddpt.html) ti yan gẹgẹbi irinṣẹ didakọ. Lilo apapo yii, o le daakọ awọn ipele eyikeyi lati OS eyikeyi, niwọn igba ti didaakọ waye Àkọsílẹ-nipasẹ-ìdènà ni ẹgbẹ eto ipamọ. Niwọn bi o ti jẹ dandan lati daakọ bulọọki nipasẹ bulọọki, ati pe nọmba awọn bulọọki gbọdọ ka, a lo aṣẹ blockdev lati ka nọmba iru awọn iterations. Iwọn bulọọki ti o pọju ni a gba ni idanwo; ddpt ko ṣiṣẹ gangan pẹlu bulọọki nla kan. Abajade jẹ iwe afọwọkọ ti o rọrun ni atẹle yii:

#!/bin/bash
# first parameter = input device
# second parameter = output device
# device size must be the same
# changing bs variable can reduce speed, max speed should be at bs=32768. 32768 is max setting, lower settings should be calculated dividing by 2

set -o nounset
bs=32768
s=`blockdev --getsz $1`
i=0
while [ $i -le $s ]
do
ddpt of=$2 bs=512 oflag=xcopy,direct if=$1 iflag=xcopy,direct count=$bs verbose=-1 skip=$i seek=$i
i=$(( $i+$bs ))
done

Jẹ ki a ṣe ayẹwo diẹ! O dara, bi kekere kan, faili 1TB ko ni kiakia ṣẹda ati ṣayẹwo nipasẹ md5sum :)

root@sales-demo-05:/home/vasilyk# blockdev --getsz /dev/mapper/mpathfs
2516582400
root@sales-demo-05:/home/vasilyk# blockdev --getsz /dev/mapper/mpathfr
2516582400
root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfs /xcopy_source/
mount: /xcopy_source: wrong fs type, bad option, bad superblock on /dev/mapper/mpathfs, missing codepage or helper program, or other error.
root@sales-demo-05:/home/vasilyk# mkfs /dev/mapper/mpathfs
mke2fs 1.44.1 (24-Mar-2018)
Discarding device blocks: done
Creating filesystem with 314572800 4k blocks and 78643200 inodes
Filesystem UUID: bed3ea00-c181-4b4e-b52e-d9bb498be756
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424, 20480000, 23887872, 71663616, 78675968,
        102400000, 214990848

Allocating group tables: done
Writing inode tables: done
Writing superblocks and filesystem accounting information: done

root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfs /xcopy_source/
root@sales-demo-05:/home/vasilyk# ls -l /xcopy_source/
total 16
drwx------ 2 root root 16384 Aug 19 15:35 lost+found
root@sales-demo-05:/home/vasilyk# head -c 1T </dev/urandom > /xcopy_source/1TB_file
root@sales-demo-05:/home/vasilyk# ls -l /xcopy_source/
total 1074791444
-rw-r--r-- 1 root root 1099511627776 Aug 19 17:25 1TB_file
drwx------ 2 root root         16384 Aug 19 15:35 lost+found
root@sales-demo-05:/home/vasilyk# umount /xcopy_source
root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfr /xcopy_dest/
mount: /xcopy_dest: wrong fs type, bad option, bad superblock on /dev/mapper/mpathfr, missing codepage or helper program, or other error.
root@sales-demo-05:/home/vasilyk# cat xcopy.sh
#!/bin/bash
# first parameter = input device
# second parameter = output device
# device size must be the same
# changing bs variable can reduce speed, max speed should be at bs=32768. 32768 is max setting, lower settings should be calculated dividing by 2

bs=32768
s=`blockdev --getsz $1`
i=0
while [ $i -le $s ]
do
ddpt of=$2 bs=512 oflag=xcopy,direct if=$1 iflag=xcopy,direct count=$bs verbose=-1 skip=$i seek=$i
i=$(( $i+$bs ))
done
root@sales-demo-05:/home/vasilyk# time ./xcopy.sh /dev/mapper/mpathfs /dev/mapper/mpathfr
real    11m30.878s
user    2m3.000s
sys     1m11.657s

Kini n ṣẹlẹ lori eto ibi ipamọ ni akoko yẹn:

Jẹ ki a tẹsiwaju pẹlu Linux.

root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfr /xcopy_dest/
root@sales-demo-05:/home/vasilyk# ls -l /xcopy_dest/
total 1074791444
-rw-r--r-- 1 root root 1099511627776 Aug 19 17:25 1TB_file
drwx------ 2 root root         16384 Aug 19 15:35 lost+found
root@sales-demo-05:/home/vasilyk# mount /dev/mapper/mpathfs /xcopy_source/
root@sales-demo-05:/home/vasilyk# md5sum /xcopy_source/1TB_file
53dc6dfdfc89f099c0d5177c652b5764  /xcopy_source/1TB_file
root@sales-demo-05:/home/vasilyk# md5sum /xcopy_dest/1TB_file
53dc6dfdfc89f099c0d5177c652b5764  /xcopy_dest/1TB_file
root@sales-demo-05:/home/vasilyk#

Ohun gbogbo ti ṣiṣẹ, ṣugbọn ṣe idanwo ati lo ninu eewu tirẹ! Gẹgẹbi iwọn didun orisun, o dara lati ya awọn aworan, fun awọn ibẹrẹ.

orisun: www.habr.com