Cov ntaub ntawv thaub qab siv FreeFileSync thiab 7-zip

Anamnesis, yog li hais lus:

Fujitsu rx300 s6 server, RAID6 ntawm 6 1TB disks, XenServer 6.2 ntsia, ntau lub servers tig, ntawm lawv Ubuntu nrog ob peb lub npas, 3,5 lab cov ntaub ntawv, 1,5 TB ntawm cov ntaub ntawv, tag nrho cov no maj mam loj hlob thiab o.

Kev Ua Haujlwm: teeb tsa cov ntaub ntawv thaub qab los ntawm cov ntaub ntawv server, ib nrab hnub, ib nrab lub lis piam.
Peb muaj lub tshuab thaub qab Windows nrog RAID5 (tus qauv txheej txheem tsis zoo nrog RAID maub los ua rau niam) ntxiv rau 2TB disk cais rau nruab nrab ntawm cov ntaub ntawv tam sim no. Nws muaj peev xwm siv tau ib qho kev faib tawm Linux, tab sis lub tshuab no twb muaj nyob nrog kev tua array thiab daim ntawv tso cai Windows.

Nruab rau ntawm lub server thaub qab FreeFileSync, peb teeb tsa "daim iav" ntawm txhua yam ua ke los ntawm tag nrho cov ntaub ntawv neeg rau zaub mov sib koom ib hnub nyob rau yav tsaus ntuj tom qab 18 teev los ntawm kev khiav nws los ntawm lub sijhawm teem sijhawm.

Lub ntsiab lus tseem ceeb: thaum txuag cov haujlwm batch, nco ntsoov xyuas "Kaw lub qhov rais ua haujlwm thaum ua tiav," txwv tsis pub cov txheej txheem yuav sib npaug thiab sib npaug.

Peb pov cov ntaub ntawv ib ntus rau hauv daim npog qhov ncauj tshwj xeeb: *.dwl, *.dwl2, *.tmp.

FreeFileSync siv lub network zoo heev, kev luam tawm yuav tshwm sim hauv ntau cov xov, qhov ceev nce mus txog 80 Mbps thaum luam cov ntaub ntawv loj, tsis muaj kev thaiv cov ntaub ntawv me me.

Archiving yuav tau ua nyob rau hauv lub zos backup server, es tsis txhob siv yav tas los TheCopier nrog network archiving. Los ntawm txoj kev, TheCopier yog qhov zoo! Tab sis nrog cov ntim zoo li no, nws tsuas yog tsis muaj sijhawm hloov txhua yam, txawm tias 1Gbps interface ntawm thaub qab thiab 2Gbps ntawm cov ntaub ntawv ib qho (daim ntawv cog lus ntawm ob daim npav network).

Kuj siv yav tas los SyncToy, tab sis thaum cov ntaub ntawv ntau tshaj 1,5-2 lab, nws nres ua haujlwm ib txwm, nws tsuas tuaj yeem tiv tsis tau.

Txhawm rau khaws cov folders tsim nyog, peb sau cov ntaub ntawv batch rau 7-zip:

set now=%TIME:~0,-3%
set now=% now::=.%
set now =% now: = 0%
set now=%DATE:~-4%.%DATE:~3,2%.%DATE:~0,2%_%tam sim no%
C:"Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_10-04.zip E:10-04
C:"Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_35-110.zip E:35-110
C:"Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_asu.zip E:asu
C: "Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_director.zip E:director
C: "Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_gpr.zip E:gpr
C:"Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_otiz.zip E:otiz
C: "Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_ps.zip E:ps
C: "Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_pto.zip E:pto
C: "Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_rza.zip E:rza
C: "Program Files"7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_smeta.zip E:smeta

::a - tsim ib qho archive
:: -tzip lossis -t7z - archive hom (zip yog 1.5-2 zaug sai dua)
:: -mx=1 β€” compression ratio (1 yam tsawg kawg nkaus, 9 qhov siab tshaj plaws x=[0 | 1 | 3 | 5 | 7 | 9])
:: -mmt=on - enables multithreading qhov twg nws tsis enabled
:: -mtc=off - disables file system timestamps (thaum saved, modified, etc.)
:: -ssw - kuj compresses cov ntaub ntawv qhib rau kev sau ntawv
:: -xr!.Sync* - tsis suav nrog cov ntaub ntawv BtSync ib ntus los ntawm kev khaws cia, tawm mus tas li

Kev tsim kho tam sim no =% thiab lwm yam tso cai rau koj kom txuag tau cov hom ntawv teev sijhawm hauv cov ntaub ntawv npe yam tsis muaj teeb meem tshwm sim thaum tus naj npawb ntawm hnub lossis hli tsawg dua 10, uas yog, peb hloov qhov xoom.

Tawm tswv yim -xr!.Sync* yog ib qho rudiment sab laug los ntawm qhov qub siv BTSync.

Txog li 500 GB thiab 700-800 txhiab cov ntaub ntawv, BTSync tseem ua haujlwm zoo, synchronized ntawm ya, tab sis nrog cov ntim tam sim no nws tau siv ntau lub cim xeeb thiab cov peev txheej processor ob qho tib si ntawm Ubuntu cov ntaub ntawv server thiab ntawm Windows backup qhov twg nws tau pib los ntawm cov kev pab cuam, thiab kuj tsuas yog raped disk system los ntawm tas li nyeem thiab sau.

Txawm hais tias tus archiver yog 7-zip, peb archive nws nyob rau hauv lub zip hom es tsis txhob ntawm cov haiv neeg 7z, vim hais tias nws yog sai npaum li cas, thiab tsis muaj qhov sib txawv ntawm compression nrog mx = 1, qhov no tau raug txheeb xyuas los ntawm ntau qhov kev sim.

Archives raug tua ib tug los ntawm ib tug.

Cov ntawv tais ceev tseg nrog cov ntaub ntawv tseem raug ntxuav los ntawm kev teem caij ua haujlwm siv fpurge utility, tawm hauv archives tsis pub dhau ib lub lim tiam.
Yog li ntawd, peb muaj ib daim ntawv theej ntawm cov ntaub ntawv rau hnub dhau los, nrog rau cov ntaub ntawv khaws tseg rau lub lim tiam dhau los; FreeFileSync tso cov ntaub ntawv tshem tawm hauv lub thoob khib nyiab.

Tau qhov twg los: www.hab.com

Ntxiv ib saib