Anamnesis, penei:
ʻO Fujitsu rx300 s6 server, RAID6 o 6 1TB disks, XenServer 6.2 i hoʻokomo ʻia, he nui nā kikowaena e wili ana, ma waena o lākou ʻo Ubuntu me nā pōpō, 3,5 miliona mau faila, 1,5 TB o ka ʻikepili, ke ulu mālie nei kēia a me ka pehu.
Hana: hoʻonohonoho i ka hoʻihoʻi ʻikepili mai kahi kikowaena faila, hapa i kēlā me kēia lā, hapa pule.
Loaʻa iā mākou kahi mīkini hoʻihoʻi Windows me RAID5 (kahi ʻōnaehana maʻamau maikaʻi ʻole me kahi mea hoʻoponopono RAID i kūkulu ʻia i loko o ka makuahine) me kahi disk 2TB ʻokoʻa no ke kope waena o ke kūlana o kēia manawa o nā faila. Hiki ke hoʻohana i kekahi mahele Linux, akā ua loaʻa mua kēia mīkini me kahi hoʻouka kaua a me kahi laikini Windows.
E hoʻouka ma kahi kikowaena waihona , ua hoʻonohonoho mākou i kahi "kukui" o nā mea a pau i ka lālani mai nā māhele kikowaena faila a pau i hoʻokahi lā i ke ahiahi ma hope o 18 mau hola ma o ka holo ʻana ma o ka mea hoʻonohonoho.
ʻO kahi mea nui: i ka wā e mālama ai i kahi hana puʻupuʻu, e nānā pono i ka "E pani i ka puka makani hana ke hoʻopau ʻia," i ʻole e hoʻonui a hoʻonui nā kaʻina hana.
Hoʻolei mākou i nā faila no ka manawa pōkole: *.dwl, *.dwl2, *.tmp.
Hoʻohana maikaʻi ʻo FreeFileSync i ka pūnaewele, hana ʻia ke kope ʻana ma nā ʻāpana he nui, hiki ka wikiwiki i ka 80 Mbps i ke kope ʻana i nā faila nui, ʻaʻohe mea i ʻike ʻia ma nā faila liʻiliʻi.
E mālama ʻia ka waihona ma kahi kikowaena kākoʻo kūloko, ma kahi o ka mea i hoʻohana mua ʻia me ka waihona pūnaewele. Ma ke ala, maikaʻi ʻo TheCopier! Akā me ia mau puke, ʻaʻohe manawa e hoʻololi i nā mea āpau, ʻoiai ʻo ka 1Gbps interface ma ka backup a me 2Gbps ma ka faila hoʻokahi (ka paʻa o nā kāleka ʻelua).
Hoʻohana ʻia ma mua , akā inā ʻoi aku ka nui o nā faila ma mua o 1,5-2 miliona, ua pau ka hana maʻamau, ʻaʻole hiki ke hoʻokō.
No ka mālama ʻana i nā waihona pono, kākau mākou i kahi faila no :
hoʻonoho i kēia manawa=%MANA:~0,-3%
hoʻonoho i kēia manawa=%i kēia manawa::=.%
hoʻonoho i kēia manawa=%i kēia manawa: =0%
hoʻonoho i kēia manawa=%DATE:~-4%.%DATE:~3,2%.%DATE:~0,2%_%i kēia manawa%
C: "Nā waihona papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_10-04.zip E:10-04
C: "Nā waihona papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_35-110.zip E:35-110
C: "Nā waihona papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_asu.zip E:asu
C: "Nā Kōnae Papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_director.zip E:director
C: "Nā Kōnae Papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_gpr.zip E:gpr
C: "Nā waihona papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_otiz.zip E:otiz
C: "Nā Kōnae Papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_ps.zip E:ps
C: "Nā Kōnae Papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_pto.zip E:pto
C: “Nā waihona papahana” 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_rza.zip E:rza
C: "Nā Kōnae Papahana" 7-Zip7z.exe a -tzip -mx=1 -mmt=on -mtc=off -ssw D:backupsAll%now%_smeta.zip E:smeta
::a - hana i kahi waihona
:: -tzip a i ʻole -t7z - ʻano waihona (zip he 1.5-2 mau manawa wikiwiki)
:: -mx=1 — lākiō puʻupuʻu (1 liʻiliʻi, 9 koina nui x=[0 | 1 | 3 | 5 | 7 | 9 ])
:: -mmt=on - hiki i ka multithreading kahi i hiki ole ai
:: -mtc=off - hoʻopau i nā timestamp ʻōnaehana faila (ke mālama ʻia, hoʻololi ʻia, etc.)
:: -ssw - hoʻokomo pū i nā faila i wehe ʻia no ke kākau ʻana
:: -xr.
ʻO ke kūkulu ʻana i kēia manawa =% a pēlā aku e hiki ai iā ʻoe ke mālama i ke ʻano o ka hoʻopaʻa ʻana i ka manawa ma kahi inoa faila me ka ʻole o nā pilikia i kū mai i ka wā i emi iho ai ka helu o ka lā a i ʻole ka mahina ma mua o 10, ʻo ia hoʻi, hoʻololi mākou i kahi zero.
ʻO ka manaʻo -xr!.Sync* he kumu kumu i koe mai ka mea i hoʻohana mua ʻia .
A hiki i ka 500 GB a me 700-800 tausani mau faila, ua hana maikaʻi ʻo BTSync, i hoʻonohonoho ʻia ma ka lele, akā me nā puke o kēia manawa ua hoʻopau loa ia i ka hoʻomanaʻo a me nā kumuwaiwai ma ka waihona waihona ʻo Ubuntu a ma ka waihona Windows kahi i hoʻokuʻu ʻia ai. ka lawelawe, a me ka ʻōnaehana disk hoʻopaʻa wale ʻia e ka heluhelu a me ke kākau mau ʻana.
ʻOiai ʻo 7-zip ka waihona, hoʻopaʻa mākou iā ia ma ka format zip ma kahi o ka 7z maoli, no ka mea, ʻoi aku ka wikiwiki, a ʻaʻohe ʻokoʻa o ka hoʻopili ʻana me mx=1, ua hōʻoia ʻia kēia e nā hoʻokolohua he nui.
Hoʻokō ʻia nā waihona i kēlā me kēia.
Hoʻomaʻemaʻe ʻia ka waihona me nā waihona ma o kahi hana i hoʻonohonoho ʻia me ka hoʻohana ʻana i ka pono fpurge, e waiho ana i nā waihona ma mua o hoʻokahi pule.
ʻO ka hopena, loaʻa iā mākou kahi kope o nā faila no ka lā ma mua, a me nā waihona no ka pule hope loa; Hoʻokomo ʻo FreeFileSync i nā faila i holoi ʻia i ka ʻōpala.
Source: www.habr.com