Tsim lub tsev pheej yig NAS system ntawm Linux

Tsim lub tsev pheej yig NAS system ntawm Linux

Kuv, zoo li ntau lwm tus neeg siv MacBook Pro, tau ntsib teeb meem ntawm kev nco tsis txaus. Txhawm rau kom meej meej, rMBP kuv siv txhua hnub tau nruab nrog SSD nrog lub peev xwm ntawm 256GB nkaus xwb, uas, ib txwm, tsis txaus rau lub sijhawm ntev.

Thiab thaum twg, nyob rau sab saum toj ntawm txhua yam ntxiv, kuv pib kaw cov yeeb yaj kiab thaum kuv ya, qhov xwm txheej tsuas yog zuj zus. Qhov ntim ntawm cov duab thaij tom qab kev ya davhlau yog 50+ GB, thiab kuv cov neeg pluag 256GB SSD sai sai tau sau, yuam kom kuv yuav ib qho 1TB tsav sab nraud. Txawm li cas los xij, tom qab ib xyoos, nws tsis tuaj yeem tswj hwm tus nqi ntawm cov ntaub ntawv kuv tab tom tsim, tsis hais txog qhov tsis muaj kev rov ua dua thiab kev thaub qab ua rau nws tsis tsim nyog rau hosting cov ntaub ntawv tseem ceeb.

Yog li, ntawm ib lub sijhawm kuv tau txiav txim siab los tsim lub NAS loj hauv kev cia siab tias qhov system no yuav kav ntev li ob peb xyoos yam tsis tas yuav hloov kho dua tshiab.

Kuv tau sau tsab xov xwm no feem ntau ua ib qho kev ceeb toom ntawm qhov kuv tau ua thiab kuv tau ua li cas yog tias kuv yuav tsum tau ua dua. Kuv vam tias nws yuav muaj txiaj ntsig rau koj thiab yog tias koj txiav txim siab ua ib yam.

Tej zaum nws yuav yooj yim dua?

Yog li, peb paub tias peb xav tau dab tsi, cov lus nug tseem nyob: ua li cas?

Kuv thawj zaug saib cov kev daws teeb meem kev lag luam thiab saib tshwj xeeb ntawm Synology, uas yuav tsum muab cov neeg siv khoom zoo tshaj plaws-qib NAS systems ntawm kev ua lag luam. Txawm li cas los xij, tus nqi ntawm qhov kev pabcuam no tau dhau los ua siab heev. Qhov pheej yig tshaj 4-bay system raug nqi $ 300+ thiab tsis suav nrog hard drives. Tsis tas li ntawd, cov khoom ntim sab hauv ntawm xws li cov khoom siv nws tus kheej tsis yog qhov tshwj xeeb tshaj plaws, uas hu rau cov lus nug nws qhov kev ua tau zoo tiag tiag.

Tom qab ntawd kuv xav tias: vim li cas ho tsis tsim NAS server kuv tus kheej?

Nrhiav ib lub server uas tsim nyog

Yog hais tias koj yuav sib sau ua ke xws li ib tug neeg rau zaub mov, ces ua ntej ntawm tag nrho cov koj yuav tsum nrhiav kom raug kho vajtse. Ib tus neeg siv khoom siv yuav tsum tsim nyog rau qhov tsim no, vim peb yuav tsis xav tau kev ua haujlwm ntau rau kev khaws cia. Ntawm cov khoom tsim nyog, peb yuav tsum nco ntsoov ntau ntawm RAM, ob peb SATA txuas thiab daim npav network zoo. Txij li thaum kuv tus neeg rau zaub mov yuav ua haujlwm nyob rau hauv qhov chaw ntawm kuv qhov chaw nyob mus tas li, lub suab nrov kuj tseem ceeb.

Kuv pib tshawb nrhiav hauv eBay. Txawm hais tias kuv pom ntau tus siv Dell PowerEdge R410 / R210 nyob rau hauv qis dua $ 100, muaj kev paub ua haujlwm hauv chav neeg rau zaub mov, kuv paub tias 1U units no ua suab nrov heev thiab tsis haum rau kev siv hauv tsev. Raws li txoj cai, ntauwd servers feem ntau tsis tshua muaj suab nrov, tab sis, hmoov tsis, muaj ob peb ntawm lawv ntawm eBay, thiab lawv tag nrho cov kim lossis tsis muaj zog.

Qhov chaw tom ntej mus saib yog Craiglist, qhov twg kuv pom ib tug neeg muag HP ProLiant N40L siv rau xwb $75! Kuv paub txog cov servers no, uas feem ntau raug nqi ib ncig $ 300 txawm siv, yog li kuv tau xa email rau tus neeg muag khoom hauv kev cia siab tias qhov kev tshaj tawm tseem ua haujlwm. Tau kawm tias qhov no yog qhov teeb meem, kuv, tsis xav txog ob zaug, mus rau San Mateo los khaws cov neeg rau zaub mov no, uas thaum xub thawj siab ib muag yeej txaus siab rau kuv. Nws tau hnav tsawg heev thiab tsuas yog me ntsis plua plav, txhua yam zoo heev.

Tsim lub tsev pheej yig NAS system ntawm Linux
Duab ntawm tus neeg rau zaub mov, tam sim ntawd tom qab yuav khoom

Nov yog cov specifications rau cov khoom siv kuv yuav:

  • CPUAMD Turion(tm) II Neo N40L Dual-Core Processor (64-ntsis)
  • RAM: 8 GB tsis-ECC RAM (ntsuas los ntawm tus tswv yav dhau los)
  • flash: 4 GB USB Drive
  • SATA Connectors:4 + 1
  • NIC: 1 Gbps on-board NIC

Tsis tas yuav hais, txawm tias muaj hnub nyoog ntau xyoo, qhov tshwj xeeb ntawm cov neeg rau zaub mov no tseem zoo dua rau feem ntau NAS kev xaiv ntawm kev ua lag luam, tshwj xeeb tshaj yog hais txog RAM. Ib me ntsis tom qab, kuv txawm upgraded mus rau 16 GB ECC nrog ib tug loj buffer loj thiab nce kev tiv thaiv cov ntaub ntawv.

Xaiv hard drives

Tam sim no peb muaj kev ua haujlwm zoo heev thiab txhua yam uas tseem tshuav yog xaiv hard drives rau nws. Pom tseeb, rau qhov $ 75 kuv tsuas yog tau txais tus neeg rau zaub mov xwb tsis muaj HDD, uas tsis ua rau kuv xav tsis thoob.

Tom qab ua kev tshawb fawb me ntsis, kuv pom tias WD Red HDDs zoo tshaj plaws rau kev khiav NAS systems 24/7. Txhawm rau yuav lawv, kuv tig mus rau Amazon, qhov twg kuv yuav 4 daim ntawv luam ntawm 3 TB txhua. Yeej, koj tuaj yeem txuas txhua HDD koj nyiam, tab sis nco ntsoov tias lawv yog tib lub peev xwm thiab ceev. Qhov no yuav pab koj kom tsis txhob muaj teeb meem RAID ua haujlwm tau ntev.

Kev teeb tsa

Kuv xav tias ntau tus yuav siv qhov system rau lawv cov NAS tsim FreeNAS, thiab tsis muaj dab tsi txhaum nrog qhov ntawd. Txawm li cas los xij, txawm tias muaj peev xwm txhim kho cov kab ke no ntawm kuv lub server, kuv nyiam siv CentOS, txij li ZFS ntawm Linux system tau pib npaj rau qhov chaw tsim khoom, thiab feem ntau, kev tswj hwm Linux server tau paub ntau dua rau kuv. Dhau li ntawd, kuv tsis txaus siab rau qhov zoo nkauj interface thiab cov yam ntxwv muab los ntawm FreeNAS - RAIDZ array thiab AFP sib koom tau txaus rau kuv.

Txhim kho CentOS ntawm USB yog qhov yooj yim heev - tsuas yog qhia USB raws li qhov chaw khau raj, thiab thaum pib lub installation wizard yuav coj koj mus rau tag nrho nws cov theem.

RAID tsim

Tom qab ua tiav kev txhim kho CentOS, Kuv kuj tau teeb tsa ZFS ntawm Linux raws li tau teev tseg cov kauj ruam ntawm no.

Thaum cov txheej txheem no tiav lawm, kuv thauj ZFS Kernel module:

$ sudo modprobe zfs

Thiab tsim RAIDZ1 array siv cov lus txib zpool:

$ sudo zpool create data raidz1 ata-WDC_WD30EFRX-68AX9N0_WD-WMC1T0609145 ata-WDC_WD30EFRX-68AX9N0_WD-WMC1T0609146 ata-WDC_WD30EFRX-68AX9N0_WD-WMC1T0609147 ata-WDC_WD30EFRX-68AX9N0_WD-WMC1T0609148
$ sudo zpool add data log ata-SanDisk_Ultra_II_240GB_174204A06001-part5
$ sudo zpool add data cache ata-SanDisk_Ultra_II_240GB_174204A06001-part6

Thov nco ntsoov tias ntawm no kuv tab tom siv IDs ntawm lub hard drive es tsis txhob ntawm lawv cov npe (sdx) kom txo tau txoj hauv kev uas lawv tsis tuaj yeem txuas tom qab khau raj vim muaj tsab ntawv hloov.

Kuv kuj tau ntxiv ZIL thiab L2ARC cache khiav ntawm ib qho SSD cais, faib qhov SSD ua ob ntu: 5GB rau ZIL thiab tus so rau L2ARC.

Raws li rau RAIDZ1, nws tuaj yeem tiv taus 1 disk tsis ua haujlwm. Ntau tus sib cav tias qhov kev xaiv pas dej no yuav tsum tsis txhob siv vim qhov tshwm sim ntawm qhov thib ob disk tsis ua haujlwm thaum lub sijhawm RAID rov tsim kho, uas tuaj yeem ua rau cov ntaub ntawv poob. Kuv tsis quav ntsej cov lus pom zoo no, txij li kuv niaj hnub ua cov ntawv luam theej ntawm cov ntaub ntawv tseem ceeb ntawm lub chaw taws teeb, thiab qhov tsis ua tiav ntawm txawm tias tag nrho cov array tsuas tuaj yeem cuam tshuam rau cov ntaub ntawv muaj, tab sis tsis yog nws txoj kev nyab xeeb. Yog tias koj tsis muaj peev xwm ua thaub qab, ces nws yuav zoo dua los siv cov kev daws teeb meem zoo li RAIDZ2 lossis RAID10.

Koj tuaj yeem txheeb xyuas tau tias lub pas dej tsim tau ua tiav los ntawm kev khiav:

$ sudo zpool status

ΠΈ

$ sudo zfs list
NAME                               USED  AVAIL  REFER  MOUNTPOINT
data                               510G  7.16T   140K  /mnt/data

Los ntawm lub neej ntawd, ZFS mounts lub pas dej tshiab tsim ncaj qha rau /, uas yog feem ntau undesirable. Koj tuaj yeem hloov qhov no los ntawm kev khiav:

zfs set mountpoint=/mnt/data data

Ntawm no koj tuaj yeem xaiv los tsim ib lossis ntau cov ntaub ntawv khaws cia cov ntaub ntawv. Kuv tsim ob, ib qho rau Time Machine backup thiab ib qho rau kev sib koom ua ntaub ntawv cia. Kuv txwv qhov loj ntawm Lub Sijhawm Tshuab dataset rau quota ntawm 512 GB los tiv thaiv nws txoj kev loj hlob tsis kawg.

Optimization

zfs set compression=on data

Cov lus txib no ua rau ZFS compression txhawb nqa. Compression siv lub zog CPU tsawg, tab sis tuaj yeem txhim kho I / O throughput, yog li ib txwm pom zoo.

zfs set relatime=on data

Nrog rau cov lus txib no peb txo tus naj npawb ntawm cov hloov tshiab rau atimetxo IOPS tiam thaum nkag mus rau cov ntaub ntawv.

Los ntawm lub neej ntawd, ZFS ntawm Linux siv 50% ntawm lub cev nco rau ARC. Hauv kuv qhov xwm txheej, thaum tag nrho cov ntaub ntawv me me, qhov no tuaj yeem ruaj ntseg nce mus rau 90% vim tias tsis muaj lwm daim ntawv thov yuav khiav ntawm lub server.

$ cat /etc/modprobe.d/zfs.conf 
options zfs zfs_arc_max=14378074112

Tom qab ntawd siv arc_summary.py Koj tuaj yeem txheeb xyuas tau tias cov kev hloov pauv tau siv:

$ python arc_summary.py
...
ARC Size:				100.05%	11.55	GiB
	Target Size: (Adaptive)		100.00%	11.54	GiB
	Min Size (Hard Limit):		0.27%	32.00	MiB
	Max Size (High Water):		369:1	11.54	GiB
...

Teeb tsa cov haujlwm uas tshwm sim

kuv siv systemd-zpool-scrub los teeb tsa systemd timers los ua kev ntxuav ib zaug ib lub lim tiam thiab zfs-auto-snapshot kom tau txais kev tsim snapshots txhua 15 feeb, 1 teev thiab 1 hnub.

Txhim kho Netatalk

nettalk yog qhov qhib qhov kev siv ntawm AFP (Apple Fileing Protocol). Ua raws official installation cov lus qhia rau CentOS, Kuv tau txais ib qho kev sib sau ua ke thiab nruab RPM pob hauv ob peb feeb xwb.

Kev teeb tsa

$ cat /etc/netatalk/afp.conf
[datong@Titan ~]$ cat /etc/netatalk/afp.conf 
;
; Netatalk 3.x configuration file
;

[Global]
; Global server settings
mimic model = TimeCapsule6,106

; [Homes]
; basedir regex = /home

; [My AFP Volume]
; path = /path/to/volume

; [My Time Machine Volume]
; path = /path/to/backup
; time machine = yes

[Datong's Files]
path = /mnt/data/datong
valid users = datong

[Datong's Time Machine Backups]
path = /mnt/data/datong_time_machine_backups
time machine = yes
valid users = datong

nco ntsoov tias vol dbnest yog ib qho kev txhim kho loj hauv kuv rooj plaub, txij li lub neej ntawd Netatalk sau CNID database rau hauv paus ntawm cov ntaub ntawv, uas tsis yog qhov xav tau txij li kuv lub ntsiab filesystem khiav ntawm USB thiab yog li ntawd kuj qeeb. Tig rau vol dbnest tshwm sim hauv kev txuag cov ntaub ntawv hauv Volume hauv paus, uas nyob rau hauv cov ntaub ntawv no belongs rau ZFS pas dej ua ke thiab twb yog ib qho kev txiav txim ntawm magnitude ntau tsim.

Enabling ports hauv Firewall

$ sudo firewall-cmd --permanent --zone=public --add-service=mdns
$ sudo firewall-cmd --permanent --zone=public --add-port=afpovertcp/tcp

sudo firewall-cmd --permanent --zone=public --add-port=afpovertcp/tcp
Yog tias txhua yam raug teeb tsa kom raug, koj lub tshuab yuav tsum tshwm sim hauv Finder, thiab Lub Sijhawm Tshuab yuav tsum ua haujlwm ib yam nkaus.

Cov chaw ntxiv
SMART saib xyuas

Nws raug nquahu kom saib xyuas cov xwm txheej ntawm koj cov disks txhawm rau tiv thaiv disk tsis ua haujlwm.

$ sudo yum install smartmontools
$ sudo systemctl start smartd

Daemon rau UPS

Saib xyuas tus nqi ntawm APC UPS thiab tua lub kaw lus thaum tus nqi qis qis.

$ sudo yum install epel-release
$ sudo yum install apcupsd
$ sudo systemctl enable apcupsd

Kho vajtse upgrade

Ib lub lim tiam tom qab teeb tsa lub kaw lus, kuv tau pib txhawj xeeb txog cov neeg rau zaub mov tsis yog ECC lub cim xeeb. Tsis tas li ntawd, nyob rau hauv cov ntaub ntawv ntawm ZFS, lub cim xeeb ntxiv rau buffering yuav pab tau heev. Yog li kuv rov qab mus rau Amazon qhov twg kuv yuav 2x Kingston DDR3 8GB ECC RAM rau $ 80 txhua thiab hloov lub desktop RAM ntsia los ntawm tus tswv yav dhau los. Lub kaw lus booted thawj zaug tsis muaj teeb meem, thiab kuv tau ua kom paub tseeb tias ECC txhawb nqa tau qhib:

$ dmesg | grep ECC
[   10.492367] EDAC amd64: DRAM ECC enabled.

tshwm sim

Kuv txaus siab heev rau qhov tshwm sim. Tam sim no kuv tuaj yeem ua kom tus neeg rau zaub mov 1Gbps LAN txuas tsis tu ncua los ntawm kev luam cov ntaub ntawv, thiab Lub Sijhawm Tshuab ua haujlwm tsis muaj qhov tsis zoo. Yog li, tag nrho, kuv zoo siab nrog kev teeb tsa.

Tus nqi tag nrho:

  1. 1 * HP ProLiant N40L = $75
  2. 2 * 8 GB ECC RAM = $ 174
  3. 4 * WD Red 3 TB HDD = $440

Tag nrho = $ 689

Tam sim no kuv tuaj yeem hais tias tus nqi tsim nyog.

Koj puas ua koj tus kheej NAS servers?

Tsim lub tsev pheej yig NAS system ntawm Linux

Tsim lub tsev pheej yig NAS system ntawm Linux

Tau qhov twg los: www.hab.com

Ntxiv ib saib