Hloov tshiab!. Nyob rau hauv cov lus, ib tug ntawm cov nyeem tau hais kom sim (tej zaum nws tab tom ua haujlwm rau nws tus kheej) yog li kuv tau ntxiv ib ntu txog qhov kev daws teeb meem no. kuv kuj sau , vim hais tias cov txheej txheem txawv heev ntawm tus so.
Ua ncaj ncees, kuv tso tseg thiab tso tseg (tsawg kawg rau tam sim no). Kuv yuav siv . Vim li cas? Vim yog khaws cia! Leej twg yuav tau xav tias kuv yuav tinker ntau nrog cia dua li Kubernetes nws tus kheej. kuv siv vim nws pheej yig thiab kev ua tau zoo thiab txij li thaum pib kuv tau siv cov pawg siv . Kuv tsis tau sim tswj Kubernetes cov kev pabcuam los ntawm Google/Amazon/Microsoft/DigitalOcean, thiab lwm yam, vim kuv xav kawm txhua yam ntawm kuv tus kheej. Kuv kuj yog frugal.
Yog li yog, kuv tau siv sijhawm ntau los txiav txim siab seb qhov chaw khaws cia xaiv thaum kuv tab tom ntsuas qhov ua tau Kubernetes pawg. Kuv nyiam qhib qhov kev daws teeb meem, tsis yog vim tus nqi xwb, tab sis kuv tau saib ob peb txoj kev them nyiaj tawm ntawm kev xav paub vim tias lawv muaj cov dawb versions nrog kev txwv. Kuv tau sau qee tus lej los ntawm kev xeem tsis ntev los no thaum kuv piv cov kev xaiv sib txawv, thiab lawv yuav txaus siab rau cov kev kawm txog Kubernetes cia. Txawm hais tias kuv tus kheej tau hais lus zoo rau Kubernetes rau tam sim no. Kuv kuj xav hais , uas tuaj yeem muab ncaj qha rau Hetzner Cloud ntim, tab sis kuv tseem tsis tau sim nws. Kuv ntsia mus rau hauv huab software-txhais cia vim tias kuv xav tau kev rov ua dua thiab muaj peev xwm ua kom nrawm nrawm nrawm ntawm txhua lub node, tshwj xeeb tshaj yog nyob rau hauv cov ntaub ntawv ntawm qhov tsis ua haujlwm thiab lwm yam xwm txheej zoo sib xws. Qee qhov kev daws teeb meem muab cov ntsiab lus hauv lub sijhawm snapshots thiab off-site backups, uas yog yooj yim.
Kuv sim 6-7 kev daws teeb meem cia:
Li kuv twb hais lawm Tau sim feem ntau ntawm cov kev xaiv los ntawm cov npe, Kuv pib tau teeb tsa ntawm OpenEBS. OpenEBS yog ib qho yooj yim rau nruab thiab siv, tab sis kom ua siab ncaj, tom qab kev sim nrog cov ntaub ntawv tiag tiag hauv kev thauj khoom, kuv poob siab rau nws qhov kev ua tau zoo. Qhov no yog qhov qhib, thiab cov neeg tsim khoom yog nyob ntawm lawv tus kheej ib txwm pab tau heev thaum kuv xav tau kev pab. Hmoov tsis zoo, nws muaj kev ua haujlwm tsis zoo piv rau lwm cov kev xaiv, yog li cov kev ntsuam xyuas yuav tsum tau rov ua dua. OpenEBS tam sim no muaj 3 lub tshuab cia, tab sis kuv tab tom tshaj tawm cov txiaj ntsig ntawm cStor. Kuv tsis muaj tus lej rau Jiva thiab LocalPV tseem.
Hauv kev txiav txim siab, Jiva yog me ntsis sai dua, thiab LocalPV feem ntau nrawm, tsis muaj qhov phem dua li qhov ntsuas disk ncaj qha. Qhov teeb meem nrog LocalPV yog qhov ntim tsuas yog nkag mus rau ntawm qhov chaw uas nws tau npaj, thiab tsis muaj qhov rov ua dua tshiab. Kuv muaj qee qhov teeb meem rov qab kho qhov thaub qab ntawm ntawm ib pawg tshiab vim cov npe ntawm node txawv. Yog tias peb tham txog kev thaub qab, cStor muaj , uas koj tuaj yeem ua rau off-site backups ntawm snapshots ntawm lub sijhawm, uas yooj yim dua li cov ntaub ntawv-theem thaub qab nrog Velero-Restic. kuv sau , kom nws yooj yim dua los tswj cov thaub qab thiab rov qab nrog cov plugin no. Zuag qhia tag nrho, Kuv nyiam OpenEBS, tab sis nws qhov kev ua tau zoo ...
Rook kuj tseem qhib qhov chaw thiab txawv ntawm qhov seem ntawm cov kev xaiv ntawm daim ntawv teev npe nyob rau hauv uas nws yog lub chaw cia khoom uas ua haujlwm tswj kev tswj xyuas nyuaj nrog cov backends sib txawv, piv txwv li. , thiab lwm yam, uas yooj yim heev rau kev ua haujlwm. Kuv muaj teeb meem nrog EfgeFS thaum kuv sim nws ob peb lub hlis dhau los, yog li kuv tau sim nrog Ceph. Ceph tsis tsuas yog muab cov khoom thaiv cia, tab sis tseem muaj cov khoom khaws cia sib xws nrog S3 / Swift thiab faib cov ntaub ntawv. Qhov kuv nyiam txog Ceph yog lub peev xwm nthuav tawm cov ntaub ntawv ntim thoob plaws ntau lub disk kom lub ntim tuaj yeem siv ntau qhov chaw disk dua li tuaj yeem haum rau ntawm ib qho disk. Nws yooj yim. Lwm qhov tshwj xeeb tshaj yog thaum koj ntxiv cov disks rau ib pawg, nws cia li rov faib cov ntaub ntawv hla tag nrho cov disks.
Ceph muaj snapshots, tab sis raws li kuv paub, lawv tsis tuaj yeem siv ncaj qha rau hauv Rook/Kubernetes. Muaj tseeb, kuv tsis tau nkag mus tob rau hauv qhov no. Tab sis tsis muaj cov thaub qab tawm ntawm qhov chaw, yog li koj yuav tsum tau siv qee yam nrog Velero / Restic, tab sis tsuas muaj cov ntaub ntawv-theem thaub qab, tsis yog qhov taw tes-hauv-lub sijhawm snapshots. Qhov kuv nyiam heev txog Rook yog nws yooj yim npaum li cas los ua haujlwm nrog Ceph - nws zais yuav luag txhua yam khoom nyuaj thiab muab cov cuab yeej los tham nrog Ceph ncaj qha rau kev daws teeb meem. Hmoov tsis zoo, thaum lub sij hawm ntsuas kev ntxhov siab ntawm Ceph ntim, kuv pheej muaj teeb meem nrog , uas ua rau Ceph tsis ruaj khov. Nws tseem tsis tau paub meej tias qhov no yog kab laum hauv Ceph nws tus kheej lossis teeb meem ntawm txoj kev Rook tswj Ceph. Kuv tinkered nrog lub cim xeeb nqis, thiab nws tau zoo dua, tab sis qhov teeb meem tsis tau daws tag nrho. Ceph muaj kev ua tau zoo, raws li koj tuaj yeem pom hauv cov qauv hauv qab no. Nws tseem muaj lub dashboard zoo.
Kuv nyiam Longhorn. Hauv kuv lub tswv yim, qhov no yog ib qho kev cog lus daws teeb meem. Muaj tseeb, cov neeg tsim khoom lawv tus kheej (Rancher Labs) lees tias nws tseem tsis tau tsim nyog rau qhov chaw ua haujlwm, thiab qhov no qhia tau hais tias. Nws yog qhov qhib thiab muaj kev ua tau zoo (txawm tias lawv tseem tsis tau ua kom zoo dua), tab sis cov ntim siv sijhawm ntev heev los txuas rau lub plhaub taum pauv, thiab qhov phem tshaj plaws nws yuav siv sijhawm 15-16 feeb, tshwj xeeb tshaj yog tom qab rov kho qhov thaub qab loj lossis txhim kho cov haujlwm ua haujlwm. Nws muaj snapshots thiab off-site backups ntawm cov snapshots, tab sis lawv tsuas yog siv rau ntim, yog li koj tseem yuav xav tau ib yam dab tsi zoo li Velero rau backup lwm yam kev pab. Backups thiab restores yog heev txhim khu kev qha, tab sis indecently qeeb. Tiag tiag, cia li incredibly qeeb. Kev siv CPU thiab lub cev thauj khoom feem ntau nce siab thaum ua haujlwm nrog tus nqi nruab nrab ntawm cov ntaub ntawv hauv Longhorn. Muaj lub dashboard yooj yim los tswj Longhorn. Kuv twb tau hais tias kuv nyiam Longhorn, tab sis nws xav tau qee yam haujlwm.
StorageOS yog thawj cov khoom them nqi ntawm cov npe. Nws muaj tus tsim tawm version nrog qhov txwv tswj qhov loj me ntawm 500GB, tab sis kuv tsis xav tias muaj qhov txwv ntawm cov nodes. Lub chaw muag khoom tau hais rau kuv tias tus nqi pib ntawm $ 125 ib hlis rau 1 TB, yog tias kuv nco tau raug. Muaj ib qho yooj yim dashboard thiab ib qho yooj yim CLI, tab sis ib yam dab tsi coj txawv txawv mus nrog qhov kev ua tau zoo: nyob rau hauv ib co benchmarks nws yog heev dlej, tab sis nyob rau hauv lub ntim kev nyuaj siab xeem kuv tsis nyiam qhov ceev ntawm tag nrho cov. Feem ntau, kuv tsis paub yuav hais li cas. Yog li kuv tsis nkag siab ntau. Tsis muaj qhov chaw thaub qab ntawm no thiab koj tseem yuav tau siv Velero nrog Restic rau cov ntaub ntawv thaub qab. Nws yog qhov txawv, vim tias cov khoom raug them. Thiab cov neeg tsim khoom tsis txaus siab los sib txuas lus ntawm Slack.
Kuv tau kawm txog Robin ntawm Reddit los ntawm lawv tus thawj coj ua haujlwm. Kuv yeej tsis tau hnov ββtxog nws ua ntej. Tej zaum vim kuv tab tom nrhiav kev daws teeb meem dawb, tab sis Robin tau them. Lawv muaj qhov zoo nkauj dawb dawb version nrog 10TB ntawm kev cia thiab peb cov nodes. Zuag qhia tag nrho, cov khoom yog heev dlej thiab muaj zoo nta. Muaj CLI zoo, tab sis qhov txias tshaj plaws yog tias koj tuaj yeem snapshot thiab thaub qab tag nrho daim ntawv thov (hauv cov khoom siv qhov no hu ua Helm tso tawm lossis "flex apps"), suav nrog ntim thiab lwm yam kev pabcuam, yog li koj tuaj yeem ua yam tsis muaj Velero. Thiab txhua yam yuav zoo heev yog tias tsis yog rau ib qho me me: yog tias koj rov qab los (lossis "ntshuam", raws li nws hu ua Robin) ib daim ntawv thov ntawm pawg tshiab - piv txwv li, thaum rov qab los ntawm kev puas tsuaj - kev kho dua tshiab, tau kawg, ua haujlwm, tab sis txuas ntxiv rov qab daim ntawv thov nws yog txwv tsis pub. Qhov no tsuas yog tsis tuaj yeem ua tau hauv qhov kev tso tawm no, raws li cov neeg tsim khoom tau lees paub. Qhov no yog, muab tso rau nws me me, coj txawv txawv, tshwj xeeb tshaj yog xav txog lwm yam zoo (piv txwv li, ceev heev backups thiab restores). Cov neeg tsim khoom cog lus tias yuav kho txhua yam los ntawm kev tso tawm tom ntej. Kev ua tau zoo feem ntau yog qhov zoo, tab sis kuv pom qhov tsis txaus ntseeg: yog tias kuv khiav qhov ntsuas ncaj qha ntawm lub ntim txuas nrog tus tswv tsev, qhov kev nyeem ntawv nrawm nrawm dua li khiav tib lub ntim los ntawm hauv lub plhaub. Tag nrho lwm cov txiaj ntsig zoo ib yam, tab sis hauv txoj kev xav yuav tsum tsis muaj qhov sib txawv. Txawm hais tias lawv tab tom ua haujlwm rau nws, kuv chim siab txog qhov teeb meem nrog rov qab thiab thaub qab - Kuv xav tias thaum kawg kuv tau pom cov kev daws teeb meem tsim nyog, thiab kuv tseem kam them rau nws thaum kuv xav tau ntau qhov chaw lossis ntau lub servers.
Kuv tsis muaj lus hais ntau ntawm no. Qhov no yog cov khoom them nyiaj, sib npaug txias thiab kim. Qhov kev ua tau zoo tsuas yog amazing. Qhov no yog qhov qhia tau zoo tshaj plaws kom deb li deb. Slack tau hais rau kuv tias tus nqi pib ntawm $ 205 toj ib hlis ib ntawm, raws li tau teev tseg hauv Google's GKE Marketplace. Kuv tsis paub tias nws yuav pheej yig dua yog tias koj yuav ncaj qha. Kuv tsis muaj peev xwm them taus qhov ntawd, yog li kuv poob siab heev uas daim ntawv tso cai tsim tawm (txog 1 TB thiab 3 ntawm) yog qhov siv tsis tau nrog Kubernetes tshwj tsis yog tias koj txaus siab nrog kev muab zoo li qub. Kuv tau cia siab tias daim ntawv tso cai ntim yuav cia li txo qis rau tus tsim tawm thaum kawg ntawm lub sijhawm sim, tab sis qhov ntawd tsis tshwm sim. Daim ntawv tso cai tsim tawm tsuas yog siv ncaj qha nrog Docker, thiab kev teeb tsa hauv Kubernetes yog qhov nyuaj heev thiab txwv. Tau kawg, kuv nyiam qhov qhib, tab sis yog tias kuv muaj nyiaj, kuv yuav xaiv Portworx. Txog tam sim no, nws qhov kev ua tau zoo tsuas yog tsis piv rau lwm qhov kev xaiv.
Kuv ntxiv tshooj no tom qab tshaj tawm cov ntawv tshaj tawm, thaum ib tus neeg nyeem tau hais kom sim Linstor. Kuv sim nws thiab kuv nyiam nws! Tab sis peb tseem yuav tsum tau khawb tob. Tam sim no kuv tuaj yeem hais tias qhov kev ua tau zoo tsis yog qhov phem (Kuv ntxiv cov txiaj ntsig hauv qab no). Qhov tseem ceeb, kuv tau txais kev ua tau zoo ib yam li lub disk ncaj qha, tsis muaj nyiaj siv ua haujlwm. (Tsis txhob nug yog vim li cas Portworx muaj cov lej zoo dua li tus qauv tsav ncaj qha. Kuv tsis muaj lub tswv yim. Khawv koob, kuv twv.) Yog li Linstor zoo li muaj txiaj ntsig zoo txog tam sim no. Nws tsis yooj yim rau nruab, tab sis nws tsis yooj yim li lwm yam kev xaiv. Ua ntej kuv yuav tsum tau nruab Linstor (kernel module thiab cov cuab yeej / cov kev pabcuam) thiab teeb tsa LVM rau nyias muab thiab snapshot txhawb sab nraum Kubernetes, ncaj qha rau tus tswv tsev, thiab tom qab ntawd tsim cov peev txheej uas xav tau los siv khaws cia los ntawm Kubernetes. Kuv tsis nyiam tias nws tsis ua haujlwm ntawm CentOS thiab kuv yuav tsum siv Ubuntu. Tsis txaus ntshai, tau kawg, tab sis me ntsis kev ntxhov siab, vim tias cov ntaub ntawv (uas yog qhov zoo heev, los ntawm txoj kev) hais txog ob peb pob khoom uas tsis tuaj yeem pom hauv Epel repositories. Linstor muaj snapshots, tab sis tsis yog off-site backups, yog li ntawm no dua kuv yuav tsum tau siv Velero nrog Restic rau backup ntim. Kuv xav tau snapshots es tsis txhob ntawm cov ntaub ntawv-theem thaub qab, tab sis qhov no tuaj yeem zam tau yog tias cov tshuaj ua tau zoo thiab txhim khu kev qha. Linstor yog qhov qhib tab sis tau them nyiaj yug. Yog tias kuv nkag siab raug, nws tuaj yeem siv tau yam tsis muaj kev txwv, txawm tias koj tsis muaj daim ntawv cog lus txhawb nqa, tab sis qhov no yuav tsum tau qhia meej. Kuv tsis paub yuav ua li cas kuaj Linstor rau Kubernetes, tab sis cov txheej txheem cia nws tus kheej yog sab nraum Kubernetes thiab, pom tau tias, qhov kev daws teeb meem tsis tshwm sim nag hmo, yog li nws twb tau sim nyob rau hauv cov xwm txheej tiag tiag. Puas muaj kev daws teeb meem ntawm no uas yuav ua rau kuv hloov kuv lub siab thiab rov qab mus rau Kubernetes? kuv tsis paub. Peb tseem yuav tsum tau khawb tob thiab kawm txog kev rov ua dua tshiab. Cia peb saib. Tab sis thawj qhov kev xav yog qhov zoo. Kuv yeej xav siv kuv tus kheej Kubernetes pawg tsis yog Heroku kom muaj kev ywj pheej ntau dua thiab kawm yam tshiab. Txij li Linstor tsis yooj yim rau nruab ib yam li lwm tus, kuv yuav sau ib tsab xov xwm txog nws sai sai.
Benchmarks
Hmoov tsis zoo, kuv tsis tau khaws ntau cov ntawv hais txog qhov sib piv vim kuv tsis xav tias kuv yuav sau txog nws. Kuv tsuas yog muaj cov txiaj ntsig los ntawm cov txiaj ntsig fio yooj yim thiab tsuas yog rau ib leeg ntawm pawg, yog li kuv tsis muaj tus lej rau kev teeb tsa rov ua dua. Tab sis los ntawm cov txiaj ntsig no koj tuaj yeem tau txais lub tswv yim ntxhib ntawm qhov yuav xav tau los ntawm txhua qhov kev xaiv, vim tias kuv muab piv rau lawv ntawm tib huab servers, 4 cores, 16 GB ntawm RAM, nrog rau 100 GB ntxiv disk rau cov ntim kuaj. Kuv tau khiav cov qauv ntsuas peb zaug rau txhua qhov kev daws teeb meem thiab suav qhov txiaj ntsig nruab nrab, ntxiv rau kuv rov pib qhov chaw rau server rau txhua yam khoom. Qhov no yog tag nrho unscientific kiag li, tsuas yog muab rau koj ib tug dav lub tswv yim. Hauv lwm qhov kev sim, kuv tau theej 38 GB ntawm cov duab thiab cov yeeb yaj kiab los ntawm lub ntim los sim nyeem thiab sau ntawv, tab sis, alas, kuv tsis tau khaws cov lej. Hauv luv: Portworkx tau nrawm dua.
Rau qhov ntsuas ntsuas qhov ntim kuv siv qhov manifest:
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: dbench
spec:
storageClassName: ...
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 5Gi
---
apiVersion: batch/v1
kind: Job
metadata:
name: dbench
spec:
template:
spec:
containers:
- name: dbench
image: sotoaster/dbench:latest
imagePullPolicy: IfNotPresent
env:
- name: DBENCH_MOUNTPOINT
value: /data
- name: FIO_SIZE
value: 1G
volumeMounts:
- name: dbench-pv
mountPath: /data
restartPolicy: Never
volumes:
- name: dbench-pv
persistentVolumeClaim:
claimName: dbench
backoffLimit: 4Kuv thawj zaug tsim ib lub ntim nrog cov chav kawm cia tsim nyog thiab tom qab ntawd khiav txoj haujlwm nrog fio qab ntawm qhov chaw. Kuv coj 1 GB los kwv yees qhov kev ua tau zoo thiab tsis tos ntev. Nov yog cov txiaj ntsig:
Kuv tau hais txog tus nqi zoo tshaj plaws rau txhua qhov metric hauv ntsuab thiab qhov phem tshaj hauv liab.
xaus
Raws li koj tuaj yeem pom, feem ntau Portworx ua tau zoo dua li lwm tus. Tab sis rau kuv nws yog kim. Kuv tsis paub ntau npaum li cas Robin tus nqi, tab sis lawv muaj qhov zoo tshaj plaws dawb version, yog li yog tias koj xav tau cov khoom them nyiaj, koj tuaj yeem sim nws (cia siab tias lawv kho qhov teeb meem nrog rov qab thiab thaub qab sai sai). Ntawm peb qhov pub dawb, Kuv muaj teeb meem tsawg kawg nrog OpenEBS, tab sis nws qhov kev ua tau zoo yog qhov tsis txaus ntseeg. Nws yog kev khuv leej kuv tsis tau txuag tau ntau dua, tab sis kuv vam tias cov lej thiab kuv cov lus yuav pab tau koj.
Tau qhov twg los: www.hab.com