Buyekeza!. Kumazwana, omunye wabafundi uphakamise ukuzama (mhlawumbe uzisebenzela ngokwakhe) ngakho-ke ngengeze isigaba mayelana nalesi sixazululo. Ngabhala futhi , ngoba inqubo ihluke kakhulu kwabanye.
Uma ngikhuluma iqiniso, ngadela futhi ngadela (okungenani okwamanje). Ngizosebenzisa . Kungani? Ngenxa yesitoreji! Ubani obengacabanga ukuthi ngizokhexa kakhulu ngesitoreji kuneKubernetes uqobo. Ngiyasebenzisa ngoba ayibizi futhi ukusebenza kuhle futhi kusukela ekuqaleni bengilokhu ngithumela amaqoqo ngisebenzisa . Angizange ngizame izinsiza eziphethwe ze-Kubernetes ezivela ku-Google/Amazon/Microsoft/DigitalOcean, njll., njll., ngoba bengifuna ukufunda yonke into mina. Ngiyawonga.
Ngakho-ke yebo, ngichithe isikhathi esiningi ngizama ukunquma ukuthi yisiphi isitoreji engingasikhetha ngenkathi ngihlola isitaki se-Kubernetes esingaba khona. Ngikhetha izixazululo zomthombo ovulekile, hhayi nje ngenxa yentengo, kodwa ngibheke izinketho ezimbalwa ezikhokhelwayo ngenxa yelukuluku ngoba zinezinguqulo zamahhala ezinemikhawulo. Ngibhale phansi ezinye izinombolo ezivivinyweni zakamuva lapho ngiqhathanisa izinketho ezihlukile, futhi zingathakazelisa kulabo abafunda ngesitoreji se-Kubernetes. Nakuba mina ngokwami ngivalelise kuKubernetes okwamanje. Nami ngifuna ukubalula , engahlinzeka ngokuqondile ngamavolumu e-Hetzner Cloud, kodwa angikakayizami okwamanje. Ngibheke kwisitoreji esichazwe yisoftware yamafu ngoba bengidinga ukuphindaphinda kanye nekhono lokukhweza ngokushesha amavolumu aqhubekayo kunoma iyiphi indawo, ikakhulukazi uma kwenzeka kuba nokwehluleka kwamanodi nezinye izimo ezifanayo. Ezinye izixazululo zinikeza izifinyezo ze-point-in-time nama-backups angekho kusayithi, okuyinto elula.
Ngihlole izixazululo zesitoreji esingu-6-7:
Njengoba sengishilo Ngemva kokuhlola izinketho eziningi ohlwini, ngiqale ngahlala ku-OpenEBS. I-OpenEBS ilula kakhulu ukuyifaka nokusebenzisa, kodwa ukwethembeka, ngemva kokuhlola ngedatha yangempela ngaphansi komthwalo, ngangidumazekile ngokusebenza kwayo. Lona umthombo ovulekile, futhi abathuthukisi babodwa njalo ngisiza kakhulu lapho ngidinga usizo. Ngeshwa, inokusebenza okungekuhle kakhulu uma kuqhathaniswa nezinye izinketho, ngakho-ke ukuhlolwa bekufanele kuqalwe kabusha. I-OpenEBS njengamanje inezinjini zokugcina ezi-3, kodwa ngithumela imiphumela ye-benchmark ye-cStor. Anginazo izinombolo ze-Jiva ne-LocalPV okwamanje.
Ngamafuphi, i-Jiva iyashesha kancane, futhi i-LocalPV ngokuvamile iyashesha, ayimbi kakhulu kune-benchmark yediski ngokuqondile. Inkinga nge-LocalPV ukuthi ivolumu ingafinyelelwa kuphela endaweni lapho ilungiswe khona, futhi akukho ukuphindaphinda nhlobo. Ngibe nezinkinga zokubuyisela isipele nge kwiqoqo elisha ngoba amagama e-node ayehlukile. Uma sikhuluma ngama-backups, i-cStor ine , lapho ungenza khona izipele ezitholakala ngaphandle kwesayithi ngesikhathi esithile, okulula kakhulu kunezipele ezisezingeni lefayela nge-Velero-Restic. Ngibhalile , ukwenza kube lula ukuphatha izipele nokubuyisela ngale plugin. Sekukonke, ngithanda i-OpenEBS, kepha ukusebenza kwayo ...
I-Rook iphinde ibe umthombo ovulekile futhi ihluke kuzo zonke ezinye izinketho ohlwini ngoba iyi-orchestrator yokugcina eyenza imisebenzi eyinkimbinkimbi yokuphatha isitoreji nge-backends ehlukene, isb. , nezinye, okwenza umsebenzi ube lula kakhulu. Ngibe nezinkinga nge-EfgeFS lapho ngizama ezinyangeni ezimbalwa ezedlule, ngakho ngavivinya ikakhulukazi nge-Ceph. I-Ceph ayinikezi kuphela isitoreji se-block, kodwa futhi isitoreji sezinto esihambisana ne-S3/Swift kanye nesistimu yefayela esabalalisiwe. Engikuthandayo nge-Ceph yikhono lokusabalalisa idatha yevolumu kuwo wonke amadiski amaningi ukuze ivolumu isebenzise isikhala sediski esiningi kunalokho esingangena kudiski eyodwa. Ikhululekile. Esinye isici esihle ukuthi uma ungeza amadiski eqoqweni, iphinde isabalalise idatha kuwo wonke amadiski.
I-Ceph inezifinyezo, kodwa ngokwazi kwami, azikwazi ukusetshenziswa ngokuqondile ku-Rook/Kubernetes. Yiqiniso, angingenanga ngokujulile kulokhu. Kodwa awekho ama-backups angaphandle kwesayithi, ngakho-ke kuzodingeka usebenzise okuthile nge-Velero/Restic, kodwa kukhona ama-backups wezinga lefayela kuphela, hhayi izifinyezo ze-point-in-time. Engikuthanda kakhulu ngoRook ukuthi kulula kangakanani ukusebenza ne-Ceph - ifihla cishe zonke izinto eziyinkimbinkimbi futhi inikeza amathuluzi okukhuluma noCeph ngokuqondile ukuze kuxazululwe inkinga. Ngeshwa, ngesikhathi sokuhlolwa kokucindezeleka kwemiqulu ye-Ceph, ngangilokhu nginenkinga , okwenza uCeph angazinzi. Akukacaci ukuthi lesi yisiphazamisi kuCeph uqobo noma inkinga ngendlela uRook aphatha ngayo uCeph. Ngasebenzisa izilungiselelo zememori, futhi kwaba ngcono, kodwa inkinga ayizange ixazululwe ngokuphelele. I-Ceph inokusebenza okuhle, njengoba ubona kumabhentshimakhi angezansi. Iphinde ibe nedeshibhodi enhle.
Ngiyithanda kakhulu i-Longhorn. Ngokubona kwami, lesi yisixazululo esithembisayo. Yiqiniso, abathuthukisi ngokwabo (i-Rancher Labs) bayavuma ukuthi ayikafaneleki endaweni yokusebenza, futhi lokhu kubonisa. Ingumthombo ovulekile futhi inokusebenza okuhloniphekile (yize bengakayithuthukisi okwamanje), kodwa amavolumu athatha isikhathi eside kakhulu ukuxhuma ku-pod, futhi ezimweni ezimbi kakhulu kuthatha imizuzu engu-15-16, ikakhulukazi ngemva kokubuyisela isipele esikhulu noma ukuthuthukisa umsebenzi. Inezifinyezo kanye nezipele ezingekho kusayithi zalezi zifinyezo, kodwa zisebenza kuphela kumavolumu, ngakho-ke usazodinga into efana ne-Velero ukuze wenze ezinye izinsiza. Izipele nokubuyisela zithembeke kakhulu, kodwa kuhamba kancane. Ngokujulile, kuhamba kancane ngendlela emangalisayo. Ukusetshenziswa kwe-CPU nomthwalo wesistimu kuvame ukukhuphuka uma usebenza nenani elimaphakathi ledatha e-Longhorn. Kukhona ideshibhodi elula yokuphatha i-Longhorn. Sengike ngasho ukuthi ngiyayithanda iLonghorn, kodwa idinga umsebenzi othile.
I-StorageOS iwumkhiqizo wokuqala okhokhelwayo ohlwini. Inenguqulo yonjiniyela enosayizi olinganiselwe wesitoreji ophethwe ongu-500GB, kodwa angicabangi ukuthi kunomkhawulo enanini lamanodi. Umnyango wezokuthengisa wangitshela ukuthi izindleko ziqala ku-$125 ngenyanga nge-TB engu-1, uma ngikhumbula kahle. Kukhona ideshibhodi eyisisekelo kanye ne-CLI elula, kodwa kukhona okungajwayelekile okwenzekayo ngokusebenza: kwamanye amabhentshimakhi kuhloniphekile, kodwa ekuhlolweni kokucindezeleka kwevolumu angizange ngithande nhlobo isivinini. Ngokuvamile, angazi ukuthi ngithini. Ngakho angizange ngiqonde okuningi ngempela. Awekho ama-backups angekho kusayithi futhi kuzodingeka usebenzise i-Velero ene-Restic ukuze wenze ikhophi yasenqolobaneni. Kuyamangaza, ngoba umkhiqizo uyakhokhwa. Futhi abathuthukisi bebengazimisele ukuxhumana ku-Slack.
Ngifunde ngoRobin kuReddit kumqondisi wabo wezobuchwepheshe. Ngangingakaze ngizwe ngaye ngaphambili. Mhlawumbe ngoba bengifuna izixazululo zamahhala, kodwa uRobin uyakhokhelwa. Banenguqulo enhle yamahhala ene-10TB yokugcina kanye nama-node amathathu. Sekukonke, umkhiqizo uhloniphekile futhi unezici ezinhle. Kukhona i-CLI enhle, kodwa into ebanda kunazo zonke ukuthi ungakwazi ukuthwebula futhi wenze isipele lonke uhlelo lokusebenza (esikhethini sezinsiza lokhu kubizwa ngokuthi ukukhishwa kwe-Helm noma "izinhlelo zokusebenza eziguqukayo"), okuhlanganisa amavolumu nezinye izinsiza, ukuze ukwazi ukwenza ngaphandle kwe-Velero. Futhi konke kungaba kuhle uma kungenjalo ngemininingwane eyodwa encane: uma ubuyisela (noma "ukungenisa", njengoba kubizwa ngoRobin) uhlelo lokusebenza kuqoqo elisha - isibonelo, uma kwenzeka ukululama enhlekeleleni - ukubuyiselwa, Yebo, iyasebenza, kodwa qhubeka wenze isipele isicelo akuvunyelwe. Lokhu akwenzeki kulokhu kukhululwa, njengoba abathuthukisi beqinisekisile. Lokhu kungukuthi, ukukubeka kancane, okungajwayelekile, ikakhulukazi uma kucatshangelwa ezinye izinzuzo (isibonelo, ama-backups ashesha kakhulu nokubuyisela). Onjiniyela bathembisa ukulungisa yonke into ngokukhishwa okulandelayo. Ukusebenza ngokuvamile kuhle, kodwa ngiphawule okungavamile: uma ngisebenzisa ibhentshimakhi ngokuqondile kuvolumu enamathiselwe kumsingathi, isivinini sokufunda siyashesha kakhulu kunokusebenzisa ivolumu efanayo ngaphakathi kwe-pod. Yonke eminye imiphumela iyafana, kodwa ngokombono akufanele kube khona umehluko. Nakuba besebenza ngakho, ngangicasulwe inkinga yokubuyisela nokwenza isipele - ngacabanga ukuthi ekugcineni ngithole isisombululo esifanele, futhi ngangizimisele ngisho nokusikhokhela lapho ngidinga indawo eyengeziwe noma amaseva amaningi.
Akukho okuningi engingakusho lapha. Lona umkhiqizo okhokhelwayo, opholile ngokulinganayo futhi obizayo. Ukusebenza kumane kumangalisa. Lesi yinkomba engcono kakhulu kuze kube manje. USlack wangitshela ukuthi intengo iqala ku-$205 ngenyanga ngenodi ngayinye, njengoba kufakwe ohlwini lweMakethe ye-GKE yakwaGoogle. Angazi noma izobiza yini uma uthenga ngqo. Angikwazi ukukukhokhela lokho noma kunjalo, ngakho-ke ngiphoxeke kakhulu, kakhulu ukuthi ilayisense yonjiniyela (efika ku-1 TB kanye nama-node angu-3) ayinamsebenzi nge-Kubernetes ngaphandle kokuthi weneliseke ngokuhlinzekwa okumile. Benginethemba lokuthi ilayisensi yevolumu izokwehliselwa ngokuzenzakalelayo kunjiniyela ekupheleni kwesikhathi sesilingo, kodwa lokho akwenzekanga. Ilayisensi yonjiniyela ingasetshenziswa kuphela ngqo ne-Docker, futhi ukucushwa ku-Kubernetes kunzima kakhulu futhi kunomkhawulo. Yebo, ngikhetha umthombo ovulekile, kodwa ukube benginayo imali, bengizokhetha i-Portworx. Kuze kube manje, ukusebenza kwayo akuqhathanisi nezinye izinketho.
Ngingeze lesi sigaba ngemuva kokushicilelwa kweposi, lapho umfundi esikisela ukuzama i-Linstor. Ngiyizamile futhi ngiyithandile! Kodwa ngidinga ukwenza okunye ukumba. Okwamanje, ngingasho ukuthi ukusebenza kuhle kakhulu (ngingeze imiphumela yokulinganisa ngezansi). Eqinisweni, ngithole ukusebenza okufanayo nokwesilinganiso sediski esiqondile, ngaphandle kwezindleko. (Ungabuzi ukuthi kungani izinombolo ze-Portworx zingcono kunesilinganiso sediski esiqondile. Angazi. Umlingo, ngicabanga.) Ngakho-ke, i-Linstor ibonakala isebenza kahle kakhulu kuze kube manje. Ukuyibeka akunzima impela, kodwa akulula njengezinye izinketho. Okokuqala, kwadingeka ngifake i-Linstor (imodyuli ye-kernel namathuluzi/izinsizakalo) bese ngisetha i-LVM yokunikeza okuncane kanye nokusekelwa kwesithombe ngaphandle kwe-Kubernetes, ngqo ku-host, bese ngidala izinsiza ezidingekayo ukusebenzisa isitoreji esivela ku-Kubernetes. Angizange ngijabule ukuthi ayisebenzanga CentOS futhi kwadingeka ngisebenzise UbuntuAkuyona into enkulu, vele, kodwa kuyacasula kancane ngoba imibhalo (emihle kakhulu, ngendlela) ikhuluma ngamaphakheji amaningana angatholakali ezindaweni zokugcina ze-Epel ezichaziwe. I-Linstor inezithombe, kodwa ayinazo izipele ezingaphandle kwendawo, ngakho-ke kwadingeka ngisebenzise i-Velero ne-Restic futhi ukuze ngithole izipele zevolumu. Ngingathanda izithombe kunezipele ezisezingeni lefayela, kodwa lokho kuyabekezeleleka uma ikhambi lisebenza kahle futhi lithembekile. I-Linstor ingumthombo ovulekile, kodwa kukhona ukwesekwa okukhokhelwayo. Uma ngikuqonda kahle, ungayisebenzisa ngaphandle kwemingcele noma ngabe awunayo inkontileka yokusekela, kodwa kuzodingeka ngikuhlole lokho. Angazi ukuthi i-Linstor ihlolwe kangakanani kuma-Kubernetes, kodwa ungqimba lwesitoreji ngokwalo lungaphandle kwama-Kubernetes, futhi kubonakala sengathi selukhona isikhathi eside, ngakho-ke kungenzeka ukuthi selivele lihlolwe ezimweni zangempela. Ingabe kukhona ikhambi lapha elingangenza ngishintshe umqondo wami futhi ngibuyele kuma-Kubernetes? Angazi. Ngidinga ukumba kabanzi futhi ngifunde ngokukopisha. Sizobona. Kodwa umbono wokuqala muhle. Ngingathanda ngempela ukusebenzisa amaqoqo ami e-Kubernetes esikhundleni se-Heroku ukuze ngithole inkululeko eyengeziwe nokufunda izinto ezintsha. Njengoba i-Linstor ilula ukuyifaka njengabanye, ngizobhala okuthunyelwe ngalokho maduze.
Izilinganiso
Ngeshwa, angigcinanga amanothi amaningi mayelana nokuqhathanisa ngoba angizange ngicabange ukuthi ngizobhala ngakho. Nginemiphumela kuphela evela kumabhentshimakhi e-fio ayisisekelo kanye namaqoqo e-node eyodwa kuphela, ngakho-ke anginazo izinombolo zokucushwa okuphindaphindiwe okwamanje. Kodwa kule miphumela ungathola umbono onzima wokuthi yini ongayilindela kunketho ngayinye, ngoba ngiwaqhathanise kumaseva amafu afanayo, ama-cores angu-4, i-16 GB ye-RAM, nediski eyengeziwe engu-100 GB yamavolumu ahloliwe. Ngisebenzise amabhentshimakhi kathathu kusixazululo ngasinye futhi ngabala umphumela omaphakathi, futhi ngaphinde ngisetha kabusha izilungiselelo zeseva zomkhiqizo ngamunye. Konke lokhu akuhambisani neze nesayensi, ukuze nje ukunikeze umbono ojwayelekile. Kwezinye izivivinyo, ngikopishe i-38 GB yezithombe namavidiyo kusuka kuvolumu ukuze ngihlole ukufunda nokubhala, kodwa, maye, angizange ngigcine izinombolo. Ngamafuphi: I-Portworkx yayishesha kakhulu.
Ngebhentshimakhi yevolumu ngisebenzise le-manifest:
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: dbench
spec:
storageClassName: ...
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 5Gi
---
apiVersion: batch/v1
kind: Job
metadata:
name: dbench
spec:
template:
spec:
containers:
- name: dbench
image: sotoaster/dbench:latest
imagePullPolicy: IfNotPresent
env:
- name: DBENCH_MOUNTPOINT
value: /data
- name: FIO_SIZE
value: 1G
volumeMounts:
- name: dbench-pv
mountPath: /data
restartPolicy: Never
volumes:
- name: dbench-pv
persistentVolumeClaim:
claimName: dbench
backoffLimit: 4Ngiqale ngakha ivolumu ngekilasi elifanele lokugcina bese ngiqhuba umsebenzi nge-fio ngemuva kwezigcawu. Ngithathe u-1 GB ukulinganisa ukusebenza futhi ngingalindi isikhathi eside kakhulu. Nansi imiphumela:
Ngigqamise inani elingcono kakhulu lemethrikhi ngayinye ngokuluhlaza kanye nokubi kakhulu ngokubomvu.
isiphetho
Njengoba ubona, ezimweni eziningi i-Portworx yenze kangcono kunezinye. Kodwa kimi kuyabiza. Angazi ukuthi uRobin ubiza malini, kodwa banenguqulo enkulu yamahhala, ngakho-ke uma ufuna umkhiqizo okhokhelwayo, ungazama (ngethemba ukuthi bazolungisa inkinga ngokubuyisela kanye nezipele maduze). Kulawa amathathu amahhala, ngibe nezinkinga ezincane nge-OpenEBS, kodwa ukusebenza kwayo kubi. Kuyadabukisa ukuthi angigcinanga eminye imiphumela, kodwa ngithemba izinombolo kanye nokuphawula kwami kuzokusiza.
Source: www.habr.com
