Buyekeza!. Kumazwana, omunye wabafundi uphakamise ukuzama (mhlawumbe uzisebenzela ngokwakhe) ngakho-ke ngengeze isigaba mayelana nalesi sixazululo. Ngabhala futhi , ngoba inqubo ihluke kakhulu kwabanye.
Uma ngikhuluma iqiniso, ngadela futhi ngadela (okungenani okwamanje). Ngizosebenzisa . Kungani? Ngenxa yesitoreji! Ubani obengacabanga ukuthi ngizokhexa kakhulu ngesitoreji kuneKubernetes uqobo. Ngiyasebenzisa ngoba ayibizi futhi ukusebenza kuhle futhi kusukela ekuqaleni bengilokhu ngithumela amaqoqo ngisebenzisa . Angizange ngizame izinsiza eziphethwe ze-Kubernetes ezivela ku-Google/Amazon/Microsoft/DigitalOcean, njll., njll., ngoba bengifuna ukufunda yonke into mina. Ngiyawonga.
Ngakho-ke yebo, ngichithe isikhathi esiningi ngizama ukunquma ukuthi yisiphi isitoreji engingasikhetha ngenkathi ngihlola isitaki se-Kubernetes esingaba khona. Ngikhetha izixazululo zomthombo ovulekile, hhayi nje ngenxa yentengo, kodwa ngibheke izinketho ezimbalwa ezikhokhelwayo ngenxa yelukuluku ngoba zinezinguqulo zamahhala ezinemikhawulo. Ngibhale phansi ezinye izinombolo ezivivinyweni zakamuva lapho ngiqhathanisa izinketho ezihlukile, futhi zingathakazelisa kulabo abafunda ngesitoreji se-Kubernetes. Nakuba mina ngokwami ββngivalelise kuKubernetes okwamanje. Nami ngifuna ukubalula , engahlinzeka ngokuqondile ngamavolumu e-Hetzner Cloud, kodwa angikakayizami okwamanje. Ngibheke kwisitoreji esichazwe yisoftware yamafu ngoba bengidinga ukuphindaphinda kanye nekhono lokukhweza ngokushesha amavolumu aqhubekayo kunoma iyiphi indawo, ikakhulukazi uma kwenzeka kuba nokwehluleka kwamanodi nezinye izimo ezifanayo. Ezinye izixazululo zinikeza izifinyezo ze-point-in-time nama-backups angekho kusayithi, okuyinto elula.
Ngihlole izixazululo zesitoreji esingu-6-7:
Njengoba sengishilo Ngemva kokuhlola izinketho eziningi ohlwini, ngiqale ngahlala ku-OpenEBS. I-OpenEBS ilula kakhulu ukuyifaka nokusebenzisa, kodwa ukwethembeka, ngemva kokuhlola ngedatha yangempela ngaphansi komthwalo, ngangidumazekile ngokusebenza kwayo. Lona umthombo ovulekile, futhi abathuthukisi babodwa njalo ngisiza kakhulu lapho ngidinga usizo. Ngeshwa, inokusebenza okungekuhle kakhulu uma kuqhathaniswa nezinye izinketho, ngakho-ke ukuhlolwa bekufanele kuqalwe kabusha. I-OpenEBS njengamanje inezinjini zokugcina ezi-3, kodwa ngithumela imiphumela ye-benchmark ye-cStor. Anginazo izinombolo ze-Jiva ne-LocalPV okwamanje.
Ngamafuphi, i-Jiva iyashesha kancane, futhi i-LocalPV ngokuvamile iyashesha, ayimbi kakhulu kune-benchmark yediski ngokuqondile. Inkinga nge-LocalPV ukuthi ivolumu ingafinyelelwa kuphela endaweni lapho ilungiswe khona, futhi akukho ukuphindaphinda nhlobo. Ngibe nezinkinga zokubuyisela isipele nge kwiqoqo elisha ngoba amagama e-node ayehlukile. Uma sikhuluma ngama-backups, i-cStor ine , lapho ungenza khona izipele ezitholakala ngaphandle kwesayithi ngesikhathi esithile, okulula kakhulu kunezipele ezisezingeni lefayela nge-Velero-Restic. Ngibhalile , ukwenza kube lula ukuphatha izipele nokubuyisela ngale plugin. Sekukonke, ngithanda i-OpenEBS, kepha ukusebenza kwayo ...
I-Rook iphinde ibe umthombo ovulekile futhi ihluke kuzo zonke ezinye izinketho ohlwini ngoba iyi-orchestrator yokugcina eyenza imisebenzi eyinkimbinkimbi yokuphatha isitoreji nge-backends ehlukene, isb. , nezinye, okwenza umsebenzi ube lula kakhulu. Ngibe nezinkinga nge-EfgeFS lapho ngizama ezinyangeni ezimbalwa ezedlule, ngakho ngavivinya ikakhulukazi nge-Ceph. I-Ceph ayinikezi kuphela isitoreji se-block, kodwa futhi isitoreji sezinto esihambisana ne-S3/Swift kanye nesistimu yefayela esabalalisiwe. Engikuthandayo nge-Ceph yikhono lokusabalalisa idatha yevolumu kuwo wonke amadiski amaningi ukuze ivolumu isebenzise isikhala sediski esiningi kunalokho esingangena kudiski eyodwa. Ikhululekile. Esinye isici esihle ukuthi uma ungeza amadiski eqoqweni, iphinde isabalalise idatha kuwo wonke amadiski.
I-Ceph inezifinyezo, kodwa ngokwazi kwami, azikwazi ukusetshenziswa ngokuqondile ku-Rook/Kubernetes. Yiqiniso, angingenanga ngokujulile kulokhu. Kodwa awekho ama-backups angaphandle kwesayithi, ngakho-ke kuzodingeka usebenzise okuthile nge-Velero/Restic, kodwa kukhona ama-backups wezinga lefayela kuphela, hhayi izifinyezo ze-point-in-time. Engikuthanda kakhulu ngoRook ukuthi kulula kangakanani ukusebenza ne-Ceph - ifihla cishe zonke izinto eziyinkimbinkimbi futhi inikeza amathuluzi okukhuluma noCeph ngokuqondile ukuze kuxazululwe inkinga. Ngeshwa, ngesikhathi sokuhlolwa kokucindezeleka kwemiqulu ye-Ceph, ngangilokhu nginenkinga , okwenza uCeph angazinzi. Akukacaci ukuthi lesi yisiphazamisi kuCeph uqobo noma inkinga ngendlela uRook aphatha ngayo uCeph. Ngasebenzisa izilungiselelo zememori, futhi kwaba ngcono, kodwa inkinga ayizange ixazululwe ngokuphelele. I-Ceph inokusebenza okuhle, njengoba ubona kumabhentshimakhi angezansi. Iphinde ibe nedeshibhodi enhle.
Ngiyithanda kakhulu i-Longhorn. Ngokubona kwami, lesi yisixazululo esithembisayo. Yiqiniso, abathuthukisi ngokwabo (i-Rancher Labs) bayavuma ukuthi ayikafaneleki endaweni yokusebenza, futhi lokhu kubonisa. Ingumthombo ovulekile futhi inokusebenza okuhloniphekile (yize bengakayithuthukisi okwamanje), kodwa amavolumu athatha isikhathi eside kakhulu ukuxhuma ku-pod, futhi ezimweni ezimbi kakhulu kuthatha imizuzu engu-15-16, ikakhulukazi ngemva kokubuyisela isipele esikhulu noma ukuthuthukisa umsebenzi. Inezifinyezo kanye nezipele ezingekho kusayithi zalezi zifinyezo, kodwa zisebenza kuphela kumavolumu, ngakho-ke usazodinga into efana ne-Velero ukuze wenze ezinye izinsiza. Izipele nokubuyisela zithembeke kakhulu, kodwa kuhamba kancane. Ngokujulile, kuhamba kancane ngendlela emangalisayo. Ukusetshenziswa kwe-CPU nomthwalo wesistimu kuvame ukukhuphuka uma usebenza nenani elimaphakathi ledatha e-Longhorn. Kukhona ideshibhodi elula yokuphatha i-Longhorn. Sengike ngasho ukuthi ngiyayithanda iLonghorn, kodwa idinga umsebenzi othile.
I-StorageOS iwumkhiqizo wokuqala okhokhelwayo ohlwini. Inenguqulo yonjiniyela enosayizi olinganiselwe wesitoreji ophethwe ongu-500GB, kodwa angicabangi ukuthi kunomkhawulo enanini lamanodi. Umnyango wezokuthengisa wangitshela ukuthi izindleko ziqala ku-$125 ngenyanga nge-TB engu-1, uma ngikhumbula kahle. Kukhona ideshibhodi eyisisekelo kanye ne-CLI elula, kodwa kukhona okungajwayelekile okwenzekayo ngokusebenza: kwamanye amabhentshimakhi kuhloniphekile, kodwa ekuhlolweni kokucindezeleka kwevolumu angizange ngithande nhlobo isivinini. Ngokuvamile, angazi ukuthi ngithini. Ngakho angizange ngiqonde okuningi ngempela. Awekho ama-backups angekho kusayithi futhi kuzodingeka usebenzise i-Velero ene-Restic ukuze wenze ikhophi yasenqolobaneni. Kuyamangaza, ngoba umkhiqizo uyakhokhwa. Futhi abathuthukisi bebengazimisele ukuxhumana ku-Slack.
Ngifunde ngoRobin kuReddit kumqondisi wabo wezobuchwepheshe. Ngangingakaze ngizwe ngaye ngaphambili. Mhlawumbe ngoba bengifuna izixazululo zamahhala, kodwa uRobin uyakhokhelwa. Banenguqulo enhle yamahhala ene-10TB yokugcina kanye nama-node amathathu. Sekukonke, umkhiqizo uhloniphekile futhi unezici ezinhle. Kukhona i-CLI enhle, kodwa into ebanda kunazo zonke ukuthi ungakwazi ukuthwebula futhi wenze isipele lonke uhlelo lokusebenza (esikhethini sezinsiza lokhu kubizwa ngokuthi ukukhishwa kwe-Helm noma "izinhlelo zokusebenza eziguqukayo"), okuhlanganisa amavolumu nezinye izinsiza, ukuze ukwazi ukwenza ngaphandle kwe-Velero. Futhi konke kungaba kuhle uma kungenjalo ngemininingwane eyodwa encane: uma ubuyisela (noma "ukungenisa", njengoba kubizwa ngoRobin) uhlelo lokusebenza kuqoqo elisha - isibonelo, uma kwenzeka ukululama enhlekeleleni - ukubuyiselwa, Yebo, iyasebenza, kodwa qhubeka wenze isipele isicelo akuvunyelwe. Lokhu akwenzeki kulokhu kukhululwa, njengoba abathuthukisi beqinisekisile. Lokhu kungukuthi, ukukubeka kancane, okungajwayelekile, ikakhulukazi uma kucatshangelwa ezinye izinzuzo (isibonelo, ama-backups ashesha kakhulu nokubuyisela). Onjiniyela bathembisa ukulungisa yonke into ngokukhishwa okulandelayo. Ukusebenza ngokuvamile kuhle, kodwa ngiphawule okungavamile: uma ngisebenzisa ibhentshimakhi ngokuqondile kuvolumu enamathiselwe kumsingathi, isivinini sokufunda siyashesha kakhulu kunokusebenzisa ivolumu efanayo ngaphakathi kwe-pod. Yonke eminye imiphumela iyafana, kodwa ngokombono akufanele kube khona umehluko. Nakuba besebenza ngakho, ngangicasulwe inkinga yokubuyisela nokwenza isipele - ngacabanga ukuthi ekugcineni ngithole isisombululo esifanele, futhi ngangizimisele ngisho nokusikhokhela lapho ngidinga indawo eyengeziwe noma amaseva amaningi.
Akukho okuningi engingakusho lapha. Lona umkhiqizo okhokhelwayo, opholile ngokulinganayo futhi obizayo. Ukusebenza kumane kumangalisa. Lesi yinkomba engcono kakhulu kuze kube manje. USlack wangitshela ukuthi intengo iqala ku-$205 ngenyanga ngenodi ngayinye, njengoba kufakwe ohlwini lweMakethe ye-GKE yakwaGoogle. Angazi noma izobiza yini uma uthenga ngqo. Angikwazi ukukukhokhela lokho noma kunjalo, ngakho-ke ngiphoxeke kakhulu, kakhulu ukuthi ilayisense yonjiniyela (efika ku-1 TB kanye nama-node angu-3) ayinamsebenzi nge-Kubernetes ngaphandle kokuthi weneliseke ngokuhlinzekwa okumile. Benginethemba lokuthi ilayisensi yevolumu izokwehliselwa ngokuzenzakalelayo kunjiniyela ekupheleni kwesikhathi sesilingo, kodwa lokho akwenzekanga. Ilayisensi yonjiniyela ingasetshenziswa kuphela ngqo ne-Docker, futhi ukucushwa ku-Kubernetes kunzima kakhulu futhi kunomkhawulo. Yebo, ngikhetha umthombo ovulekile, kodwa ukube benginayo imali, bengizokhetha i-Portworx. Kuze kube manje, ukusebenza kwayo akuqhathanisi nezinye izinketho.
Ngingeze lesi sigaba ngemuva kokushicilelwa kokuthunyelwe, lapho umfundi oyedwa ephakamisa ukuthi uzame uLinstor. Ngizamile futhi ngakuthanda! Kodwa kusadingeka sijule. Manje ngingasho ukuthi ukusebenza akukubi (ngingeze imiphumela yebhentshimakhi ngezansi). Empeleni, ngithole ukusebenza okufanayo nediski ngokuqondile, ngaphandle kokungaphezulu. (Ungabuzi ukuthi kungani i-Portworx inezinombolo ezingcono kune-benchmark yedrayivu ngokuqondile. Angazi. Umlingo, ngiyacabanga.) Ngakho-ke i-Linstor ibonakala isebenza kakhulu kuze kube manje. Akunzima kangako ukuyifaka, kodwa akulula njengezinye izinketho. Okokuqala kwadingeka ngifake i-Linstor (imoduli ye-kernel namathuluzi/izinsizakalo) futhi ngilungiselele i-LVM yokuhlinzeka okuncane nokusekelwa kwesithombe esifinyeziwe ngaphandle kwe-Kubernetes, ngqo kumsingathi, bese ngidala izinsiza ezidingekayo ukusebenzisa isitoreji esivela ku-Kubernetes. Angizange ngithande ukuthi ingasebenzi ku-CentOS futhi kwadingeka ngisebenzise Ubuntu. Yebo, akukubi, kodwa kuyacasula kancane, ngoba imibhalo (enhle kakhulu, ngendlela) ikhuluma ngamaphakheji amaningana angatholakali ezindaweni zokugcina ze-Epel. I-Linstor inezifinyezo, kodwa hhayi ama-backups angaphandle kwesayithi, ngakho-ke lapha futhi bekufanele ngisebenzise i-Velero ene-Restic ukwenza isipele amavolumu. Ngingancamela izifinyezo esikhundleni sezipele ezisezingeni lefayela, kodwa lokhu kungabekezelelwa uma isisombululo sisebenza futhi sithembekile. I-Linstor ingumthombo ovulekile kodwa unokusekelwa okukhokhelwayo. Uma ngiqonda kahle, ingasetshenziswa ngaphandle kwemingcele, ngisho noma ungenayo inkontileka yokusekela, kodwa lokhu kudinga ukucaciswa. Angazi ukuthi i-Linstor ihlolwe kanjani i-Kubernetes, kodwa isendlalelo sesitoreji ngokwaso singaphandle kwe-Kubernetes futhi, ngokusobala, isisombululo asizange sivele izolo, ngakho-ke cishe sesivele sihlolwe ezimweni zangempela. Ingabe likhona ikhambi lapha elizongenza ngishintshe umqondo wami ngibuyele ku-Kubernetes? Angazi. Kusadingeka sijule futhi sifunde ukuphindaphinda. Asibone. Kodwa umbono wokuqala muhle. Ngingathanda nakanjani ukusebenzisa amaqoqo ami e-Kubernetes esikhundleni se-Heroku ukuze ngibe nenkululeko eyengeziwe futhi ngifunde izinto ezintsha. Njengoba i-Linstor ingelula ukuyifaka njengabanye, ngizobhala okuthunyelwe ngayo maduze.
Izilinganiso
Ngeshwa, angigcinanga amanothi amaningi mayelana nokuqhathanisa ngoba angizange ngicabange ukuthi ngizobhala ngakho. Nginemiphumela kuphela evela kumabhentshimakhi e-fio ayisisekelo kanye namaqoqo e-node eyodwa kuphela, ngakho-ke anginazo izinombolo zokucushwa okuphindaphindiwe okwamanje. Kodwa kule miphumela ungathola umbono onzima wokuthi yini ongayilindela kunketho ngayinye, ngoba ngiwaqhathanise kumaseva amafu afanayo, ama-cores angu-4, i-16 GB ye-RAM, nediski eyengeziwe engu-100 GB yamavolumu ahloliwe. Ngisebenzise amabhentshimakhi kathathu kusixazululo ngasinye futhi ngabala umphumela omaphakathi, futhi ngaphinde ngisetha kabusha izilungiselelo zeseva zomkhiqizo ngamunye. Konke lokhu akuhambisani neze nesayensi, ukuze nje ukunikeze umbono ojwayelekile. Kwezinye izivivinyo, ngikopishe i-38 GB yezithombe namavidiyo kusuka kuvolumu ukuze ngihlole ukufunda nokubhala, kodwa, maye, angizange ngigcine izinombolo. Ngamafuphi: I-Portworkx yayishesha kakhulu.
Ngebhentshimakhi yevolumu ngisebenzise le-manifest:
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: dbench
spec:
storageClassName: ...
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 5Gi
---
apiVersion: batch/v1
kind: Job
metadata:
name: dbench
spec:
template:
spec:
containers:
- name: dbench
image: sotoaster/dbench:latest
imagePullPolicy: IfNotPresent
env:
- name: DBENCH_MOUNTPOINT
value: /data
- name: FIO_SIZE
value: 1G
volumeMounts:
- name: dbench-pv
mountPath: /data
restartPolicy: Never
volumes:
- name: dbench-pv
persistentVolumeClaim:
claimName: dbench
backoffLimit: 4Ngiqale ngakha ivolumu ngekilasi elifanele lokugcina bese ngiqhuba umsebenzi nge-fio ngemuva kwezigcawu. Ngithathe u-1 GB ukulinganisa ukusebenza futhi ngingalindi isikhathi eside kakhulu. Nansi imiphumela:
Ngigqamise inani elingcono kakhulu lemethrikhi ngayinye ngokuluhlaza kanye nokubi kakhulu ngokubomvu.
isiphetho
Njengoba ubona, ezimweni eziningi i-Portworx yenze kangcono kunezinye. Kodwa kimi kuyabiza. Angazi ukuthi uRobin ubiza malini, kodwa banenguqulo enkulu yamahhala, ngakho-ke uma ufuna umkhiqizo okhokhelwayo, ungazama (ngethemba ukuthi bazolungisa inkinga ngokubuyisela kanye nezipele maduze). Kulawa amathathu amahhala, ngibe nezinkinga ezincane nge-OpenEBS, kodwa ukusebenza kwayo kubi. Kuyadabukisa ukuthi angigcinanga eminye imiphumela, kodwa ngithemba izinombolo kanye nokuphawula kwami ββββkuzokusiza.
Source: www.habr.com