I-Opennebula. Amanothi amafushane

Sanibonani nonke. Le ndatshana ibhalelwe labo abasadabukile phakathi kokukhetha amapulatifomu e-virtualization nangemva kokufunda indatshana ochungechungeni oluthi "Sifake i-proxmox futhi ngokujwayelekile konke kuhamba kahle, iminyaka engu-6 yesikhathi sokusebenza ngaphandle kwekhefu elilodwa." Kodwa ngemva kokufaka isisombululo esisodwa noma esinye esingaphandle kwebhokisi, umbuzo uphakama: ngingakulungisa kanjani lokhu lapha, ukuze ukuqapha kuqondakala kangcono, futhi lapha, ukulawula izipele…. Futhi-ke kufika isikhathi futhi uyaqaphela ukuthi ufuna okuthile okusebenzayo, noma ufuna konke okungaphakathi kwesistimu yakho kucace, hhayi leli bhokisi elimnyama, noma ufuna ukusebenzisa okuthile okungaphezu kwe-hypervisor kanye nenqwaba yemishini ebonakalayo. Lesi sihloko sizoqukatha imicabango nokuzijwayeza okusekelwe endaweni yesikhulumi se-Opennebula - ngikhethe ngoba. ayifuni ngezinsiza kanye nezakhiwo azinzima kangako.

Ngakho-ke, njengoba sibona, abahlinzeki abaningi bamafu basebenza ku-kvm futhi benza ukuxhumana kwangaphandle ukuze balawule imishini. Kuyacaca ukuthi abasingathi abakhulu babhala izinhlaka zabo zengqalasizinda yamafu, i-YANDEX efanayo njengesibonelo. Othile usebenzisa i-openstack futhi wenza uxhumano ngalesi sisekelo - SELECTEL, MAIL.RU. Kodwa uma une-hardware yakho kanye nabasebenzi abancane abangochwepheshe, khona-ke ngokuvamile ukhetha into eyenziwe ngomumo - i-VMWARE, i-HYPER-V, kukhona amalayisense amahhala nakhokhelwayo, kodwa akusikho lokho esikhuluma ngakho manje. Ake sikhulume ngabashisekayo - laba yilabo abangesabi ukunikeza futhi bazame okusha, naphezu kweqiniso lokuthi inkampani yakubeka kwacaca, "Ubani ozosebenza ngemuva kwakho," "Ngabe sizokwethula lokhu ekukhiqizeni kamuva ? Kuyathusa." Kodwa ungaqala ukusebenzisa lezi zixazululo ebhentshini lokuhlola, futhi uma wonke umuntu ethanda, khona-ke ungakwazi ukuphakamisa umbuzo wokuthuthukiswa okuqhubekayo futhi usebenzise ezindaweni ezibucayi kakhulu.

Nasi futhi isixhumanisi sombiko www.youtube.com/watch?v=47Mht_uoX3A kusuka kubahlanganyeli abakhuthele ekuthuthukisweni kwale nkundla.

Mhlawumbe kulesi sihloko into izoba yinto engafaneleki futhi isivele iqondakala kuchwepheshe abanolwazi, futhi kwezinye izimo ngeke ngichaze konke ngoba imiyalo nezincazelo ezifanayo zitholakala ku-intanethi. Lokhu kungokuhlangenwe nakho kwami ​​​​ngale nkundla. Ngethemba ukuthi ababambiqhaza abakhuthele bazongeza kumazwana ukuthi yini engenziwa kangcono kanye namaphutha engiwenzile. Zonke izenzo zenzeke endaweni yokuma yasekhaya ehlanganisa ama-PC angu-3 anezici ezihlukahlukene. Futhi, angizange ngibonise ukuthi le software isebenza kanjani nokuthi ifakwa kanjani. Cha, ulwazi lokuphatha kuphela kanye nezinkinga engihlangabezane nazo. Mhlawumbe lokhu kuzoba usizo kumuntu ekukhetheni kwakhe.

Ngakho, ake siqale. Njengomphathi wesistimu, amaphuzu alandelayo abalulekile kimi, ngaphandle kwalokho mancane amathuba okuthi ngisebenzise lesi sixazululo.

1. Ukuphinda ukufakwa

Есть куча инструкций по установке opennebula, тут не должно возникнуть проблем. От версии к версии появляются новые фичи, которые не всегда смогут заработать при переходе от версии к версии.

2. Ukuqapha

Sizoqapha i-node ngokwayo, i-kvm ne-opennebula. Ngenhlanhla, isivele isilungile. Kunezinketho eziningi mayelana nokuqapha abaphathi be-Linux, i-Zabbix efanayo noma umthumeli we-node - noma ubani othanda okungcono - okwamanje ngichaza njengamamethrikhi wesistimu yokuqapha (izinga lokushisa lapho lingalinganiswa khona, ukuhambisana kwe-disk array), ngokusebenzisa i-zabbix. , kanye nezinhlelo zokusebenza ngomthumeli wempahla we-Prometheus. Ngokuqapha kwe-kvm, isibonelo, ungathatha iphrojekthi github.com/zhangjianweibj/prometheus-libvirt-exporter.git и поставить запуск через systemd, вполне хорошо работает и показывает метрики kvm, также есть готовый dashboard grafana.com/grafana/dashboards/12538.

Isibonelo, nali ifayela lami:

/etc/systemd/system/libvirtd_exporter.service
[Unit]
Description=Node Exporter

[Service]
User=node_exporter
ExecStart=/usr/sbin/prometheus-libvirt-exporter --web.listen-address=":9101"

[Install]
WantedBy=multi-user.target

Futhi ngakho-ke sinomthengisi ongu-1, sidinga owesibili ukuqapha i-opennebula ngokwayo, ngisebenzise lokhu github.com/kvaps/opennebula-exporter/blob/master/opennebula_exporter

Ingangezwa kokujwayelekile i-node_exporter ukuqapha uhlelo okulandelayo.

Kufayela le-node_exporter sishintsha isiqalo kanje:

ExecStart=/usr/sbin/node_exporter --web.listen-address=":9102" --collector.textfile.directory=/var/lib/opennebula_exporter/textfile_collector

Dala inkomba mkdir -p /var/lib/opennebula_exporter

bash iskripthi esivezwe ngenhla, okokuqala sibheka umsebenzi ngekhonsoli, uma sibonisa lokho esikudingayo (uma kunikeza iphutha, bese ufaka i-xmlstarlet), sikopishe ku-/usr/local/bin/opennebula_exporter.sh

Engeza umsebenzi we-cron weminithi ngalinye:

*/1 * * * * (/usr/local/bin/opennebula_exporter.sh > /var/lib/opennebula_exporter/textfile_collector/opennebula.prom)

Amamethrikhi aqala ukuvela, ungawathatha njenge-prometheus futhi wakhe amagrafu futhi wenze izexwayiso. E-Grafana ungadweba, isibonelo, ideshibhodi elula.

(kuyacaca ukuthi lapha ngidlula i-cpu, inqama)

Kulabo abathanda futhi abasebenzisa Zabbix, kukhona github.com/OpenNebula/addon-zabbix

Mayelana nokuqapha, okuyinhloko ukuthi kukhona. Yiqiniso, ungakwazi, ngaphezu kwalokho, ukusebenzisa amathuluzi okuqapha omshini obonakalayo eyakhelwe ngaphakathi futhi ulayishe idatha ekukhokheni, lapha wonke umuntu unombono wakhe, angikaqali ukusebenza kulokhu eduze.

Angikaqali ngempela ukugawula. Indlela elula yokwengeza i-td-ejenti ukuze uhlukanise /var/lib/one directory enezinkulumo ezivamile. Isibonelo, ifayela le-sunstone.log lifana ne-nginx regexp namanye amafayela abonisa umlando wokufinyelela endawenikazi - yini inzuzo yalokhu? Isibonelo, singakwazi ukulandelela ngokucacile inombolo ethi "Iphutha, iphutha" futhi silandele ngokushesha ukuthi yikuphi ukungasebenzi kahle nokuthi kuliphi izinga.

3. Izipele

Kukhona futhi amaphrojekthi aqediwe akhokhelwayo - isibonelo sep wiki.sepsoftware.com/wiki/index.php/4_4_3_Tigon:OpenNebula_Backup. Lapha kufanele siqonde ukuthi ukumane wenze ikhophi yasenqolobaneni yesithombe somshini akufani nhlobo kulokhu, ngoba imishini yethu ebonakalayo kufanele isebenze ngokuhlanganisa okugcwele (ifayela lomongo elifanayo elichaza izilungiselelo zenethiwekhi, igama le-vm nezilungiselelo zangokwezifiso zezinhlelo zakho zokusebenza) . Ngakho-ke, lapha sinquma ukuthi sizosekela ngani futhi kanjani. Kwezinye izimo kungcono ukwenza amakhophi alokho okuku-vm uqobo. Futhi mhlawumbe udinga kuphela ukwenza isipele idiski eyodwa emshinini owunikeziwe.

Isibonelo, sinqume ukuthi yonke imishini iqala ngezithombe eziphikelelayo, ngakho-ke, ngemva kokufunda docs.opennebula.io/5.12/operation/vm_management/img_guide.html

Lokhu kusho ukuthi okokuqala singalayisha isithombe ku-vm yethu:

onevm disk-saveas 74 3 prom.qcow2
Image ID: 77

Смотрим, под каким именем он сохранился

oneimage show 77
/var/lib/one//datastores/100/f9503161fe180658125a9b32433bf6e8
   
И далее копируем куда нам необходимо. Конечно, так себе способ. Просто хотел показать, что используя инструменты opennebula можно строить подобные решения.

Ngathola naku-inthanethi umbiko othakazelisayo futhi kukhona okwengeziwe iphrojekthi evulekile enjalo, но тут только под qcow2 хранилище.

Kodwa njengoba sonke sazi, ngokushesha noma kamuva kufika isikhathi lapho ufuna ama-backups akhuphukayo, kunzima kakhulu lapha futhi mhlawumbe abaphathi bazokwaba imali yesisombululo esikhokhelwayo, noma bahambe ngenye indlela futhi baqonde ukuthi lapha sinqamula izinsiza kuphela, nokwenza ama-backups ezingeni lesicelo kanye nokwengeza inombolo yama-node amasha nemishini ebonakalayo - yebo, lapha, ngisho ukuthi ukusebenzisa ifu ukwethula amaqoqo ohlelo lokusebenza, nokwethula isizindalwazi kwenye iplatifomu noma ukuthatha esenziwe ngomumo. kumphakeli, uma kungenzeka.

4. Ukusebenzisa kalula

Kulesi sigaba ngizochaza izinkinga engihlangabezane nazo. Isibonelo, ngokwezithombe, njengoba sazi, kukhona ukuphikelela - uma lesi sithombe sifakwe ku-vm, yonke idatha ibhalwa kulesi sithombe. Futhi uma kungenakuphikelela, khona-ke isithombe sikopishwa kusitoreji futhi idatha ibhalwa kulokho okukopishwe kusithombe somthombo - yile ndlela izifanekiso zesifanekiso ezisebenza ngayo. Ngizibangele izinkinga ngokuphindaphindiwe ngokukhohlwa ukucacisa ukuphikelela futhi isithombe se-200 GB sikopishwe, inkinga ukuthi le nqubo ngokuqinisekile ayikwazi ukukhanselwa, kufanele uye ku-node futhi ubulale inqubo yamanje "cp".

Enye yezinto ezimbi ezibalulekile ukuthi awukwazi ukukhansela izenzo usebenzisa i-gui. Noma kunalokho, uzowakhansela futhi ubone ukuthi akwenzeki lutho futhi uzowaqala futhi, uwakhansele futhi empeleni kuzoba nezinqubo ze-2 cp ezikopisha isithombe.

Bese-ke kufika ekuqondeni ukuthi kungani izinombolo ze-opennebula isenzakalo ngasinye esisha nge-id entsha, isibonelo, ku-proxmox efanayo kwakheka i-vm ene-id 101, yayisusa, bese uyayidala futhi kanye ne-id 101. Ku-opennebula lokhu ngeke kwenzeke, isenzakalo esisha ngasinye sizodalwa nge-id entsha futhi lokhu kunomqondo wako siqu - isibonelo, ukusula idatha endala noma ukufakwa okungaphumelelanga.

Okufanayo kuya ekugcinweni; ngaphezu kwakho konke, le nkundla ihloselwe ukugcina indawo eyodwa. Kukhona ama-addon okusebenzisa indawo, kodwa akusikho lokho esikhuluma ngakho kuleli cala. Ngicabanga ukuthi esikhathini esizayo othile uzobhala isihloko mayelana nokuthi bakwazi kanjani ukusebenzisa isitoreji sendawo kuma-node futhi bayisebenzise ngempumelelo ekukhiqizeni.

5. Ubulula obukhulu

Yebo, lapho uqhubeka, bancipha abazokuqondisisa.

Ngaphansi kwemibandela yokuma kwami ​​- ama-node angu-3 anesitoreji se-nfs - konke kusebenza kahle. Kodwa uma senza izivivinyo ezihilela ukuphela kukagesi, isibonelo, lapho sisebenzisa isifinyezo futhi sivala amandla e-node, sigcina izilungiselelo ku-database ukuthi kukhona isifinyezo, kodwa empeleni asikho (kahle, sonke siyaqonda ukuthi ekuqaleni wabhala isizindalwazi mayelana nalesi senzo ku-sql , kodwa ukusebenza ngokwako akuzange kuphumelele). Inzuzo ukuthi lapho udala isifinyezo, kwakhiwa ifayela elihlukile futhi kukhona "umzali", ngakho-ke uma kunezinkinga futhi noma kungasebenzi nge-gui, singakwazi ukuthatha ifayela le-qcow2 futhi silibuyisele ngokwehlukana. docs.opennebula.io/5.8/operation/vm_management/vm_instances.html

Kumanethiwekhi, ngeshwa, akuyona yonke into elula kangaka. Nokho, okungenani kulula kune-openstack, ngisebenzise kuphela i-vlan (802.1Q) - isebenza kahle kakhulu, kodwa uma wenza izinguquko kuzilungiselelo ezivela kunethiwekhi yesifanekiso, lezi zilungiselelo ngeke zisetshenziswe emishinini esebenzayo kakade, i.e. udinga ukususa futhi wengeze ikhadi lenethiwekhi, bese kuzosetshenziswa izilungiselelo ezintsha.

Uma usafuna ukuyiqhathanisa ne-openstack, ungasho lokhu: ku-opennebula ayikho incazelo ecacile yokuthi yibuphi ubuchwepheshe obusetshenziselwa ukugcina idatha, ukuphatha inethiwekhi, izinsiza - umlawuli ngamunye uzinqumela ukuthi yini evumelana naye.

6. Ama-plugin engeziwe nokufakwa

Phela, njengoba sikuqonda, ipulatifomu yefu ayikwazi ukuphatha i-kvm kuphela, kodwa futhi i-vmware esxi. Ngeshwa, bengingenalo ichibi ne-Vcenter, uma kukhona oke wazama, sicela ubhale.

Usekelo lwabanye abahlinzeki bamafu kushiwo docs.opennebula.io/5.12/advanced_components/cloud_bursting/index.html
AWS, AZURE.

Ngazama futhi ukuxhuma i-Vmware Cloud kusuka ku-Selectel, kodwa akukho lutho olusebenzayo - ngokujwayelekile, ivinjiwe ngoba kunezici eziningi, futhi akukho phuzu ekubhaleni ukusekelwa kwezobuchwepheshe komhlinzeki wokubamba.

Futhi, manje inguqulo entsha ine-firecracker - lokhu ukwethulwa kwe-microvm, uhlobo lwe-kvm harness phezu kwe-docker, enikeza ukuguquguquka okwengeziwe, ukuphepha kanye nokwanda kokukhiqiza ngoba asikho isidingo sokumosha izinsiza ekulingiseni imishini. Okuwukuphela kwenzuzo engiyibonayo nge-Docker ukuthi ayithathi inombolo eyengeziwe yezinqubo futhi awekho amasokhethi asetshenziswayo lapho usebenzisa lokhu kulingisa, i.e. Kungenzeka impela ukuyisebenzisa njengesilinganisi somthwalo (kodwa ngokunokwenzeka kufanelekile ukubhala indatshana ehlukile mayelana nalokhu kuze kube yilapho sengizifeze ngokugcwele zonke izivivinyo).

7. Ulwazi oluhle lokusebenzisa nokulungisa iphutha

Bengifuna ukwabelana ngalokho engikubonile mayelana nomsebenzi, ngichaze okunye kwawo ngenhla, ngingathanda ukubhala okwengeziwe. Impela, mhlawumbe akumina ngedwa oqale wacabanga ukuthi lolu akulona uhlelo olulungile futhi ngokujwayelekile yonke into elapha iwudondolo - basebenza kanjani nalokhu? Kodwa-ke ukuqonda kuza ukuthi konke kunengqondo. Yebo, awukwazi ukujabulisa wonke umuntu futhi ezinye izici zidinga ukuthuthukiswa.

Isibonelo, ukusebenza okulula kokukopisha isithombe sediski kusuka esitolo sedatha esisodwa kuya kwesinye. Endabeni yami, kukhona ama-node angu-2 ane-nfs, ngithumela isithombe - ukukopisha kwenzeka nge-opennebula yangaphambili, nakuba sonke sijwayele ukuthi idatha kufanele ikopishwe ngokuqondile phakathi kwabasingathi - ku-vmware efanayo, i-hyper-v esiyijwayele. ngijwayele lokhu, kodwa lapha komunye. Kukhona indlela ehlukile kanye nemibono ehlukile, futhi kunguqulo 5.12 basuse inkinobho ethi "thuthela ku-datastore" - umshini kuphela odluliselwayo, kodwa hhayi isitoreji ngoba kusho ukugcinwa endaweni eyodwa.

Okulandelayo iphutha elidumile ngezizathu ezihlukahlukene: "Iphutha lokuthumela umshini obonakalayo: Ayikwazanga ukudala isizinda kusuka /var/lib/one//datastores/103/10/deployment.5" Ngezansi into ephezulu okufanele uyibuke.

• Amalungelo esithombe somsebenzisi oyedwa womlawuli;
• Izimvume zomsebenzisi we-oneadmin ukuthi aqalise i-libvirtd;
• Ingabe isitolo sedatha sifakwe ngendlela efanele? Hamba futhi uhlole indlela ku-node ngokwayo, mhlawumbe kukhona okuwile;
• Inethiwekhi elungiselelwe ngokungalungile, noma kunalokho ku-frontend ikuzilungiselelo zenethiwekhi lapho isikhombimsebenzisi esiyinhloko se-vlan siyi-br0, kodwa ku-node ibhalwe njenge-bridge0 - kufanele ifane.

I-datastore yesistimu igcina imethadatha ye-vm yakho, uma usebenzisa i-vm ngesithombe esiqhubekayo, i-vm idinga ukufinyelela ekucushweni okudalwe ekuqaleni kusitoreji lapho udale khona i-vm - lokhu kubaluleke kakhulu. Ngakho-ke, lapho udlulisela i-vm kwesinye isitolo sedatha, udinga ukuhlola kabili yonke into.

8. Imibhalo, umphakathi. Ukuthuthukiswa okuqhubekayo

Futhi okunye, amadokhumenti amahle, umphakathi kanye nento eyinhloko ukuthi iphrojekthi iyaqhubeka iphila esikhathini esizayo.

Ngokuvamile, yonke into ibhalwe kahle futhi ngisho nokusebenzisa umthombo osemthethweni ngeke kube yinkinga ukufaka nokuthola izimpendulo zemibuzo.

Umphakathi, uyasebenza. Ishicilela izixazululo eziningi ezenziwe ngomumo ongazisebenzisa ekufakeni kwakho.

Okwamanje, ezinye izinqubomgomo enkampanini zishintshile kusukela ngo-5.12 forum.opennebula.io/t/towards-a-stronger-opennebula-community/8506/14 Kuzothakazelisa ukubona ukuthi iphrojekthi ithuthukiswa kanjani. Ekuqaleni, ngaveza ngokuqondile abanye abathengisi abasebenzisa izixazululo zabo nalokho okunikezwa yimboni. Yebo, ayikho impendulo ecacile yokuthi yini okufanele isetshenziswe. Kodwa ezinhlanganweni ezincane, ukugcina ifu labo elincane eliyimfihlo kungase kungabizi njengoba kubonakala. Into esemqoka ukwazi kahle ukuthi yini oyidingayo.

Ngenxa yalokho, kungakhathaliseki ukuthi ukhetha ini njengohlelo lwamafu, akufanele ume kumkhiqizo owodwa. Uma unesikhathi, kufanelekile ukubheka ezinye izixazululo ezivulekile.

Kukhona ingxoxo emnandi t.me/opennebula активно помогают и не отправляют искать решение проблемы в гугл. Присоединяйтесь.

Source: www.habr.com