ãã®èšäºã¯ååã®èšäºã®ç¶ãã§ãã
ããã§ã¯ãã€ã³ãã©ã¹ãã©ã¯ãã£ãæºåããããã®ãã¹ãŠã®æºåæé ããã§ã«å®äºããŠãããšããäºå®ãèæ ®ããŠãé«å¯çšæ§ä»®æ³ãââã·ã³ããã¹ãããããã® oVirt 4.3 ã¯ã©ã¹ã¿ãŒã®åºæ¬çãªã€ã³ã¹ããŒã«ãšæ§æã®ããã»ã¹ã«ã€ããŠèª¬æããŸãã
ã¯ããã«
ãã®èšäºã®äž»ãªç®çã¯ããNext -> ã¯ã -> çµäºãã€ã³ã¹ããŒã«ããã³æ§ææã«ããã€ãã®æ©èœã衚瀺ããæ¹æ³ã ã€ã³ãã©ã¹ãã©ã¯ãã£ãšç°å¢ã®ç¹æ§ã«ãããã¯ã©ã¹ã¿ãŒããããã€ããããã»ã¹ã¯ãããã«èšèŒãããŠããããã»ã¹ãšå¿ ãããäžèŽãããšã¯éããŸããããäžè¬ååã¯åãã§ãã
䞻芳çãªèŠ³ç¹ããèšãã°ã
èå³ã®ããæ¹ã¯ãRHEV (å¥å oVirt) ãš VMware vSphere ã®ãã¹ãŠã®éããã€ã³ã¿ãŒãããã§èŠã€ããããšãã§ããŸããããšãã°ã
å¥éãä»®æ³ãã·ã³ã®ãããã¯ãŒã¯ã«é¢ããäœæ¥ãå°ãæ¯èŒããŠã¿ãããšæããŸãã oVirt ã¯ãVMware vSphere ãšåæ§ã®ä»®æ³ãã·ã³ (以äžãVM ãšåŒã³ãŸã) ã®ãããã¯ãŒã¯ç®¡çåçãå®è£ ããŸãã
- æšæºã® Linux ããªããžã䜿çšãã (VMware 㧠- æšæº vSwitch)ãä»®æ³åãã¹ãäžã§å®è¡ãããŸãã
- Open vSwitch (OVS) ã䜿çšãã (VMware 㧠- åæ£å vSwitch) ã¯ãäžå€®ã® OVN ãµãŒããŒãšç®¡ç察象ãã¹ãäžã® OVN ã³ã³ãããŒã©ãŒãšãã XNUMX ã€ã®äž»èŠã³ã³ããŒãã³ãã§æ§æãããåæ£ä»®æ³ã¹ã€ããã§ãã
å®è£ ãç°¡åãªããããã®èšäºã§ã¯ãKVM ãã€ããŒãã€ã¶ãŒã䜿çšããå Žåã®æšæºçãªéžæã§ãããæšæºã® Linux ããªããžã䜿çšã㊠VM ã® oVirt ã§ãããã¯ãŒã¯ãèšå®ããæ¹æ³ã«ã€ããŠèª¬æããããšã«æ³šæããŠãã ããã
ããã«é¢ããŠãã¯ã©ã¹ã¿ãŒå ã®ãããã¯ãŒã¯ãæäœããå Žåã«ã¯ãéåããªãããã«ããããã®åºæ¬çãªã«ãŒã«ãããã€ããããŸãã
- oVirt ã«è¿œå ããåã®ãã¹ãäžã®ãã¹ãŠã®ãããã¯ãŒã¯èšå®ã¯ãIP ã¢ãã¬ã¹ãé€ããŠåäžã§ããå¿ èŠããããŸãã
- ãã¹ãã oVirt ã®å¶åŸ¡äžã«çœ®ãããåŸã¯ãèªåã®ã¢ã¯ã·ã§ã³ã«å®å šãªèªä¿¡ãæããã«ãããã¯ãŒã¯èšå®ãæåã§å€æŽããããšã¯åŒ·ããå§ãã§ããŸãããããã¯ããã¹ããåèµ·åãããããšãŒãžã§ã³ãã
- VM ã®æ°ãããããã¯ãŒã¯ã®è¿œå ãšãã®æäœã¯ãoVirt 管çã³ã³ãœãŒã«ããã®ã¿è¡ãå¿ èŠããããŸãã
ããXNUMX〠éèŠãªæ³šæç¹ â éåžžã«ã¯ãªãã£ã«ã«ãªç°å¢ (ééçæ倱ã«éåžžã«ææ) ã®å Žåã¯ãäŸç¶ãšããŠææãµããŒãã䜿çšããããšããå§ãããŸãã
ãããŠæåŸã« ããããã§ã oVirt ã¯ã©ã¹ã¿ãŒããããã€ããåã«ã次ã®ããšãããç解ããŠãã ããã
ãã®èšäºãš oVirt ã¯ã©ã¹ã¿ãŒã®åäœåçãç解ããããã®åºæ¬ãšãªãã®ã¯ã次ã®ã¬ã€ãã³ã¹ ããã¥ã¡ã³ãã§ãã
oVirt ã€ã³ã¹ããŒã«ã¬ã€ã oVirt ã»ã«ããã¹ã ãšã³ãžã³ ã¬ã€ã oVirt 管çã¬ã€ã
ããªã¥ãŒã ã¯ããã»ã©å€ããªããXNUMX ïœ XNUMX æéããã°åºæ¬çãªåçãå®å
šã«ãã¹ã¿ãŒã§ããŸããã詳现ãç¥ãããæ¹ã¯ã以äžãèªãããšããå§ãããŸãã
ãããã£ãŠããã¹ããã¹ã€ãããã¹ãã¬ãŒãž ã·ã¹ãã ã®åºæ¬èšå®ããã¹ãŠå®äºããããoVirt ã®å±éã«çŽæ¥é²ã¿ãŸãã
ããŒã 2. oVirt 4.3 ã¯ã©ã¹ã¿ãŒã®ã€ã³ã¹ããŒã«ãšæ§æ
説æã容æã«ããããã«ããã®èšäºã®äž»èŠãªã»ã¯ã·ã§ã³ããªã¹ãããŸãããããã®ã»ã¯ã·ã§ã³ã¯ XNUMX ã€ãã€å®äºããå¿ èŠããããŸãã
- oVirt 管çãµãŒããŒã®ã€ã³ã¹ããŒã«
- æ°ããããŒã¿ã»ã³ã¿ãŒã®æ§ç¯
- æ°ããã¯ã©ã¹ã¿ãŒã®äœæ
- ã»ã«ããã¹ãç°å¢ãžã®è¿œå ãã¹ãã®ã€ã³ã¹ããŒã«
- ã¹ãã¬ãŒãžé åãŸãã¯ã¹ãã¬ãŒãžãã¡ã€ã³ã®äœæ
- ä»®æ³ãã·ã³ã®ãããã¯ãŒã¯ã®äœæãšæ§æ
- ä»®æ³ãã·ã³ããããã€ããããã®ã€ã³ã¹ããŒã« ã€ã¡ãŒãžã®äœæ
- ä»®æ³ãã·ã³ãäœæãã
oVirt 管çãµãŒããŒã®ã€ã³ã¹ããŒã«
oVirt管çãµãŒã㌠oVirt ã€ã³ãã©ã¹ãã©ã¯ãã£ã®æãéèŠãªèŠçŽ ã§ãããoVirt ã€ã³ãã©ã¹ãã©ã¯ãã£å šäœã管çããä»®æ³ãã·ã³ããã¹ãããŸãã¯ä»®æ³ããã€ã¹ã®åœ¢åŒã§ãã
ä»®æ³åã®äžçã§ã¯ãããã«ãã䌌ããã®ã¯æ¬¡ã®ãšããã§ãã
- VMware vSphere - vCenter Server
- Microsoft Hyper-V - System Center ä»®æ³ãã·ã³ ãããŒãžã£ãŒ (VMM)ã
oVirt 管çãµãŒããŒãã€ã³ã¹ããŒã«ããã«ã¯ã次㮠XNUMX ã€ã®ãªãã·ã§ã³ããããŸãã
ãªãã·ã§ã³1
ç¹æ®ãª VM ãŸãã¯ãã¹ãã®åœ¢åŒã§ãµãŒããŒãå±éããŸãã
ãã®ãªãã·ã§ã³ã¯éåžžã«ããŸãæ©èœããŸããããã®ãã㪠VM ãã¯ã©ã¹ã¿ãŒããç¬ç«ããŠåäœããå Žåãã€ãŸãã KVM ãå®è¡ããéåžžã®ä»®æ³ãã·ã³ãšããŠã¯ã©ã¹ã¿ãŒ ãã¹ãäžã§å®è¡ãããŠããŸããã
ãã®ãã㪠VM ãã¯ã©ã¹ã¿ãŒ ãã¹ãã«ãããã€ã§ããªãã®ã¯ãªãã§ãã?
oVirt 管çãµãŒããŒãå±éããããã»ã¹ã®æåã®æ®µéã§ããžã¬ã³ãããããŸãã管ç VM ãã€ã³ã¹ããŒã«ããå¿ èŠããããŸãããå®éã«ã¯ã¯ã©ã¹ã¿ãŒèªäœããŸã ååšããªãããããã®å Žã§äœãæãã€ãããšãã§ããã§ãããã? ããã§ããå°æ¥ã®ã¯ã©ã¹ã¿ãŒ ããŒãã« KVM ãã€ã³ã¹ããŒã«ãããã®äžã«ãããšãã° CentOS OS ã䜿çšããŠä»®æ³ãã·ã³ãäœæãããã®äžã« oVirt ãšã³ãžã³ããããã€ããŸãã ããã¯éåžžããã®ãã㪠VM ãå®å šã«å¶åŸ¡ãããšããçç±ã§å®è¡ã§ããŸããããã®å Žåãå°æ¥çã«ãã®ãããªå¶åŸ¡ VM ã« 100% åé¡ãçºçãããããããã¯èª€ã£ãæå³ã§ãã
- oVirt ã³ã³ãœãŒã«ã§ã¯ã©ã¹ã¿ãŒã®ãã¹ã (ããŒã) éã§ç§»è¡ããããšã¯ã§ããŸããã
- KVM ã䜿çšããŠç§»è¡ããå Žå ããŒã·ã¥ã®ç§»è¡ããã® VM 㯠oVirt ã³ã³ãœãŒã«ãã管çã§ããªããªããŸãã
- ã¯ã©ã¹ã¿ãã¹ãã¯è¡šç€ºã§ããŸãã ã¡ã³ããã³ã¹ã¢ãŒã (ã¡ã³ããã³ã¹ ã¢ãŒã)ã次ã䜿çšããŠãã® VM ããã¹ããããã¹ãã«ç§»è¡ããå Žå ããŒã·ã¥ã®ç§»è¡.
ãããã£ãŠãã«ãŒã«ã«åŸã£ãŠãã¹ãŠãå®è¡ããŸããoVirt 管çãµãŒããŒã«å¥ã®ãã¹ãã䜿çšãããããã®äžã§å®è¡ãããç¬ç«ãã VM ã䜿çšããããããã«è¯ãã®ã¯ãXNUMX çªç®ã®ãªãã·ã§ã³ã«èšèŒãããŠãããšããã«å®è¡ããããšã§ãã
ãªãã·ã§ã³2
oVirt Engine ã¢ãã©ã€ã¢ã³ã¹ã«ãã£ãŠç®¡çãããã¯ã©ã¹ã¿ãŒ ãã¹ãã« oVirt Engine ã¢ãã©ã€ã¢ã³ã¹ãã€ã³ã¹ããŒã«ããŸãã
ç§ãã¡ã®å Žåãããæ£ç¢ºã§é©åã§ãããšããã«èæ
®ãããã®ã¯ããã®ãªãã·ã§ã³ã§ãã
ãã®ãã㪠VM ã®èŠä»¶ã«ã€ããŠã¯ä»¥äžã§èª¬æããŸããããã©ãŒã«ã ãã¬ã©ã³ãã«ããããã«ãå¶åŸ¡ VM ãå®è¡ã§ããã€ã³ãã©ã¹ãã©ã¯ãã£å
ã«å°ãªããšã XNUMX ã€ã®ãã¹ããæã€ããšãæšå¥šãããããšã ããä»ãå ããŠãããŸãã ããã§ä»ãå ããŠããããã®ã§ãããåã®èšäºã®ã³ã¡ã³ãã«ãæžããŸããããç§ã¯æ±ºããŠååŸã§ããŸããã§ããã ã¹ããªãããã¬ã€ã³ XNUMX ã€ã®ãã¹ããããªã oVirt ã¯ã©ã¹ã¿ãŒäžã§ããã¹ãããããšã³ãžã³ VM ãå®è¡ããæ©èœãåããŠããŸãã
ã¯ã©ã¹ã¿ãŒã®æåã®ãã¹ããžã® oVirt Engine ã¢ãã©ã€ã¢ã³ã¹ã®ã€ã³ã¹ããŒã«
å
¬åŒããã¥ã¡ã³ããžã®ãªã³ã¯ -
ãã®ããã¥ã¡ã³ãã§ã¯ããã¹ã ãšã³ãžã³ VM ããããã€ããåã«æºããå¿ èŠãããåææ¡ä»¶ãæå®ããã€ã³ã¹ããŒã« ããã»ã¹èªäœã«ã€ããŠã詳现ã«èª¬æããŠããããããã®ãŸãŸç¹°ãè¿ãããšã«ããŸãæå³ããªããããããã€ãã®éèŠãªè©³çŽ°ã«çŠç¹ãåœãŠãŸãã
- ãã¹ãŠã®ã¢ã¯ã·ã§ã³ãéå§ããåã«ããã¹ãã® BIOS èšå®ã§ä»®æ³åãµããŒããå¿ ãæå¹ã«ããŠãã ããã
- ãã¹ã ãšã³ãžã³ ã€ã³ã¹ããŒã©ãŒã®ããã±ãŒãžããã¹ãã«ã€ã³ã¹ããŒã«ããŸãã
yum -y install http://resources.ovirt.org/pub/yum-repo/ovirt-release43.rpm
yum -y install epel-release
yum install screen ovirt-hosted-engine-setup
- ãã¹ãäžã®ç»é¢ã§ oVirt Hosted Engine ããããã€ããæé ãéå§ããŸã (Ctrl-A + D ã§çµäºãCtrl-D ã§éããããšãã§ããŸã)ã
screen
hosted-engine --deploy
å¿ èŠã«å¿ããŠãäºåã«æºåãããå¿çãã¡ã€ã«ã䜿çšããŠã€ã³ã¹ããŒã«ãå®è¡ã§ããŸãã
hosted-engine --deploy --config-append=/var/lib/ovirt-hosted-engine-setup/answers/answers-ohe.conf
- ãã¹ãåãšã³ãžã³ããããã€ãããšãã¯ãå¿ èŠãªãã©ã¡ãŒã¿ãŒããã¹ãŠæå®ããŸãã
- ÐžÐŒÑ ÐºÐ»Ð°ÑÑеÑа
- кПлОÑеÑÑвП vCPU О vRAM (ÑекПЌеМЎÑеÑÑÑ 4 vCPU О 16 Ðб)
- паÑПлО
- ÑОп Ñ
ÑаМОлОÑа ÐŽÐ»Ñ hosted engine ÐÐ â в МаÑеЌ ÑлÑÑае FC
- ÐœÐŸÐŒÐµÑ LUN ÐŽÐ»Ñ ÑÑÑаМПвкО hosted engine
- гЎе бÑÐŽÐµÑ ÐœÐ°Ñ
ПЎОÑÑÑÑ Ð±Ð°Ð·Ð° ЎаММÑÑ
ÐŽÐ»Ñ hosted engine â ÑекПЌеМЎÑÑ ÐŽÐ»Ñ Ð¿ÑПÑÑПÑÑ Ð²ÑбÑаÑÑ Local (ÑÑП ÐÐ PostgreSQL ÑабПÑаÑÑÐ°Ñ Ð²ÐœÑÑÑО ÑÑПй ÐÐ)
О ÐŽÑ. паÑаЌеÑÑÑ.
- ãã¹ãåãšã³ãžã³ãåããé«å¯çšæ§ VM ãã€ã³ã¹ããŒã«ããããã«ã以åã«ã¹ãã¬ãŒãž ã·ã¹ãã äžã«ãµã€ãº 4 㧠150 GB ã®ç¹å¥ãª LUN ãäœæãããããã¯ã©ã¹ã¿ãŒ ãã¹ãã«æäŸãããŸããããããåç
§ããŠãã ããã
åã®èšäº .
以åã¯ããã¹ãäžã§ã®å¯èŠæ§ããã§ãã¯ããŸããã
multipath -ll
âŠ
3600a098000e4b4b3000003c95d171065 dm-3 DELL , MD38xxf
size=150G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='service-time 0' prio=14 status=active
| `- 15:0:0:4 sdc 8:32 active ready running
`-+- policy='service-time 0' prio=9 status=enabled
`- 18:0:0:4 sdj 8:144 active ready running
- ãã¹ãåãšã³ãžã³ã®ãããã€ã¡ã³ãããã»ã¹èªäœã¯è€éã§ã¯ãªããæåŸã«æ¬¡ã®ãããªå 容ãåãåãã¯ãã§ãã
[ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20191129131846.conf'
[ INFO ] Generating answer file '/etc/ovirt-hosted-engine/answers.conf'
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
[ INFO ] Hosted Engine successfully deployed
ãã¹ãäžã® oVirt ãµãŒãã¹ã®ååšã確èªããŸãã
ãã¹ãŠãæ£ããè¡ãããå Žåã¯ãã€ã³ã¹ããŒã«ãå®äºããåŸãWeb ãã©ãŠã¶ã䜿çšããŠæ¬¡ã®å Žæã«ç§»åããŸãã
ã管çããŒã¿ã«ãã®ã¹ã¯ãªãŒã³ã·ã§ãã
ã¹ã¯ãªãŒã³ã·ã§ããã®ããã«ããã°ã€ã³ãšãã¹ã¯ãŒã (ã€ã³ã¹ããŒã« ããã»ã¹äžã«èšå®) ããŠã£ã³ããŠã«å ¥åãããšãOpen Virtualization Manager ã³ã³ãããŒã« ããã«ã衚瀺ãããä»®æ³ã€ã³ãã©ã¹ãã©ã¯ãã£ã«é¢ãããã¹ãŠã®ã¢ã¯ã·ã§ã³ãå®è¡ã§ããŸãã
- ããŒã¿ã»ã³ã¿ãŒãè¿œå ãã
- ã¯ã©ã¹ã¿ãŒãè¿œå ããŠæ§æãã
- ãã¹ãã®è¿œå ãšç®¡ç
- ä»®æ³ãã·ã³ãã£ã¹ã¯ã®ã¹ãã¬ãŒãžé åãŸãã¯ã¹ãã¬ãŒãžãã¡ã€ã³ãè¿œå ãã
- ä»®æ³ãã·ã³ã®ãããã¯ãŒã¯ãè¿œå ããã³æ§æãã
- ä»®æ³ãã·ã³ãã€ã³ã¹ããŒã« ã€ã¡ãŒãžãVM ãã³ãã¬ãŒãã®è¿œå ãšç®¡ç
ããããã¹ãŠã®ã¢ã¯ã·ã§ã³ã«ã€ããŠã¯ã倧èŠæš¡ãªã»ã«ã§ã®ã¢ã¯ã·ã§ã³ãããã°ããã詳现ãã€åŸ®åŠãªãã¥ã¢ã³ã¹ã䌎ããã®ãå«ããŠãããã«è©³ãã説æããŸãã
ããããæåã«ãã®ã¢ããªã³ãèªãããšããå§ãããŸããããã¯ããããå€ãã®äººã«ãšã£ãŠåœ¹ç«ã€ã§ãããã
è£è¶³
1) ååãšããŠããã®ãããªå¿ èŠãããå Žåã¯ãããã±ãŒãžã䜿çšããŠäºåã«ã¯ã©ã¹ã¿ãŒ ããŒãã« KVM ãã€ããŒãã€ã¶ãŒãã€ã³ã¹ããŒã«ããããšã劚ãããã®ã¯ãããŸããã libvirt О qemu-kvm ïŒãŸã㯠qemu-kvm-ev) ãå¿ èŠãªããŒãžã§ã³ã«è¿œå ããŸãããã ããoVirt ã¯ã©ã¹ã¿ãŒ ããŒãããããã€ããå Žåã¯ãããèªäœã§ãããè¡ãããšãã§ããŸãã
ããã libvirt О qemu-kvm ææ°ããŒãžã§ã³ãã€ã³ã¹ããŒã«ããŠããªãå Žåã¯ããã¹ãåãšã³ãžã³ããããã€ãããšãã«æ¬¡ã®ãšã©ãŒãçºçããå¯èœæ§ããããŸãã
error: unsupported configuration: unknown CPU feature: md-clear
ãããã®ã æã€å¿
èŠããããŸã
<feature policy='require' name='md-clear'/>
md-clear ãµããŒãã䜿çšã㊠libvirt v.4.5.0-10.el7_6.12 ãã€ã³ã¹ããŒã«ããŸãã
yum-config-manager --disable mirror.centos.org_centos-7_7_virt_x86_64_libvirt-latest_
yum install centos-release-qemu-ev
yum update
yum install qemu-kvm qemu-img virt-manager libvirt libvirt-python libvirt-client virt-install virt-viewer libguestfs libguestfs-tools dejavu-lgc-sans-fonts virt-top libvirt libvirt-python libvirt-client
systemctl enable libvirtd
systemctl restart libvirtd && systemctl status libvirtd
ãmd-clearãã®ãµããŒãã確èªããŸãã
virsh domcapabilities kvm | grep require
<feature policy='require' name='ss'/>
<feature policy='require' name='hypervisor'/>
<feature policy='require' name='tsc_adjust'/>
<feature policy='require' name='clflushopt'/>
<feature policy='require' name='pku'/>
<feature policy='require' name='md-clear'/>
<feature policy='require' name='stibp'/>
<feature policy='require' name='ssbd'/>
<feature policy='require' name='invtsc'/>
ãã®åŸããã¹ãåãšã³ãžã³ã®ã€ã³ã¹ããŒã«ãç¶è¡ã§ããŸãã
2) oVirt 4.3 ã§ã¯ããã¡ã€ã¢ãŠã©ãŒã«ã®ååšãšäœ¿çš ãã¡ã€ã¢ãŠã©ãŒã« ã¯å¿ é ã®èŠä»¶ã§ãã
ãã¹ãåãšã³ãžã³çšã® VM ã®ãããã€äžã«æ¬¡ã®ãšã©ãŒã衚瀺ãããå Žå:
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "firewalld is required to be enabled and active in order to correctly deploy hosted-engine. Please check, fix accordingly and re-deploy.n"}
[ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook
[https://bugzilla.redhat.com/show_bug.cgi?id=1608467
次ã«ãå¥ã®ãã¡ã€ã¢ãŠã©ãŒã« (䜿çšãããŠããå Žå) ããªãã«ããã€ã³ã¹ããŒã«ããŠå®è¡ããå¿ èŠããããŸãã ãã¡ã€ã¢ãŠã©ãŒã«:
yum install firewalld
systemctl enable firewalld
systemctl start firewalld
firewall-cmd --state
firewall-cmd --get-default-zone
firewall-cmd --get-active-zones
firewall-cmd --get-zones
åŸã§ã¯ã©ã¹ã¿ãŒã®æ°ãããã¹ãã« ovirt ãšãŒãžã§ã³ããã€ã³ã¹ããŒã«ãããšãã«ãå¿ èŠãªããŒããæ§æãããŸãã ãã¡ã€ã¢ãŠã©ãŒã« èªåçã
3) ãã¹ãããããšã³ãžã³ã䜿çšã㊠VM ãå®è¡ãããŠãããã¹ããåèµ·åããŸãã
éåžžã¯ã
ãã¹ãããããšã³ãžã³ VM ã®ãã¹ãŠã®ç®¡çã¯ã次ã®ã³ãã³ãã䜿çšããŠã®ã¿è¡ãããŸãã ãã¹ããšã³ãžã³ ãããå®è¡ããããã¹ãäžã§ãçŽ ããšãªãã SSH çµç±ã§ãã® VM ã«æ¥ç¶ããã³ãã³ããããå®è¡ã§ãããšããäºå®ãå¿ããŠã¯ãããŸãããshutdown'ã
VM ãã¡ã³ããã³ã¹ ã¢ãŒãã«ããæé :
hosted-engine --set-maintenance --mode=global
hosted-engine --vm-status
!! Cluster is in GLOBAL MAINTENANCE mode !!
--== Host host1.test.local (id: 1) status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : host1.test.local
Host ID : 1
Engine status : {"health": "good", "vm": "up", "detail": "Up"}
Score : 3400
stopped : False
Local maintenance : False
crc32 : dee1a774
local_conf_timestamp : 1821
Host timestamp : 1821
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=1821 (Sat Nov 29 14:25:19 2019)
host-id=1
score=3400
vm_conf_refresh_time=1821 (Sat Nov 29 14:25:19 2019)
conf_on_shared_storage=True
maintenance=False
state=GlobalMaintenance
stopped=False
hosted-engine --vm-shutdown
ãã¹ãããããšã³ãžã³ ãšãŒãžã§ã³ãã䜿çšããŠãã¹ããåèµ·åããå¿ èŠãªæäœãè¡ããŸãã
åèµ·ååŸããã¹ãããããšã³ãžã³ã䜿çšã㊠VM ã®ã¹ããŒã¿ã¹ã確èªããŸãã
hosted-engine --vm-status
ãã¹ãããããšã³ãžã³ãåãã VM ãèµ·åããããµãŒãã¹ ãã°ã«åæ§ã®ãšã©ãŒã衚瀺ãããå Žå:
ãµãŒãã¹ãã°ã®ãšã©ãŒ:
journalctl -u ovirt-ha-agent
...
Jun 29 14:34:44 host1 journal: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine ERROR Failed to start necessary monitors
Jun 29 14:34:44 host1 journal: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Traceback (most recent call last):#012 File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 131, in _run_agent#012 return action(he)#012 File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 55, in action_proper#012 return he.start_monitoring()#012 File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 413, in start_monitoring#012 self._initialize_broker()#012 File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 537, in _initialize_broker#012 m.get('options', {}))#012 File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 86, in start_monitor#012 ).format(t=type, o=options, e=e)#012RequestError: brokerlink - failed to start monitor via ovirt-ha-broker: [Errno 2] No such file or directory, [monitor: 'ping', options: {'addr': '172.20.32.32'}]
Jun 29 14:34:44 host1 journal: ovirt-ha-agent ovirt_hosted_engine_ha.agent.agent.Agent ERROR Trying to restart agent
次ã«ãã¹ãã¬ãŒãžã«æ¥ç¶ãããšãŒãžã§ã³ããåèµ·åããŸãã
hosted-engine --connect-storage
systemctl restart ovirt-ha-agent
systemctl status ovirt-ha-agent
hosted-engine --vm-start
hosted-engine --vm-status
ãã¹ãããããšã³ãžã³ã§ VM ãèµ·åããåŸãã¡ã³ããã³ã¹ ã¢ãŒãã解é€ããŸãã
VM ãã¡ã³ããã³ã¹ ã¢ãŒãããåé€ããæé :
hosted-engine --check-liveliness
hosted-engine --set-maintenance --mode=none
hosted-engine --vm-status
--== Host host1.test.local (id: 1) status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : host1.test.local
Host ID : 1
Engine status : {"health": "good", "vm": "up", "detail": "Up"}
Score : 3400
stopped : False
Local maintenance : False
crc32 : 6d1eb25f
local_conf_timestamp : 6222296
Host timestamp : 6222296
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=6222296 (Fri Jan 17 11:40:43 2020)
host-id=1
score=3400
vm_conf_refresh_time=6222296 (Fri Jan 17 11:40:43 2020)
conf_on_shared_storage=True
maintenance=False
state=EngineUp
stopped=False
4) ãã¹ãããããšã³ãžã³ãšããã«é¢é£ãããã¹ãŠã®ãã®ãåé€ããŸãã
å Žåã«ãã£ãŠã¯ã以åã«ã€ã³ã¹ããŒã«ãããã¹ãåãšã³ãžã³ãé©åã«åé€ããå¿
èŠãããå ŽåããããŸãã
ãã¹ãäžã§ã³ãã³ããå®è¡ããã ãã§ãã
/usr/sbin/ovirt-hosted-engine-cleanup
次ã«ãå¿ èŠã«å¿ããŠããã®åã«ããã€ãã®æ§æãããã¯ã¢ããããäžèŠãªããã±ãŒãžãåé€ããŸãã
yum autoremove ovirt* qemu* virt* libvirt* libguestfs
æ°ããããŒã¿ã»ã³ã¿ãŒã®æ§ç¯
åèããã¥ã¡ã³ã - oVirt 管çã¬ã€ãã
ãŸããããäœã§ããããå®çŸ©ããŸããã ããŒã¿ã»ã³ã¿ãŒ (ãã«ãããåŒçš) ã¯ãç¹å®ã®ç°å¢ã§äœ¿çšããããªãœãŒã¹ã®ã»ãããå®çŸ©ããè«çãšã³ãã£ãã£ã§ãã
ããŒã¿ã»ã³ã¿ãŒã¯ã次ã®ãã®ã§æ§æãããäžçš®ã®ã³ã³ããã§ãã
- ã¯ã©ã¹ã¿ãŒãšãã¹ãã®åœ¢åŒã®è«çãªãœãŒã¹
- ãã¹ãäžã®è«çãããã¯ãŒã¯ãšç©çã¢ããã¿ãŒã®åœ¢åŒã®ã¯ã©ã¹ã¿ãŒ ãããã¯ãŒã¯ ãªãœãŒã¹ã
- ã¹ãã¬ãŒãžé åïŒã¹ãã¬ãŒãžãã¡ã€ã³ïŒã®åœ¢åŒã®ã¹ãã¬ãŒãžãªãœãŒã¹ïŒVMãã£ã¹ã¯ããã³ãã¬ãŒããã€ã¡ãŒãžïŒã
ããŒã¿ã»ã³ã¿ãŒã«ã¯ãä»®æ³ãã·ã³ãå®è¡ãããŠããè€æ°ã®ãã¹ãã§æ§æãããè€æ°ã®ã¯ã©ã¹ã¿ãŒãå«ããããšãã§ããããã«é¢é£ä»ããããè€æ°ã®ã¹ãã¬ãŒãžé åãæã€ããšãã§ããŸãã
è€æ°ã®ããŒã¿ã»ã³ã¿ãŒãååšããå Žåãããããããã¯äºãã«ç¬ç«ããŠåäœããŸãã Ovirt ã«ã¯åœ¹å²ããšã«æš©éãåé¢ãããŠãããããŒã¿ã»ã³ã¿ãŒ ã¬ãã«ãšåã
ã®è«çèŠçŽ ã®äž¡æ¹ã§æš©éãåå¥ã«æ§æã§ããŸãã
ããŒã¿ ã»ã³ã¿ãŒ (è€æ°ã®ããŒã¿ ã»ã³ã¿ãŒãããå Žå) ã¯ãåäžã®ç®¡çã³ã³ãœãŒã«ãŸãã¯ããŒã¿ã«ãã管çãããŸãã
ããŒã¿ ã»ã³ã¿ãŒãäœæããã«ã¯ã管çããŒã¿ã«ã«ç§»åããæ°ããããŒã¿ ã»ã³ã¿ãŒãäœæããŸãã
èšç® >> ããŒã¿ã»ã³ã¿ãŒ >> æ°äœ
ã¹ãã¬ãŒãž ã·ã¹ãã äžã§å ±æã¹ãã¬ãŒãžã䜿çšãããããã¹ãã¬ãŒãž ã¿ã€ãã¯å ±æã§ããå¿ èŠããããŸãã
ããŒã¿ã»ã³ã¿ãŒäœæãŠã£ã¶ãŒãã®ã¹ã¯ãªãŒã³ã·ã§ãã
ãã¹ãåãšã³ãžã³ã䜿çšããŠä»®æ³ãã·ã³ãã€ã³ã¹ããŒã«ãããšãããã©ã«ãã§ããŒã¿ã»ã³ã¿ãŒãäœæãããŸãã ããŒã¿ã»ã³ã¿ãŒ1ãã¯ãªãã¯ããå¿ èŠã«å¿ããŠã¹ãã¬ãŒãž ã¿ã€ããå¥ã®ã¹ãã¬ãŒãž ã¿ã€ãã«å€æŽããŸãã
ããŒã¿ã»ã³ã¿ãŒã®äœæã¯ç°¡åãªã¿ã¹ã¯ã§ãè€éãªãã¥ã¢ã³ã¹ã¯ãããŸãããããŒã¿ã»ã³ã¿ãŒã®äœæã«é¢ãããã¹ãŠã®è¿œå ã¢ã¯ã·ã§ã³ã¯ããã¥ã¡ã³ãã§èª¬æãããŠããŸãã å¯äžæ³šæãã¹ãç¹ã¯ãVM çšã®ããŒã«ã« ã¹ãã¬ãŒãž (ãã£ã¹ã¯) ã®ã¿ãæã€åäžãã¹ãã¯ãã¹ãã¬ãŒãž ã¿ã€ã - å ±æã®ããŒã¿ ã»ã³ã¿ãŒã«ã¢ã¯ã»ã¹ã§ããªã (ããã«è¿œå ããããšã¯ã§ããªã) ããããããã«å¯ŸããŠã¯ãå¥ã®ããŒã¿ã»ã³ã¿ãŒ - ã€ãŸãããŒã«ã« ã¹ãã¬ãŒãžãåããåã ã®ãã¹ãã«ã¯ãç¬èªã®åå¥ã®ããŒã¿ ã»ã³ã¿ãŒãå¿ èŠã§ãã
æ°ããã¯ã©ã¹ã¿ãŒã®äœæ
ããã¥ã¡ã³ããžã®ãªã³ã¯ - oVirt 管çã¬ã€ãã
äœèšãªè©³çŽ°ã¯æãã«ããŠã éãŸã â ããã¯ãå ±éã®ã¹ãã¬ãŒãžé å (ãã®å Žåã®ããã«ãã¹ãã¬ãŒãž ã·ã¹ãã äžã®å ±æãã£ã¹ã¯ã®åœ¢åŒ) ãæã€ãã¹ãã®è«çã°ã«ãŒãã§ãã ãŸããã¯ã©ã¹ã¿å ã®ãã¹ãã¯ããŒããŠã§ã¢ãåäžã§ãããåãã¿ã€ãã®ããã»ããµ (Intel ãŸã㯠AMD) ãæèŒããŠããããšãæãŸããã§ãã ãã¡ãããã¯ã©ã¹ã¿ãŒå ã®ãµãŒããŒãå®å šã«åäžã§ããããšãæåã§ãã
ã¯ã©ã¹ã¿ãŒã¯ããŒã¿ã»ã³ã¿ãŒã®äžéšã§ã (ç¹å®ã®çš®é¡ã®ã¹ãã¬ãŒãžãåããŠããŸã) ããŒã«ã« ãŸãã¯ å ±æ)ããã¹ãŠã®ãã¹ãã¯ãå ±æã¹ãã¬ãŒãžããããã©ããã«å¿ããŠãäœããã®çš®é¡ã®ã¯ã©ã¹ã¿ãŒã«å±ããŠããå¿ èŠããããŸãã
ãã¹ãäžã«ãã¹ãããããšã³ãžã³ãåããä»®æ³ãã·ã³ãã€ã³ã¹ããŒã«ãããšãããã©ã«ãã§ããŒã¿ã»ã³ã¿ãŒãäœæãããŸãã ããŒã¿ã»ã³ã¿ãŒ1ãã¯ã©ã¹ã¿ãŒãšäžç·ã« â ã¯ã©ã¹ã¿ãŒ1ããããŠå°æ¥çã«ã¯ããã®ãã©ã¡ãŒã¿ãèšå®ããããè¿œå ã®ãªãã·ã§ã³ãæå¹ã«ããããããã«ãã¹ããè¿œå ãããããããšãã§ããŸãã
ãã€ãã®ããã«ããã¹ãŠã®ã¯ã©ã¹ã¿ãŒèšå®ã®è©³çŽ°ã«ã€ããŠã¯ãå ¬åŒããã¥ã¡ã³ããåç §ããããšããå§ãããŸãã ã¯ã©ã¹ã¿ãŒã®ã»ããã¢ããæ©èœã®äžéšã«ã€ããŠã¯ãã¯ã©ã¹ã¿ãŒã®äœææã«ã¿ãã§åºæ¬ãã©ã¡ãŒã¿ãŒã®ã¿ãæ§æããã ãã§ååã§ããããšã ããè¿œå ããŸãã .
æãéèŠãªãã©ã¡ãŒã¿ãã¡ã¢ããŸãã
- ããã»ããµã¿ã€ã â ã¯ã©ã¹ã¿ãŒ ãã¹ãã«ã€ã³ã¹ããŒã«ãããŠããããã»ããµãŒãããã»ããµãŒã®è£œé å ããã¹ãäžã®ã©ã®ããã»ããµãŒãæãå€ããã«åºã¥ããŠéžæãããŸããããã«å¿ããŠãã¯ã©ã¹ã¿ãŒå ã§äœ¿çšå¯èœãªãã¹ãŠã®ããã»ããµãŒåœä»€ã䜿çšãããŸãã
- ã¹ã€ããã¿ã€ã â ç§ãã¡ã®ã¯ã©ã¹ã¿ãŒã§ã¯ Linux ããªããžã®ã¿ã䜿çšããããããããéžæããŸãã
- ãã¡ã€ã¢ãŠã©ãŒã«ã®çš®é¡ â ããã§ãã¹ãŠãæããã§ãããã㯠firewalld ã§ããããã¹ãäžã§æå¹ã«ããŠæ§æããå¿ èŠããããŸãã
ã¯ã©ã¹ã¿ãŒãã©ã¡ãŒã¿ãŒãå«ãã¹ã¯ãªãŒã³ã·ã§ãã
ã»ã«ããã¹ãç°å¢ãžã®è¿œå ãã¹ãã®ã€ã³ã¹ããŒã«
ã»ã«ããã¹ãç°å¢ã®è¿œå ãã¹ãã¯ãéåžžã®ãã¹ããšåãæ¹æ³ã§è¿œå ãããŸããããã¹ãåãšã³ãžã³ãåãã VM ããããã€ããè¿œå æé ãå¿
èŠã§ãã ãã¹ãåãšã³ãžã³ã®ãããã€ã¡ã³ãã¢ã¯ã·ã§ã³ãéžæããŠãã ãã >> é
åããŸãã è¿œå ã®ãã¹ãã«ã¯ããã¹ãåãšã³ãžã³ãåãã VM ã® LUN ãæäŸããå¿
èŠããããããå¿
èŠã«å¿ããŠããã®ãã¹ãã䜿çšããŠããã¹ãåãšã³ãžã³ãåãã VM ããã¹ãã§ããããšã«ãªããŸãã
ãã©ãŒã«ã ãã¬ã©ã³ã¹ãç®çãšããŠããã¹ã ãšã³ãžã³ VM ãé
眮ã§ãããã¹ããå°ãªããšã XNUMX ã€ããããšã匷ããå§ãããŸãã
è¿œå ã®ãã¹ãã§ãiptables ãç¡å¹ã«ã (æå¹ãªå Žå)ãfirewalld ãæå¹ã«ããŸãã
systemctl stop iptables
systemctl disable iptables
systemctl enable firewalld
systemctl start firewalld
å¿ èŠãª KVM ããŒãžã§ã³ãã€ã³ã¹ããŒã«ããŸã (å¿ èŠãªå Žå)ã
yum-config-manager --disable mirror.centos.org_centos-7_7_virt_x86_64_libvirt-latest_
yum install centos-release-qemu-ev
yum update
yum install qemu-kvm qemu-img virt-manager libvirt libvirt-python libvirt-client virt-install virt-viewer libguestfs libguestfs-tools dejavu-lgc-sans-fonts virt-top libvirt libvirt-python libvirt-client
systemctl enable libvirtd
systemctl restart libvirtd && systemctl status libvirtd
virsh domcapabilities kvm | grep md-clear
å¿ èŠãªãªããžããªãšãã¹ãåãšã³ãžã³ ã€ã³ã¹ããŒã©ãŒãã€ã³ã¹ããŒã«ããŸãã
yum -y install http://resources.ovirt.org/pub/yum-repo/ovirt-release43.rpm
yum -y install epel-release
yum update
yum install screen ovirt-hosted-engine-setup
次ã«ãã³ã³ãœãŒã«ã«ç§»åããŸã ä»®æ³åãããŒãžã£ãŒãéããæ°ãããã¹ããè¿œå ããã§æžãããŠããããã«ãã¹ãŠã段éçã«å®è¡ããŸãã
ãã®çµæãè¿œå ã®ãã¹ããè¿œå ãããšã管çã³ã³ãœãŒã«ã«ã¹ã¯ãªãŒã³ã·ã§ããã®ãããªç»åã衚瀺ãããã¯ãã§ãã
管çããŒã¿ã« - ãã¹ãã®ã¹ã¯ãªãŒã³ã·ã§ãã
ãã¹ã ãšã³ãžã³ VM ãçŸåšã¢ã¯ãã£ãã«ãªã£ãŠãããã¹ãã«ã¯ãéè²ã®çå ãšããã¹ãããããšã³ãžã³ VM ã®å®è¡"ãå¿ èŠã«å¿ããŠãã® VM ãèµ·åã§ãããã¹ã - ç¢æ"ãã¹ãåãšã³ãžã³ VM ãå®è¡ã§ãã'ã
ãã¹ãã«é害ãçºçããå Žåãããã¹ãããããšã³ãžã³ VM ã®å®è¡ããšæå®ãããšãXNUMX çªç®ã®ãã¹ãã§èªåçã«åèµ·åãããŸãã ãã® VM ã¯ãã¡ã³ããã³ã¹ã®ããã«ã¢ã¯ãã£ã ãã¹ãããã¹ã¿ã³ã〠ãã¹ãã«ç§»è¡ããããšãã§ããŸãã
oVirt ãã¹ãã§ã®é»æºç®¡ç/ãã§ã³ã·ã³ã°ã®ã»ããã¢ãã
ããã¥ã¡ã³ãã®ãªã³ã¯:
- Red Hat Virtualization 4.3 â> ãã¯ãã«ã«ãªãã¡ã¬ã³ã¹ â>
第4ç« é»æºç®¡ç - oVirt 管çã¬ã€ã ->
第 7 ç« : ãã¹ã
ãã¹ãã®è¿œå ãšæ§æãå®äºããããã«èŠãããããããŸããããããã¯å®å
šã«çå®ã§ã¯ãããŸããã
ãã¹ããæ£åžžã«åäœããããã¹ãã®é害ãç¹å®/解決ããã«ã¯ãé»æºç®¡ç/ãã§ã³ã·ã³ã°èšå®ãå¿
èŠã§ãã
Fencingãã§ã³ã·ã³ã°ããŸãã¯ãã§ã³ã·ã³ã°ã¯ãé害ã®ãããã¹ããŸãã¯å€±æãããã¹ããã¯ã©ã¹ã¿ãŒããäžæçã«é€å€ããããã»ã¹ã§ããããã®éã«ããã¹ãäžã® oVirt ãµãŒãã¹ãŸãã¯ãã¹ãèªäœãåèµ·åãããŸãã
é»æºç®¡ç/ãã§ã³ã·ã³ã°ã®å®çŸ©ãšãã©ã¡ãŒã¿ã«é¢ãã詳现ã¯ããã€ãã®ããã«ããã¥ã¡ã³ãã«èšèŒãããŠããŸãããiDRAC 640 ãæèŒãã Dell R9 ãµãŒããŒã«é©çšããããã®éèŠãªãã©ã¡ãŒã¿ã®èšå®æ¹æ³ã®äŸã®ã¿ã瀺ããŸãã
- 管çããŒã¿ã«ã«ç§»åãã èšç® >> ãã¹ã ãã¹ããéžæããŸãã
- ã¯ãªã㯠線é.
- ã¿ããã¯ãªãã¯ããŸã ãã¯ãŒãããžã¡ã³ã.
- ãªãã·ã§ã³ã®æšªã«ããããã¯ã¹ã«ãã§ãã¯ãå ¥ããŸã é»æºç®¡çãæå¹ã«ãã.
- ãªãã·ã§ã³ã®æšªã«ããããã¯ã¹ã«ãã§ãã¯ãå ¥ããŸã Kdumpã®çµ±åã«ãŒãã« ã¯ã©ãã·ã¥ ãã³ãã®èšé²äžã«ãã¹ãããã§ã³ã·ã³ã° ã¢ãŒãã«ç§»è¡ããã®ãé²ããŸãã
泚æããŠãã ããã
ãã§ã«å®è¡äžã®ãã¹ã㧠Kdump çµ±åãæå¹ã«ããåŸããoVirt 管çã¬ã€ããã®æé ã«åŸã£ãŠåã€ã³ã¹ããŒã«ããå¿
èŠããããŸã ->
- ãªãã·ã§ã³ã§ãããã¯ã¹ã«ãã§ãã¯ãå ¥ããããšãã§ããŸã é»æºç®¡çã®ããªã·ãŒå¶åŸ¡ãç¡å¹ã«ãããã¹ãã®é»æºç®¡çãã¯ã©ã¹ã¿ãŒã®ã¹ã±ãžã¥ãŒã« ããªã·ãŒã«ãã£ãŠå¶åŸ¡ããããªãå Žåã
- ãã¿ã³ (+) æ°ããé»æºç®¡çããã€ã¹ãè¿œå ããã«ã¯ããšãŒãžã§ã³ãã®ããããã£ç·šéãŠã£ã³ããŠãéããŸãã
iDRAC9 ã®å Žåã¯ã次ã®ãã£ãŒã«ãã«å ¥åããŸãã- äœæ â iDRAC9ã¢ãã¬ã¹
- ãŠãŒã¶ãŒåãã¹ã¯ãŒã â iDRAC9 ã«ãã°ã€ã³ããããã®ãã°ã€ã³ãšãã¹ã¯ãŒãããããã
- ã¿ã€ã âdrac5
- ããŒã¯ ã»ãã¥ã¢ãŒ
- 次ã®ãªãã·ã§ã³ãè¿œå ããŸãã cmd_prompt=>,login_timeout=30
ãã¹ãããããã£ã®ãé»æºç®¡çããã©ã¡ãŒã¿ãå«ãã¹ã¯ãªãŒã³ã·ã§ãã
ã¹ãã¬ãŒãžé åãŸãã¯ã¹ãã¬ãŒãžãã¡ã€ã³ã®äœæ
ããã¥ã¡ã³ããžã®ãªã³ã¯ - oVirt 管çã¬ã€ãã
ã¹ãã¬ãŒãžãã¡ã€ã³ããŸãã¯ã¹ãã¬ãŒãžé åã¯ãä»®æ³ãã·ã³ã®ãã£ã¹ã¯ãã€ã³ã¹ããŒã« ã€ã¡ãŒãžããã³ãã¬ãŒããã¹ãããã·ã§ãããä¿åããããã®éäžçãªå Žæã§ãã
ã¹ãã¬ãŒãžé åã¯ãããŸããŸãªãããã³ã«ãã¯ã©ã¹ã¿ãŒããããã¯ãŒã¯ ãã¡ã€ã« ã·ã¹ãã ã䜿çšããŠããŒã¿ ã»ã³ã¿ãŒã«æ¥ç¶ã§ããŸãã
oVirt ã«ã¯ XNUMX çš®é¡ã®ã¹ãã¬ãŒãžé åããããŸãã
- ããŒã¿ãã¡ã€ã³ â ä»®æ³ãã·ã³ (ãã£ã¹ã¯ããã³ãã¬ãŒã) ã«é¢é£ä»ãããããã¹ãŠã®ããŒã¿ãä¿åããŸãã Data Domain ãç°ãªãããŒã¿ã»ã³ã¿ãŒéã§å ±æããããšã¯ã§ããŸããã
- ISO ãã¡ã€ã³ (æ§åŒã®ã¹ãã¬ãŒãžé å) â OS ã€ã³ã¹ããŒã« ã€ã¡ãŒãžã®ä¿åçšã ISO ãã¡ã€ã³ã¯ãç°ãªãããŒã¿ã»ã³ã¿ãŒéã§å ±æã§ããŸãã
- ãã¡ã€ã³ã®ãšã¯ã¹ããŒã (æ§åŒã®ã¹ãã¬ãŒãžé å) â ããŒã¿ã»ã³ã¿ãŒéã§ç§»åãããç»åã®äžæã¹ãã¬ãŒãžçšã
ãã®ç¹å®ã®ã±ãŒã¹ã§ã¯ãData Domain ã¿ã€ãã®ã¹ãã¬ãŒãžé åã¯ããã¡ã€ã㌠ãã£ãã« ãããã³ã« (FCP) ã䜿çšããŠã¹ãã¬ãŒãž ã·ã¹ãã äžã® LUN ã«æ¥ç¶ããŸãã
oVirt ã®èŠ³ç¹ããèŠããšãã¹ãã¬ãŒãž ã·ã¹ãã (FC ãŸã㯠iSCSI) ã䜿çšããå Žåãåä»®æ³ãã£ã¹ã¯ãã¹ãããã·ã§ããããŸãã¯ãã³ãã¬ãŒãã¯è«çãã£ã¹ã¯ã«ãªããŸãã
ããã㯠ããã€ã¹ã¯ãããªã¥ãŒã ã°ã«ãŒãã䜿çšã㊠(ã¯ã©ã¹ã¿ãŒ ãã¹ãäžã§) åäžã®ãŠãããã«çµã¿ç«ãŠãããLVM ã䜿çšããŠè«çããªã¥ãŒã ã«åå²ãããVM ã®ä»®æ³ãã£ã¹ã¯ãšããŠäœ¿çšãããŸãã
ããããã¹ãŠã®ã°ã«ãŒããšå€ãã® LVM ããªã¥ãŒã ã¯ã次ã®ã³ãã³ãã䜿çšããŠã¯ã©ã¹ã¿ãŒ ãã¹ãäžã§ç¢ºèªã§ããŸãã vgs О lvsã åœç¶ã®ããšãªããããã®ãããªãã£ã¹ã¯ã䜿çšãããã¹ãŠã®ã¢ã¯ã·ã§ã³ã¯ãç¹å¥ãªå Žåãé€ããŠãoVirt ã³ã³ãœãŒã«ããã®ã¿å®è¡ããå¿ èŠããããŸãã
VM ã®ä»®æ³ãã£ã¹ã¯ã«ã¯ãQCOW2 ãŸã㯠RAW ã® XNUMX ã€ã®ã¿ã€ãããããŸãã ãã£ã¹ã¯ã¯ã现ãããŸãã¯ãåã"ãã¹ãããã·ã§ããã¯åžžã«æ¬¡ã®ããã«äœæãããŸãã"èã".
ã¹ãã¬ãŒãž ãã¡ã€ã³ãã€ãŸã FC çµç±ã§ã¢ã¯ã»ã¹ãããã¹ãã¬ãŒãžé åã管çããæ¹æ³ã¯éåžžã«è«ççã§ããå VM ä»®æ³ãã£ã¹ã¯ã«ã¯ãXNUMX ã€ã®ãã¹ãã®ã¿ãæžã蟌ã¿å¯èœãªåå¥ã®è«çããªã¥ãŒã ããããŸãã FC æ¥ç¶ã®å ŽåãoVirt ã¯ã¯ã©ã¹ã¿ãŒåããã LVM ã®ãããªãã®ã䜿çšããŸãã
åãã¹ãã¬ãŒãžé åã«ããä»®æ³ãã·ã³ã¯ãåãã¯ã©ã¹ã¿ã«å±ãããã¹ãéã§ç§»è¡ã§ããŸãã
説æãããããããã«ãoVirt ã®ã¯ã©ã¹ã¿ãŒã¯ãVMware vSphere ã Hyper-V ã®ã¯ã©ã¹ã¿ãŒãšåæ§ãæ¬è³ªçã«åãããšãæå³ããŸãããã¹ãã®è«çã°ã«ãŒãã§ãããããŒããŠã§ã¢æ§æãåäžã§ããããšãæãŸãããä»®æ³ã¹ãã¬ãŒãžã«å ±éã®ã¹ãã¬ãŒãžãåããŠããŸãããã·ã³ãã£ã¹ã¯ã
ããŒã¿çšã®ã¹ãã¬ãŒãžé å (VM ãã£ã¹ã¯) ã®äœæã«çŽæ¥é²ã¿ãŸããããããããªããšããŒã¿ã»ã³ã¿ãŒã¯åæåãããŸããã
ã¹ãã¬ãŒãž ã·ã¹ãã äžã®ã¯ã©ã¹ã¿ ãã¹ãã«æäŸããããã¹ãŠã® LUN ã¯ãã³ãã³ãããã«ããã¹ -ll'ã
ã«ãã
ãŠã£ã¶ãŒããèµ·åããããå¿ èŠãªãã£ãŒã«ãã«å ¥åããŸãã
- åå â ã¯ã©ã¹ã¿ãŒåãèšå®ããŸã
- ãã¡ã€ã³æ©èœ -ããŒã¿
- ä¿ç®¡ã¿ã€ã â ãã¡ã€ããŒãã£ãã«
- 䜿çšãããã¹ã â å¿ èŠãª LUN ã䜿çšå¯èœãªãã¹ããéžæããŸã
LUN ã®ãªã¹ãã§ãå¿ èŠãª LUN ã«ããŒã¯ãä»ããŠã Add ãã㊠ÐÐã å¿ èŠã«å¿ããŠã ãã¯ãªãã¯ããŠãã¹ãã¬ãŒãžé åã®è¿œå ãã©ã¡ãŒã¿ã調æŽã§ããŸãã é«åºŠãªãã©ã¡ãŒã¿.
ãã¹ãã¬ãŒãžãã¡ã€ã³ãè¿œå ãŠã£ã¶ãŒãã®ã¹ã¯ãªãŒã³ã·ã§ãã
ãŠã£ã¶ãŒãã®çµæã«åºã¥ããŠãæ°ããã¹ãã¬ãŒãžé åãåãåããããŒã¿ã»ã³ã¿ãŒã¯æ¬¡ã®ã¹ããŒã¿ã¹ã«ç§»è¡ããã¯ãã§ãã UPããŸãã¯åæåãããŠããŸã:
ããŒã¿ã»ã³ã¿ãŒãšãã®äžã®ã¹ãã¬ãŒãžé åã®ã¹ã¯ãªãŒã³ã·ã§ãã:
ä»®æ³ãã·ã³ã®ãããã¯ãŒã¯ã®äœæãšæ§æ
ããã¥ã¡ã³ããžã®ãªã³ã¯ - oVirt 管çã¬ã€ãã
ãããã¯ãŒã¯ã¯ãoVirt ä»®æ³ã€ã³ãã©ã¹ãã©ã¯ãã£ã§äœ¿çšãããè«çãããã¯ãŒã¯ãã°ã«ãŒãåããããã«æ©èœããŸãã
ä»®æ³ãã·ã³äžã®ãããã¯ãŒã¯ ã¢ããã¿ãšãã¹ãäžã®ç©çã¢ããã¿ã®éã§å¯Ÿè©±ããã«ã¯ãLinux ããªããžãªã©ã®è«çã€ã³ã¿ãŒãã§ã€ã¹ã䜿çšãããŸãã
ãããã¯ãŒã¯éã§ãã©ãã£ãã¯ãã°ã«ãŒãåããŠåå²ããããã«ãã¹ã€ããäžã« VLAN ãæ§æãããŸãã
oVirt ã§ä»®æ³ãã·ã³ã®è«çãããã¯ãŒã¯ãäœæããå Žåã¯ãã¯ã©ã¹ã¿ã®ç°ãªãããŒãã§å®è¡ãããŠããå Žåã§ã VM ãçžäºã«éä¿¡ã§ããããã«ãã¹ã€ããäžã® VLAN çªå·ã«å¯Ÿå¿ããèå¥åãå²ãåœãŠãå¿ èŠããããŸãã
ä»®æ³ãã·ã³ãæ¥ç¶ããããã®ãã¹ãäžã®ãããã¯ãŒã¯ ã¢ããã¿ãŒã®äºåèšå®ã¯ã
ãã¹ãããããšã³ãžã³ã§ VM ãäœæããåŸãããŒã¿ã»ã³ã¿ãŒãšã¯ã©ã¹ã¿ãŒã®èªåäœæã«å ããŠãã¯ã©ã¹ã¿ãŒã管çããããã®è«çãããã¯ãŒã¯ãèªåçã«äœæãããŸããã ãªããªãã管çããã® VM ãæ¥ç¶ãããŠããå Žæã
å¿ èŠã«å¿ããŠãè«çãããã¯ãŒã¯èšå®ã衚瀺ã§ããŸãã ãªããªãã管ç ãã ããoVirt ã€ã³ãã©ã¹ãã©ã¯ãã£ã®å¶åŸ¡ã倱ããªãããã«æ³šæããå¿ èŠããããŸãã
è«çãããã¯ãŒã¯èšå® ovritmgmt
éåžžã® VM çšã«æ°ããè«çãããã¯ãŒã¯ãäœæããã«ã¯ã管çããŒã¿ã«ã§æ¬¡ã®å Žæã«ç§»åããŸãã ãããã¯ãŒã¯ >> ãããã¯ãŒã¯ >> æ°äœãããã³ã¿ãäž ç®çã® VLAN ID ãæã€ãããã¯ãŒã¯ãè¿œå ããããã®æšªã®ããã¯ã¹ããã§ãã¯ããŸããVMãããã¯ãŒã¯"ãããã¯ãVM ãžã®å²ãåœãŠã«äœ¿çšã§ããããšãæå³ããŸãã
æ°ãã VLAN32 è«çãããã¯ãŒã¯ã®ã¹ã¯ãªãŒã³ã·ã§ãã
ã¿ã ã¯ã©ã¹ã¿ããã®ãããã¯ãŒã¯ãã¯ã©ã¹ã¿ãŒã«æ¥ç¶ããŸã ã¯ã©ã¹ã¿ãŒ1.
ãã®åŸã次ãžè¡ããŸã èšç® >> ãã¹ããåãã¹ãã«é çªã«ç§»åããã¿ãã«ç§»åããŸã ãããã¯ãŒã¯ã€ã³ã¿ãŒãã§ãŒã¹ãã¯ãªãã¯ããŠãŠã£ã¶ãŒããèµ·åããŸã ãã¹ããããã¯ãŒã¯ã®ã»ããã¢ãããæ°ããè«çãããã¯ãŒã¯ã®ãã¹ãã«ãã€ã³ãããŸãã
ããã¹ã ãããã¯ãŒã¯ã®ã»ããã¢ããããŠã£ã¶ãŒãã®ã¹ã¯ãªãŒã³ã·ã§ãã
oVirt ãšãŒãžã§ã³ãã¯ããã¹ãäžã§å¿ èŠãªãããã¯ãŒã¯èšå®ããã¹ãŠèªåçã«è¡ããVLAN ãš BRIDGE ãäœæããŸãã
ãã¹ãäžã®æ°ãããããã¯ãŒã¯ã®æ§æãã¡ã€ã«ã®äŸ:
cat ifcfg-bond1
# Generated by VDSM version 4.30.17.1
DEVICE=bond1
BONDING_OPTS='mode=1 miimon=100'
MACADDR=00:50:56:82:57:52
ONBOOT=yes
MTU=1500
DEFROUTE=no
NM_CONTROLLED=no
IPV6INIT=no
cat ifcfg-bond1.432
# Generated by VDSM version 4.30.17.1
DEVICE=bond1.432
VLAN=yes
BRIDGE=ovirtvm-vlan432
ONBOOT=yes
MTU=1500
DEFROUTE=no
NM_CONTROLLED=no
IPV6INIT=no
cat ifcfg-ovirtvm-vlan432
# Generated by VDSM version 4.30.17.1
DEVICE=ovirtvm-vlan432
TYPE=Bridge
DELAY=0
STP=off
ONBOOT=yes
MTU=1500
DEFROUTE=no
NM_CONTROLLED=no
IPV6INIT=no
ã¯ã©ã¹ã¿ãŒãã¹ãäžã§ã®ããšãããäžåºŠæãåºãããŠãã ããã å¿ èŠã¯ãããŸã äºåã«ãããã¯ãŒã¯ã€ã³ã¿ãŒãã§ã€ã¹ãæåã§äœæããŸã ifcfg-bond1.432 О ifcfg-ovirtvm-vlan432.
è«çãããã¯ãŒã¯ãè¿œå ãããã¹ããšãã¹ã ãšã³ãžã³ VM éã®æ¥ç¶ã確èªããåŸãä»®æ³ãã·ã³ã§äœ¿çšã§ããããã«ãªããŸãã
ä»®æ³ãã·ã³ããããã€ããããã®ã€ã³ã¹ããŒã« ã€ã¡ãŒãžã®äœæ
ããã¥ã¡ã³ããžã®ãªã³ã¯ - oVirt 管çã¬ã€ãã
OS ã€ã³ã¹ããŒã« ã€ã¡ãŒãžããªããã°ä»®æ³ãã·ã³ãã€ã³ã¹ããŒã«ããããšã¯ã§ããŸããããã ããããšãã°ãããã¯ãŒã¯äžã«ã€ã³ã¹ããŒã«ãããŠããå Žåã«ã¯ããã¡ããåé¡ãããŸããã
ç§ãã¡ã®å Žåãããã¯äžå¯èœãªã®ã§ããã®ã€ã¡ãŒãžãèªå㧠oVirt ã«ã€ã³ããŒãããå¿ èŠããããŸãã 以åã¯ãããã«ã¯ ISO ãã¡ã€ã³ãäœæããå¿ èŠããããŸããããoVirt ã®æ°ããããŒãžã§ã³ã§ã¯å»æ¢ãããããã管çããŒã¿ã«ããã¹ãã¬ãŒãž ãã¡ã€ã³ã«ã€ã¡ãŒãžãçŽæ¥ã¢ããããŒãã§ããããã«ãªããŸããã
管çããŒã¿ã«ã§ã次ã®å Žæã«ç§»åããŸãã Storage >> ãã£ã¹ã¯ >> ã¢ããããŒã >> éå§
OS ã€ã¡ãŒãžã ISO ãã¡ã€ã«ãšããŠè¿œå ãããã©ãŒã ã®ãã¹ãŠã®ãã£ãŒã«ãã«å
¥åããŠããã¿ã³ãã¯ãªãã¯ããŸããæ¥ç¶ã®ãã¹ã".
ã€ã³ã¹ããŒã« ã€ã¡ãŒãžã®è¿œå ãŠã£ã¶ãŒãã®ã¹ã¯ãªãŒã³ã·ã§ãã
次ã®ãããªãšã©ãŒãçºçããå Žå:
Unable to upload image to disk d6d8fd10-c1e0-4f2d-af15-90f8e636dadc due to a network error. Ensure that ovirt-imageio-proxy service is installed and configured and that ovirt-engine's CA certificate is registered as a trusted CA in the browser. The certificate can be fetched from https://ovirt.test.local/ovirt-engine/services/pki-resource?resource=ca-certificate&format=X509-PEM-CA`
次ã«ãoVirt 蚌ææžãããã«è¿œå ããå¿ èŠããããŸããä¿¡é Œãããã«ãŒã CAã管çè ã®ã³ã³ãããŒã« ã¹ããŒã·ã§ã³äžã® (ä¿¡é Œãããã«ãŒã CA)ãããããã€ã¡ãŒãžãããŠã³ããŒãããããšããŠããŸãã
蚌ææžãä¿¡é Œãããã«ãŒã CA ã«è¿œå ããåŸãããäžåºŠãããã¯ãªãã¯ããŸããæ¥ç¶ã®ãã¹ã"ã次ãååŸããå¿ èŠããããŸã:
Connection to ovirt-imageio-proxy was successful.
蚌ææžãè¿œå ããã¢ã¯ã·ã§ã³ãå®äºããããISO ã€ã¡ãŒãžãã¹ãã¬ãŒãž ãã¡ã€ã³ã«å床ã¢ããããŒãããŠã¿ãããšãã§ããŸãã
ååãšããŠãããŒã¿ ã¿ã€ãã䜿çšããŠå¥ã®ã¹ãã¬ãŒãž ãã¡ã€ã³ãäœæããŠãã€ã¡ãŒãžãšãã³ãã¬ãŒãã VM ãã£ã¹ã¯ãšã¯å¥ã«ä¿åãããããã¹ãåãšã³ãžã³ã®ã¹ãã¬ãŒãž ãã¡ã€ã³ã«ä¿åãããã§ããŸãããããã¯ç®¡çè ã®è£éã«ãã£ãŠç°ãªããŸãã
ãã¹ãåãšã³ãžã³ã®ã¹ãã¬ãŒãž ãã¡ã€ã³å ã® ISO ã€ã¡ãŒãžã®ã¹ã¯ãªãŒã³ã·ã§ãã
ä»®æ³ãã·ã³ãäœæãã
ããã¥ã¡ã³ããžã®ãªã³ã¯:
oVirt ä»®æ³ãã·ã³ç®¡çã¬ã€ã â>
ã³ã³ãœãŒã«ã¯ã©ã€ã¢ã³ãã®ãªãœãŒã¹
OS ãå«ãã€ã³ã¹ããŒã« ã€ã¡ãŒãžã oVirt ã«ããŒãããåŸãä»®æ³ãã·ã³ã®äœæã«çŽæ¥é²ãããšãã§ããŸãã å€ãã®äœæ¥ãè¡ãããŠããŸãããããã§ã«æçµæ®µéã«å°éããŠããããã®ããã«ãã¹ãŠã®äœæ¥ãéå§ãããé«å¯çšæ§ã®ä»®æ³ãã·ã³ããã¹ãããããã®ãã©ãŒã«ã ãã¬ã©ã³ããªã€ã³ãã©ã¹ãã©ã¯ãã£ãååŸããŠããŸãã ãããŠããããã¯ãã¹ãŠå®å šã«ç¡æã§ãããœãããŠã§ã¢ ã©ã€ã»ã³ã¹ã®è³Œå ¥ã«ã¯äžéãè²»ããããŸããã
CentOS 7ã§ä»®æ³ãã·ã³ãäœæããã«ã¯ãOSããã€ã³ã¹ããŒã«ã€ã¡ãŒãžãããŠã³ããŒãããå¿ èŠããããŸãã
管çããŒã¿ã«ã«ç§»åããŸãã èšç® >> ä»®æ³ãã·ã³ãã¯ãªãã¯ããVM äœæãŠã£ã¶ãŒããèµ·åããŸãã ãã¹ãŠã®ãã©ã¡ãŒã¿ãšãã£ãŒã«ãã«å ¥åããã¯ãªãã¯ããŸãã ÐÐã ããã¥ã¡ã³ãã«åŸãã°ããã¹ãŠã¯éåžžã«ç°¡åã§ãã
äŸãšããŠããã£ã¹ã¯ãäœæããããããã¯ãŒã¯ã«æ¥ç¶ãããã€ã³ã¹ããŒã« ã€ã¡ãŒãžããèµ·åãããé«å¯çšæ§ VM ã®åºæ¬èšå®ãšè¿œå èšå®ã瀺ããŸãã
é«å¯çšæ§ VM èšå®ã®ã¹ã¯ãªãŒã³ã·ã§ãã
ãŠã£ã¶ãŒãã§ã®äœæ¥ãçµäºãããããŠã£ã¶ãŒããéããæ°ãã VM ãèµ·åããŠãããã« OS ãã€ã³ã¹ããŒã«ããŸãã
ãããè¡ãã«ã¯ã管çããŒã¿ã«ãããã® VM ã®ã³ã³ãœãŒã«ã«ç§»åããŸãã
VM ã³ã³ãœãŒã«ã«æ¥ç¶ããããã®ç®¡çããŒã¿ã«èšå®ã®ã¹ã¯ãªãŒã³ã·ã§ãã
VM ã³ã³ãœãŒã«ã«æ¥ç¶ããã«ã¯ããŸãä»®æ³ãã·ã³ã®ããããã£ã§ã³ã³ãœãŒã«ãæ§æããå¿ èŠããããŸãã
VMèšå®ã®ãã³ã³ãœãŒã«ãã¿ãã®ã¹ã¯ãªãŒã³ã·ã§ãã
VM ã³ã³ãœãŒã«ã«æ¥ç¶ããã«ã¯ãããšãã°æ¬¡ã®ããã«äœ¿çšã§ããŸãã
ãã©ãŠã¶ ãŠã£ã³ããŠã§ VM ã³ã³ãœãŒã«ã«çŽæ¥æ¥ç¶ããã«ã¯ãã³ã³ãœãŒã«çµç±ã®æ¥ç¶èšå®ã¯æ¬¡ã®ããã«ããå¿ èŠããããŸãã
VM ã« OS ãã€ã³ã¹ããŒã«ããåŸãoVirt ã²ã¹ã ãšãŒãžã§ã³ããã€ã³ã¹ããŒã«ããããšããå§ãããŸãã
yum -y install epel-release
yum install -y ovirt-guest-agent-common
systemctl enable ovirt-guest-agent.service && systemctl restart ovirt-guest-agent.service
systemctl status ovirt-guest-agent.service
ãããã£ãŠãç§ãã¡ã®ã¢ã¯ã·ã§ã³ã®çµæãšããŠãäœæããã VM ã¯é«å¯çšæ§ã«ãªããŸãã oVirt ãå®è¡ããŠããã¯ã©ã¹ã¿ãŒ ããŒãã«é害ãçºçããå ŽåãoVirt 㯠XNUMX çªç®ã®ããŒãã§èªåçã«åèµ·åããŸãã ãã® VM ã¯ãã¡ã³ããã³ã¹ããã®ä»ã®ç®çã§ã¯ã©ã¹ã¿ãŒ ãã¹ãéã§ç§»è¡ããããšãã§ããŸãã
ãŸãšã
ãã®èšäºã§ãoVirt ãä»®æ³ã€ã³ãã©ã¹ãã©ã¯ãã£ã管çããããã®ãŸã£ããæ®éã®ããŒã«ã§ãããå°å ¥ã¯ããã»ã©é£ãããªãããšããããšãäŒããã°å¹žãã§ããéèŠãªã®ã¯ãèšäºãšããã¥ã¡ã³ãã®äž¡æ¹ã§èª¬æãããŠããç¹å®ã®ã«ãŒã«ãšèŠä»¶ã«åŸãããšã§ãã
èšäºã®ããªã¥ãŒã ã倧ããããããã¹ãŠã®è©³çŽ°ãªèª¬æãšã¹ã¯ãªãŒã³ã·ã§ãããå«ãããŸããŸãªãŠã£ã¶ãŒãã®æ®µéçãªå®è¡ãäžéšã®ã³ãã³ãã®é·ãçµè«ãªã©ãå€ãã®å 容ãå«ããããšã¯ã§ããŸããã§ããã å®éãããã«ã¯äžåã®æ¬ãæžãå¿ èŠããããŸããããœãããŠã§ã¢ã®æ°ããããŒãžã§ã³ã¯é©æ°ãå€æŽãšãšãã«åžžã«ç»å ŽãããããããŸãæå³ããããŸããã æãéèŠãªããšã¯ããã¹ãŠãé£æºããŠåäœããåçãç解ããä»®æ³ãã·ã³ã管çããããã®ãã©ãŒã«ã ãã¬ã©ã³ããªãã©ãããã©ãŒã ãäœæããããã®äžè¬çãªã¢ã«ãŽãªãºã ãååŸããããšã§ãã
ä»®æ³ã€ã³ãã©ã¹ãã©ã¯ãã£ãäœæããŸããããä»åºŠã¯ããã®åã ã®èŠçŽ (ãã¹ããä»®æ³ãã·ã³ãå éšãããã¯ãŒã¯ãããã³å€éšäžç) ã®éã§çžäºäœçšããããã«ä»®æ³ã€ã³ãã©ã¹ãã©ã¯ãã£ãåŠç¿ãããå¿ èŠããããŸãã
ãã®ããã»ã¹ã¯ãã·ã¹ãã 管çè ãŸãã¯ãããã¯ãŒã¯ç®¡çè ã®äž»ãªã¿ã¹ã¯ã® XNUMX ã€ã§ããã次ã®èšäºã§èª¬æããŸããäŒæ¥ã®ãã©ãŒã«ã ãã¬ã©ã³ã ã€ã³ãã©ã¹ãã©ã¯ãã£ã«ããã VyOS ä»®æ³ã«ãŒã¿ãŒã®äœ¿çšã«ã€ããŠã§ã (ãæ³åã®ãšããããããã¯ä»®æ³ã«ãŒã¿ãŒãšããŠæ©èœããŸã)ã oVirt ã¯ã©ã¹ã¿ãŒäžã®ãã·ã³)ã
åºæïŒ habr.com