<html><head><meta http-equiv="Content-Type" content="text/html charset=euc-kr"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>Hi Hyun Woo,</div><div><br></div><div>My all hosts(gcloud01~03) have a virsh command </div><div><br></div><div><br></div><div><br></div><div><div>[root@gcloud03 ~]# which virsh</div><div>/usr/bin/virsh</div><div>[root@gcloud03 ~]# virsh -c <a href="qemu:///system">qemu:///system</a> nodeinfo</div><div>CPU 모델: x86_64</div><div>CPU: 6</div><div>CPU 주파수: 2660 MHz</div><div>CPU 소켓: 1</div><div>소켓당 코어: 6</div><div>코어당 스레드: 1</div><div>NUMA cell: 1</div><div>메모리 용량: 24597092 KiB</div><div><br></div><div>[root@gcloud03 ~]#</div></div><div><br></div><div><br></div><div><br></div><div>Thanks</div><div>Gyeong-Ryoon Kim.</div><div><br></div><div><br></div><div>2013. 8. 13., 오후 10:57, Hyun Woo Kim <<a href="mailto:hyunwoo@fnal.gov">hyunwoo@fnal.gov</a>> 작성:</div><br class="Apple-interchange-newline"><blockquote type="cite">
<meta http-equiv="Content-Type" content="text/html; charset=euc-kr">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; font-size: 14px; font-family: Calibri, sans-serif; ">
<div>This error seems to say that gcloud03 does not have virsh command installed yet.</div>
<div>HyunWoo</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family: Calibri; font-size: 11pt; text-align: left; border-width: 1pt medium medium; border-style: solid none none; padding: 3pt 0in 0in; border-top-color: rgb(181, 196, 223); ">
<span style="font-weight:bold">From: </span>김 경륜 <<a href="mailto:grkim@kisti.re.kr">grkim@kisti.re.kr</a>><br>
<span style="font-weight:bold">Date: </span>Tuesday, August 13, 2013 3:22 AM<br>
<span style="font-weight:bold">To: </span>Users OpenNebula <<a href="mailto:users@lists.opennebula.org">users@lists.opennebula.org</a>><br>
<span style="font-weight:bold">Subject: </span>[one-users] live migration error<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
HI all
<div><br>
</div>
<div>When I do live migration command it doesn't work </div>
<div><br>
</div>
<div>I have this error message on vm log.</div>
<div><br>
</div>
<div><span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon</span><span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; "> Aug
12 20:39:39 2013 [LCM][I]: New VM state is MIGRATE</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][I]: Successfully execute transfer manager driver operation:
tm_premigrate.</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][I]: ExitCode: 0</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][I]: Successfully execute network driver operation: pre.</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][I]: Command execution fail: /gcloud/one//var/remotes/vmm/kvm/migrate_local
'one-43' 'gcloud01' 'gcloud03' 43 gcloud03</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][I]: /gcloud/one//var/remotes/vmm/kvm/migrate_local: line
25: virsh: command not found</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][I]: ExitCode: 127</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon</span><span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; "> Aug
12 20:39:39 2013 [VMM][I]: Failed to execute virtualization driver operation: migrate.</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span class="vm_log_error" style="box-sizing: border-box; color: rgb(255, 141, 129); font-size: 14px; line-height: 28px; text-align: left; font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:39 2013 [VMM][E]: Error live migrating VM</span><br style="box-sizing: border-box; color: rgb(242, 242, 242); font-family: 'Open Sans', sans-serif; font-size: 14px; line-height: 28px; text-align: left; ">
<span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; ">Mon Aug 12 20:39:40 2013 [LCM][I]: Fail to live migrate VM. Assuming that the VM is still
RUNNING (will poll VM).</span></div>
<div><span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; "><br>
</span></div>
<div><span style="color: rgb(242, 242, 242); font-size: 14px; line-height: 28px; text-align: left; background-color: rgb(111, 111, 111); font-family: 'Open Sans', sans-serif; "><br>
</span></div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>I'm using scientific linux for all the host and kvm driver . The OpenNubula version is 4.2.</div>
<div><br>
</div>
<div><br>
</div>
<div>basic configuration like below:</div>
<div><br>
</div>
<div>>> front-end machine</div>
<div>[oneadmin@gcloud-front etc]$ grep -vE '^(#|$)' oned.conf</div>
<div>LOG = [</div>
<div> system = "file",</div>
<div> debug_level = 3</div>
<div>]</div>
<div>MONITORING_INTERVAL = 300</div>
<div>SCRIPTS_REMOTE_DIR=/var/tmp/one</div>
<div>PORT = 2633</div>
<div>DB = [ backend = "sqlite" ]</div>
<div>VNC_BASE_PORT = 5900</div>
<div>NETWORK_SIZE = 254</div>
<div>MAC_PREFIX = "02:00"</div>
<div>DATASTORE_CAPACITY_CHECK = "yes"</div>
<div>DEFAULT_IMAGE_TYPE = "OS"</div>
<div>DEFAULT_DEVICE_PREFIX = "hd"</div>
<div>IM_MAD = [</div>
<div> name = "kvm",</div>
<div> executable = "one_im_ssh",</div>
<div> arguments = "-r 0 -t 15 kvm" ]</div>
<div>IM_MAD = [</div>
<div> name = "ec2",</div>
<div> executable = "one_im_ec2",</div>
<div> arguments = "im_ec2/im_ec2.conf" ]</div>
<div>VM_MAD = [</div>
<div> name = "kvm",</div>
<div> executable = "one_vmm_exec",</div>
<div> arguments = "-t 15 -r 0 kvm -l migrate=migrate_local",</div>
<div> #arguments = "-t 15 -r 0 kvm -l ",</div>
<div> default = "vmm_exec/vmm_exec_kvm.conf",</div>
<div> type = "kvm" ]</div>
<div>VM_MAD = [</div>
<div> name = "ec2",</div>
<div> executable = "one_vmm_ec2",</div>
<div> arguments = "vmm_ec2/vmm_ec2.conf",</div>
<div> type = "xml" ]</div>
<div>TM_MAD = [</div>
<div> executable = "one_tm",</div>
<div> arguments = "-t 15 -d dummy,lvm,shared,qcow2,ssh,vmfs,iscsi,ceph" ]</div>
<div>DATASTORE_MAD = [</div>
<div> executable = "one_datastore",</div>
<div> arguments = "-t 15 -d dummy,fs,vmfs,iscsi,lvm,ceph"</div>
<div>]</div>
<div>HM_MAD = [</div>
<div> executable = "one_hm" ]</div>
<div>AUTH_MAD = [</div>
<div> executable = "one_auth_mad",</div>
<div> authn = "ssh,x509,ldap,server_cipher,server_x509"</div>
<div>]</div>
<div>SESSION_EXPIRATION_TIME = 900</div>
<div>DEFAULT_UMASK = 177</div>
<div>VM_RESTRICTED_ATTR = "NIC/MAC"</div>
<div>VM_RESTRICTED_ATTR = "NIC/VLAN_ID"</div>
<div>IMAGE_RESTRICTED_ATTR = "SOURCE"</div>
<div>[oneadmin@gcloud-front etc]$</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>>>> host machines</div>
<div><br>
</div>
<div> [root@gcloud01 ~]# grep -Ev '^(#|$)' /etc/libvirt/qemu.conf</div>
<div>user = "oneadmin"</div>
<div>group = "oneadmin"</div>
<div>dynamic_ownership = 0</div>
<div>[root@gcloud01 ~]#</div>
<div><br>
</div>
<div>
<div> [root@gcloud01 ~]# grep -vE '^(#|$)' libvirtd</div>
<div>LIBVIRTD_ARGS="--listen"</div>
<div><br>
</div>
<div> [root@gcloud01 ~]#grep -vE '^(#|$)' libvirtd.conf</div>
<div>unix_sock_group = "libvirt"</div>
<div>unix_sock_ro_perms = "0777"</div>
<div>unix_sock_rw_perms= "0777"</div>
<div>auth_unix_ro = "none"</div>
<div>auth_unix_rw = "none"</div>
<div><br>
</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Thanks </div>
<div>Gyeong-Ryoon Kim.</div>
</div>
</div>
</span>
</div>
</blockquote></div><br></body></html>