I did a full verification and turned out to be the same problem, a wrong entry in /etc/hosts. One of the node's entry was not propoerly set (mispelled domain) and it made impossible for one node's Kvm connect to the other one.<br>
<br>In order to find out the problem I increased libvirt's debug level to maximum and I saw thew wrong remote host.domain error.<br><br>Thank you very much for the support and apologies for the noise,<br><br>Samuel.<br>
<br><div class="gmail_quote">On 30 June 2011 19:15, Javier Fontan <span dir="ltr"><<a href="mailto:jfontan@gmail.com">jfontan@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
I cannot see any info that leads me to find the problem. Have you<br>
tried migrating VM's manually, that is, using libvirt/kvm manually,<br>
not OpenNebula. Also check that both machines have the same processor<br>
and libvirt/kvm versions.<br>
<div><div></div><div class="h5"><br>
On Fri, Jun 17, 2011 at 5:58 PM, samuel <<a href="mailto:samu60@gmail.com">samu60@gmail.com</a>> wrote:<br>
><br>
> The error happened to be a wrong entry in the file /etc/hosts, where the<br>
> remote node's IP was set to the local one and there were several errors.<br>
><br>
> However, it is not yet possible to perform live migration on the same<br>
> escenario (normal migration works perfectly), I always end up with the<br>
> following error:<br>
> Fri Jun 17 17:47:58 2011 [LCM][I]: New VM state is MIGRATE<br>
> Fri Jun 17 17:51:09 2011 [VMM][I]: Command execution fail: 'if [ -x<br>
> "/var/tmp/one/vmm/kvm/migrate" ]; then /var/tmp/one/vmm/kvm/migrate one-21<br>
> node2; else exit 42; fi'<br>
> Fri Jun 17 17:51:09 2011 [VMM][I]: STDERR follows.<br>
> Fri Jun 17 17:51:09 2011 [VMM][I]: error: operation failed: migration job:<br>
> unexpectedly failed<br>
> Fri Jun 17 17:51:09 2011 [VMM][I]: ExitCode: 1<br>
> Fri Jun 17 17:51:09 2011 [VMM][E]: Error live-migrating VM, error: operation<br>
> failed: migration job: unexpectedly failed<br>
> Fri Jun 17 17:51:09 2011 [LCM][I]: Fail to life migrate VM. Assuming that<br>
> the VM is still RUNNING (will poll VM).<br>
><br>
> This is the output of the file /var/log/libvirt/qemu/one-21.log<br>
> 2011-06-17 17:48:02.232: starting up<br>
> LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin<br>
> QEMU_AUDIO_DRV=none /usr/bin/kvm -S -M pc-0.14 -cpu qemu32 -enable-kvm -m<br>
> 2048 -smp 1,sockets=1,cores=1,threads=1 -name one-21 -uuid<br>
> b9330d8d-3d2e-666a-c9e5-5e32e81c29dc -nodefconfig -nodefaults -chardev<br>
> socket,id=charmonitor,path=/var/lib/libvirt/qemu/one-21.monitor,server,nowait<br>
> -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot c<br>
> -drive<br>
> file=/srv/cloud/one/var//21/images/disk.0,if=none,id=drive-ide0-0-0,format=raw<br>
> -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0 -netdev<br>
> tap,fd=18,id=hostnet0 -device<br>
> rtl8139,netdev=hostnet0,id=net0,mac=02:00:c0:a8:32:03,bus=pci.0,addr=0x3<br>
> -usb -vnc <a href="http://0.0.0.0:21" target="_blank">0.0.0.0:21</a> -vga cirrus -incoming tcp:<a href="http://0.0.0.0:49152" target="_blank">0.0.0.0:49152</a> -device<br>
> virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x4<br>
> 2011-06-17 17:51:11.997: shutting down<br>
><br>
> And on /var/log/syslog, the folloing line:<br>
> Jun 17 17:51:46 node2 libvirtd: 17:51:46.798: 1200: error :<br>
> qemuDomainWaitForMigrationComplete:4218 : operation failed: migration job:<br>
> unexpectedly failed<br>
><br>
> Can anyone provide help on this issue? How can I debug the live migration?<br>
><br>
> Thank you very much in advance,<br>
> Samuel.<br>
><br>
> On 7 June 2011 17:22, samuel <<a href="mailto:samu60@gmail.com">samu60@gmail.com</a>> wrote:<br>
>><br>
>> Hi folks,<br>
>><br>
>> After few tricks to the standard configuration (controller exporting via<br>
>> NFS opennebula directories to 2 other nodes) seems to work except for one<br>
>> point: live migration.<br>
>><br>
>> When starting live migration (from sunstone web interface), the following<br>
>> problem appears:<br>
>><br>
>> Tue Jun 7 17:12:51 2011 [VMM][I]: Command execution fail: 'if [ -x<br>
>> "/var/tmp/one/vmm/kvm/migrate" ]; then /var/tmp/one/vmm/kvm/migrate one-131<br>
>> node1; else exit 42; fi'<br>
>> Tue Jun 7 17:12:51 2011 [VMM][I]: STDERR follows.<br>
>> Tue Jun 7 17:12:51 2011 [VMM][I]: error: Requested operation is not<br>
>> valid: domain is already active as 'one-131'<br>
>> Tue Jun 7 17:12:51 2011 [VMM][I]: ExitCode: 1<br>
>> Tue Jun 7 17:12:51 2011 [VMM][E]: Error live-migrating VM, error:<br>
>> Requested operation is not valid: domain is already active as 'one-131'<br>
>> Tue Jun 7 17:12:51 2011 [LCM][I]: Fail to life migrate VM. Assuming that<br>
>> the VM is still RUNNING (will poll VM).<br>
>><br>
>> I'm using qemu+ssh transport with the following version:<br>
>> $ virsh version<br>
>> Compilado contra la biblioteca: libvir 0.8.8<br>
>> Utilizando la biblioteca: libvir 0.8.8<br>
>> Utilizando API: QEMU 0.8.8<br>
>> Ejecutando hypervisor: QEMU 0.14.0<br>
>><br>
>> Installed version of open nebula is 2.2.<br>
>><br>
>> Could anyone shed some light on this issue? I've looked in the Internet<br>
>> and found some posts relating to qemu bugs but I'd like to know whether can<br>
>> I get more information about this issue.<br>
>><br>
>> Thank you very much in advance,<br>
>> Samuel.<br>
><br>
><br>
</div></div>> _______________________________________________<br>
> Users mailing list<br>
> <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
><br>
><br>
<font color="#888888"><br>
<br>
<br>
--<br>
Javier Fontan, Grid & Virtualization Technology Engineer/Researcher<br>
DSA Research Group: <a href="http://dsa-research.org" target="_blank">http://dsa-research.org</a><br>
Globus GridWay Metascheduler: <a href="http://www.GridWay.org" target="_blank">http://www.GridWay.org</a><br>
OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org" target="_blank">http://www.OpenNebula.org</a><br>
</font></blockquote></div><br>