[one-users] unable to cold migrate

Tue Feb 5 15:47:28 PST 2013

Hi

Right now I have a OpenNebula server, running the front end (SunStone) 
and host all on one machine. It works great. Lets refer to this as the 
master.

I am trying to add a new host (reffered to as the host) to run more 
VM's. I am attempting to migrate from the master to the host without 
success. Firstly, what is installed:

MASTER
uname -a
Linux MASTER 3.2.0-4-amd64 #1 SMP Debian 3.2.35-2 x86_64 GNU/Linux

cat /etc/debian_version
7.0

ii  opennebula                         3.4.1-3.1 amd64        controller 
which executes the OpenNebula cluster services
ii  opennebula-common                  3.4.1-3.1 all          empty 
package to create OpenNebula users and directories
ii  opennebula-sunstone                3.4.1-3.1 all          web 
interface to which executes the OpenNebula cluster services
ii  opennebula-tools                   3.4.1-3.1 all          
Command-line tools for OpenNebula Cloud
ii  ruby-opennebula                    3.4.1-3.1 all          Ruby 
bindings for OpenNebula Cloud API (OCA)
ii  kvm                                1:1.1.2+dfsg-5 amd64        dummy 
transitional package from kvm to qemu-kvm
ii  qemu-kvm                           1.1.2+dfsg-5 amd64        Full 
virtualization on x86 hardware
ii  libvirt-bin                        0.9.12-5 amd64        programs 
for the libvirt library
ii  libvirt0                           0.9.12-5 amd64        library for 
interfacing with different virtualization systems
ii  python-libvirt                     0.9.12-5 amd64        libvirt 
Python bindings

HOST
uname -a
Linux HOST 3.2.0-4-amd64 #1 SMP Debian 3.2.35-2 x86_64 GNU/Linux

cat /etc/debian_version
7.0

i  opennebula-common                  3.4.1-3.1 all          empty 
package to create OpenNebula users and directories
ii  opennebula-node                    3.4.1-3.1 all          empty 
package to prepare a machine as OpenNebula Node
ii  libvirt-bin                        0.9.12-5 amd64        programs 
for the libvirt library
ii  libvirt0                           0.9.12-5 amd64        library for 
interfacing with different virtualization systems

Reading /usr/share/doc/opennebula-node/README.Debian it tells you what 
to do, I followed those instructions, everything completed successfully.
Things I find odd... kvm/qemu-kvm packages are not installed on the HOST 
but that README file says to ensure that the kernel modules are loaded 
which they are.

oneadmin at MASTER:~$ onehost list
   ID NAME         CLUSTER     RVM   TCPU   FCPU   ACPU   TMEM FMEM   
AMEM STAT
    2 MASTER.matrix Internal     16   3200   2509    200 126.1G 27.2G  
22.1G   on
    4 HOST.mat -             0   1600   1600   1600  31.5G  31.1G 31.5G   on

But that said, here is what happens in the VM's log when I try to migrate:

Wed Feb  6 09:31:46 2013 [VMM][D]: Message received: LOG I 161 ExitCode: 0
Wed Feb  6 09:31:46 2013 [VMM][D]: Message received: LOG I 161 
Successfully execute virtualization driver operation: save.
Wed Feb  6 09:31:46 2013 [VMM][D]: Message received: LOG I 161 ExitCode: 0
Wed Feb  6 09:31:46 2013 [VMM][D]: Message received: LOG I 161 
Successfully execute network driver operation: clean.
Wed Feb  6 09:31:46 2013 [VMM][D]: Message received: SAVE SUCCESS 161 -
Wed Feb  6 09:31:47 2013 [TM][D]: Message received: LOG I 161 ExitCode: 0
Wed Feb  6 09:31:47 2013 [TM][D]: Message received: LOG I 161 ExitCode: 0
Wed Feb  6 09:31:47 2013 [TM][D]: Message received: TRANSFER SUCCESS 161 -
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG I 161 ExitCode: 0
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG I 161 
Successfully execute network driver operation: pre.
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG I 161 Command 
execution fail: /var/tmp/one/vmm/kvm/restore 
/var/lib/one//datastores/0/161/checkpoint HOST 161 HOST
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG E 161 restore: 
Command "virsh --connect qemu:///system restore 
/var/lib/one//datastores/0/161/checkpoint" failed: error: Failed to 
restore domain from /var/lib/one//datastores/0/161/checkpoint
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG I 161 error: 
Failed to create file '/var/lib/one//datastores/0/161/checkpoint': 
Operation not permitted
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG E 161 Could not 
restore from /var/lib/one//datastores/0/161/checkpoint
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG I 161 ExitCode: 1
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: LOG I 161 Failed to 
execute virtualization driver operation: restore.
Wed Feb  6 09:31:47 2013 [VMM][D]: Message received: RESTORE FAILURE 161 
Could not restore from /var/lib/one//datastores/0/161/checkpoint
Wed Feb  6 09:31:49 2013 [InM][I]: ExitCode: 0

I can work out this operation is that is not permitted, is it a 
permissions issue? What host is this error originating from.. is it 
saying the MASTER does not have access to that file or the HOST? I have 
no idea.

Any help appreicated.

Thanks

Jurgen

-- 
Jürgen Weber

Systems Engineer
IT Infrastructure Team Leader

THE ICONIC | E jurgen.weber at theiconic.com.au | www.theiconic.com.au