[one-users] write changes using "save as" and qcow2

Jaime Melis jmelis at opennebula.org
Wed May 16 03:42:44 PDT 2012


Andreas,

actually, I think Shankhadeep is right. Does the VM go back to running
after a few minutes in shutdown? If the VM doesn't have the acpid package
installed, it won't shutdown on the shutdown event, thus never going into
the epilog state.

Can you make sure that you have acpid installed? (does it log you off when
you onevm shutdown the vm?)

You could also try with onevm cancel. That will destroy the vm
instantaneously and call the epilog...

Cheers,
Jaime

On Wed, May 16, 2012 at 12:33 PM, Andreas Calvo <andreas.calvo at scytl.com>wrote:

>  Jaime,
> Yes, it shows as if the image was going to be created.
>
> VIRTUAL MACHINE 1601
> INFORMATION
> ID                  : 1601
> NAME                : one-1601
> USER                : oneadmin
> GROUP               : oneadmin
> STATE               : ACTIVE
> LCM_STATE           : RUNNING
> HOSTNAME            : cloud12
> START TIME          : 05/16 12:31:22
> END TIME            : -
> DEPLOY ID           : one-1601
>
> VIRTUAL MACHINE
> MONITORING
> NET_RX              : 0
> USED CPU            : 0
> USED MEMORY         : 0
> NET_TX              : 0
>
> PERMISSIONS
>
> OWNER               : um-
> GROUP               : ---
> OTHER               : ---
>
> VIRTUAL MACHINE
> TEMPLATE
> CONTEXT=[
>   DNS1="192.168.0.100",
>   DNS2="192.168.0.101",
>   FILES="/var/lib/one/templates/context-scripts/linux/jmeter/init.sh
> /var/lib/one/templates/id_rsa.pub",
>   GATEWAY="10.4.16.1",
>   HOSTNAME="jdetect-1601",
>   ROOT_PUBKEY="id_rsa.pub",
>   TARGET="hdc",
>   USERNAME="technical",
>   USER_PUBKEY="id_rsa.pub" ]
> CPU="0.5"
> DISK=[
>   BUS="virtio",
>   CLONE="YES",
>   CLUSTER_ID="100",
>   DATASTORE="default",
>   DATASTORE_ID="1",
>   DISK_ID="0",
>   DRIVER="qcow2",
>   IMAGE="jdetect-node3",
>   IMAGE_ID="42",
>   READONLY="NO",
>   SAVE="YES",
>   SAVE_AS="80",
>
> SAVE_AS_SOURCE="/var/lib/one/datastores/1/d2a57eb9dfa252c1ec5b044ff351b392",
>   SOURCE="/var/lib/one/datastores/1/f971c24769f5312679fd455162a76fbc",
>   TARGET="vda",
>   TM_MAD="qcow2",
>   TYPE="DISK" ]
> FEATURES=[
>   ACPI="yes" ]
> GRAPHICS=[
>   PORT="7501",
>   TYPE="vnc" ]
> MEMORY="1024"
> NAME="one-1601"
> NIC=[
>   BRIDGE="onebr4",
>   CLUSTER_ID="100",
>   IP="10.4.16.99",
>   MAC="02:00:0a:04:10:63",
>   NETWORK="opennebula",
>   NETWORK_ID="4",
>   PHYDEV="eth1",
>   VLAN="YES",
>   VLAN_ID="102" ]
> OS=[
>   ARCH="x86_64",
>   BOOT="hd" ]
> RAW=[
>   TYPE="kvm" ]
> REQUIREMENTS="CLUSTER_ID = 100"
> TEMPLATE_ID="14"
> VCPU="1"
> VMID="1601"
>
> VIRTUAL MACHINE
> HISTORY
>  SEQ        HOSTNAME REASON           START        TIME       PTIME
>    0         cloud12   none  05/16 12:31:33    0d 00:00    0d 00:00
>
> El 16/05/12 12:22, Jaime Melis escribió:
>
> Hello Andreas,
>
>  I can't seem to find anything wrong with your setup. I have a question,
> though, once you do onevm saveas does it show in "onevm show <vm_id>" like
> this?
>
>  $ onevm show <vm_id>
> [...]
> DISK = [
> [...]
>    SAVE="YES",
>   SAVE_AS="4",
>
> SAVE_AS_SOURCE="/var/lib/one/datastores/1/9e2ca60e8780e40f79d13e7d587b471c",
>  [...]
>
>  cheers,
> Jaime
> On Wed, May 9, 2012 at 10:22 AM, Andreas Calvo <andreas.calvo at scytl.com>wrote:
>
>> Sure!
>>
>> /var/lib/one/config:
>> AUTH_MAD=ARGUMENTS=--authn
>> ssh,x509,ldap,server_cipher,server_x509,EXECUTABLE=one_auth_mad
>> DATASTORE_LOCATION=/var/lib/one//datastores
>> DATASTORE_MAD=ARGUMENTS=-t 15 -d
>> fs,vmware,iscsi,EXECUTABLE=one_datastore
>> DB=BACKEND=sqlite
>> DEBUG_LEVEL=3
>> DEFAULT_DEVICE_PREFIX=hd
>> DEFAULT_IMAGE_TYPE=OS
>> ENABLE_OTHER_PERMISSIONS=YES
>> HM_MAD=EXECUTABLE=one_hm
>> HOST_MONITORING_INTERVAL=600
>> HOST_PER_INTERVAL=15
>> IMAGE_RESTRICTED_ATTR=SOURCE
>> IM_MAD=ARGUMENTS=-r 0 -t 15 kvm,EXECUTABLE=one_im_ssh,NAME=im_kvm
>> MAC_PREFIX=02:00
>> MANAGER_TIMER=15
>> NETWORK_SIZE=254
>> PORT=2633
>> SCRIPTS_REMOTE_DIR=/var/tmp/one
>> SESSION_EXPIRATION_TIME=900
>> TM_MAD=ARGUMENTS=-t 15 -d
>> dummy,shared,qcow2,ssh,vmware,iscsi,EXECUTABLE=one_tm
>> VM_MAD=ARGUMENTS=-t 15 -r 0
>>
>> kvm,DEFAULT=vmm_exec/vmm_exec_kvm.conf,EXECUTABLE=one_vmm_exec,NAME=vmm_kvm,TYPE=kvm
>> VM_PER_INTERVAL=5
>> VM_POLLING_INTERVAL=600
>> VM_RESTRICTED_ATTR=DISK/SOURCE
>> VM_RESTRICTED_ATTR=NIC/MAC
>> VM_RESTRICTED_ATTR=NIC/VLAN_ID
>> VM_RESTRICTED_ATTR=RANK
>> VNC_BASE_PORT=5900
>>
>> /var/log/one/1319.log:
>> Wed May  9 10:14:48 2012 [TM][I]: ExitCode: 0
>> Wed May  9 10:14:49 2012 [LCM][I]: New VM state is BOOT
>> Wed May  9 10:14:49 2012 [VMM][I]: Generating deployment
>> file: /var/lib/one/1319/deployment.0
>> Wed May  9 10:14:49 2012 [VMM][I]: ExitCode: 0
>> Wed May  9 10:14:49 2012 [VMM][I]: Successfully execute network driver
>> operation: pre.
>> Wed May  9 10:14:49 2012 [VMM][I]: ExitCode: 0
>> Wed May  9 10:14:49 2012 [VMM][I]: Successfully execute virtualization
>> driver operation: deploy.
>> Wed May  9 10:14:49 2012 [VMM][I]: ExitCode: 0
>> Wed May  9 10:14:49 2012 [VMM][I]: Successfully execute network driver
>> operation: post.
>> Wed May  9 10:14:50 2012 [LCM][I]: New VM state is RUNNING
>> Wed May  9 10:16:36 2012 [LCM][I]: New VM state is SHUTDOWN
>>
>> VM in Shutdown state and nothing else is done (no EPILOG).
>>
>> oneimage list:
>> 35 oneadmin QA       jdetect-node default       1.8G   OS  No  rdy     0
>> 70 oneadmin oneadmin test         default         2G   OS  No lock     0
>>
>> oneimage show 35:
>> IMAGE 35
>> INFORMATION
>> ID             : 35
>> NAME           : jdetect-node
>> USER           : oneadmin
>> GROUP          : QA
>> DATASTORE      : default
>> TYPE           : OS
>> REGISTER TIME  : 04/17 12:45:14
>> PERSISTENT     : No
>> SOURCE         :
>> /var/lib/one/datastores/1/632d821bb0531b28591c5d719a4bf9af
>> PATH           : /home/oneadmin/linux/centos/jdetect-node.qcow2
>> SIZE           : 1885
>> STATE          : rdy
>> RUNNING_VMS    : 0
>>
>> PERMISSIONS
>> OWNER          : um-
>> GROUP          : u--
>> OTHER          : u--
>>
>> IMAGE
>> TEMPLATE
>> BUS="virtio"
>> DESCRIPTION="Centos 6.2 minimal installation"
>> DEV_PREFIX="hd"
>> PUBLIC="YES"
>>
>> oneimage show 70:
>> IMAGE 70
>> INFORMATION
>> ID             : 70
>> NAME           : test
>> USER           : oneadmin
>> GROUP          : oneadmin
>> DATASTORE      : default
>> TYPE           : OS
>> REGISTER TIME  : 05/09 10:16:11
>> PERSISTENT     : No
>> SOURCE         :
>> /var/lib/one/datastores/1/259fa23ffa9ac7c22247f0b80da85b47
>> FSTYPE         : save_as
>> SIZE           : 2057
>> STATE          : lock
>> RUNNING_VMS    : 0
>>
>> PERMISSIONS
>> OWNER          : um-
>> GROUP          : ---
>> OTHER          : ---
>>
>> IMAGE
>> TEMPLATE
>> DEV_PREFIX="hd"
>> SAVED_DISK_ID="0"
>> SAVED_IMAGE_ID="42"
>> SAVED_VM_ID="1319"
>> SAVE_AS="YES"
>>
>> onedatastore list:
>>  1 default         blades   9      fs     qcow2
>>
>> onedatastore show 1:
>> DATASTORE 1
>> INFORMATION
>> ID             : 1
>> NAME           : default
>> USER           : oneadmin
>> GROUP          : oneadmin
>> CLUSTER        : blades
>> DS_MAD         : fs
>> TM_MAD         : qcow2
>> BASE PATH      : /var/lib/one/datastores/1
>>
>> PERMISSIONS
>> OWNER          : um-
>> GROUP          : u--
>> OTHER          : u--
>>
>> DATASTORE
>> TEMPLATE
>> DS_MAD="fs"
>> TM_MAD="qcow2"
>>
>> IMAGES
>> 20
>> 34
>> 35
>> 38
>> 42
>> 50
>> 59
>> 68
>> 69
>>
>> Thanks!
>>
>> On Tue, 2012-05-08 at 17:13 +0200, Jaime Melis wrote:
>> > Hello Andreas,
>> >
>> >
>> > I'm tested the qcow2 drivers again with saveas a they do work for me.
>> > Could you attach more logs in order to debug this?
>> >
>> >
>> > /var/lib/one/config (be sure to blank the passwords if any)
>> > /var/log/one/<vmid>.log
>> >
>> >
>> > and onedastatore show, and oneimage show of the image and its
>> > datastore.
>> >
>> >
>> > Regards,
>> > Jaime
>> >
>> > On Mon, May 7, 2012 at 10:48 AM, Andreas Calvo
>> > <andreas.calvo at scytl.com> wrote:
>> >         I does not get to the EPILOG state, so it's is not saving
>> >         changes.
>> >         Do I have to enable the qcow driver in the datastore drivers?
>> >         --
>> >         Andreas Calvo Gómez
>> >         Systems Engineer
>> >         Scytl Secure Electronic Voting
>> >         Plaça Gal·la Placidia, 1-3, 1st floor · 08006 Barcelona
>> >         Phone: + 34 934 230 324
>> >         Fax:   + 34 933 251 028
>> >         http://www.scytl.com
>> >
>> >         NOTICE: The information in this e-mail and in any of its
>> >         attachments is
>> >         confidential and intended solely for the attention and use of
>> >         the named
>> >         addressee(s). If you are not the intended recipient, any
>> >         disclosure,
>> >         copying,
>> >         distribution or retaining of this message or any part of it,
>> >         without the
>> >         prior
>> >         written consent of Scytl Secure Electronic Voting, SA is
>> >         prohibited and
>> >         may be
>> >         unlawful. If you have received this in error, please contact
>> >         the sender
>> >         and
>> >         delete the material from any computer.
>> >
>> >         On Fri, 2012-05-04 at 14:03 -0400, Shankhadeep Shome wrote:
>> >         > No you don't have to change image to persistent, it wouldn't
>> >         change
>> >         > the running vm anyways. After the shutdown there are two
>> >         more states,
>> >         > EPILOG and DONE. EPILOG is reached after the VM is
>> >         completely shutdown
>> >         > and reported back, DONE is after the VM files are deleted
>> >         from the
>> >         > system datastore, you should see both steps in the vm log.
>> >         Maybe you
>> >         > can post the last few lines of the vm log, just go
>> >         > to /var/log/one/<vm#>.log on the opennebula server and post
>> >         the last
>> >         > 20 lines.
>> >         >
>> >         > On Fri, May 4, 2012 at 5:07 AM, Andreas Calvo
>> >         > <andreas.calvo at scytl.com> wrote:
>> >         >         What I see when I run the SHUTDOWN command is:
>> >         >         Fri May  4 11:03:11 2012 [LCM][I]: New VM state is
>> >         SHUTDOWN
>> >         >
>> >         >         Is there something else I should do?
>> >         >         Image is not marked as persistent, should it be
>> >         changed?
>> >         >
>> >         >         On Thu, 2012-05-03 at 23:51 -0400, Shankhadeep Shome
>> >         wrote:
>> >         >         > If you use a qcow backing store this is what
>> >         happens in the
>> >         >         background
>> >         >         >
>> >         >         > qemu-img create -backing_store (your original
>> >         image) -f
>> >         >         qcow2 (running
>> >         >         > image)
>> >         >         >
>> >         >         > when you save as its
>> >         >         >
>> >         >         > qemu-img convert (running image + backing store)
>> >         -O qcow2
>> >         >         (new base
>> >         >         > image)
>> >         >         >
>> >         >         > The vm log should look like this... check to see
>> >         if you have
>> >         >         errors.
>> >         >         > How big is your source image? Conversion can take
>> >         a while
>> >         >         depending on
>> >         >         > your image size and backing store.
>> >         >         >
>> >         >         > Thu May  3 23:41:28 2012 [LCM][I]: New VM state is
>> >         SHUTDOWN
>> >         >         > Thu May  3 23:41:48 2012 [VMM][I]: ExitCode: 0
>> >         >         > Thu May  3 23:41:48 2012 [VMM][I]: Successfully
>> >         execute
>> >         >         virtualization
>> >         >         > driver operation: shutdown.
>> >         >         > Thu May  3 23:41:48 2012 [VMM][I]: ExitCode: 0
>> >         >         > Thu May  3 23:41:48 2012 [VMM][I]: Successfully
>> >         execute
>> >         >         network driver
>> >         >         > operation: clean.
>> >         >         > Thu May  3 23:41:49 2012 [LCM][I]: New VM state is
>> >         EPILOG
>> >         >         > Thu May  3 23:42:42 2012 [TM][I]: mvds:
>> >         >         > Moving /var/lib/one/datastores/0/88/disk.0 to
>> >         datastore
>> >         >         >
>> >         >
>> >         as /var/lib/one/datastores/101/4f062daaf6ad2f47fd36c6b35a0bd56c
>> >         >         > Thu May  3 23:42:42 2012 [TM][I]: ExitCode: 0
>> >         >         > Thu May  3 23:42:43 2012 [TM][I]: delete:
>> >         >         > Deleting /var/lib/one/datastores/0/88
>> >         >         > Thu May  3 23:42:43 2012 [TM][I]: ExitCode: 0
>> >         >         > Thu May  3 23:42:43 2012 [DiM][I]: New VM state is
>> >         DONE
>> >         >         >
>> >         >         > On Thu, May 3, 2012 at 2:44 PM, Andreas Calvo
>> >         >         > <andreas.calvo at scytl.com> wrote:
>> >         >         > >
>> >         >         > > Hi all,
>> >         >         > > What is the procedure to save a running VM as an
>> >         image if
>> >         >         it's
>> >         >         > running
>> >         >         > > with QCOW2?
>> >         >         > >
>> >         >         > > As per the documentation, I've used shutdown
>> >         after issuing
>> >         >         save as,
>> >         >         > but
>> >         >         > > the image gets in a LOCKED stated and do not
>> >         progress.
>> >         >         > > If the VM gets deleted, the image changes to
>> >         READY but I
>> >         >         think it's
>> >         >         > just
>> >         >         > > a link to the old image used by the VM. Trying
>> >         to start a
>> >         >         new
>> >         >         > template
>> >         >         > > using this new image throws an error.
>> >         >         > >
>> >         >         > > Tried with SHUTDOWN and STOP without luck.
>> >         >         > >
>> >         >         > > I guess I'm missing something, does anyone how
>> >         to do it?
>> >         >         > >
>> >         >         > > Thanks in advance
>> >         >         > >
>> >         >         > > _______________________________________________
>> >         >         > > Users mailing list
>> >         >         > > Users at lists.opennebula.org
>> >         >         > >
>> >         >
>> >         http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>> >         >         >
>> >         >
>> >         >
>> >         >
>> >
>> >         _______________________________________________
>> >         Users mailing list
>> >         Users at lists.opennebula.org
>> >         http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>> >
>> >
>> >
>> >
>> >
>> >
>> > --
>> > Jaime Melis
>> > Project Engineer
>> > OpenNebula - The Open Source Toolkit for Cloud Computing
>> > www.OpenNebula.org | jmelis at opennebula.org
>>
>>
>
>
>  --
> Jaime Melis
> Project Engineer
> OpenNebula - The Open Source Toolkit for Cloud Computing
> www.OpenNebula.org | jmelis at opennebula.org
>
>


-- 
Jaime Melis
Project Engineer
OpenNebula - The Open Source Toolkit for Cloud Computing
www.OpenNebula.org | jmelis at opennebula.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20120516/4fde2e45/attachment-0003.htm>


More information about the Users mailing list