[one-users] MySQL deadlock when trying to register a new vm image

Thu Sep 11 00:23:32 PDT 2014

Hi,

no workarounds so far. But my mysql db is using default options and also runs in a virtual machine – so I suspect it just needs some tweaking. I’m going to change few parameters during this week. I’ll post the results to mailing list if it works.

Ondra

From: Galimba [mailto:galimba at gmail.com]
Sent: Wednesday, September 10, 2014 10:04 PM
To: users at lists.opennebula.org; cmartin at opennebula.org; Hamada, Ondrej
Subject: Re: MySQL deadlock when trying to register a new vm image

I found this [1] mail and I believe the deadlock issue is the same I'm having.
Any pointers on a workaround?

Best regards
galimba

[1] http://lists.opennebula.org/pipermail/users-opennebula.org/2014-April/044546.html

On Tue, Sep 9, 2014 at 5:53 PM, Galimba <galimba at gmail.com<mailto:galimba at gmail.com>> wrote:
Greetings!
I've recently upgraded from v4.4 to 4.6. As part of the upgrade, we decided to create a new db using MySQL. The configurations ran smooth, all nodes and datastores are being monitored without issues but when I tried to upload a ttylinux image for testing, sunstone didn't show the image uploaded on the list. As if it wasn' t even there. I ran the  #oneimage list command, and there's no image there either. So I tried uploading again, while I checked the oned.log. I then tried to upload other images.
I have OpenNebula front end installed on a host, several other nodes that are speciffic for running the VMs and a NAS with 20TB that holds the datastores. While I was uploading an ubuntu image (20GB), I checked the transmition rate on the network and I was supprised to see that the traffic between my desktop (where I was uploading from) and the frontend was very heavy, but the datastore was not recieving the image I was uploading.
Interestingly, the log showed this error:

Tue Sep  9 16:20:04 2014 [ONE][E]: SQL command was: REPLACE INTO datastore_pool (oid, name, body, uid, gid, owner_u, group_u, other_u, cid) VALUES (0,'system','<DATASTORE><ID>0</ID><UID>0</UID><GID>0</GID><UNAME>oneadmin</UNAME><GNAME>oneadmin</GNAME><NAME>system</NAME><PERMISSIONS><OWNER_U>1</OWNER_U><OWNER_M>1</OWNER_M><OWNER_A>0</OWNER_A><GROUP_U>1</GROUP_U><GROUP_M>0</GROUP_M><GROUP_A>0</GROUP_A><OTHER_U>0</OTHER_U><OTHER_M>0</OTHER_M><OTHER_A>0</OTHER_A></PERMISSIONS><DS_MAD><![CDATA[-]]></DS_MAD><TM_MAD><![CDATA[shared]]></TM_MAD><BASE_PATH><![CDATA[/var/lib/one//datastores/0]]></BASE_PATH><TYPE>1</TYPE><DISK_TYPE>0</DISK_TYPE><CLUSTER_ID>-1</CLUSTER_ID><CLUSTER></CLUSTER><TOTAL_MB>9461612</TOTAL_MB><FREE_MB>8956832</FREE_MB><USED_MB>1</USED_MB><IMAGES></IMAGES><TEMPLATE><BASE_PATH><![CDATA[/var/lib/one//datastores/]]></BASE_PATH><SHARED><![CDATA[YES]]></SHARED><TM_MAD><![CDATA[shared]]></TM_MAD><TYPE><![CDATA[SYSTEM_DS]]></TYPE></TEMPLATE></DATASTORE>',0,0,1,1,0,-1), error 1213 : Deadlock found when trying to get lock; try restarting transaction

/*******************************************************/
I leave down here a copy of my oned.conf

/*******************************************************/
LOG = [
  system      = "file",
  debug_level = 3
]
MONITORING_INTERVAL = 60
MONITORING_THREADS  = 50
SCRIPTS_REMOTE_DIR=/var/tmp/one
PORT = 2633
DB = [ backend = "mysql",
        server  = "localhost",
        port    = 0,
        user    = "oneadmin",
        passwd  = "__________________",
        db_name = "opennebula" ]
VNC_BASE_PORT = 5900
FEDERATION = [
    MODE = "STANDALONE",
    ZONE_ID = 0,
    MASTER_ONED = ""
]
NETWORK_SIZE = 254
MAC_PREFIX   = "02:00"
DATASTORE_CAPACITY_CHECK = "yes"
DEFAULT_IMAGE_TYPE    = "OS"
DEFAULT_DEVICE_PREFIX = "hd"
DEFAULT_CDROM_DEVICE_PREFIX = "vd"
IM_MAD = [
      name       = "collectd",
      executable = "collectd",
      arguments  = "-p 4124 -f 5 -t 50 -i 20" ]
IM_MAD = [
      name       = "kvm",
      executable = "one_im_ssh",
      arguments  = "-r 3 -t 15 kvm" ]
VM_MAD = [
    name       = "kvm",
    executable = "one_vmm_exec",
    arguments  = "-t 15 -r 0 kvm",
    default    = "vmm_exec/vmm_exec_kvm.conf",
    type       = "kvm" ]
TM_MAD = [
    executable = "one_tm",
    arguments = "-t 15 -d dummy,lvm,shared,fs_lvm,qcow2,ssh,vmfs,ceph"
]
DATASTORE_MAD = [
    executable = "one_datastore",
    arguments  = "-t 15 -d dummy,fs,vmfs,lvm,ceph"
]
HM_MAD = [
    executable = "one_hm" ]
AUTH_MAD = [
    executable = "one_auth_mad",
    authn = "ssh,x509,ldap,server_cipher,server_x509"
]
SESSION_EXPIRATION_TIME = 900
DEFAULT_UMASK = 177
VM_RESTRICTED_ATTR = "CONTEXT/FILES"
VM_RESTRICTED_ATTR = "NIC/MAC"
VM_RESTRICTED_ATTR = "NIC/VLAN_ID"
VM_RESTRICTED_ATTR = "NIC/BRIDGE"
IMAGE_RESTRICTED_ATTR = "SOURCE"
INHERIT_DATASTORE_ATTR  = "CEPH_HOST"
INHERIT_DATASTORE_ATTR  = "CEPH_SECRET"
INHERIT_DATASTORE_ATTR  = "CEPH_USER"
INHERIT_DATASTORE_ATTR  = "RBD_FORMAT"
INHERIT_DATASTORE_ATTR  = "GLUSTER_HOST"
INHERIT_DATASTORE_ATTR  = "GLUSTER_VOLUME"
INHERIT_VNET_ATTR       = "VLAN_TAGGED_ID"
TM_MAD_CONF = [
    name = "dummy", ln_target = "NONE", clone_target = "SYSTEM", shared = "yes"
]
TM_MAD_CONF = [
    name = "lvm", ln_target = "NONE", clone_target = "SELF", shared = "yes"
]
TM_MAD_CONF = [
    name = "shared", ln_target = "NONE", clone_target = "SYSTEM", shared = "yes"
]
TM_MAD_CONF = [
    name = "fs_lvm", ln_target = "SYSTEM", clone_target = "SYSTEM", shared="yes"
]
TM_MAD_CONF = [
    name = "qcow2", ln_target = "NONE", clone_target = "SYSTEM", shared = "yes"
]
TM_MAD_CONF = [
    name = "ssh", ln_target = "SYSTEM", clone_target = "SYSTEM", shared = "no"
]
TM_MAD_CONF = [
    name = "vmfs", ln_target = "NONE", clone_target= "SYSTEM", shared = "yes"
]
TM_MAD_CONF = [
    name = "ceph", ln_target = "NONE", clone_target = "SELF", shared = "yes"
]
/**********************************************************/
best regards
galimba

--
[Image removed by sender.]

--
[Image removed by sender.]
________________________________
This e-mail and any attachment is for authorised use by the intended recipient(s) only. It may contain proprietary material, confidential information and/or be subject to legal privilege. It should not be copied, disclosed to, retained or used by, any other party. If you are not an intended recipient then please promptly delete this e-mail and any attachment and all copies and inform the sender. Thank you for understanding.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140911/3c892b9e/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ~WRD000.jpg
Type: image/jpeg
Size: 823 bytes
Desc: ~WRD000.jpg
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140911/3c892b9e/attachment-0001.jpg>