[one-users] MySQL deadlock when trying to register a new vm image
Ruben S. Montero
rsmontero at opennebula.org
Mon Oct 6 09:42:15 PDT 2014
Could you check the reason for the deadlock?
mysql> SHOW ENGINE INNODB STATUS\G
It probably refers to a next-lock issue, could you try setting:
mysql> SET GLOBAL TRANSACTION ISOLATION LEVEL READ COMMITTED;
And check if the deadlocks are gone?
On Thu, Sep 11, 2014 at 9:39 PM, Galimba <galimba at gmail.com> wrote:
> uppon closer examination, we figured out that the deadlocks were not
> related to the image problem.
> I was able to fix the uploading problem using this [1], but the random
> deadlock issue persists. I tried to onedb fsck, backup it and restore it...
> but it's all the same.
>
>
>
> [1] ->
> http://docs.opennebula.org/4.6/release_notes/release_notes/known_issues.html
>
> On Thu, Sep 11, 2014 at 4:23 AM, Hamada, Ondrej <ondrej.hamada at acision.com
> > wrote:
>
>> Hi,
>>
>>
>>
>> no workarounds so far. But my mysql db is using default options and also
>> runs in a virtual machine – so I suspect it just needs some tweaking. I’m
>> going to change few parameters during this week. I’ll post the results to
>> mailing list if it works.
>>
>>
>>
>> Ondra
>>
>>
>>
>> *From:* Galimba [mailto:galimba at gmail.com]
>> *Sent:* Wednesday, September 10, 2014 10:04 PM
>> *To:* users at lists.opennebula.org; cmartin at opennebula.org; Hamada, Ondrej
>> *Subject:* Re: MySQL deadlock when trying to register a new vm image
>>
>>
>>
>> I found this [1] mail and I believe the deadlock issue is the same I'm
>> having.
>>
>> Any pointers on a workaround?
>>
>>
>>
>> Best regards
>>
>> galimba
>>
>>
>> [1]
>> http://lists.opennebula.org/pipermail/users-opennebula.org/2014-April/044546.html
>>
>>
>>
>> On Tue, Sep 9, 2014 at 5:53 PM, Galimba <galimba at gmail.com> wrote:
>>
>> Greetings!
>>
>> I've recently upgraded from v4.4 to 4.6. As part of the upgrade, we
>> decided to create a new db using MySQL. The configurations ran smooth, all
>> nodes and datastores are being monitored without issues but when I tried to
>> upload a ttylinux image for testing, sunstone didn't show the image
>> uploaded on the list. As if it wasn' t even there. I ran the #oneimage
>> list command, and there's no image there either. So I tried uploading
>> again, while I checked the oned.log. I then tried to upload other images.
>>
>> I have OpenNebula front end installed on a host, several other nodes that
>> are speciffic for running the VMs and a NAS with 20TB that holds the
>> datastores. While I was uploading an ubuntu image (20GB), I checked the
>> transmition rate on the network and I was supprised to see that the traffic
>> between my desktop (where I was uploading from) and the frontend was very
>> heavy, but the datastore was not recieving the image I was uploading.
>>
>> Interestingly, the log showed this error:
>>
>> Tue Sep 9 16:20:04 2014 [ONE][E]: SQL command was: REPLACE INTO
>> datastore_pool (oid, name, body, uid, gid, owner_u, group_u, other_u, cid)
>> VALUES
>> (0,'system','<DATASTORE><ID>0</ID><UID>0</UID><GID>0</GID><UNAME>oneadmin</UNAME><GNAME>oneadmin</GNAME><NAME>system</NAME><PERMISSIONS><OWNER_U>1</OWNER_U><OWNER_M>1</OWNER_M><OWNER_A>0</OWNER_A><GROUP_U>1</GROUP_U><GROUP_M>0</GROUP_M><GROUP_A>0</GROUP_A><OTHER_U>0</OTHER_U><OTHER_M>0</OTHER_M><OTHER_A>0</OTHER_A></PERMISSIONS><DS_MAD><![CDATA[-]]></DS_MAD><TM_MAD><![CDATA[shared]]></TM_MAD><BASE_PATH><![CDATA[/var/lib/one//datastores/0]]></BASE_PATH><TYPE>1</TYPE><DISK_TYPE>0</DISK_TYPE><CLUSTER_ID>-1</CLUSTER_ID><CLUSTER></CLUSTER><TOTAL_MB>9461612</TOTAL_MB><FREE_MB>8956832</FREE_MB><USED_MB>1</USED_MB><IMAGES></IMAGES><TEMPLATE><BASE_PATH><![CDATA[/var/lib/one//datastores/]]></BASE_PATH><SHARED><![CDATA[YES]]></SHARED><TM_MAD><![CDATA[shared]]></TM_MAD><TYPE><![CDATA[SYSTEM_DS]]></TYPE></TEMPLATE></DATASTORE>',0,0,1,1,0,-1),
>> error 1213 : Deadlock found when trying to get lock; try restarting
>> transaction
>>
>> /*******************************************************/
>>
>> I leave down here a copy of my oned.conf
>>
>> /*******************************************************/
>>
>> LOG = [
>> system = "file",
>> debug_level = 3
>> ]
>> MONITORING_INTERVAL = 60
>> MONITORING_THREADS = 50
>> SCRIPTS_REMOTE_DIR=/var/tmp/one
>> PORT = 2633
>> DB = [ backend = "mysql",
>> server = "localhost",
>> port = 0,
>> user = "oneadmin",
>> passwd = "__________________",
>> db_name = "opennebula" ]
>> VNC_BASE_PORT = 5900
>> FEDERATION = [
>> MODE = "STANDALONE",
>> ZONE_ID = 0,
>> MASTER_ONED = ""
>> ]
>> NETWORK_SIZE = 254
>> MAC_PREFIX = "02:00"
>> DATASTORE_CAPACITY_CHECK = "yes"
>> DEFAULT_IMAGE_TYPE = "OS"
>> DEFAULT_DEVICE_PREFIX = "hd"
>> DEFAULT_CDROM_DEVICE_PREFIX = "vd"
>> IM_MAD = [
>> name = "collectd",
>> executable = "collectd",
>> arguments = "-p 4124 -f 5 -t 50 -i 20" ]
>> IM_MAD = [
>> name = "kvm",
>> executable = "one_im_ssh",
>> arguments = "-r 3 -t 15 kvm" ]
>> VM_MAD = [
>> name = "kvm",
>> executable = "one_vmm_exec",
>> arguments = "-t 15 -r 0 kvm",
>> default = "vmm_exec/vmm_exec_kvm.conf",
>> type = "kvm" ]
>> TM_MAD = [
>> executable = "one_tm",
>> arguments = "-t 15 -d dummy,lvm,shared,fs_lvm,qcow2,ssh,vmfs,ceph"
>> ]
>> DATASTORE_MAD = [
>> executable = "one_datastore",
>> arguments = "-t 15 -d dummy,fs,vmfs,lvm,ceph"
>> ]
>> HM_MAD = [
>> executable = "one_hm" ]
>> AUTH_MAD = [
>> executable = "one_auth_mad",
>> authn = "ssh,x509,ldap,server_cipher,server_x509"
>> ]
>> SESSION_EXPIRATION_TIME = 900
>> DEFAULT_UMASK = 177
>> VM_RESTRICTED_ATTR = "CONTEXT/FILES"
>> VM_RESTRICTED_ATTR = "NIC/MAC"
>> VM_RESTRICTED_ATTR = "NIC/VLAN_ID"
>> VM_RESTRICTED_ATTR = "NIC/BRIDGE"
>> IMAGE_RESTRICTED_ATTR = "SOURCE"
>> INHERIT_DATASTORE_ATTR = "CEPH_HOST"
>> INHERIT_DATASTORE_ATTR = "CEPH_SECRET"
>> INHERIT_DATASTORE_ATTR = "CEPH_USER"
>> INHERIT_DATASTORE_ATTR = "RBD_FORMAT"
>> INHERIT_DATASTORE_ATTR = "GLUSTER_HOST"
>> INHERIT_DATASTORE_ATTR = "GLUSTER_VOLUME"
>> INHERIT_VNET_ATTR = "VLAN_TAGGED_ID"
>> TM_MAD_CONF = [
>> name = "dummy", ln_target = "NONE", clone_target = "SYSTEM", shared =
>> "yes"
>> ]
>> TM_MAD_CONF = [
>> name = "lvm", ln_target = "NONE", clone_target = "SELF", shared =
>> "yes"
>> ]
>> TM_MAD_CONF = [
>> name = "shared", ln_target = "NONE", clone_target = "SYSTEM", shared
>> = "yes"
>> ]
>> TM_MAD_CONF = [
>> name = "fs_lvm", ln_target = "SYSTEM", clone_target = "SYSTEM",
>> shared="yes"
>> ]
>> TM_MAD_CONF = [
>> name = "qcow2", ln_target = "NONE", clone_target = "SYSTEM", shared =
>> "yes"
>> ]
>> TM_MAD_CONF = [
>> name = "ssh", ln_target = "SYSTEM", clone_target = "SYSTEM", shared =
>> "no"
>> ]
>> TM_MAD_CONF = [
>> name = "vmfs", ln_target = "NONE", clone_target= "SYSTEM", shared =
>> "yes"
>> ]
>> TM_MAD_CONF = [
>> name = "ceph", ln_target = "NONE", clone_target = "SELF", shared =
>> "yes"
>> ]
>> /**********************************************************/
>>
>> best regards
>>
>> galimba
>>
>>
>>
>> --
>>
>> [image: Image removed by sender.]
>>
>>
>>
>>
>> --
>>
>> [image: Image removed by sender.]
>> ------------------------------
>>
>> This e-mail and any attachment is for authorised use by the intended
>> recipient(s) only. It may contain proprietary material, confidential
>> information and/or be subject to legal privilege. It should not be copied,
>> disclosed to, retained or used by, any other party. If you are not an
>> intended recipient then please promptly delete this e-mail and any
>> attachment and all copies and inform the sender. Thank you for
>> understanding.
>>
>
>
>
> --
>
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>
--
--
Ruben S. Montero, PhD
Project co-Lead and Chief Architect
OpenNebula - Flexible Enterprise Cloud Made Simple
www.OpenNebula.org | rsmontero at opennebula.org | @OpenNebula
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20141006/ea97d9d1/attachment-0001.htm>
More information about the Users
mailing list