<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.E-mailStijl17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="NL" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi Javier,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The bug concerning the bulk creation of VM’s works as expected now. Do you have an idea of what the problem is while bulk deleting vm’s?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sebastiaan Smit<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Van:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Javier Fontan [mailto:jfontan@opennebula.org]
<br>
<b>Verzonden:</b> vrijdag 14 november 2014 15:44<br>
<b>Aan:</b> Sebastiaan Smit; users@lists.opennebula.org<br>
<b>Onderwerp:</b> Re: [one-users] Bulk delete of vCenter VM's leaves stray VM's<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">There was a bug in the driver that caused error when deploying several VMs at the same time. To fix it change the file /var/lib/one/remotes/vmm/vcenter/vcenter_driver.rb at line 120 from this code:<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> def find_vm_template(uuid)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> vms = @dc.vmFolder.childEntity.grep(RbVmomi::VIM::VirtualMachine)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"> return vms.find{ |v| v.config.uuid == uuid }<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> end<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">to this other one:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> def find_vm_template(uuid)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> vms = @dc.vmFolder.childEntity.grep(RbVmomi::VIM::VirtualMachine)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"> return vms.find{ |v| v.config && v.config.uuid == uuid }<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> end<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">We are still looking into the problem when deleting several VMs.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks for telling us.<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Thu Nov 13 2014 at 12:59:55 PM Javier Fontan <<a href="mailto:jfontan@opennebula.org">jfontan@opennebula.org</a>> wrote:<o:p></o:p></p>
<p class="MsoNormal">Hi,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">We have opened an issue to track this problem:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><a href="http://dev.opennebula.org/issues/3334" target="_blank">http://dev.opennebula.org/issues/3334</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Meanwhile you can decrease the number of actions sent changing in /etc/one/oned.conf the parameter -t (number of threads) for VM driver. For example:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">VM_MAD = [<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> name = "vcenter",<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> executable = "one_vmm_sh",<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> arguments = "-p -t 2 -r 0 vcenter -s sh",<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> type = "xml" ]<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Cheers<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Wed Nov 12 2014 at 5:40:00 PM Sebastiaan Smit <<a href="mailto:bas@echelon.nl" target="_blank">bas@echelon.nl</a>> wrote:<o:p></o:p></p>
<p class="MsoNormal">Hi list,<br>
<br>
We're testing the vCenter functionality in version 4.10 and see some strange behaviour while doing bulk actions.<br>
<br>
Deleting VM's sometimes leave stray VM's on our cluster. We see the following in de VM log:<br>
<br>
Sun Nov 9 15:51:34 2014 [Z0][LCM][I]: New VM state is RUNNING<br>
Wed Nov 12 17:30:36 2014 [Z0][LCM][I]: New VM state is CLEANUP.<br>
Wed Nov 12 17:30:36 2014 [Z0][VMM][I]: Driver command for 60 cancelled<br>
Wed Nov 12 17:30:36 2014 [Z0][DiM][I]: New VM state is DONE<br>
Wed Nov 12 17:30:41 2014 [Z0][VMM][W]: Ignored: LOG I 60 Command execution fail: /var/lib/one/remotes/vmm/vcenter/cancel '423cdcae-b6b3-07c1-def6-96b9f3f4b7b3' 'demo-01' 60 demo-01<br>
Wed Nov 12 17:30:41 2014 [Z0][VMM][W]: Ignored: LOG I 60 Cancel of VM 423cdcae-b6b3-07c1-def6-96b9f3f4b7b3 on host demo-01 failed due to "ManagedObjectNotFound: The object has already been deleted or has not been completely created"<br>
Wed Nov 12 17:30:41 2014 [Z0][VMM][W]: Ignored: LOG I 60 ExitCode: 255<br>
Wed Nov 12 17:30:41 2014 [Z0][VMM][W]: Ignored: LOG I 60 Failed to execute virtualization driver operation: cancel.<br>
Wed Nov 12 17:30:41 2014 [Z0][VMM][W]: Ignored: LOG I 60 Successfully execute network driver operation: clean.<br>
Wed Nov 12 17:30:41 2014 [Z0][VMM][W]: Ignored: CLEANUP SUCCESS 60<br>
<br>
We see it in a different manner while bulk creating VM's (20+ at a time):<br>
<br>
Sun Nov 9 16:01:34 2014 [Z0][DiM][I]: New VM state is ACTIVE.<br>
Sun Nov 9 16:01:34 2014 [Z0][LCM][I]: New VM state is PROLOG.<br>
Sun Nov 9 16:01:34 2014 [Z0][LCM][I]: New VM state is BOOT<br>
Sun Nov 9 16:01:34 2014 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/81/deployment.0<br>
Sun Nov 9 16:01:34 2014 [Z0][VMM][I]: Successfully execute network driver operation: pre.<br>
Sun Nov 9 16:01:36 2014 [Z0][VMM][I]: Command execution fail: /var/lib/one/remotes/vmm/vcenter/deploy '/var/lib/one/vms/81/deployment.0' 'demo-01' 81 demo-01<br>
Sun Nov 9 16:01:36 2014 [Z0][VMM][I]: Deploy of VM 81 on host demo-01 with /var/lib/one/vms/81/deployment.0 failed due to "undefined method `uuid' for nil:NilClass"<br>
Sun Nov 9 16:01:36 2014 [Z0][VMM][I]: ExitCode: 255<br>
Sun Nov 9 16:01:36 2014 [Z0][VMM][I]: Failed to execute virtualization driver operation: deploy.<br>
Sun Nov 9 16:01:36 2014 [Z0][VMM][E]: Error deploying virtual machine<br>
Sun Nov 9 16:01:36 2014 [Z0][DiM][I]: New VM state is FAILED<br>
Wed Nov 12 17:30:19 2014 [Z0][DiM][I]: New VM state is DONE.<br>
Wed Nov 12 17:30:19 2014 [Z0][LCM][E]: epilog_success_action, VM in a wrong state<br>
<br>
<br>
I think these have two different root causes. The cluster is not under load.<br>
<br>
<br>
Has anyone else seen this behaviour?<br>
<br>
Best regards,<br>
--<br>
Sebastiaan Smit<br>
Echelon BV<br>
<br>
E: <a href="mailto:bas@echelon.nl" target="_blank">bas@echelon.nl</a><br>
W: <a href="http://www.echelon.nl" target="_blank">www.echelon.nl</a><br>
T: (088) 3243566 (gewijzigd nummer)<br>
T: (088) 3243505 (servicedesk)<br>
F: (053) 4336222<br>
<br>
KVK: 06055381<br>
<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><o:p></o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>