<div dir="ltr">Since we couldn't find any explanation in the code, I'll close the bug ticket. Let's chalk it up to this corruption.<div>Thanks for the feedback</div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr">--<br><div>Carlos Martín, MSc<br>Project Engineer</div><div>OpenNebula - Flexible Enterprise Cloud Made Simple<br><div><span style="border-collapse:collapse;color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px"><a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:cmartin@opennebula.org" target="_blank">cmartin@opennebula.org</a> | <a href="http://twitter.com/opennebula" target="_blank">@OpenNebula</a></span><span style="border-collapse:collapse;color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px"><a href="mailto:cmartin@opennebula.org" style="color:rgb(42,93,176)" target="_blank"></a></span></div></div></div></div></div>
<br><div class="gmail_quote">On Mon, Nov 17, 2014 at 4:48 PM, Dmitri Chebotarov <span dir="ltr"><<a href="mailto:dchebota@gmu.edu" target="_blank">dchebota@gmu.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Sorry for the late response.<br>
<br>
I ended up rebuilding trouble nodes as part of RHEL7 upgrade.<br>
<br>
I believe the problem was related to absence of proper fencing for HOSTS.<br>
VMs that are using persistent storage ended up with corrupted filesystem - I fixed some disks with fsck, others restored from backup.<br>
<br>
I'm looking into how to implement fencing (via power reset) via HOST_HOOK, all hosts can be controlled using xCAT and I have xCAT's REST API configured, I need to figure out how to execute multiple HOST_HOOK...<br>
<span class="im HOEnZb"><br>
<br>
--<br>
Thank you,<br>
<br>
Dmitri Chebotarov<br>
VCL Sys Eng, Engineering & Architectural Support, TSD - Ent Servers & Messaging<br>
223 Aquia Building, Ffx, MSN: 1B5<br>
Phone: <a href="tel:%28703%29%20993-6175" value="+17039936175">(703) 993-6175</a> | Fax: <a href="tel:%28703%29%20993-3404" value="+17039933404">(703) 993-3404</a><br>
<br>
<br>
</span><div class="HOEnZb"><div class="h5">> On Oct 20, 2014, at 11:30 , Carlos Martín Sánchez <<a href="mailto:cmartin@opennebula.org">cmartin@opennebula.org</a>> wrote:<br>
><br>
> Hi Dmitri,<br>
><br>
> Do you still experience this issue? If so, we could use more information to further debug this.<br>
><br>
> Please send the output of onehost show -x.<br>
> And from the host, the output of this command: cd /var/tmp/one/im/kvm-probes.d/; ./poll.sh<br>
><br>
> Thank you.<br>
><br>
> --<br>
> Carlos Martín, MSc<br>
> Project Engineer<br>
> OpenNebula - Flexible Enterprise Cloud Made Simple<br>
> <a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:cmartin@opennebula.org">cmartin@opennebula.org</a> | @OpenNebula<br>
><br>
> On Wed, Oct 1, 2014 at 6:30 PM, Carlos Martín Sánchez <<a href="mailto:cmartin@opennebula.org">cmartin@opennebula.org</a>> wrote:<br>
> Hi,<br>
><br>
> That is strange, so we opened a bug to look into it for the next release:<br>
> <a href="http://dev.opennebula.org/issues/3217" target="_blank">http://dev.opennebula.org/issues/3217</a><br>
><br>
> Cheers,<br>
> Carlos<br>
><br>
> --<br>
> Carlos Martín, MSc<br>
> Project Engineer<br>
> OpenNebula - Flexible Enterprise Cloud Made Simple<br>
> <a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:cmartin@opennebula.org">cmartin@opennebula.org</a> | @OpenNebula<br>
><br>
> On Tue, Sep 30, 2014 at 5:46 PM, Dmitri Chebotarov <<a href="mailto:dchebota@gmu.edu">dchebota@gmu.edu</a>> wrote:<br>
> Hi,<br>
><br>
> Something strange is happening with my VMs...<br>
> Below is 'one host show 161' output and it shows that ONE marks running VMs as zombies on the host. It happens to multiple VMs/HOSTs, but now all. I tried to delete ZOMBIES attribute, but few minutes later it's back with the list of running VMs. What would cause this behavior?<br>
><br>
> (ONE 4.8)<br>
><br>
> $ onehost show 161<br>
> HOST 161 INFORMATION<br>
> ID : 161<br>
> NAME : BC3-6<br>
> CLUSTER : RHEL<br>
> STATE : MONITORED<br>
> IM_MAD : kvm<br>
> VM_MAD : kvm<br>
> VN_MAD : ovswitch<br>
> LAST MONITORING TIME : 09/30 11:35:22<br>
><br>
> HOST SHARES<br>
> TOTAL MEM : 47.1G<br>
> USED MEM (REAL) : 16.9G<br>
> USED MEM (ALLOCATED) : 14G<br>
> TOTAL CPU : 2400<br>
> USED CPU (REAL) : 50<br>
> USED CPU (ALLOCATED) : 700<br>
> RUNNING VMS : 4<br>
><br>
> MONITORING INFORMATION<br>
> ARCH="x86_64"<br>
> ARCH="x86_64"<br>
> CPUSPEED="1596"<br>
> CPUSPEED="1596"<br>
> HOSTNAME="BC3-6"<br>
> HOSTNAME="BC3-6"<br>
> HYPERVISOR="kvm"<br>
> HYPERVISOR="kvm"<br>
> MODELNAME="Intel(R) Xeon(R) CPU X5660 @ 2.80GHz"<br>
> MODELNAME="Intel(R) Xeon(R) CPU X5660 @ 2.80GHz"<br>
> NETRX="45361301966553"<br>
> NETRX="0"<br>
> NETTX="2465939705538"<br>
> NETTX="0"<br>
> RESERVED_CPU=""<br>
> RESERVED_MEM=""<br>
> TOTAL_ZOMBIES="4"<br>
> VERSION="4.8.0"<br>
> ZOMBIES="one-51701, one-51774, one-51747, one-51763"<br>
><br>
> VIRTUAL MACHINES<br>
><br>
> ID USER GROUP NAME STAT UCPU UMEM HOST TIME<br>
> 51701 vcl-gmu- vcl vmguest-vcl323 runn 14 4G BC3-6 0d 12h40<br>
> 51747 vcl-gmu- vcl vmguest-vcl65 ( runn 9 2G BC3-6 0d 10h25<br>
> 51763 vcl-gmu- vcl vmguest-vcl312 runn 12 4G BC3-6 0d 09h10<br>
> 51774 vcl-gmu- vcl vmguest-vcl17 ( runn 14 4G BC3-6 0d 06h10<br>
><br>
> --<br>
> Thank you,<br>
><br>
> Dmitri Chebotarov<br>
> VCL Sys Eng, Engineering & Architectural Support, TSD - Ent Servers & Messaging<br>
> 223 Aquia Building, Ffx, MSN: 1B5<br>
> Phone: (703) 993-6175 | Fax: (703) 993-3404<br>
> _______________________________________________<br>
> Users mailing list<br>
> <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
><br>
><br>
<br>
</div></div></blockquote></div><br></div>