<p dir="ltr">Hi </p>
<p dir="ltr">I've tested with the very same environment and it should work. Could you try to define the secret with the oneadmin account and:</p>
<p dir="ltr">-c qemu:///system </p>
<p dir="ltr">option for virsh command.</p>
<p dir="ltr">Also to manually test it, once the vm is in failed state go to the vm directory in the host and simply execute:</p>
<p dir="ltr">virsh create -c qemu:///system deployment.0</p>
<p dir="ltr">Cheers</p>
<p dir="ltr">Ruben</p>
<div class="gmail_quote">On Apr 8, 2014 7:05 PM, "Steve @ MyEvolve" <<a href="mailto:steve@myevolve.com">steve@myevolve.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Bill,<div><br></div><div>I am using Centos 6.5 and CephX. I installed the following rpm versions from Ceph on the nodes and I also followed the procedure for authentication :</div><div><br></div><div>
<p>rpm -Uvh <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a> <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-img-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-img-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a> <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-guest-agent-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-guest-agent-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a> <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a></p>
<p><br></p><p>
</p><p><span>CephX</span></p><p><span>virsh secret-define --file secret.xml; </span>virsh secret-set-value --secret <span>34afabcd-8ee0-45fd-a880-09df24fef603</span> --base64 $(cat client.libvirt.key)</p>
<p><br></p><p>Also, Ruben -- how do I:</p><p>"<span style="font-family:arial,sans-serif;font-size:12.727272033691406px">1.- could you try manually to add port to the <source attribute, and check if the VM boots with virsh create"</span></p>
<p><span style="font-family:arial,sans-serif;font-size:12.727272033691406px"><br></span></p><p>Thank you,</p><p>Steve</p><p><br></p></div><div><br></div></div><div class="gmail_extra"><br>
<br><div class="gmail_quote">On Tue, Apr 8, 2014 at 6:20 AM, Campbell, Bill <span dir="ltr"><<a href="mailto:bcampbell@axcess-financial.com" target="_blank">bcampbell@axcess-financial.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Are you using CentOS/RHEL? Are you using CephX Authentication?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">There have been a few changes in how Libvirt handles the configurations of Ceph images, and I’m not sure if that version of Qemu is compiled with RBD support.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <a href="mailto:users-bounces@lists.opennebula.org" target="_blank">users-bounces@lists.opennebula.org</a> [mailto:<a href="mailto:users-bounces@lists.opennebula.org" target="_blank">users-bounces@lists.opennebula.org</a>] <b>On Behalf Of </b>Ruben S. Montero<br>
<b>Sent:</b> Tuesday, April 08, 2014 6:00 AM<br><b>To:</b> Steve @ MyEvolve<br><b>Cc:</b> <a href="mailto:users@lists.opennebula.org" target="_blank">users@lists.opennebula.org</a><br><b>Subject:</b> Re: [one-users] Images from Images (Ceph) Datastore Not Deploying<u></u><u></u></span></p>
<div><div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">Well<u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">The deployment file seems to be properly generated, so given the error message complaining about the missing port:<u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">1.- could you try manually to add port to the <source attribute, and check if the VM boots with virsh create<u></u><u></u></p></div><div>
<p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">2.- I've not seen this required by ceph, here it is working with the libvirt packages from the ceph guys (libvirt 0.10.2 and qemu-kvm-0.12.1), Could it be a version problem?<u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Cheers<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div></div>
<div><p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p><div><p class="MsoNormal">On Tue, Apr 8, 2014 at 11:09 AM, Steve @ MyEvolve <<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"><div><p class="MsoNormal">Hi Ruben,<u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p>
</div><div><p class="MsoNormal">Contents of /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p><domain type='kvm' xmlns:qemu='<a href="http://libvirt.org/schemas/domain/qemu/1.0" target="_blank">http://libvirt.org/schemas/domain/qemu/1.0</a>'><u></u><u></u></p>
<p> <name>one-32</name><u></u><u></u></p><p> <cputune><u></u><u></u></p><p> <shares>1024</shares><u></u><u></u></p><p> </cputune><u></u><u></u></p><p>
<memory>524288</memory><u></u><u></u></p><p> <os><u></u><u></u></p><p> <type arch='x86_64'>hvm</type><u></u><u></u></p><p> <boot dev='hd'/><u></u><u></u></p>
<p> </os><u></u><u></u></p><p> <devices><u></u><u></u></p><p> <emulator>/usr/libexec/qemu-kvm</emulator><u></u><u></u></p><p> <disk type='network' device='disk'><u></u><u></u></p>
<p> <source protocol='rbd' name='one/one-18-32-0'><u></u><u></u></p><p> <host name='cloudweb12' port='6789'/><u></u><u></u></p>
<p> <host name='cloudweb13' port='6789'/><u></u><u></u></p><p> <host name='cloudweb14' port='6789'/><u></u><u></u></p>
<p> </source><u></u><u></u></p><p> <target dev='hda'/><u></u><u></u></p><p> <driver name='qemu' type='raw' cache='none'/><u></u><u></u></p>
<p> </disk><u></u><u></u></p><p> <disk type='file' device='cdrom'><u></u><u></u></p><p> <source file='/var/lib/one//datastores/125/32/disk.1'/><u></u><u></u></p>
<p> <target dev='hdb'/><u></u><u></u></p><p> <readonly/><u></u><u></u></p><p> <driver name='qemu' type='raw'/><u></u><u></u></p>
<p> </disk><u></u><u></u></p><p> <interface type='bridge'><u></u><u></u></p><p> <source bridge='br0'/><u></u><u></u></p><p> <mac address='02:00:26:6b:bb:96'/><u></u><u></u></p>
<p> </interface><u></u><u></u></p><p> <graphics type='vnc' listen='0.0.0.0' port='5947'/><u></u><u></u></p><p> </devices><u></u><u></u></p><p>
<features><u></u><u></u></p><p> <acpi/><u></u><u></u></p><p> </features><u></u><u></u></p><p></domain><u></u><u></u></p><p><u></u> <u></u></p></div><div><p class="MsoNormal">
<u></u> <u></u></p></div><div><p class="MsoNormal">Ceph Datastore:<u></u><u></u></p></div><div><p class="MsoNormal">CEPH_HOST = <span style="font-size:10.5pt;font-family:"Arial","sans-serif";color:#333333;background:#f9f9f9">cloudweb12:6789 cloudweb13:6789 cloudweb14:6789</span><u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal"><span style="font-family:"Arial","sans-serif";color:#333333;background:#f9f9f9">Thanks,</span><u></u><u></u></p>
</div><div><p class="MsoNormal"><span style="font-family:"Arial","sans-serif";color:#333333;background:#f9f9f9">Steve</span><u></u><u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12.0pt">
<u></u> <u></u></p><div><p class="MsoNormal">On Tue, Apr 8, 2014 at 1:18 AM, Ruben S. Montero <<a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a>> wrote:<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div><p class="MsoNormal">Hi<u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Could you send /var/lib/one//datastores/125/32/deployment.0? Also could you double check you ceph datastore configuration, specially the CEPH_HOST attribute to read something like<u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">CEPH_HOST="cephmon1:6789 cephmon2:6789"<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">
Cheers<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Ruben<u></u><u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p><div>
<div><div><p class="MsoNormal">On Mon, Apr 7, 2014 at 2:02 AM, Steve @ MyEvolve <<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>> wrote:<u></u><u></u></p></div></div><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div><div><div><p class="MsoNormal">Hi,<u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">I've added successfully images from the marketplace to the default image datastore and deployed without any issues. <u></u><u></u></p>
<div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">I've continued to add a Ceph datastore and retrieved an image from marketplace to it successfully as well.<u></u><u></u></p></div><div><p class="MsoNormal">
<u></u> <u></u></p></div><div><p class="MsoNormal">However, when I try to deploy this same image, I get the following failures:<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p>Sun Apr 6 16:01:41 2014 [DiM][I]: New VM state is ACTIVE.<u></u><u></u></p>
<p>Sun Apr 6 16:01:41 2014 [LCM][I]: New VM state is PROLOG.<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [LCM][I]: New VM state is BOOT<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/32/deployment.0<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Successfully execute network driver operation: pre.<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/32/deployment.0' 'cloud4' 32 cloud4<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: error: XML error: missing port for host<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 255<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [DiM][I]: New VM state is FAILED<u></u><u></u></p>
<p><u></u> <u></u></p><p>Any suggestions/help would be greatly appreciated!<u></u><u></u></p><p><u></u> <u></u></p><p>Thank you,<u></u><u></u></p><p>Steve<u></u><u></u></p><p><u></u> <u></u></p></div></div></div><p class="MsoNormal">
<u></u> <u></u></p></div></div><p class="MsoNormal" style="margin-bottom:12.0pt">_______________________________________________<br>Users mailing list<br><a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><u></u><u></u></p></blockquote></div><p class="MsoNormal"><span style="color:#888888"><br>
<br clear="all"><span><u></u><u></u></span></span></p><div><p class="MsoNormal"><u></u> <u></u></p></div><p class="MsoNormal"><span><span style="color:#888888">-- </span><u></u><u></u></span></p><div><div><div><p class="MsoNormal">
<span style="color:#888888">-- </span><u></u><u></u></p></div></div><p class="MsoNormal"><span style="color:#888888">Ruben S. Montero, PhD<br>Project co-Lead and Chief Architect<u></u><u></u></span></p><div><p class="MsoNormal">
<span style="color:#888888">OpenNebula - Flexible Enterprise Cloud Made Simple<br><a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a> | @OpenNebula<u></u><u></u></span></p>
</div></div></div></blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></blockquote></div><p class="MsoNormal"><br><br clear="all"><u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><p class="MsoNormal">
-- <u></u><u></u></p><div><div><div><p class="MsoNormal">-- <u></u><u></u></p></div></div><p class="MsoNormal">Ruben S. Montero, PhD<br>Project co-Lead and Chief Architect<u></u><u></u></p><div><p class="MsoNormal">OpenNebula - Flexible Enterprise Cloud Made Simple<br>
<a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a> | @OpenNebula<u></u><u></u></p></div></div></div></div></div>
</div>
<br><div><b>NOTICE: Protect the information in this message in accordance with the company's security policies. If you received this message in error, immediately notify the sender and destroy all copies.</b></div>
<br></div></blockquote></div><br></div>
</blockquote></div>