<div dir="ltr">Hi Bill & Ruben,<div><br></div><div>1.) I have confirmed that <span style="color:rgb(31,73,125);font-family:Calibri,sans-serif;font-size:14.545454025268555px">CEPH_HOST, CEPH_USER, and CEPH_SECRET are properly set in my datastore.</span></div>
<div><span style="color:rgb(31,73,125);font-family:Calibri,sans-serif;font-size:14.545454025268555px"><br></span></div><div><span style="color:rgb(31,73,125);font-family:Calibri,sans-serif;font-size:14.545454025268555px">2.) Bill you bring up a good point about why:</span></div>
<div><span style="color:rgb(31,73,125);font-family:Calibri,sans-serif;font-size:14.545454025268555px"><br></span></div><div>
<p class=""><auth username='libvirt'></p>
<p class=""> <secret type='ceph' uuid='34afabcd-8ee0-45fd-a880-09df24fef603'/></p>
<p class=""></auth></p><p class="">is not added to my deployment.0 file. I added it to the end just before </domain>.</p><p class=""><br></p><p class="">3.) I have tried to run the following command to manually test, but it doesn't work for me. What am I doing wrong?</p>
<p class="">[root@cloud2 54]# virsh create -c qemu:///system deployment.0</p><p class="">error: unexpected data 'qemu:///system'</p><p class="">
</p><p class="">[root@cloud2 54]#</p><p class=""><br></p><p class="">Thank you so much, I know we have to be close!</p><p class="">Steve</p></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Apr 9, 2014 at 11:56 AM, Campbell, Bill <span dir="ltr"><<a href="mailto:bcampbell@axcess-financial.com" target="_blank">bcampbell@axcess-financial.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">A couple of things:<u></u><u></u></span></p><p><u></u><span style="font-size:11pt;font-family:Symbol;color:rgb(31,73,125)"><span>·<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'"> </span></span></span><u></u><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">You shouldn’t need the port, that should be generated appropriately<u></u><u></u></span></p>
<p><u></u><span style="font-size:11pt;font-family:Symbol;color:rgb(31,73,125)"><span>·<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'"> </span></span></span><u></u><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">I’m not seeing your secret definition within the deployment.0 file. That must exist if using the newer versions of Libvirt w/CephX authentication (Libvirt assumes if you are specifying hosts that a secret should be there). You should have an entry in that file like so (right after the </source>):<u></u><u></u></span></p>
<p><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal" style="margin-left:0.5in;text-indent:0.5in"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><auth username='libvirt'><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> <secret type='ceph' uuid='ebc9c744-016d-40af-ae73-621f558398f0'/><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </auth><u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p><u></u><span style="font-size:11pt;font-family:Symbol;color:rgb(31,73,125)"><span>·<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'"> </span></span></span><u></u><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">You’ve defined the secret/user on the Datastore within OpenNebula using the appropriate configuration attributes CEPH_HOST, CEPH_USER, and CEPH_SECRET?<u></u><u></u></span></p>
<p style="margin-left:1in"><u></u><span style="font-size:11pt;font-family:'Courier New';color:rgb(31,73,125)"><span>o<span style="font-style:normal;font-variant:normal;font-weight:normal;font-size:7pt;line-height:normal;font-family:'Times New Roman'"> </span></span></span><u></u><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">And also defined the appropriate secret in Libvirt within each hypervisor in your configuration?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Outside of verifying the above, I’m not sure what else can be attempted. You could try disabling CephX authentication, removing the CEPH_HOST configuration attributes, and copying the /etc/ceph/ceph.conf and admin keyring to each hypervisor and see if you can connect that way (however newer versions of libvirt will probably prevent that from happening).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:Calibri,sans-serif">From:</span></b><span style="font-size:11pt;font-family:Calibri,sans-serif"> Steve @ MyEvolve [mailto:<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>] <br>
<b>Sent:</b> Wednesday, April 09, 2014 2:44 PM<br><b>To:</b> Ruben S. Montero<br><b>Cc:</b> <a href="mailto:users@lists.opennebula.org" target="_blank">users@lists.opennebula.org</a>; Bill Campbell</span></p><div><div class="h5">
<br><b>Subject:</b> Re: [one-users] Images from Images (Ceph) Datastore Not Deploying<u></u><u></u></div></div><p></p><div><div class="h5"><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">Any suggestions on this?<u></u><u></u></p>
</div><div><p class="MsoNormal" style="margin-bottom:12pt"><u></u> <u></u></p><div><p class="MsoNormal">On Tue, Apr 8, 2014 at 7:37 PM, Steve @ MyEvolve <<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in"><div><p class="MsoNormal">Hi Ruben,<u></u><u></u></p>
<div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">So I've been trying to experiment a bit. I started over. Re-imported ttylinux into ceph datastore. Created new template and new vm and I logged in as oneadmin and defined the secret as instructed on all hosts.<u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">In creating the new VM, the process failed as before. <u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">
I tried as you suggested:<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p>[oneadmin@cloud2 54]$ virsh create -c qemu:///system deployment.0<u></u><u></u></p><p>error: unexpected data 'qemu:///system'<u></u><u></u></p>
<p>But as you can see I got an error message I'm not sure what to do with.<u></u><u></u></p><p><u></u> <u></u></p><p>Also, I have a new log that looks different -- seems adding the port to the CEPH_HOST was the distinguishing factor. <u></u><u></u></p>
<p><u></u> <u></u></p><p><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(242,242,242);background-color:rgb(111,111,111)">Tue Apr 8 19:30:04 2014 [DiM][I]: New VM state is ACTIVE.</span><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(242,242,242)"><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:04 2014 [LCM][I]: New VM state is PROLOG.</span><br><span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:09 2014 [LCM][I]: New VM state is BOOT</span><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/54/deployment.0</span><br><span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: ExitCode: 0</span><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: Successfully execute network driver operation: pre.</span><br><span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/54/deployment.0' 'cloud2' 54 cloud2</span><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/125/54/deployment.0</span><br><span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789,if=none,id=drive-ide0-0-0,format=raw,cache=none: error connecting</span><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: qemu-kvm: -drive file=rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789: Operation not supported</span><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: </span><br></span><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(255,141,129)">Tue Apr 8 19:30:10 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/125/54/deployment.0</span><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(242,242,242)"><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: ExitCode: 255</span><br><span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.</span><br>
</span><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(255,141,129)">Tue Apr 8 19:30:10 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/125/54/deployment.0</span><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(242,242,242)"><br>
<span style="background-color:rgb(111,111,111)">Tue Apr 8 19:30:10 2014 [DiM][I]: New VM state is FAILED</span></span><u></u><u></u></p><p><u></u> <u></u></p><p>And also here is deployment.0:<u></u><u></u></p><div><p><domain type='kvm' xmlns:qemu='<a href="http://libvirt.org/schemas/domain/qemu/1.0" target="_blank">http://libvirt.org/schemas/domain/qemu/1.0</a>'><u></u><u></u></p>
</div><p> <name>one-54</name><u></u><u></u></p><div><p> <cputune><u></u><u></u></p><p> <shares>1024</shares><u></u><u></u></p><p> </cputune><u></u><u></u></p>
<p> <memory>524288</memory><u></u><u></u></p><p> <os><u></u><u></u></p><p> <type arch='x86_64'>hvm</type><u></u><u></u></p><p> <boot dev='hd'/><u></u><u></u></p>
<p> </os><u></u><u></u></p><p> <devices><u></u><u></u></p><p> <emulator>/usr/libexec/qemu-kvm</emulator><u></u><u></u></p><p> <disk type='network' device='disk'><u></u><u></u></p>
</div><p> <source protocol='rbd' name='one/one-28-54-0'><u></u><u></u></p><div><p> <host name='cloudweb12' port='6789'/><u></u><u></u></p>
</div><p> </source><u></u><u></u></p><div><p> <target dev='hda'/><u></u><u></u></p><p> <driver name='qemu' type='raw' cache='none'/><u></u><u></u></p>
<p> </disk><u></u><u></u></p><p> <disk type='file' device='cdrom'><u></u><u></u></p></div><p> <source file='/var/lib/one//datastores/125/54/disk.1'/><u></u><u></u></p>
<div><p> <target dev='hdb'/><u></u><u></u></p><p> <readonly/><u></u><u></u></p><p> <driver name='qemu' type='raw'/><u></u><u></u></p>
<p> </disk><u></u><u></u></p><p> <interface type='bridge'><u></u><u></u></p><p> <source bridge='br0'/><u></u><u></u></p></div><p> <mac address='02:00:26:6b:bb:98'/><u></u><u></u></p>
<p> </interface><u></u><u></u></p><p> <graphics type='vnc' listen='0.0.0.0' port='5954'/><u></u><u></u></p><div><p> </devices><u></u><u></u></p>
<p> <features><u></u><u></u></p><p> <acpi/><u></u><u></u></p><p> </features><u></u><u></u></p><p></domain><u></u><u></u></p><p><u></u> <u></u></p></div><p>Thank you!<u></u><u></u></p>
<p><span style="color:rgb(136,136,136)">Steve<u></u><u></u></span></p><p><span style="color:rgb(136,136,136)"><u></u> <u></u></span></p></div></div><div><div><div><p class="MsoNormal" style="margin-bottom:12pt"><u></u> <u></u></p>
<div><p class="MsoNormal">On Tue, Apr 8, 2014 at 10:13 AM, Ruben S. Montero <<a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a>> wrote:<u></u><u></u></p><blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<p>Hi <u></u><u></u></p><p>I've tested with the very same environment and it should work. Could you try to define the secret with the oneadmin account and:<u></u><u></u></p><p>-c qemu:///system <u></u><u></u></p><p>option for virsh command.<u></u><u></u></p>
<p>Also to manually test it, once the vm is in failed state go to the vm directory in the host and simply execute:<u></u><u></u></p><p>virsh create -c qemu:///system deployment.0<u></u><u></u></p><p>Cheers<u></u><u></u></p>
<p><span style="color:rgb(136,136,136)">Ruben<u></u><u></u></span></p><div><div><div><p class="MsoNormal">On Apr 8, 2014 7:05 PM, "Steve @ MyEvolve" <<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in"><div><p class="MsoNormal">Hi Bill,<u></u><u></u></p>
<div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">I am using Centos 6.5 and CephX. I installed the following rpm versions from Ceph on the nodes and I also followed the procedure for authentication :<u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p>rpm -Uvh <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a> <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-img-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-img-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a> <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-guest-agent-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-guest-agent-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a> <a href="http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph.x86_64.rpm" target="_blank">http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph.x86_64.rpm</a><u></u><u></u></p>
<p><u></u> <u></u></p><p>CephX<u></u><u></u></p><p>virsh secret-define --file secret.xml; virsh secret-set-value --secret 34afabcd-8ee0-45fd-a880-09df24fef603 --base64 $(cat client.libvirt.key)<u></u><u></u></p><p><u></u> <u></u></p>
<p>Also, Ruben -- how do I:<u></u><u></u></p><p>"<span style="font-size:9.5pt;font-family:Arial,sans-serif">1.- could you try manually to add port to the <source attribute, and check if the VM boots with virsh create"</span><u></u><u></u></p>
<p><u></u> <u></u></p><p>Thank you,<u></u><u></u></p><p>Steve<u></u><u></u></p><p><u></u> <u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12pt"><u></u> <u></u></p>
<div><p class="MsoNormal">On Tue, Apr 8, 2014 at 6:20 AM, Campbell, Bill <<a href="mailto:bcampbell@axcess-financial.com" target="_blank">bcampbell@axcess-financial.com</a>> wrote:<u></u><u></u></p><blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div><div><p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Are you using CentOS/RHEL? Are you using CephX Authentication?</span><u></u><u></u></p><p class="MsoNormal">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p><p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">There have been a few changes in how Libvirt handles the configurations of Ceph images, and I’m not sure if that version of Qemu is compiled with RBD support.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p><p class="MsoNormal"><b><span style="font-size:11pt;font-family:Calibri,sans-serif">From:</span></b><span style="font-size:11pt;font-family:Calibri,sans-serif"> <a href="mailto:users-bounces@lists.opennebula.org" target="_blank">users-bounces@lists.opennebula.org</a> [mailto:<a href="mailto:users-bounces@lists.opennebula.org" target="_blank">users-bounces@lists.opennebula.org</a>] <b>On Behalf Of </b>Ruben S. Montero<br>
<b>Sent:</b> Tuesday, April 08, 2014 6:00 AM<br><b>To:</b> Steve @ MyEvolve<br><b>Cc:</b> <a href="mailto:users@lists.opennebula.org" target="_blank">users@lists.opennebula.org</a><br><b>Subject:</b> Re: [one-users] Images from Images (Ceph) Datastore Not Deploying</span><u></u><u></u></p>
<div><div><p class="MsoNormal"> <u></u><u></u></p><div><p class="MsoNormal">Well<u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">The deployment file seems to be properly generated, so given the error message complaining about the missing port:<u></u><u></u></p>
</div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">1.- could you try manually to add port to the <source attribute, and check if the VM boots with virsh create<u></u><u></u></p></div><div>
<p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">2.- I've not seen this required by ceph, here it is working with the libvirt packages from the ceph guys (libvirt 0.10.2 and qemu-kvm-0.12.1), Could it be a version problem?<u></u><u></u></p>
</div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">Cheers<u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div></div>
<div><p class="MsoNormal" style="margin-bottom:12pt"> <u></u><u></u></p><div><p class="MsoNormal">On Tue, Apr 8, 2014 at 11:09 AM, Steve @ MyEvolve <<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt"><div><p class="MsoNormal">Hi Ruben,<u></u><u></u></p><div><p class="MsoNormal">
<u></u><u></u></p></div><div><p class="MsoNormal">Contents of /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p><domain type='kvm' xmlns:qemu='<a href="http://libvirt.org/schemas/domain/qemu/1.0" target="_blank">http://libvirt.org/schemas/domain/qemu/1.0</a>'><u></u><u></u></p>
<p> <name>one-32</name><u></u><u></u></p><p> <cputune><u></u><u></u></p><p> <shares>1024</shares><u></u><u></u></p><p> </cputune><u></u><u></u></p><p>
<memory>524288</memory><u></u><u></u></p><p> <os><u></u><u></u></p><p> <type arch='x86_64'>hvm</type><u></u><u></u></p><p> <boot dev='hd'/><u></u><u></u></p>
<p> </os><u></u><u></u></p><p> <devices><u></u><u></u></p><p> <emulator>/usr/libexec/qemu-kvm</emulator><u></u><u></u></p><p> <disk type='network' device='disk'><u></u><u></u></p>
<p> <source protocol='rbd' name='one/one-18-32-0'><u></u><u></u></p><p> <host name='cloudweb12' port='6789'/><u></u><u></u></p>
<p> <host name='cloudweb13' port='6789'/><u></u><u></u></p><p> <host name='cloudweb14' port='6789'/><u></u><u></u></p>
<p> </source><u></u><u></u></p><p> <target dev='hda'/><u></u><u></u></p><p> <driver name='qemu' type='raw' cache='none'/><u></u><u></u></p>
<p> </disk><u></u><u></u></p><p> <disk type='file' device='cdrom'><u></u><u></u></p><p> <source file='/var/lib/one//datastores/125/32/disk.1'/><u></u><u></u></p>
<p> <target dev='hdb'/><u></u><u></u></p><p> <readonly/><u></u><u></u></p><p> <driver name='qemu' type='raw'/><u></u><u></u></p>
<p> </disk><u></u><u></u></p><p> <interface type='bridge'><u></u><u></u></p><p> <source bridge='br0'/><u></u><u></u></p><p> <mac address='02:00:26:6b:bb:96'/><u></u><u></u></p>
<p> </interface><u></u><u></u></p><p> <graphics type='vnc' listen='0.0.0.0' port='5947'/><u></u><u></u></p><p> </devices><u></u><u></u></p><p>
<features><u></u><u></u></p><p> <acpi/><u></u><u></u></p><p> </features><u></u><u></u></p><p></domain><u></u><u></u></p><p> <u></u><u></u></p></div><div><p class="MsoNormal">
<u></u><u></u></p></div><div><p class="MsoNormal">Ceph Datastore:<u></u><u></u></p></div><div><p class="MsoNormal">CEPH_HOST = <span style="font-size:10.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51);background-color:rgb(249,249,249)">cloudweb12:6789 cloudweb13:6789 cloudweb14:6789</span><u></u><u></u></p>
</div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal"><span style="font-family:Arial,sans-serif;color:rgb(51,51,51);background-color:rgb(249,249,249)">Thanks,</span><u></u><u></u></p>
</div><div><p class="MsoNormal"><span style="font-family:Arial,sans-serif;color:rgb(51,51,51);background-color:rgb(249,249,249)">Steve</span><u></u><u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12pt">
<u></u><u></u></p><div><p class="MsoNormal">On Tue, Apr 8, 2014 at 1:18 AM, Ruben S. Montero <<a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a>> wrote:<u></u><u></u></p><blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div><p class="MsoNormal">Hi<u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">Could you send /var/lib/one//datastores/125/32/deployment.0? Also could you double check you ceph datastore configuration, specially the CEPH_HOST attribute to read something like<u></u><u></u></p>
</div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">CEPH_HOST="cephmon1:6789 cephmon2:6789"<u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">
Cheers<u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">Ruben<u></u><u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12pt"> <u></u><u></u></p><div><div>
<div><p class="MsoNormal">On Mon, Apr 7, 2014 at 2:02 AM, Steve @ MyEvolve <<a href="mailto:steve@myevolve.com" target="_blank">steve@myevolve.com</a>> wrote:<u></u><u></u></p></div></div><blockquote style="border-style:none none none solid;border-left-color:rgb(204,204,204);border-left-width:1pt;padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div><div><div><p class="MsoNormal">Hi,<u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">I've added successfully images from the marketplace to the default image datastore and deployed without any issues. <u></u><u></u></p>
<div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">I've continued to add a Ceph datastore and retrieved an image from marketplace to it successfully as well.<u></u><u></u></p></div><div><p class="MsoNormal">
<u></u><u></u></p></div><div><p class="MsoNormal">However, when I try to deploy this same image, I get the following failures:<u></u><u></u></p></div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p>Sun Apr 6 16:01:41 2014 [DiM][I]: New VM state is ACTIVE.<u></u><u></u></p>
<p>Sun Apr 6 16:01:41 2014 [LCM][I]: New VM state is PROLOG.<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [LCM][I]: New VM state is BOOT<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/32/deployment.0<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Successfully execute network driver operation: pre.<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/32/deployment.0' 'cloud4' 32 cloud4<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: error: XML error: missing port for host<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 255<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.<u></u><u></u></p>
<p>Sun Apr 6 16:01:43 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/125/32/deployment.0<u></u><u></u></p><p>Sun Apr 6 16:01:43 2014 [DiM][I]: New VM state is FAILED<u></u><u></u></p>
<p> <u></u><u></u></p><p>Any suggestions/help would be greatly appreciated!<u></u><u></u></p><p> <u></u><u></u></p><p>Thank you,<u></u><u></u></p><p>Steve<u></u><u></u></p><p> <u></u><u></u></p></div></div></div><p class="MsoNormal">
<u></u><u></u></p></div></div><p class="MsoNormal" style="margin-bottom:12pt">_______________________________________________<br>Users mailing list<br><a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><u></u><u></u></p></blockquote></div><p class="MsoNormal"><span style="color:rgb(136,136,136)"><br>
<br clear="all"></span><u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><p class="MsoNormal"><span style="color:rgb(136,136,136)">-- </span><u></u><u></u></p><div><div><div><p class="MsoNormal"><span style="color:rgb(136,136,136)">-- </span><u></u><u></u></p>
</div></div><p class="MsoNormal"><span style="color:rgb(136,136,136)">Ruben S. Montero, PhD<br>Project co-Lead and Chief Architect</span><u></u><u></u></p><div><p class="MsoNormal"><span style="color:rgb(136,136,136)">OpenNebula - Flexible Enterprise Cloud Made Simple<br>
<a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a> | @OpenNebula</span><u></u><u></u></p></div></div></div></blockquote>
</div><p class="MsoNormal"> <u></u><u></u></p></div></blockquote></div><p class="MsoNormal"><br><br clear="all"><u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><p class="MsoNormal">-- <u></u><u></u></p>
<div><div><div><p class="MsoNormal">-- <u></u><u></u></p></div></div><p class="MsoNormal">Ruben S. Montero, PhD<br>Project co-Lead and Chief Architect<u></u><u></u></p><div><p class="MsoNormal">OpenNebula - Flexible Enterprise Cloud Made Simple<br>
<a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:rsmontero@opennebula.org" target="_blank">rsmontero@opennebula.org</a> | @OpenNebula<u></u><u></u></p></div></div></div></div></div>
</div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal"><b>NOTICE: Protect the information in this message in accordance with the company's security policies. If you received this message in error, immediately notify the sender and destroy all copies.</b><u></u><u></u></p>
</div><p class="MsoNormal"><u></u> <u></u></p></div></blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></blockquote></div></div></div></blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></div></div>
</blockquote></div><p class="MsoNormal"><u></u> <u></u></p></div></div></div></div><div><div class="h5">
<br><div><b>NOTICE: Protect the information in this message in accordance with the company's security policies. If you received this message in error, immediately notify the sender and destroy all copies.</b></div>
<br></div></div></div></blockquote></div><br></div></div>