[one-users] Images from Images (Ceph) Datastore Not Deploying
Steve @ MyEvolve
steve at myevolve.com
Wed Apr 9 11:43:39 PDT 2014
Any suggestions on this?
On Tue, Apr 8, 2014 at 7:37 PM, Steve @ MyEvolve <steve at myevolve.com> wrote:
> Hi Ruben,
>
> So I've been trying to experiment a bit. I started over. Re-imported
> ttylinux into ceph datastore. Created new template and new vm and I logged
> in as oneadmin and defined the secret as instructed on all hosts.
>
> In creating the new VM, the process failed as before.
>
> I tried as you suggested:
>
> [oneadmin at cloud2 54]$ virsh create -c qemu:///system deployment.0
>
> error: unexpected data 'qemu:///system'
>
> But as you can see I got an error message I'm not sure what to do with.
>
>
> Also, I have a new log that looks different -- seems adding the port to
> the CEPH_HOST was the distinguishing factor.
>
>
> Tue Apr 8 19:30:04 2014 [DiM][I]: New VM state is ACTIVE.
> Tue Apr 8 19:30:04 2014 [LCM][I]: New VM state is PROLOG.
> Tue Apr 8 19:30:09 2014 [LCM][I]: New VM state is BOOT
> Tue Apr 8 19:30:10 2014 [VMM][I]: Generating deployment file:
> /var/lib/one/vms/54/deployment.0
> Tue Apr 8 19:30:10 2014 [VMM][I]: ExitCode: 0
> Tue Apr 8 19:30:10 2014 [VMM][I]: Successfully execute network driver
> operation: pre.
> Tue Apr 8 19:30:10 2014 [VMM][I]: Command execution fail: cat << EOT |
> /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/54/deployment.0'
> 'cloud2' 54 cloud2
> Tue Apr 8 19:30:10 2014 [VMM][I]: error: Failed to create domain from
> /var/lib/one//datastores/125/54/deployment.0
> Tue Apr 8 19:30:10 2014 [VMM][I]: error: internal error process exited
> while connecting to monitor: qemu-kvm: -drive
> file=rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789,if=none,id=drive-ide0-0-0,format=raw,cache=none:
> error connecting
> Tue Apr 8 19:30:10 2014 [VMM][I]: qemu-kvm: -drive
> file=rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789,if=none,id=drive-ide0-0-0,format=raw,cache=none:
> could not open disk image
> rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789:
> Operation not supported
> Tue Apr 8 19:30:10 2014 [VMM][I]:
> Tue Apr 8 19:30:10 2014 [VMM][E]: Could not create domain from
> /var/lib/one//datastores/125/54/deployment.0
> Tue Apr 8 19:30:10 2014 [VMM][I]: ExitCode: 255
> Tue Apr 8 19:30:10 2014 [VMM][I]: Failed to execute virtualization driver
> operation: deploy.
> Tue Apr 8 19:30:10 2014 [VMM][E]: Error deploying virtual machine: Could
> not create domain from /var/lib/one//datastores/125/54/deployment.0
> Tue Apr 8 19:30:10 2014 [DiM][I]: New VM state is FAILED
>
>
> And also here is deployment.0:
>
> <domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0
> '>
>
> <name>one-54</name>
>
> <cputune>
>
> <shares>1024</shares>
>
> </cputune>
>
> <memory>524288</memory>
>
> <os>
>
> <type arch='x86_64'>hvm</type>
>
> <boot dev='hd'/>
>
> </os>
>
> <devices>
>
> <emulator>/usr/libexec/qemu-kvm</emulator>
>
> <disk type='network' device='disk'>
>
> <source protocol='rbd' name='one/one-28-54-0'>
>
> <host name='cloudweb12' port='6789'/>
>
> </source>
>
> <target dev='hda'/>
>
> <driver name='qemu' type='raw' cache='none'/>
>
> </disk>
>
> <disk type='file' device='cdrom'>
>
> <source
> file='/var/lib/one//datastores/125/54/disk.1'/>
>
> <target dev='hdb'/>
>
> <readonly/>
>
> <driver name='qemu' type='raw'/>
>
> </disk>
>
> <interface type='bridge'>
>
> <source bridge='br0'/>
>
> <mac address='02:00:26:6b:bb:98'/>
>
> </interface>
>
> <graphics type='vnc' listen='0.0.0.0' port='5954'/>
>
> </devices>
>
> <features>
>
> <acpi/>
>
> </features>
>
> </domain>
>
>
> Thank you!
>
> Steve
>
>
>
>
> On Tue, Apr 8, 2014 at 10:13 AM, Ruben S. Montero <
> rsmontero at opennebula.org> wrote:
>
>> Hi
>>
>> I've tested with the very same environment and it should work. Could you
>> try to define the secret with the oneadmin account and:
>>
>> -c qemu:///system
>>
>> option for virsh command.
>>
>> Also to manually test it, once the vm is in failed state go to the vm
>> directory in the host and simply execute:
>>
>> virsh create -c qemu:///system deployment.0
>>
>> Cheers
>>
>> Ruben
>> On Apr 8, 2014 7:05 PM, "Steve @ MyEvolve" <steve at myevolve.com> wrote:
>>
>>> Hi Bill,
>>>
>>> I am using Centos 6.5 and CephX. I installed the following rpm versions
>>> from Ceph on the nodes and I also followed the procedure for authentication
>>> :
>>>
>>> rpm -Uvh
>>> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-0.12.1.2-2.415.el6.3ceph.x86_64.rpm
>>> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-img-0.12.1.2-2.415.el6.3ceph.x86_64.rpm
>>> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-guest-agent-0.12.1.2-2.415.el6.3ceph.x86_64.rpm
>>> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph.x86_64.rpm
>>>
>>>
>>> CephX
>>>
>>> virsh secret-define --file secret.xml; virsh secret-set-value --secret
>>> 34afabcd-8ee0-45fd-a880-09df24fef603 --base64 $(cat client.libvirt.key)
>>>
>>>
>>> Also, Ruben -- how do I:
>>>
>>> "1.- could you try manually to add port to the <source attribute, and
>>> check if the VM boots with virsh create"
>>>
>>>
>>> Thank you,
>>>
>>> Steve
>>>
>>>
>>>
>>>
>>>
>>> On Tue, Apr 8, 2014 at 6:20 AM, Campbell, Bill <
>>> bcampbell at axcess-financial.com> wrote:
>>>
>>>> Are you using CentOS/RHEL? Are you using CephX Authentication?
>>>>
>>>>
>>>>
>>>> There have been a few changes in how Libvirt handles the configurations
>>>> of Ceph images, and I'm not sure if that version of Qemu is compiled with
>>>> RBD support.
>>>>
>>>>
>>>>
>>>> *From:* users-bounces at lists.opennebula.org [mailto:
>>>> users-bounces at lists.opennebula.org] *On Behalf Of *Ruben S. Montero
>>>> *Sent:* Tuesday, April 08, 2014 6:00 AM
>>>> *To:* Steve @ MyEvolve
>>>> *Cc:* users at lists.opennebula.org
>>>> *Subject:* Re: [one-users] Images from Images (Ceph) Datastore Not
>>>> Deploying
>>>>
>>>>
>>>>
>>>> Well
>>>>
>>>>
>>>>
>>>> The deployment file seems to be properly generated, so given the error
>>>> message complaining about the missing port:
>>>>
>>>>
>>>>
>>>> 1.- could you try manually to add port to the <source attribute, and
>>>> check if the VM boots with virsh create
>>>>
>>>>
>>>>
>>>> 2.- I've not seen this required by ceph, here it is working with the
>>>> libvirt packages from the ceph guys (libvirt 0.10.2 and qemu-kvm-0.12.1),
>>>> Could it be a version problem?
>>>>
>>>>
>>>>
>>>> Cheers
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Apr 8, 2014 at 11:09 AM, Steve @ MyEvolve <steve at myevolve.com>
>>>> wrote:
>>>>
>>>> Hi Ruben,
>>>>
>>>>
>>>>
>>>> Contents of /var/lib/one//datastores/125/32/deployment.0
>>>>
>>>>
>>>>
>>>> <domain type='kvm' xmlns:qemu='
>>>> http://libvirt.org/schemas/domain/qemu/1.0'>
>>>>
>>>> <name>one-32</name>
>>>>
>>>> <cputune>
>>>>
>>>> <shares>1024</shares>
>>>>
>>>> </cputune>
>>>>
>>>> <memory>524288</memory>
>>>>
>>>> <os>
>>>>
>>>> <type arch='x86_64'>hvm</type>
>>>>
>>>> <boot dev='hd'/>
>>>>
>>>> </os>
>>>>
>>>> <devices>
>>>>
>>>> <emulator>/usr/libexec/qemu-kvm</emulator>
>>>>
>>>> <disk type='network' device='disk'>
>>>>
>>>> <source protocol='rbd' name='one/one-18-32-0'>
>>>>
>>>> <host name='cloudweb12' port='6789'/>
>>>>
>>>> <host name='cloudweb13' port='6789'/>
>>>>
>>>> <host name='cloudweb14' port='6789'/>
>>>>
>>>> </source>
>>>>
>>>> <target dev='hda'/>
>>>>
>>>> <driver name='qemu' type='raw' cache='none'/>
>>>>
>>>> </disk>
>>>>
>>>> <disk type='file' device='cdrom'>
>>>>
>>>> <source
>>>> file='/var/lib/one//datastores/125/32/disk.1'/>
>>>>
>>>> <target dev='hdb'/>
>>>>
>>>> <readonly/>
>>>>
>>>> <driver name='qemu' type='raw'/>
>>>>
>>>> </disk>
>>>>
>>>> <interface type='bridge'>
>>>>
>>>> <source bridge='br0'/>
>>>>
>>>> <mac address='02:00:26:6b:bb:96'/>
>>>>
>>>> </interface>
>>>>
>>>> <graphics type='vnc' listen='0.0.0.0' port='5947'/>
>>>>
>>>> </devices>
>>>>
>>>> <features>
>>>>
>>>> <acpi/>
>>>>
>>>> </features>
>>>>
>>>> </domain>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Ceph Datastore:
>>>>
>>>> CEPH_HOST = cloudweb12:6789 cloudweb13:6789 cloudweb14:6789
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Steve
>>>>
>>>>
>>>>
>>>> On Tue, Apr 8, 2014 at 1:18 AM, Ruben S. Montero <
>>>> rsmontero at opennebula.org> wrote:
>>>>
>>>> Hi
>>>>
>>>>
>>>>
>>>> Could you send /var/lib/one//datastores/125/32/deployment.0? Also
>>>> could you double check you ceph datastore configuration, specially
>>>> the CEPH_HOST attribute to read something like
>>>>
>>>>
>>>>
>>>> CEPH_HOST="cephmon1:6789 cephmon2:6789"
>>>>
>>>>
>>>>
>>>> Cheers
>>>>
>>>>
>>>>
>>>> Ruben
>>>>
>>>>
>>>>
>>>> On Mon, Apr 7, 2014 at 2:02 AM, Steve @ MyEvolve <steve at myevolve.com>
>>>> wrote:
>>>>
>>>> Hi,
>>>>
>>>>
>>>>
>>>> I've added successfully images from the marketplace to the default
>>>> image datastore and deployed without any issues.
>>>>
>>>>
>>>>
>>>> I've continued to add a Ceph datastore and retrieved an image from
>>>> marketplace to it successfully as well.
>>>>
>>>>
>>>>
>>>> However, when I try to deploy this same image, I get the following
>>>> failures:
>>>>
>>>>
>>>>
>>>> Sun Apr 6 16:01:41 2014 [DiM][I]: New VM state is ACTIVE.
>>>>
>>>> Sun Apr 6 16:01:41 2014 [LCM][I]: New VM state is PROLOG.
>>>>
>>>> Sun Apr 6 16:01:43 2014 [LCM][I]: New VM state is BOOT
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: Generating deployment file:
>>>> /var/lib/one/vms/32/deployment.0
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 0
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: Successfully execute network driver
>>>> operation: pre.
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: Command execution fail: cat << EOT |
>>>> /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/32/deployment.0'
>>>> 'cloud4' 32 cloud4
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: error: Failed to create domain from
>>>> /var/lib/one//datastores/125/32/deployment.0
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: error: XML error: missing port for
>>>> host
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][E]: Could not create domain from
>>>> /var/lib/one//datastores/125/32/deployment.0
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 255
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][I]: Failed to execute virtualization
>>>> driver operation: deploy.
>>>>
>>>> Sun Apr 6 16:01:43 2014 [VMM][E]: Error deploying virtual machine:
>>>> Could not create domain from /var/lib/one//datastores/125/32/deployment.0
>>>>
>>>> Sun Apr 6 16:01:43 2014 [DiM][I]: New VM state is FAILED
>>>>
>>>>
>>>>
>>>> Any suggestions/help would be greatly appreciated!
>>>>
>>>>
>>>>
>>>> Thank you,
>>>>
>>>> Steve
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at lists.opennebula.org
>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> --
>>>>
>>>> Ruben S. Montero, PhD
>>>> Project co-Lead and Chief Architect
>>>>
>>>> OpenNebula - Flexible Enterprise Cloud Made Simple
>>>> www.OpenNebula.org | rsmontero at opennebula.org | @OpenNebula
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> --
>>>>
>>>> Ruben S. Montero, PhD
>>>> Project co-Lead and Chief Architect
>>>>
>>>> OpenNebula - Flexible Enterprise Cloud Made Simple
>>>> www.OpenNebula.org | rsmontero at opennebula.org | @OpenNebula
>>>>
>>>> *NOTICE: Protect the information in this message in accordance with the
>>>> company's security policies. If you received this message in error,
>>>> immediately notify the sender and destroy all copies.*
>>>>
>>>>
>>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140409/3ec92004/attachment-0002.htm>
More information about the Users
mailing list