[one-users] ONE + Gluster : deployment incomplete

Vincent Van der Kussen vincent at vanderkussen.org
Sat Jun 28 13:33:39 PDT 2014


> Hi,
>
> I'm currently deploying an Opennebula cloud in combination with Gluster.
>
> I've configured a Gluster volume on 2 nodes (Gluster 3.5.1). I can mount
> this on Management host and on the kvm hypervisors (Centos 6.5).
>
> I also create a system datastore and image datastore as mentioned in the
> documentation. See the config below.
>
> Everything seems to be working, but not the creation of the vm with the
> deployment file.
> After some testing I found that the host + port + Gluster volume name are
> missing in the deployment file. If I add them manually, the creation of
> the vm using virsh works.
>
>
> I just can't find what is causing this problem. Any pointers?
>
>
> console output of the datastore config
>
> ---------------------------------------------------------------------------
>
> [oneadmin at node-00013 ~]$ onedatastore list
>   ID NAME                SIZE AVAIL CLUSTER      IMAGES TYPE DS       TM
>    0 system              9.6G 82%   -                 0 sys  -
> shared
>    1 default            25.5G 88%   -                 0 img  fs
> shared
>    2 files              25.5G 88%   -                 0 fil  fs       ssh
>  102 gluster image      17.2T 100%  gluster           2 img  fs
> shared
>  103 gluster syste      17.2T 100%  gluster           0 sys  -
> shared
>  104 gluster syste      17.2T 100%  gluster           0 sys  -
> shared
> [oneadmin at node-00013 ~]$
>
> ----------------------------------------------------------------------------
>
> [oneadmin at node-00013 ~]$ onedatastore show 102
> DATASTORE 102 INFORMATION
> ID             : 102
> NAME           : gluster images
> USER           : oneadmin
> GROUP          : oneadmin
> CLUSTER        : gluster
> TYPE           : IMAGE
> DS_MAD         : fs
> TM_MAD         : shared
> BASE PATH      : /var/lib/one//datastores/102
> DISK_TYPE      :
>
> DATASTORE CAPACITY
> TOTAL:         : 17.2T
> FREE:          : 17.1T
> USED:          : 20G
> LIMIT:         : -
>
> PERMISSIONS
> OWNER          : um-
> GROUP          : u--
> OTHER          : ---
>
> DATASTORE TEMPLATE
> BASE_PATH="/var/lib/one//datastores/"
> CLONE_TARGET="SYSTEM"
> DISK_TYPE="GLUSTER"
> DS_MAD="fs"
> GLUSTER_HOST="node-00006.connective.be:24007"
> GLUSTER_VOLUME="gv0"
> LN_TARGET="NONE"
> TM_MAD="shared"
> TYPE="IMAGE_DS"
>
> IMAGES
> 13
>
> ---------------------------------------------------------------------------
>
> [oneadmin at node-00013 ~]$ onedatastore show 104
> DATASTORE 104 INFORMATION
> ID             : 104
> NAME           : gluster systemDS
> USER           : oneadmin
> GROUP          : oneadmin
> CLUSTER        : gluster
> TYPE           : SYSTEM
> DS_MAD         : -
> TM_MAD         : shared
> BASE PATH      : /var/lib/one//datastores/104
> DISK_TYPE      : FILE
>
> DATASTORE CAPACITY
> TOTAL:         : 17.2T
> FREE:          : 17.1T
> USED:          : 20G
> LIMIT:         : -
>
> PERMISSIONS
> OWNER          : um-
> GROUP          : u--
> OTHER          : ---
>
> DATASTORE TEMPLATE
> BASE_PATH="/var/lib/one//datastores/"
> SHARED="YES"
> TM_MAD="shared"
> TYPE="SYSTEM_DS"
>
>  ---------------------------------------------------------------------------
>
> Example deployment file :
>
> <domain type='kvm'
> xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
>         <name>one-44</name>
>         <cputune>
>                 <shares>1024</shares>
>         </cputune>
>         <memory>524288</memory>
>         <os>
>                 <type arch='x86_64'>hvm</type>
>                 <boot dev='hd'/>
>         </os>
>         <devices>
>                 <emulator>/usr/libexec/qemu-kvm</emulator>
>                 <disk type='network' device='disk'>
>                         <source protocol='gluster' name='/44/disk.0'/>
>                         <target dev='hda'/>
>                         <driver name='qemu' type='raw' cache='none'/>
>                 </disk>
>                 <disk type='file' device='cdrom'>
>                         <source
> file='/var/lib/one//datastores/104/44/disk.1'/>
>                         <target dev='hdb'/>
>                         <readonly/>
>                         <driver name='qemu' type='raw'/>
>                 </disk>
>                 <interface type='bridge'>
>                         <source bridge='lan'/>
>                         <virtualport type='openvswitch'/>
>                         <mac address='02:00:ac:14:10:14'/>
>                 </interface>
>                 <graphics type='vnc' listen='0.0.0.0' port='5944'/>
>         </devices>
>         <features>
>                 <acpi/>
>         </features>
> </domain>
>

I have found the culprit. Following lines are missing in oned.log

INHERIT_DATASTORE_ATTR  = "GLUSTER_HOST"
INHERIT_DATASTORE_ATTR  = "GLUSTER_VOLUME"


After adding them the vm can be created

I'll open a bug.


-- 
Vincent Van der Kussen
@vincentvdk


More information about the Users mailing list