[one-users] glusterfs datastore

Javier Fontan jfontan at opennebula.org
Wed May 7 05:41:15 PDT 2014 

GlusterFS integration needs the datastores tm type shared and be
mounted in all hosts. The symlinks should also be done in the nodes.
In case of GlusterFS both datastores (system and images) point to the
same gluster volume.

On Wed, May 7, 2014 at 1:34 PM, Thomas Stein <himbeere at meine-oma.de> wrote:
> Am 07.05.14 13:20, schrieb Javier Fontan:
>> The error tells the drivers can not find the file
>> /var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5 in the
>> remote node (one2). When using shared TM drivers the datastore should
>> be swared between all nodes (including frontend) in the very same
>> location. That is, /var/lib/one//datastores/146 must be present in all
>> nodes with the shared storage mounted there.
>
> Thanks for your patience Javier. I sure i get this running soon.
>
> Problem now is when the system datastore is "shared" i have the same
> problem. With "ssh" the image is copied to the node. Shall i set the
> system datastore set back to "shared" and create symlinks one the nodes?
>
> Question is. Do all datastore need to be one the mounted gluster volume?
>
> best regards
> Thomas
>
>
>> On Wed, May 7, 2014 at 1:00 PM, Thomas Stein <himbeere at meine-oma.de> wrote:
>>> Am 07.05.14 12:35, schrieb Javier Fontan:
>>>> There is no datastore driver called "shared", that is for TM drivers.
>>>> For glusterfs the correct datastore driver is fs. CHange it and that
>>>> should solve the problem you're having.
>>>
>>> Thanks for the answer. I think the docu has to be adjusted.
>>>
>>> https://github.com/OpenNebula/docs/blob/master/source/administration/storage/gluster_ds.rst
>>>
>>> The first error is gone but now i get:
>>>
>>> Wed May 7 12:58:13 2014 [DiM][I]: New VM state is ACTIVE.
>>> Wed May 7 12:58:13 2014 [LCM][I]: New VM state is PROLOG.
>>> Wed May 7 12:58:14 2014 [TM][I]: Command execution fail:
>>> /var/lib/one/remotes/tm/shared/clone
>>> opennebula-frontend:/var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> one2:/var/lib/one/datastores/143/55/disk.0 55 146
>>> Wed May 7 12:58:14 2014 [TM][I]: clone: Cloning
>>> /var/lib/one/datastores/146/efe78e0d61224a0b459e6cc423b789a5 in
>>> one2:/var/lib/one/datastores/143/55/disk.0
>>> Wed May 7 12:58:14 2014 [TM][E]: clone: Command "cd
>>> /var/lib/one/datastores/143/55; cp
>>> /var/lib/one/datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> /var/lib/one/datastores/143/55/disk.0" failed: cp: cannot stat
>>> `/var/lib/one/datastores/146/efe78e0d61224a0b459e6cc423b789a5': No such
>>> file or directory
>>> Wed May 7 12:58:14 2014 [TM][E]: Error copying
>>> opennebula-frontend:/var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> to one2-hetzner.syseleven.de:/var/lib/one/datastores/143/55/disk.0
>>> Wed May 7 12:58:14 2014 [TM][I]: ExitCode: 1
>>> Wed May 7 12:58:14 2014 [TM][E]: Error executing image transfer script:
>>> Error copying
>>> opennebula-frontend:/var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> to one2:/var/lib/one/datastores/143/55/disk.0
>>> Wed May 7 12:58:14 2014 [DiM][I]: New VM state is FAILED
>>>
>>> I don't get it.
>>>
>>> best regards
>>> t.
>>>
>>>> On Wed, May 7, 2014 at 11:58 AM, Thomas Stein <himbeere at meine-oma.de> wrote:
>>>>> Hello.
>>>>>
>>>>> I deleted all datastores and recreated the neccessary datastores again.
>>>>> Now i get:
>>>>>
>>>>> oneadmin at opennebula-frontend:~/datastores$ onedatastore list
>>>>>   ID NAME                SIZE AVAIL CLUSTER      IMAGES TYPE DS       TM
>>>>>
>>>>>  139 glusterds             0M -     -                 0 img  shared   shared
>>>>>  140 datastore_sys         0M -     fluffy            0 sys  -        shared
>>>>>  141 datastore_fil      47.2G 34%   fluffy            0 fil  fs       shared
>>>>> oneadmin at opennebula-frontend:~/datastores$ cd
>>>>>
>>>>> oneadmin at opennebula-frontend:~$ oneimage create -d 139 --name gentoo
>>>>> --path /opt/gentoo-template.qcow2 --type OS --driver qcow2 --description
>>>>> "gentoo"
>>>>>
>>>>> [ImageAllocate] Cannot determine Image SIZE. Datastore driver 'shared'
>>>>> not available
>>>>> oneadmin at opennebula-frontend:~$
>>>>>
>>>>> Someone has an idea how to solve this error?
>>>>>
>>>>> best regards
>>>>> t.
>>>>>
>>>>>
>>>>> Am 06.05.14 17:19, schrieb Thomas Stein:
>>>>>> Hello.
>>>>>>
>>>>>> I'm playing around with glustersfs and opennebula. Followed the quick
>>>>>> howto here:
>>>>>>
>>>>>> http://opennebula.org/native-glusterfs-image-access-for-kvm-drivers/
>>>>>>
>>>>>> Alltough it's not everything clear to me, i managed to create the
>>>>>> gluster datastore on the frontend.
>>>>>>
>>>>>> oneadmin at opennebula-frontend:~$ onedatastore show 135
>>>>>> DATASTORE 135 INFORMATION
>>>>>>
>>>>>> ID             : 135
>>>>>> NAME           : gluster_image
>>>>>> USER           : oneadmin
>>>>>> GROUP          : oneadmin
>>>>>> CLUSTER        : fluffy
>>>>>> TYPE           : IMAGE
>>>>>> DS_MAD         : fs
>>>>>> TM_MAD         : shared
>>>>>> BASE PATH      : /var/lib/one//datastores/135
>>>>>> DISK_TYPE      :
>>>>>>
>>>>>> DATASTORE CAPACITY
>>>>>>
>>>>>> TOTAL:         : 492.2G
>>>>>> FREE:          : 459.4G
>>>>>> USED:          : 7.6G
>>>>>> LIMIT:         : -
>>>>>>
>>>>>> PERMISSIONS
>>>>>>
>>>>>> OWNER          : um-
>>>>>> GROUP          : u--
>>>>>> OTHER          : ---
>>>>>>
>>>>>> DATASTORE TEMPLATE
>>>>>>
>>>>>> BASE_PATH="/var/lib/one//datastores/"
>>>>>> CLONE_TARGET="SYSTEM"
>>>>>> DISK_TYPE="GLUSTER"
>>>>>> DS_MAD="fs"
>>>>>> GLUSTER_HOST="one-volume1"
>>>>>> LN_TARGET="NONE"
>>>>>> TM_MAD="shared"
>>>>>> TYPE="IMAGE_DS"
>>>>>>
>>>>>> Problem is. When i try to create an image from a template which resides
>>>>>> in that datastore i get:
>>>>>>
>>>>>> Tue May  6 17:18:00 2014 [TM][D]: Message received: TRANSFER FAILURE 48
>>>>>> Error copying
>>>>>> opennebula-frontend:/var/lib/one//datastores/135/9ba000010fc657ac57edc0af308e4fa7
>>>>>> to remotehost:/var/lib/one/datastores/129/48/disk.0
>>>>>>
>>>>>> Why does opennebula to transfer the image?
>>>>>>
>>>>>> Thanks and best regards
>>>>>> t.
>>>>>> _______________________________________________
>>>>>> Users mailing list
>>>>>> Users at lists.opennebula.org
>>>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Users mailing list
>>>>> Users at lists.opennebula.org
>>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>
>>>>
>>>>
>>>
>>
>>
>>
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org



-- 
Javier Fontán Muiños
Developer
OpenNebula - The Open Source Toolkit for Data Center Virtualization
www.OpenNebula.org | @OpenNebula | github.com/jfontan

More information about the Users mailing list