[one-users] glusterfs datastore

Wed May 7 05:00:09 PDT 2014

Am 07.05.14 13:34, schrieb Thomas Stein:
> Am 07.05.14 13:20, schrieb Javier Fontan:
>> The error tells the drivers can not find the file
>> /var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5 in the
>> remote node (one2). When using shared TM drivers the datastore should
>> be swared between all nodes (including frontend) in the very same
>> location. That is, /var/lib/one//datastores/146 must be present in all
>> nodes with the shared storage mounted there.
> 
> Thanks for your patience Javier. I sure i get this running soon.
> 
> Problem now is when the system datastore is "shared" i have the same
> problem. With "ssh" the image is copied to the node. Shall i set the
> system datastore set back to "shared" and create symlinks one the nodes?
> 
> Question is. Do all datastore need to be one the mounted gluster volume?

Almost there. Now i get:

Wed May  7 13:54:19 2014 [VMM][D]: Message received: LOG I 61 error:
internal error: process exited while connecting to monitor: kvm: -drive
file=gluster://gluster01:24007/one-volume1/61/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none:
could not open disk image
gluster://gluster01:24007/one-volume1/61/disk.0: No such file or directory

The disk image is there. Any hints?

best regards
Thomas

> best regards
> Thomas
> 
> 
>> On Wed, May 7, 2014 at 1:00 PM, Thomas Stein <himbeere at meine-oma.de> wrote:
>>> Am 07.05.14 12:35, schrieb Javier Fontan:
>>>> There is no datastore driver called "shared", that is for TM drivers.
>>>> For glusterfs the correct datastore driver is fs. CHange it and that
>>>> should solve the problem you're having.
>>>
>>> Thanks for the answer. I think the docu has to be adjusted.
>>>
>>> https://github.com/OpenNebula/docs/blob/master/source/administration/storage/gluster_ds.rst
>>>
>>> The first error is gone but now i get:
>>>
>>> Wed May 7 12:58:13 2014 [DiM][I]: New VM state is ACTIVE.
>>> Wed May 7 12:58:13 2014 [LCM][I]: New VM state is PROLOG.
>>> Wed May 7 12:58:14 2014 [TM][I]: Command execution fail:
>>> /var/lib/one/remotes/tm/shared/clone
>>> opennebula-frontend:/var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> one2:/var/lib/one/datastores/143/55/disk.0 55 146
>>> Wed May 7 12:58:14 2014 [TM][I]: clone: Cloning
>>> /var/lib/one/datastores/146/efe78e0d61224a0b459e6cc423b789a5 in
>>> one2:/var/lib/one/datastores/143/55/disk.0
>>> Wed May 7 12:58:14 2014 [TM][E]: clone: Command "cd
>>> /var/lib/one/datastores/143/55; cp
>>> /var/lib/one/datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> /var/lib/one/datastores/143/55/disk.0" failed: cp: cannot stat
>>> `/var/lib/one/datastores/146/efe78e0d61224a0b459e6cc423b789a5': No such
>>> file or directory
>>> Wed May 7 12:58:14 2014 [TM][E]: Error copying
>>> opennebula-frontend:/var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> to one2-hetzner.syseleven.de:/var/lib/one/datastores/143/55/disk.0
>>> Wed May 7 12:58:14 2014 [TM][I]: ExitCode: 1
>>> Wed May 7 12:58:14 2014 [TM][E]: Error executing image transfer script:
>>> Error copying
>>> opennebula-frontend:/var/lib/one//datastores/146/efe78e0d61224a0b459e6cc423b789a5
>>> to one2:/var/lib/one/datastores/143/55/disk.0
>>> Wed May 7 12:58:14 2014 [DiM][I]: New VM state is FAILED
>>>
>>> I don't get it.
>>>
>>> best regards
>>> t.
>>>
>>>> On Wed, May 7, 2014 at 11:58 AM, Thomas Stein <himbeere at meine-oma.de> wrote:
>>>>> Hello.
>>>>>
>>>>> I deleted all datastores and recreated the neccessary datastores again.
>>>>> Now i get:
>>>>>
>>>>> oneadmin at opennebula-frontend:~/datastores$ onedatastore list
>>>>>   ID NAME                SIZE AVAIL CLUSTER      IMAGES TYPE DS       TM
>>>>>
>>>>>  139 glusterds             0M -     -                 0 img  shared   shared
>>>>>  140 datastore_sys         0M -     fluffy            0 sys  -        shared
>>>>>  141 datastore_fil      47.2G 34%   fluffy            0 fil  fs       shared
>>>>> oneadmin at opennebula-frontend:~/datastores$ cd
>>>>>
>>>>> oneadmin at opennebula-frontend:~$ oneimage create -d 139 --name gentoo
>>>>> --path /opt/gentoo-template.qcow2 --type OS --driver qcow2 --description
>>>>> "gentoo"
>>>>>
>>>>> [ImageAllocate] Cannot determine Image SIZE. Datastore driver 'shared'
>>>>> not available
>>>>> oneadmin at opennebula-frontend:~$
>>>>>
>>>>> Someone has an idea how to solve this error?
>>>>>
>>>>> best regards
>>>>> t.
>>>>>
>>>>>
>>>>> Am 06.05.14 17:19, schrieb Thomas Stein:
>>>>>> Hello.
>>>>>>
>>>>>> I'm playing around with glustersfs and opennebula. Followed the quick
>>>>>> howto here:
>>>>>>
>>>>>> http://opennebula.org/native-glusterfs-image-access-for-kvm-drivers/
>>>>>>
>>>>>> Alltough it's not everything clear to me, i managed to create the
>>>>>> gluster datastore on the frontend.
>>>>>>
>>>>>> oneadmin at opennebula-frontend:~$ onedatastore show 135
>>>>>> DATASTORE 135 INFORMATION
>>>>>>
>>>>>> ID             : 135
>>>>>> NAME           : gluster_image
>>>>>> USER           : oneadmin
>>>>>> GROUP          : oneadmin
>>>>>> CLUSTER        : fluffy
>>>>>> TYPE           : IMAGE
>>>>>> DS_MAD         : fs
>>>>>> TM_MAD         : shared
>>>>>> BASE PATH      : /var/lib/one//datastores/135
>>>>>> DISK_TYPE      :
>>>>>>
>>>>>> DATASTORE CAPACITY
>>>>>>
>>>>>> TOTAL:         : 492.2G
>>>>>> FREE:          : 459.4G
>>>>>> USED:          : 7.6G
>>>>>> LIMIT:         : -
>>>>>>
>>>>>> PERMISSIONS
>>>>>>
>>>>>> OWNER          : um-
>>>>>> GROUP          : u--
>>>>>> OTHER          : ---
>>>>>>
>>>>>> DATASTORE TEMPLATE
>>>>>>
>>>>>> BASE_PATH="/var/lib/one//datastores/"
>>>>>> CLONE_TARGET="SYSTEM"
>>>>>> DISK_TYPE="GLUSTER"
>>>>>> DS_MAD="fs"
>>>>>> GLUSTER_HOST="one-volume1"
>>>>>> LN_TARGET="NONE"
>>>>>> TM_MAD="shared"
>>>>>> TYPE="IMAGE_DS"
>>>>>>
>>>>>> Problem is. When i try to create an image from a template which resides
>>>>>> in that datastore i get:
>>>>>>
>>>>>> Tue May  6 17:18:00 2014 [TM][D]: Message received: TRANSFER FAILURE 48
>>>>>> Error copying
>>>>>> opennebula-frontend:/var/lib/one//datastores/135/9ba000010fc657ac57edc0af308e4fa7
>>>>>> to remotehost:/var/lib/one/datastores/129/48/disk.0
>>>>>>
>>>>>> Why does opennebula to transfer the image?
>>>>>>
>>>>>> Thanks and best regards
>>>>>> t.
>>>>>> _______________________________________________
>>>>>> Users mailing list
>>>>>> Users at lists.opennebula.org
>>>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Users mailing list
>>>>> Users at lists.opennebula.org
>>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>
>>>>
>>>>
>>>
>> 
>> 
>> 
> 
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
> 