[one-users] How to use ceph filesystem

[Jaime Melis]

Hi Mario,

Cephfs CAN be used a shared filesystem datastore. I don't completely agree
with Kenneth's recommendation of using 'ssh' as the TM for the system
datastore. I think you can go for 'shared' as long as you have the
/var/lib/one/datastores/... shared via Cephfs. OpenNebula doesn't care
about what DFS solution you're using, it will simply assume files are
already there.

Another thing worth mentioning, from 4.4 onwards the HOST attribute of the
datastore should be renamed as BRIDGE_LIST.

cheers,
Jaime


On Tue, Dec 3, 2013 at 11:28 AM, Kenneth <kenneth at apolloglobal.net> wrote:

>  Actually, I'm using ceph as the system datastore. I used the cephfs
> (CEPH FUSE) and mounted it on all nodes on /var/lib/one/datastores/0/
>
> Regarding ssh for trasfer driver, I haven't really used it since I'm all
> on ceph, both system and image datastore. I may be wrong but that is how I
> understand it from the docs.
> ---
>
> Thanks,
> Kenneth
> Apollo Global Corp.
>
>  On 12/03/2013 06:11 PM, Mario Giammarco wrote:
>
>   My problem was that  because ceph is a distributed filesystem (and so
> it can be used as an alternative to nfs) I supposed I can use as a shared
> system datastore.
> Reading your reply I can see it is not true. Probably official
> documentation should clarify this.
>
> Infact I hoped to use ceph as system datastore because ceph is fault
> tolerant and nfs is not.
>
> Thanks for help,
> Mario
>
>
> 2013/12/3 Kenneth <kenneth at apolloglobal.net>
>
>>  Ceph won't be the default image datastore, but you can always choose it
>> whenever you create an image.
>>
>> You said you don't have an NFS disk and your just use plain disk on your
>> system datastore so you *should* use ssh in order to have live
>> migrations.
>>
>> Mine uses shared as datastore since I mounted a shared folder on each
>> nebula node.
>>  ---
>>
>> Thanks,
>> Kenneth
>> Apollo Global Corp.
>>
>>   On 12/03/2013 03:01 PM, Mario Giammarco wrote:
>>
>> First, thanks you for your very detailed reply!
>>
>>
>> 2013/12/3 Kenneth <kenneth at apolloglobal.net>
>>
>>>  You don't need to replace existing datastores, the important is you
>>> edit the system datastore as "ssh" because you still need to transfer files
>>> in each node when you deploy a VM.
>>>
>>
>> So I lose live migration, right?
>> If I understand correctly ceph cannot be default datastore also.
>>
>>>  Next, you should make sure that all your node are able to communicate
>>> with the ceph cluster. Issue the command "ceph -s" on all nodes including
>>> the front end to be sure that they are connected to ceph.
>>>
>>>
>>>
>>
>> ... will check...
>>
>>
>>>
>>> oneadmin at cloud-node1:~$ onedatastore list
>>>
>>>   ID NAME                SIZE AVAIL CLUSTER      IMAGES TYPE DS
>>> TM
>>>
>>>    0 system                 - -     -                 0 sys  -
>>> shared
>>>
>>>    1 default             7.3G 71%   -                 1 img  fs
>>> shared
>>>
>>>    2 files               7.3G 71%   -                 0 fil  fs       ssh
>>>
>>> * 100 cephds              5.5T 59%   -                 3 img  ceph
>>> ceph*
>>>
>>> Once you add the you have verified that the ceph datastore is active you
>>> can upload images on the sunstone GUI. Be aware that conversion of images
>>> to RBD format of ceph may take quite some time.
>>>
>>
>> I see in your configuration that system datastore is shared!
>>
>> Thanks again,
>> Mario
>>
>>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>


-- 
Jaime Melis
C12G Labs - Flexible Enterprise Cloud Made Simple
http://www.c12g.com | jmelis at c12g.com

--

Confidentiality Warning: The information contained in this e-mail and
any accompanying documents, unless otherwise expressly indicated, is
confidential and privileged, and is intended solely for the person
and/or entity to whom it is addressed (i.e. those identified in the
"To" and "cc" box). They are the property of C12G Labs S.L..
Unauthorized distribution, review, use, disclosure, or copying of this
communication, or any part thereof, is strictly prohibited and may be
unlawful. If you have received this e-mail in error, please notify us
immediately by e-mail at abuse at c12g.com and delete the e-mail and
attachments and any copy from your system. C12G's thanks you for your
cooperation.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20131203/a7e3eb87/attachment-0002.htm>