[one-users] What kinds of shared storage are you using?

[Michael Brown]

I've found that NFS is unacceptably slow too.  With both the front end and
the nodes mounting NFS, copies have to go through the front end, then back
out again, which is a bit wasteful.

We use a NetApp storage system, which can do flexclones.  We can't take
advantage of that with OpenNebula because everything is exported via NFS.  I
have a few coworkers that have experience with a NetApp api, so we plan on
writing a tm driver for NetApp soon.

I'm interested to hear about other people's setups and solutions.

--Michael Brown

On Wed, Sep 1, 2010 at 11:48 PM, Huang Zhiteng <winston.d at gmail.com> wrote:

> Hi all,
>
> In my open nebula 2.0b testing, I found NFS performance was unacceptable
> (too bad).  I haven't done any tuning or optimization to NFS yet but I doubt
> if tuning can solve the problem.  So I'd like to know what kind of shared
> storage you are using.  I thought about Global File System v2 (GFSv2).
> GFSv2 does performs much better (near native performance) but there's limit
> of 32 nodes and setting up GFS is complex. So more important question, how
> can shared storage scales to > 100 node cloud?  Or this question should be
> for > 100 node cloud, what kind of storage system should be used?   Please
> give any suggestion or comments.  If you have already implement/deploy such
> an environment, it'd be great if you can share some best practice.
>
> --------------
> Below there's some details about my setup and issue:
>
> 1 front-end, 6 nodes.  All machines are two socket Intel Xeon x5570 2.93Ghz
> (16 threads in total), with 12GB memory.  There's one SATA RAID 0 box (630GB
> capacity) connected to front-end.  Network is 1Gb Ethernet.
>
> OpenNebula 2.0b was installed to /srv/cloud/one on front-end and then
> exported via NFSv4.  Also front-end exports RAID 0 partition to
> /srv/cloud/one/var/images.
>
> The Prolog stage of Creating VM always caused frond-end machine almost
> freeze (slow response to input, even OpenNebula command would timeout) in my
> setup.  I highly suspect the root cause is poor performance NFS.
> --
> Regards
> Huang Zhiteng
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20100902/9041b929/attachment.htm>