[one-users] experiences with distributed FS?

[Hutson Betts]

Our research project is currently using GlusterFS for our distributed
NFS storage system. We're leveraging the distributed-replica
configuration in which every two pairs of servers is a replica pair, and
all pairs form a distributed cluster. We do not do data stripping since
to achieve up-time reliability with stripping would require too many
servers.

Furthermore, another nice feature of GlusterFS, is that you can just
install it into a VM, clone it a few times, and distribute them across
VMMs. However, we utilize physical servers using RAID-1.

One issue with MooseFS is that it relies upon a single Metadata server.
Therefore, if that Metadata server fails, the cluster fails. GlusterFS
does not have a Metadata server. 


-- 
Sincerely,
Hutson Betts (Computer Science and Engineering - Texas A&M University)
Key ID: F98BFC1E <http://pgp.mit.edu/>


On Wed, 2012-02-08 at 11:15 -0500, Maxim Mikheev wrote:
> Hi Joao.
> I made a similar search recently. Here is my results:
> Lustre - does not have redundancy, If you will use file striping between 
> nodes and one nodes go offline all data are not available.
> Gluster - does not support KVM virtualization. Software developer lead 
> mentioned that it will be fixed in next release (April).
> Shipping Dog - Working only with images does not allow to store plain 
> files on it. one image can be connected to only one VM per a time.
> eXtremFS - does not have support. If something not working it is your 
> problem even you ready to pay for fixing.
> 
> And my choice: MooseFS - redundant any node can go offline and data will 
> be available, scalable, with striping, with CoW, Create copy of huge 
> images in a second, has internal checksum correction, has commercial 
> support, data deduplication (commercial version only) and many other 
> features.
> 
> there are plugging for OpenNebula. It has some bugs but you can start 
> from this point.
> 
> Regards,
>      Max
> 
> 
> On 02/08/2012 08:18 AM, João Pagaime wrote:
> > Hello all,
> >
> > We're looking into the possibility of using a distributed FS, like 
> > glusterfs or similar solution for the image repository
> >
> > Can anyone share his experiences on this topic?  any hints would be 
> > nice... Existing specific documentation? REcommendend configurations? 
> > Tested configurations? Things to watch out for? Things particular to 
> > open-nebula? Problems? Stability (is it maintainable without a general 
> > shutdown)?  Effort/learning curve ("large", "small", hours, days, 
> > weeks)? Any other information?
> >
> > Thanks any way, best regards,
> > João
> >
> >
> >
> > _______________________________________________
> > Users mailing list
> > Users at lists.opennebula.org
> > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 836 bytes
Desc: This is a digitally signed message part
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20120208/aee92568/attachment-0003.pgp>