[one-users] experiences with distributed FS?

[Chris Picton]

On 2012/02/08 7:54 PM, Chris Picton wrote:
> On 2012/02/08 5:42 PM, Alberto Zuin - Liste wrote:
>> In past we used OpenNebula 2.2 with MooseFS driver for immediate 
>> deployment via snapshot, but the driver wasn't updated to OpenNebula 
>> 3.0.
>>
>> We are very happy with MooseFS: it's very easy and robust. The only 
>> consideration is on disk side: SATA is a little slow expecially in 
>> write operation, then we use a lot of RAM on each storage server (8 
>> GB) to cache data.
>
> I can agree with the point on slowness

Just to clarify - moosefs is fast in almost all respects, but is slow 
when continually reading from and writing to the same block of a file.  
Unfortunately the workload on some of my vms seems to hit this case 
fairly often, and that is what I am trying to optimise.


>
> I had a shared moosefs setup running (with only 4 moosefs servers, 
> with 2x 1Tb SATA drives in each), and found disk writes to be far too 
> slow to host our test environment correctly
>
> I have migrated this to a custom tm, which uses moosefs for image 
> store, and copies vm images to local storage to actually run.
>
> I am busy investigating moosefs slowness on a separate testing cluster 
> (and have so far improved bonnie++ rewrite speed from 1.5MB/s to 
> 18MB/s).  I should have something I am willing to put back into use as 
> a proper shared filesystem soon (I really like using the snapshot 
> capabilites to deploy vms)
>
> Chris
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>