<p>Hi,</p>
<p>This is a very timely thread. We are now working in improving the storage capabilities of OpenNebula in the next release. OpenNebula 3.4 will feature the storage Datastores (check [1]). This will overcome some of the limitations observed by the single Image Repository architecture in 3.2, namely:</p>
<p>* Separated storage area for running VMs (the <vm_id>/images directories), that can be backed by different TMs (shared, or ssh to always perform local I/O in the hosts), and a different storage server</p>
<p>* A host can now use multiple datastores with different TMs (you can access ssh, and several NFS exports at the same time, and you are not limited to the TM used to create the host)</p>
<p>* Better scale the storage by distributing VMs across different storage servers (so I/O can be balanced)</p>
<p>* Better scale the storage by easily adding more storage (e.g. now running out of space in the image repository is not easy to solve)</p>
<p>* Plan the storage based on the server/application type (so critical servers are placed on better/safer storage and less important one on cheaper storage nodes)</p>
<p>* Specialized Datastores, we plan to include several datastore types: shared, ssh, qcow, VMware and lvm-iscsi.</p>
<p>As always the system has been architected in the OpenNebula way, i.e. quite easy to hack and adapt ;)</p>
<p>This will also allow us to plan additional post-3.4 features. In particular, we will look into a storage scheduler (similar to VMware DRS for those that are familiar with the VMware portfolio). In 3.4 you do oneimage create img_template -d datastore, the storage scheduler will suggest or pick up the best datastore based on the space left, number of VMs running, performance...</p>
<p>Cheers</p>
<p>Ruben </p>
<p>[1] <a href="http://blog.opennebula.org/?p=2646">blog.opennebula.org/?p=2646</a></p>
<div class="gmail_quote">On Mar 14, 2012 6:15 PM, "Frédéric Dreier" <<a href="mailto:frederic.dreier@gmail.com">frederic.dreier@gmail.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Marshall,<br>
<br>
It all depends on how you will use you cloud.<br>
<br>
For example in the last setup I worked on we tried distributed<br>
storage. But we just hit the IOPS maximum of our storage (see IOPS on<br>
wikipedia for more info). It is due to the fact that we have a lot of<br>
VM and no SATA / SAS / iSCSI with or without RAID was able to provide<br>
the number of IOPS we needed. Result was : very slow disk operations<br>
in VM (apt-get upgrade could last hours). Some smart guys just tune<br>
the whole with a centralized NFS (Openindiana, ZFS, RAMDISK + extra<br>
DDRDRIVE) and now it rocks.<br>
<br>
Good luck,<br>
<br>
Frederic<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
2012/3/13 Marshall Grillos <<a href="mailto:mgrillos@optimalpath.com">mgrillos@optimalpath.com</a>>:<br>
> We are planning an OpenNebula deployment for a private cloud setup.<br>
><br>
><br>
><br>
> I recently read an article on the opennebula blog on storage:<br>
> <a href="http://blog.opennebula.org/?p=2187" target="_blank">http://blog.opennebula.org/?p=2187</a><br>
><br>
><br>
><br>
> This article discusses a “Distributed storage local copy” solution that<br>
> seems to scale the best. However it does not contain any information or<br>
> hints on how to configure this type of setup. I have a few questions:<br>
><br>
><br>
><br>
> 1) Will this setup allow live migrations?<br>
><br>
> 2) Can someone point me to some configuration examples?<br>
><br>
> 3) Does this require the VMWare hypervisor (we were looking at KVM or<br>
> XEN deployment)?<br>
><br>
><br>
><br>
> Does anyone know what the general architecture would look like? We were<br>
> planning on attaching a large storage array to the OpenNebula controller to<br>
> house VM images and setting up enough storage on each node to house running<br>
> images to reduce network latency. I found this article useful in that it<br>
> afforded faster deployment times than the traditional Non-shared filesystem.<br>
><br>
><br>
><br>
> Any tips/information on how to test this deployment would be great.<br>
><br>
><br>
><br>
> Thanks,<br>
><br>
> Marshall<br>
><br>
><br>
> _______________________________________________<br>
> Users mailing list<br>
> <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
><br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
</blockquote></div>