Hi !<br><br>Does your succesfully setup mean that you did not face any problems at all working with<br>all components of OpenNebula including cluster architecture, snapshots rollback without<br>any io errors, sunstone working etc? <br>
<br>Concerning gridengine I know that medical companies like Novo Nordisk is working<br>with a huge amount of data in PostgreSQL using gridengine (Sun's) which are in the repository packages.<br><br>/Poul<br><br>IT-consultant / Linux-specialist <br>
<br><br><div class="gmail_quote">2012/3/20 Olivier Sallou <span dir="ltr"><<a href="mailto:olivier.sallou@irisa.fr" target="_blank">olivier.sallou@irisa.fr</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
Le 3/20/12 5:24 PM, biro lehel a écrit :<br>
<div>> Dear all,<br>
><br>
> After having successfully set up a small-scale (but up-and-running)<br>
> experimental Private Cloud (using OpenSUSE 12.1 64bit machines -also<br>
> VM's-, KVM as hypervisor, and ONE 3.2.0), my next task is to find a way<br>
> in which GRID-like services (see below) could be implemented inside an<br>
> OpenNebula-based Cloud. Basically, and architecturally-speaking, I think<br>
> I would need a PaaS layer above my existing IaaS layer.<br>
><br>
> I am interested in the following tasks:<br>
><br>
</div>> *job distribution among a set of dynamically created (or, as a start,<br>
<div>> fixed) VM's, initiated by a master-VM<br>
> * job execution on the worker-VM's and, more importantly, execution<br>
> monitoring of these jobs by the master-VM<br>
> * results gathering on the master-VM<br>
><br>
> I have briefly looked though Hadoop, which uses MapReduce, but, having<br>
> no experience with it, I am not sure whether if it is the best tool to<br>
> use for such a use-case, and also, I don't know if it could be at all<br>
> used in my environment. So, my fundamental question is the following:<br>
> which is the best way to start on, a way that would lead to satisfying<br>
> my above-mentioned 3 necessities?<br>
> Is Hadoop perfectly compatible with OpenNebula, and could be used for<br>
> such purposes, or are there other and more fitting solutions or tools to<br>
> use? Basically, all I'm asking is, what is the most appropriate way for<br>
> obtaining these basic GRID-computing functionalities on a Platform<br>
> constructed above the Infrastructure?<br>
</div>Hadoop will fit, but Hadoop is mainly focused on map/reduce jobs, and<br>
use of HDFS storage.<br>
<br>
There is no issue at setting up Hadoop on "top of" Open Nebula, I did<br>
it. IT is up to you to configure your images to setup Hadoop<br>
automatically (with ssh password-less communication).<br>
<br>
What you refer too would be more likely a really grid system like Torque<br>
ou Sun Grid Engine. Those can also be put above Open Nebula (or other<br>
cloud system). But, same thing, you need to create images that will<br>
automatically set them up (I did too with Torque)<br>
<div>><br>
> Any suggestions, thoughts, and hints are extremely welcome, since this<br>
> is a rather important and urgent matter for me.<br>
><br>
> Thank you,<br>
> Lehel.<br>
><br>
><br>
><br>
</div>> _______________________________________________<br>
> Users mailing list<br>
> <a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
<br>
--<br>
Olivier Sallou<br>
IRISA / University of Rennes 1<br>
Campus de Beaulieu, 35000 RENNES - FRANCE<br>
Tel: 02.99.84.71.95<br>
<br>
gpg key id: 4096R/326D8438 (<a href="http://keyring.debian.org" target="_blank">keyring.debian.org</a>)<br>
Key fingerprint = 5FB4 6F83 D3B9 5204 6335 D26D 78DC 68DB 326D 8438<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
</blockquote></div><br>