<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Already answered in the list:<br>
<br>
<div class="moz-text-plain" wrap="true" graphical-quote="true"
style="font-family: -moz-fixed; font-size: 12px;" lang="x-western">
<pre wrap="">
Le 3/20/12 5:24 PM, biro lehel a écrit :
</pre>
<blockquote type="cite" style="color: #000000;">
<pre wrap="">Dear all,
After having successfully set up a small-scale (but up-and-running)
experimental Private Cloud (using OpenSUSE 12.1 64bit machines -also
VM's-, KVM as hypervisor, and ONE 3.2.0), my next task is to find a way
in which GRID-like services (see below) could be implemented inside an
OpenNebula-based Cloud. Basically, and architecturally-speaking, I think
I would need a PaaS layer above my existing IaaS layer.
I am interested in the following tasks:
*job distribution among a set of dynamically created (or, as a start,
fixed) VM's, initiated by a master-VM
* job execution on the worker-VM's and, more importantly, execution
monitoring of these jobs by the master-VM
* results gathering on the master-VM
I have briefly looked though Hadoop, which uses MapReduce, but, having
no experience with it, I am not sure whether if it is the best tool to
use for such a use-case, and also, I don't know if it could be at all
used in my environment. So, my fundamental question is the following:
which is the best way to start on, a way that would lead to satisfying
my above-mentioned 3 necessities?
Is Hadoop perfectly compatible with OpenNebula, and could be used for
such purposes, or are there other and more fitting solutions or tools to
use? Basically, all I'm asking is, what is the most appropriate way for
obtaining these basic GRID-computing functionalities on a Platform
constructed above the Infrastructure?
</pre>
</blockquote>
<pre wrap="">Hadoop will fit, but Hadoop is mainly focused on map/reduce jobs, and
use of HDFS storage.
There is no issue at setting up Hadoop on "top of" Open Nebula, I did
it. IT is up to you to configure your images to setup Hadoop
automatically (with ssh password-less communication).
What you refer too would be more likely a really grid system like Torque
ou Sun Grid Engine. Those can also be put above Open Nebula (or other
cloud system). But, same thing, you need to create images that will
automatically set them up (I did too with Torque)
</pre>
<blockquote type="cite" style="color: #000000;">
<pre wrap="">Any suggestions, thoughts, and hints are extremely welcome, since this
is a rather important and urgent matter for me.
Thank you,
Lehel.
_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a>
<a class="moz-txt-link-freetext" href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a>
</pre>
</blockquote>
<pre wrap=""><div class="moz-txt-sig">--
gpg key id: 4096R/326D8438 (keyring.debian.org)
Key fingerprint = 5FB4 6F83 D3B9 5204 6335 D26D 78DC 68DB 326D 8438
_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a>
<a class="moz-txt-link-freetext" href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a>
</div></pre>
</div>
<br>
</body>
</html>