<div dir="ltr">You can use a native Infiniband protocol called eIPoIB to allow VMs to communicate over Infiniband. This should be transparent to open nebula. If you are trying to push RDMA to the VM then you need to look into the SR-IOV features of the newer mellanox cards and the opennebula plugin for SRIOV support in VMs.<div><br></div><div>Shankhadeep</div><div><br></div><div>See this presentation for details on eIPoIB</div><div><br></div><div><a href="https://www.openfabrics.org/index.php/ofa-documents/doc_download/510-ethernet-tunneling-over-ipoib.html">https://www.openfabrics.org/index.php/ofa-documents/doc_download/510-ethernet-tunneling-over-ipoib.html</a><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Sep 29, 2014 at 10:19 AM, Galimba <span dir="ltr"><<a href="mailto:galimba@gmail.com" target="_blank">galimba@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">As a first step, I'd like to be able to deploy vms tru IPoIB.<br>
The problem ips that my opennebula frontend does Not have infiniband. Only the NAS hosting the datastore mover nfs and the nodes running the vms have IB devices.</p>
<p dir="ltr">Is it possible to get opennebula to deploy using the IB network while using ethernet as a managing network?</p>
<div class="gmail_quote">El sep 28, 2014 9:41 p.m., "Svancara, Randall" <<a href="mailto:rsvancara@wsu.edu" target="_blank">rsvancara@wsu.edu</a>> escribió:<div><div class="h5"><br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt">Hi,<br>
<br>
What are you try to achieve?? Are you trying to expose the IB network to the virtual machines using RDMA/VERBS?<br>
<br>
Thanks,<br>
<br>
Randall<br>
<div style="font-family:Times New Roman;color:#000000;font-size:16px">
<hr>
<div style="direction:ltr"><font color="#000000" face="Tahoma"><b>From:</b> Users [<a href="mailto:users-bounces@lists.opennebula.org" target="_blank">users-bounces@lists.opennebula.org</a>] on behalf of Galimba [<a href="mailto:galimba@gmail.com" target="_blank">galimba@gmail.com</a>]<br>
<b>Sent:</b> Sunday, September 28, 2014 5:07 PM<br>
<b>To:</b> <a href="mailto:users@lists.opennebula.org" target="_blank">users@lists.opennebula.org</a><br>
<b>Subject:</b> [one-users] Infiniband, nodes and VMs<br>
</font><br>
</div>
<div></div>
<div>
<div dir="ltr">Hello!
<div>I've been given the task to step up our game and connect a few nodes tru infiniband. This meaning: we've been working over gigabit ethernet this far, but now we want our ONE nodes hosting the VMs to be interconected tru IP over infiniband. We have the
hardware to do so, but I must confess I lack the expertise to pull this off.</div>
<div><br>
</div>
<div>
<div><b>I've been googling around a bit and found a couple of links. Even tho I think the answers to both my questions are there (yes, it's possible, and no it's not that hard).</b></div>
<div><br>
</div>
<div><a href="https://github.com/OpenNebula/addon-kvm-sr-iov" target="_blank">https://github.com/OpenNebula/addon-kvm-sr-iov</a><br>
</div>
<div><a href="http://blog.scottlowe.org/2009/12/02/what-is-sr-iov/" target="_blank">http://blog.scottlowe.org/2009/12/02/what-is-sr-iov/</a><br>
</div>
<div><a href="http://wiki.opennebula.org/ecosystem:sr-iov" target="_blank">http://wiki.opennebula.org/ecosystem:sr-iov</a><br>
</div>
<div><a href="http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-5.html" target="_blank">http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-5.html</a><br>
</div>
</div>
<div><br>
</div>
<div>I know little about infiniband, so here are a few questions I started with:</div>
<div>1) Is it hard to get the VMs to work with eachother over infiniband? I mean, if I have a client who wants his VMs to trade messages at really fast speed. I'd like them to be able to create VMs that work on a specific infiniband network at high speed.</div>
<div><br>
</div>
<div>2) Is it easy to configure the hosts to deliver the images back and forth over infiniband? This would really speed up the deploy.</div>
<div><br>
</div>
<div>3) Is someone using this setup? I mean, using a hardware interface shared between both the nodes and the vms.</div>
<div>
<div><br>
</div>
<div><b>I'd apreciate any input you guys can give me =)</b><br>
</div>
<div><b><br>
</b></div>
<div>best regards</div>
<div>galimba</div>
<div><br>
</div>
-- <br>
<div dir="ltr"><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote></div></div></div>
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
<br></blockquote></div><br></div>