[one-users] Infiniband, nodes and VMs

[Shankhadeep Shome]

You can use a native Infiniband protocol called eIPoIB to allow VMs to
communicate over Infiniband. This should be transparent to open nebula. If
you are trying to push RDMA to the VM then you need to look into the SR-IOV
features of the newer mellanox cards and the opennebula plugin for SRIOV
support in VMs.

Shankhadeep

See this presentation for details on eIPoIB

https://www.openfabrics.org/index.php/ofa-documents/doc_download/510-ethernet-tunneling-over-ipoib.html


On Mon, Sep 29, 2014 at 10:19 AM, Galimba <galimba at gmail.com> wrote:

> As a first step, I'd like to be able to deploy vms tru IPoIB.
> The problem ips that my opennebula frontend does Not have infiniband. Only
> the NAS hosting the datastore mover nfs and the nodes running the vms have
> IB devices.
>
> Is it possible to get opennebula to deploy using the IB network while
> using ethernet as a managing network?
> El sep 28, 2014 9:41 p.m., "Svancara, Randall" <rsvancara at wsu.edu>
> escribió:
>
>  Hi,
>>
>> What are you try to achieve??  Are you trying to expose the IB network to
>> the virtual machines using RDMA/VERBS?
>>
>> Thanks,
>>
>> Randall
>>  ------------------------------
>> *From:* Users [users-bounces at lists.opennebula.org] on behalf of Galimba [
>> galimba at gmail.com]
>> *Sent:* Sunday, September 28, 2014 5:07 PM
>> *To:* users at lists.opennebula.org
>> *Subject:* [one-users] Infiniband, nodes and VMs
>>
>>   Hello!
>> I've been given the task to step up our game and connect a few nodes tru
>> infiniband. This meaning: we've been working over gigabit ethernet this
>> far, but now we want our ONE nodes hosting the VMs to be interconected tru
>> IP over infiniband. We have the hardware to do so, but I must confess I
>> lack the expertise to pull this off.
>>
>>  *I've been googling around a bit and found a couple of links. Even tho
>> I think the answers to both my questions are there (yes, it's possible, and
>> no it's not that hard).*
>>
>>  https://github.com/OpenNebula/addon-kvm-sr-iov
>>  http://blog.scottlowe.org/2009/12/02/what-is-sr-iov/
>>  http://wiki.opennebula.org/ecosystem:sr-iov
>>  http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-5.html
>>
>>  I know little about infiniband, so here are a few questions I started
>> with:
>> 1) Is it hard to get the VMs to work with eachother over infiniband? I
>> mean, if I have a client who wants his VMs to trade messages at really fast
>> speed. I'd like them to be able to create VMs that work on a specific
>> infiniband network at high speed.
>>
>>  2) Is it easy to configure the hosts to deliver the images back and
>> forth over infiniband? This would really speed up the deploy.
>>
>>  3) Is someone using this setup? I mean, using a hardware interface
>> shared between both the nodes and the vms.
>>
>>  *I'd apreciate any input you guys can give me =)*
>>
>>  best regards
>> galimba
>>
>>  --
>>
>>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20141006/0971cd18/attachment.htm>