[one-users] Infiniband, nodes and VMs

[Svancara, Randall]

Hi,

What are you try to achieve??  Are you trying to expose the IB network to the virtual machines using RDMA/VERBS?

Thanks,

Randall
________________________________
From: Users [users-bounces at lists.opennebula.org] on behalf of Galimba [galimba at gmail.com]
Sent: Sunday, September 28, 2014 5:07 PM
To: users at lists.opennebula.org
Subject: [one-users] Infiniband, nodes and VMs

Hello!
I've been given the task to step up our game and connect a few nodes tru infiniband. This meaning: we've been working over gigabit ethernet this far, but now we want our ONE nodes hosting the VMs to be interconected tru IP over infiniband. We have the hardware to do so, but I must confess I lack the expertise to pull this off.

I've been googling around a bit and found a couple of links. Even tho I think the answers to both my questions are there (yes, it's possible, and no it's not that hard).

https://github.com/OpenNebula/addon-kvm-sr-iov
http://blog.scottlowe.org/2009/12/02/what-is-sr-iov/
http://wiki.opennebula.org/ecosystem:sr-iov
http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-5.html

I know little about infiniband, so here are a few questions I started with:
1) Is it hard to get the VMs to work with eachother over infiniband? I mean, if I have a client who wants his VMs to trade messages at really fast speed. I'd like them to be able to create VMs that work on a specific infiniband network at high speed.

2) Is it easy to configure the hosts to deliver the images back and forth over infiniband? This would really speed up the deploy.

3) Is someone using this setup? I mean, using a hardware interface shared between both the nodes and the vms.

I'd apreciate any input you guys can give me =)

best regards
galimba

--

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140929/17af91d4/attachment.htm>