[one-users] Problem with OpenVSwitch and some questions about Ceph

[Jon]

Hello All,

I've just installed OpenNebula 3.9.80 and I have to say this is
amazing.  Everything works so smoothly.

Anyway, down to business.

OpenVSwitch:

I've installed and configured OpenVSwitch and am able to manually add
the OVS config using libvirt, then launch a VM,

>>      <interface type='bridge'>
>>        <source bridge='ovsbr0'/>
>>        <virtualport type='openvswitch'>
>>        </virtualport>
>>        <model type='virtio'/>
>>        <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
>>      </interface>

Which creates the device in ovs:

>>  system at ovsbr0:
>>      lookups: hit:1346333 missed:46007 lost:0
>>      flows: 8
>>      port 0: ovsbr0 (internal)
>>      port 1: eth0
>>      port 2: br0 (internal)
>>      port 7: vnet0


However, when I attempt to create a virtual network without assigning
an IP and instantiate the template I get the error:

>> [TemplateInstantiate] Error allocating a new virtual machine. Cannot get IP/MAC lease from virtual network 0.

The template of the virtual network is:

>> oneadmin at loki:~$ onevnet show testnet1
>>  VIRTUAL NETWORK 0 INFORMATION
>>  ID             : 0
>>  NAME           : testnet1
>>  USER           : oneadmin
>>  GROUP          : oneadmin
>>  CLUSTER        : -
>>  TYPE           : FIXED
>>  BRIDGE         : ovsbr0
>>  VLAN           : No
>>  USED LEASES    : 0
>>
>>  PERMISSIONS
>>  OWNER          : um-
>>  GROUP          : ---
>>  OTHER          : ---
>>
>>  VIRTUAL NETWORK TEMPLATE
>>
>>
>>  VIRTUAL MACHINES
>>

If I add an IP to the vnet, I get the following template and error
logs (full vm log attached, I think I've identified the relevant
line):

>> Thu Mar 28 10:34:05 2013 [VMM][E]: post: Command "sudo /usr/bin/ovs-ofctl add-flow ovsbr0 in_port=,dl_src=02:00:44:47:83:43,priority=40000,actions=normal" failed.

>>  oneadmin at loki:~$ onevnet show testnet1
>>  VIRTUAL NETWORK 0 INFORMATION
>>  ID             : 0
>>  NAME           : testnet1
>>  USER           : oneadmin
>>  GROUP          : oneadmin
>>  CLUSTER        : -
>>  TYPE           : FIXED
>>  BRIDGE         : ovsbr0
>>  VLAN           : No
>>  USED LEASES    : 1
>>
>>  PERMISSIONS
>>  OWNER          : um-
>>  GROUP          : ---
>>  OTHER          : ---
>>
>>  VIRTUAL NETWORK TEMPLATE
>>
>>
>>  USED LEASES
>>  LEASE=[ MAC="02:00:44:47:83:43", IP="192.168.0.2", IP6_LINK="fe80::400:44ff:fe47:8343", USED="1", VID="7" ]
>>
>>  VIRTUAL MACHINES
>>
>>      ID USER     GROUP    NAME            STAT UCPU    UMEM HOST             TIME
>>       7 oneadmin oneadmin template-4-7    fail    0      0K              0d 00h00

>>  root at loki:~# cat /var/log/openvswitch/ovs-vswitchd.log
>>  Mar 28 10:34:04|00081|bridge|INFO|created port vnet1 on bridge ovsbr0
>>  Mar 28 10:34:07|00082|netdev_linux|WARN|ethtool command ETHTOOL_GSET on network device vnet1 failed: No such device
>>  Mar 28 10:34:07|00083|netdev_linux|INFO|ioctl(SIOCGIFHWADDR) on vnet1 device failed: No such device
>>  Mar 28 10:34:07|00084|netdev|WARN|failed to get flags for network device vnet1: No such device
>>  Mar 28 10:34:07|00085|netdev|WARN|failed to retrieve MTU for network device vnet1: No such device
>>  Mar 28 10:34:07|00086|netdev|WARN|failed to get flags for network device vnet1: No such device
>>  Mar 28 10:34:07|00087|bridge|INFO|destroyed port vnet1 on bridge ovsbr0

I attempted to run the command but I never set a password for the
oneadmin user, but I don't think it's a permissions / sudo access
problem.

Not really sure where to look next.  Any ideas are appreciated.

CEPH:

I'm trying to use a Ceph datastore with a RBD instead of a cephFS
(it's an option).
When I try to create a Ceph datastore with a RBD type, I get a state
of "Error",
but I'm not sure where to look for relevant logs, oned.log didn't seem
to have anything,
or maybe I'm just grepping for the wrong string.

As a work around, I have been creating the directory, creating the rbd
then manually mounting it,
this seems to work in my test environment, but doesn't seem very
scalable, how are others using CEPH?

Documentation:

I've noticed some errors in the documentation, namely the location of
the install scripts,

The docs state they are in:
>> /usr/share/one/install_gems
>> /usr/share/one/sunstone/install_novnc.sh

However, I found them in:
>> /usr/share/opennebula/install_gems
>> /usr/share/opennebula/install_novnc.sh
>> /usr/share/opennebula/sunstone/install_novnc.sh

Is there some repository of the documentation somewhere that we can
contribute to?
It's a small thing, but when I'm going through the instructions, I
like to copy / paste;
I figured it out, but I know if it caused me problems, it might cause
others problems too.

Thanks again, I can't wait for the final release of OpenNebula!

Best Regards,
Jon A
-------------- next part --------------
A non-text attachment was scrubbed...
Name: vm-ovs-failed-20130328
Type: application/octet-stream
Size: 4990 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20130328/be66165f/attachment.obj>