[one-users] need to create Flows? for openvswitch-based ONE (4.2) setup -- (passed on ebtables)
Jaime Melis
jmelis at opennebula.org
Tue Dec 3 03:00:30 PST 2013
Hi Mark,
there should be more info in the log file at /var/log/one/24.log
what does it say there?
cheers,
Jaime
On Wed, Nov 20, 2013 at 11:08 PM, Mark Biggers <mbiggers at ine.com> wrote:
> Hello ONE team,
>
> I have "passed" on the ebtables configuration for networking in 4.2 ONE.
> We'll need OpenVSwitch anyways to manage the VMs VLANS, so I have moved on.
>
> I *think* I have an almost working OpenVSwitch configuration. Must I
> manually create "flows" for each VM/MAC-addr to enable IP traffic, across
> the OVS "vbridge" (vbr0), in this case?
>
> The info on my new (OVS networking) setup, is included, at the end of this
> message. Thank you. (The platform is still openSUSE 12.3 on a Thinkpad
> W530...)
>
>
> On 11/19/2013 05:43 AM, Jaime Melis wrote:
>
> Hi Mark,
>
> I have the feeling the NAT policies are interfering with this. Can you
> try without applying NAT rules?
>
>
> On Wed, Nov 13, 2013 at 9:08 PM, Mark Biggers <mbiggers at ine.com> wrote:
>
>> The subject says it all. I am available on IRC -- see my signature, and
>> Google chat.
>>
>> I can get no "networking across a bridge" working, for the ONE "ebtables"
>> model.
>>
>
>> =============== edited out....
>>
>
> --
> Jaime Melis
> Project Engineer
> OpenNebula - Flexible Enterprise Cloud Made Simple
> www.OpenNebula.org | jmelis at opennebula.org
>
>
> Script started on Wed Nov 20 16:27:05 2013
>
> root at sealion.ine.corp:one # netstat -nr
> Kernel IP routing table
> Destination Gateway Genmask Flags MSS Window irtt
> Iface
> 0.0.0.0 192.168.1.1 0.0.0.0 UG 0 0 0 vbr0
> 67.139.46.149 192.168.1.1 255.255.255.255 UGH 0 0 0
> vbr0
> 127.0.0.0 0.0.0.0 255.255.255.0 U 0 0 0 lo
> 127.0.0.0 0.0.0.0 255.0.0.0 U 0 0 0 lo
> 192.168.1.0 0.0.0.0 255.255.255.0 U 0 0 0 vbr0
>
> root at sealion.ine.corp:one # ip addr
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
> inet 127.0.0.1/8 brd 127.255.255.255 scope host lo
> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state
> UP qlen 1000
> link/ether 3c:97:0e:ab:0a:de brd ff:ff:ff:ff:ff:ff
> 3: wlan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
> link/ether 6c:88:14:da:0b:44 brd ff:ff:ff:ff:ff:ff
> 4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
> link/ether 0a:0e:fd:bb:5a:8a brd ff:ff:ff:ff:ff:ff
> 7: vbr0: <BROADCAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc noqueue state
> UNKNOWN
> link/ether 3c:97:0e:ab:0a:de brd ff:ff:ff:ff:ff:ff
> inet 192.168.1.250/24 scope global vbr0
> 12: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
> state UNKNOWN qlen 500
> link/ether fe:00:0a:00:00:03 brd ff:ff:ff:ff:ff:ff
> 13: vnet1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
> state UNKNOWN qlen 500
> link/ether fe:00:0a:00:00:04 brd ff:ff:ff:ff:ff:ff
>
> root at sealion.ine.corp:one # BRIDGE_DEV=vbr0
> root at sealion.ine.corp:one # sudo ovs-ofctl dump-desc $BRIDGE_DEV
> OFPST_DESC reply (xid=0x2):
> Manufacturer: Nicira, Inc.
> Hardware: Open vSwitch
> Software: 1.11.0
> Serial Num: None
> DP Description: None
>
> root at sealion.ine.corp:one # sudo ovs-vsctl show
> 001119d6-32d7-4db8-8015-229b271cca6a
> Bridge "vbr0"
> Controller "ptcp:"
> fail_mode: standalone
> Port "vnet0"
> tag: 0
> Interface "vnet0"
> Port "vnet1"
> tag: 0
> Interface "vnet1"
> Port "eth0"
> Interface "eth0"
> Port "vbr0"
> Interface "vbr0"
> type: internal
> ovs_version: "1.11.0"
>
> root at sealion.ine.corp:one # sudo ovs-ofctl show $BRIDGE_DEV
> OFPT_FEATURES_REPLY (xid=0x2): dpid:00003c970eab0ade
> n_tables:254, n_buffers:256
> capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
> actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST
> SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
> 1(eth0): addr:3c:97:0e:ab:0a:de
> config: 0
> state: STP_FORWARD
> current: 1GB-FD COPPER AUTO_NEG
> advertised: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER AUTO_NEG
> supported: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER
> AUTO_NEG
> speed: 1000 Mbps now, 1000 Mbps max
> 2(vnet0): addr:fe:00:0a:00:00:03
> config: 0
> state: 0
> current: 10MB-FD COPPER
> speed: 10 Mbps now, 0 Mbps max
> 3(vnet1): addr:fe:00:0a:00:00:04
> config: 0
> state: 0
> current: 10MB-FD COPPER
> speed: 10 Mbps now, 0 Mbps max
> LOCAL(vbr0): addr:3c:97:0e:ab:0a:de
> config: 0
> state: 0
> speed: 0 Mbps now, 0 Mbps max
> OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
>
> root at sealion.ine.corp:one # sudo ovs-ofctl dump-flows $BRIDGE_DEV
> NXST_FLOW reply (xid=0x4):
> cookie=0x0, duration=8382.092s, table=0, n_packets=4, n_bytes=240,
> idle_age=8381, priority=40000,in_port=2,dl_src=02:00:0a:00:00:03
> actions=NORMAL
> cookie=0x0, duration=6882.175s, table=0, n_packets=4, n_bytes=240,
> idle_age=6881, priority=40000,in_port=3,dl_src=02:00:0a:00:00:04
> actions=NORMAL
> cookie=0x0, duration=6882.159s, table=0, n_packets=0, n_bytes=0,
> idle_age=6882, priority=39000,in_port=3 actions=drop
> cookie=0x0, duration=8382.072s, table=0, n_packets=0, n_bytes=0,
> idle_age=8382, priority=39000,in_port=2 actions=drop
> cookie=0x0, duration=13024.731s, table=0, n_packets=157158,
> n_bytes=44610731, idle_age=0, priority=0 actions=NORMAL
>
> root at sealion.ine.corp:one # sudo -u oneadmin onehost show 7
> HOST 7 INFORMATION
> ID : 7
> NAME : sealion.ine.corp
> CLUSTER : -
> STATE : MONITORED
> IM_MAD : kvm
> VM_MAD : kvm
> VN_MAD : ovswitch
> LAST MONITORING TIME : 11/20 16:39:02
>
> HOST SHARES
> TOTAL MEM : 31G
> USED MEM (REAL) : 1.6G
> USED MEM (ALLOCATED) : 1.5G
> TOTAL CPU : 800
> USED CPU (REAL) : 7
> USED CPU (ALLOCATED) : 200
> RUNNING VMS : 2
>
> MONITORING INFORMATION
> ARCH="x86_64"
> CPUSPEED="3000"
> FREECPU="792.8"
> FREEMEMORY="30893828"
> HOSTNAME="sealion.ine.corp"
> HYPERVISOR="kvm"
> MODELNAME="Intel(R) Core(TM) i7-3940XM CPU @ 3.00GHz"
> NETRX="0"
> NETTX="0"
> TOTALCPU="800"
> TOTALMEMORY="32557228"
> USEDCPU="7.2000000000000455"
> USEDMEMORY="1663400"
>
> VIRTUAL MACHINES
>
> ID USER GROUP NAME STAT UCPU UMEM HOST
> TIME
> 42 oneadmin oneadmin vyatta-router 32mrunn 0 768M
> sealion.in 0d 16h48
> 43 oneadmin oneadmin vyatta-router-0 32mrunn 0 768M
> sealion.in 0d 16h48
>
> root at sealion.ine.corp:one # sudo -u oneadmin onevm show 23
> VIRTUAL MACHINE 23 INFORMATION
> ID : 23
> NAME : TTYLinux Now
> USER : oneadmin
> GROUP : oneadmin
> STATE : DONE
> LCM_STATE : LCM_INIT
> RESCHED : No
> START TIME : 11/12 14:03:54
> END TIME : 11/12 14:08:22
> DEPLOY ID : -
>
> VIRTUAL MACHINE MONITORING
> USED MEMORY : 0K
> USED CPU : 0
> NET_TX : 0K
> NET_RX : 0K
>
> PERMISSIONS
> OWNER : um-
> GROUP : ---
> OTHER : ---
>
> VM DISKS
> ID TARGET IMAGE TYPE SAVE SAVE_AS
> 0 vda ttylinux-x64-img file NO -
>
> VM NICS
> ID NETWORK VLAN BRIDGE IP MAC
> 0 cloud yes br0 192.168.122.1 02:00:c0:a8:7a:01
> fe80::400:c0ff:fea8:7a01
>
> VIRTUAL MACHINE HISTORY
> SEQ HOST ACTION REAS START TIME PROLOG
> 0 host01 none erro 11/12 14:04:00 0d 00h00m 0h00m01s
>
> USER TEMPLATE
> ERROR="Tue Nov 12 14:04:01 2013 : Error deploying virtual machine: Could
> not create domain from /var/lib/one//datastores/0/23/deployment.0"
>
> VIRTUAL MACHINE TEMPLATE
> CONTEXT=[
> DISK_ID="1",
> HOSTNAME="MAINHOST",
> IMAGE_UNAME="oneadmin",
> IP_GEN="192.168.122.23",
> IP_PRIVATE="192.168.122.1",
> TARGET="vdb" ]
> CPU="0.3"
> FEATURES=[
> ACPI="no" ]
> GRAPHICS=[
> LISTEN="0.0.0.0",
> PORT="5923",
> TYPE="vnc" ]
> MEMORY="128"
> OS=[
> ARCH="x86_64" ]
> TEMPLATE_ID="21"
> VMID="23"
>
> root at sealion.ine.corp:one # sudo -u oneadmin onevm show 24
> VIRTUAL MACHINE 24 INFORMATION
> ID : 24
> NAME : TTYLinux Now
> USER : oneadmin
> GROUP : oneadmin
> STATE : DONE
> LCM_STATE : LCM_INIT
> RESCHED : No
> START TIME : 11/12 14:09:37
> END TIME : 11/12 16:51:41
> DEPLOY ID : one-24
>
> VIRTUAL MACHINE MONITORING
> USED MEMORY : 128M
> USED CPU : 99
> NET_TX : 0K
> NET_RX : 0K
>
> PERMISSIONS
> OWNER : um-
> GROUP : ---
> OTHER : ---
>
> VM DISKS
> ID TARGET IMAGE TYPE SAVE SAVE_AS
> 0 vda ttylinux-x64-img file NO -
>
> VM NICS
> ID NETWORK VLAN BRIDGE IP MAC
> 0 cloud yes br0 192.168.122.1 02:00:c0:a8:7a:01
> fe80::400:c0ff:fea8:7a01
>
> VIRTUAL MACHINE HISTORY
> SEQ HOST ACTION REAS START TIME PROLOG
> 0 host01 none erro 11/12 14:10:00 0d 00h00m 0h00m00s
> 1 host01 delete-recreate user 11/12 14:19:30 0d 02h21m
> 0h00m01s
> 2 host01 stop user 11/12 16:41:00 0d 00h06m 0h00m01s
>
> USER TEMPLATE
> ERROR="Tue Nov 12 14:10:01 2013 : Error deploying virtual machine: Could
> not create domain from /var/lib/one//datastores/0/24/deployment.0"
>
> VIRTUAL MACHINE TEMPLATE a
> CONTEXT=[
> DISK_ID="1",
> HOSTNAME="MAINHOST",
> IMAGE_UNAME="oneadmin",
> IP_GEN="192.168.122.24",
> IP_PRIVATE="192.168.122.1",
> TARGET="vdb" ]
> CPU="0.3"
> FEATURES=[
> ACPI="no" ]
> GRAPHICS=[
> LISTEN="0.0.0.0",
> PORT="5924",
> TYPE="vnc" ]
> MEMORY="128"
> OS=[
> ARCH="x86_64" ]
> TEMPLATE_ID="22"
> VMID="24"
>
> oneadmin at sealion:~ > onevm list
> ID USER GROUP NAME STAT UCPU UMEM
> HOST TIME
> 41 oneadmin oneadmin one-vr42 stop 1 768M 6d
> 00h24
> 42 oneadmin oneadmin vyatta-router runn 0 768M sealion.in
> 0d 16h48
> 43 oneadmin oneadmin vyatta-router-0 runn 0 768M sealion.in
> 0d 16h48
>
> oneadmin at sealion:~ > onevnet show 9
> VIRTUAL NETWORK 9
> INFORMATION
> ID : 9
> NAME : ovsnet_0_0
> USER : oneadmin
> GROUP : oneadmin
> CLUSTER : -
> TYPE : RANGED
> BRIDGE : vbr0
> VLAN : Yes
> VLAN ID : 0
> USED LEASES : 3
>
> PERMISSIONS
>
> OWNER : um-
> GROUP : ---
> OTHER : ---
>
> VIRTUAL NETWORK
> TEMPLATE
> DNS="10.0.0.1"
> GATEWAY="10.0.0.1"
> NETWORK_ADDRESS="10.0.0.0/24"
> NETWORK_MASK="255.255.255.0"
>
> RANGE
>
> IP_START : 10.0.0.1
> IP_END : 10.0.0.254
>
> USED
> LEASES
> LEASE=[ MAC="02:00:0a:00:00:02", IP="10.0.0.2",
> IP6_LINK="fe80::400:aff:fe00:2", USED="1", VID="41" ]
> LEASE=[ MAC="02:00:0a:00:00:03", IP="10.0.0.3",
> IP6_LINK="fe80::400:aff:fe00:3", USED="1", VID="42" ]
> LEASE=[ MAC="02:00:0a:00:00:04", IP="10.0.0.4",
> IP6_LINK="fe80::400:aff:fe00:4", USED="1", VID="43" ]
>
> VIRTUAL MACHINES
>
> ID USER GROUP NAME STAT UCPU UMEM
> HOST TIME
> 41 oneadmin oneadmin one-vr42 stop 1 768M 6d
> 00h26
> 42 oneadmin oneadmin vyatta-router runn 0 768M sealion.in
> 0d 16h48
> 43 oneadmin oneadmin vyatta-router-0 runn 0 768M sealion.in
> 0d 16h48
> oneadmin at sealion:~ > exit
> exit
>
> Script done on Wed 20 Nov 2013 04:59:17 PM EST
>
>
--
Jaime Melis
Project Engineer
OpenNebula - Flexible Enterprise Cloud Made Simple
www.OpenNebula.org | jmelis at opennebula.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20131203/a98c28bd/attachment-0001.htm>
More information about the Users
mailing list