<div dir="ltr">Hi Mark,<div><br></div><div>there should be more info in the log file at /var/log/one/24.log</div><div><br></div><div>what does it say there?</div><div><br></div><div>cheers,<br>Jaime</div></div><div class="gmail_extra">

<br><br><div class="gmail_quote">On Wed, Nov 20, 2013 at 11:08 PM, Mark Biggers <span dir="ltr"><<a href="mailto:mbiggers@ine.com" target="_blank">mbiggers@ine.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">



  
  <div bgcolor="#FFFFFF" text="#000000">
    <div>Hello ONE team,<br>
      <br>
      I have "passed" on the ebtables configuration for networking in
      4.2 ONE.   We'll need OpenVSwitch anyways to manage the VMs VLANS,
      so I have moved on.<br>
      <br>
      I *think* I have an almost working OpenVSwitch configuration.  
      Must I manually create "flows" for each VM/MAC-addr to enable IP
      traffic, across the OVS "vbridge" (vbr0), in this case?<br>
      <br>
      The info on my new (OVS networking) setup, is included, at the end
      of this message.  Thank you.  (The platform is still openSUSE 12.3
      on a Thinkpad W530...)<br>
      <br>
      <br>
      On 11/19/2013 05:43 AM, Jaime Melis wrote:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="ltr">Hi Mark,
        <div><br>
        </div>
        <div>I have the feeling the NAT policies are interfering with
          this. Can you try without applying NAT rules?</div>
      </div>
      <div class="gmail_extra"><br>
        <br>
        <div class="gmail_quote">On Wed, Nov 13, 2013 at 9:08 PM, Mark
          Biggers <span dir="ltr">
            <<a href="mailto:mbiggers@ine.com" target="_blank">mbiggers@ine.com</a>></span> wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            The subject says it all.  I am available on IRC -- see my
            signature, and Google chat.<br>
            <br>
            I can get no "networking across a bridge" working, for the
            ONE "ebtables" model.<br>
          </blockquote>
        </div>
      </div>
    </blockquote>
    <blockquote type="cite">
      <div class="gmail_extra">
        <div class="gmail_quote">
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <br>
            =============== edited out....<br clear="all">
          </blockquote>
        </div>
        <div><br>
        </div>
        -- <br>
        <div dir="ltr">
          <div>Jaime Melis<br>
            Project Engineer<br>
            OpenNebula - Flexible Enterprise Cloud Made Simple<br>
            <a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:jmelis@opennebula.org" target="_blank">
              jmelis@opennebula.org</a></div>
        </div>
      </div>
    </blockquote>
    <br>
    <tt>Script started on Wed Nov 20 16:27:05 2013<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # netstat -nr<br>
      Kernel IP routing table<br>
      Destination    Gateway        Genmask        Flags    MSS Window 
      irtt Iface<br>
      0.0.0.0        192.168.1.1    0.0.0.0        UG      0 0          
      0 vbr0<br>
      67.139.46.149    192.168.1.1    255.255.255.255 UGH      0 0   
             0 vbr0<br>
      127.0.0.0    0.0.0.0        255.255.255.0    U      0 0          
      0 lo<br>
      127.0.0.0    0.0.0.0        255.0.0.0    U      0 0           0 lo<br>
      192.168.1.0    0.0.0.0        255.255.255.0    U      0 0   
             0 vbr0<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # ip addr<br>
      1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state
      UNKNOWN<br>
          link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00<br>
          inet <a href="http://127.0.0.1/8" target="_blank">127.0.0.1/8</a> brd 127.255.255.255 scope host lo<br>
      2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
      pfifo_fast state UP qlen 1000<br>
          link/ether 3c:97:0e:ab:0a:de brd ff:ff:ff:ff:ff:ff<br>
      3: wlan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state
      DOWN qlen 1000<br>
          link/ether 6c:88:14:da:0b:44 brd ff:ff:ff:ff:ff:ff<br>
      4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop
      state DOWN<br>
          link/ether 0a:0e:fd:bb:5a:8a brd ff:ff:ff:ff:ff:ff<br>
      7: vbr0: <BROADCAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc
      noqueue state UNKNOWN<br>
          link/ether 3c:97:0e:ab:0a:de brd ff:ff:ff:ff:ff:ff<br>
          inet <a href="http://192.168.1.250/24" target="_blank">192.168.1.250/24</a> scope global vbr0<br>
      12: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
      pfifo_fast state UNKNOWN qlen 500<br>
          link/ether fe:00:0a:00:00:03 brd ff:ff:ff:ff:ff:ff<br>
      13: vnet1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
      pfifo_fast state UNKNOWN qlen 500<br>
          link/ether fe:00:0a:00:00:04 brd ff:ff:ff:ff:ff:ff<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # BRIDGE_DEV=vbr0<br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo ovs-ofctl dump-desc $BRIDGE_DEV<br>
      OFPST_DESC reply (xid=0x2):<br>
      Manufacturer: Nicira, Inc.<br>
      Hardware: Open vSwitch<br>
      Software: 1.11.0<br>
      Serial Num: None<br>
      DP Description: None<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo ovs-vsctl show<br>
      001119d6-32d7-4db8-8015-229b271cca6a<br>
          Bridge "vbr0"<br>
          Controller "ptcp:"<br>
          fail_mode: standalone<br>
          Port "vnet0"<br>
              tag: 0<br>
              Interface "vnet0"<br>
          Port "vnet1"<br>
              tag: 0<br>
              Interface "vnet1"<br>
          Port "eth0"<br>
              Interface "eth0"<br>
          Port "vbr0"<br>
              Interface "vbr0"<br>
              type: internal<br>
          ovs_version: "1.11.0"<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo ovs-ofctl show $BRIDGE_DEV<br>
      OFPT_FEATURES_REPLY (xid=0x2): dpid:00003c970eab0ade<br>
      n_tables:254, n_buffers:256<br>
      capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS
      ARP_MATCH_IP<br>
      actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC
      SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST
      ENQUEUE<br>
       1(eth0): addr:3c:97:0e:ab:0a:de<br>
           config:     0<br>
           state:     STP_FORWARD<br>
           current:     1GB-FD COPPER AUTO_NEG<br>
           advertised: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD COPPER
      AUTO_NEG<br>
           supported:     10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-FD
      COPPER AUTO_NEG<br>
           speed: 1000 Mbps now, 1000 Mbps max<br>
       2(vnet0): addr:fe:00:0a:00:00:03<br>
           config:     0<br>
           state:     0<br>
           current:     10MB-FD COPPER<br>
           speed: 10 Mbps now, 0 Mbps max<br>
       3(vnet1): addr:fe:00:0a:00:00:04<br>
           config:     0<br>
           state:     0<br>
           current:     10MB-FD COPPER<br>
           speed: 10 Mbps now, 0 Mbps max<br>
       LOCAL(vbr0): addr:3c:97:0e:ab:0a:de<br>
           config:     0<br>
           state:     0<br>
           speed: 0 Mbps now, 0 Mbps max<br>
      OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo ovs-ofctl dump-flows $BRIDGE_DEV<br>
      NXST_FLOW reply (xid=0x4):<br>
       cookie=0x0, duration=8382.092s, table=0, n_packets=4,
      n_bytes=240, idle_age=8381,
      priority=40000,in_port=2,dl_src=02:00:0a:00:00:03 actions=NORMAL<br>
       cookie=0x0, duration=6882.175s, table=0, n_packets=4,
      n_bytes=240, idle_age=6881,
      priority=40000,in_port=3,dl_src=02:00:0a:00:00:04 actions=NORMAL<br>
       cookie=0x0, duration=6882.159s, table=0, n_packets=0, n_bytes=0,
      idle_age=6882, priority=39000,in_port=3 actions=drop<br>
       cookie=0x0, duration=8382.072s, table=0, n_packets=0, n_bytes=0,
      idle_age=8382, priority=39000,in_port=2 actions=drop<br>
       cookie=0x0, duration=13024.731s, table=0, n_packets=157158,
      n_bytes=44610731, idle_age=0, priority=0 actions=NORMAL<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo -u oneadmin onehost show 7<br>
      HOST 7 INFORMATION                                    <br>
      ID              : 7<br>
      NAME              : sealion.ine.corp<br>
      CLUSTER              : -<br>
      STATE              : MONITORED<br>
      IM_MAD              : kvm<br>
      VM_MAD              : kvm<br>
      VN_MAD              : ovswitch<br>
      LAST MONITORING TIME  : 11/20 16:39:02<br>
      <br>
      HOST SHARES                                      <br>
      TOTAL MEM          : 31G<br>
      USED MEM (REAL)          : 1.6G<br>
      USED MEM (ALLOCATED)  : 1.5G<br>
      TOTAL CPU          : 800<br>
      USED CPU (REAL)          : 7<br>
      USED CPU (ALLOCATED)  : 200<br>
      RUNNING VMS          : 2<br>
      <br>
      MONITORING INFORMATION                              <br>
      ARCH="x86_64"<br>
      CPUSPEED="3000"<br>
      FREECPU="792.8"<br>
      FREEMEMORY="30893828"<br>
      HOSTNAME="sealion.ine.corp"<br>
      HYPERVISOR="kvm"<br>
      MODELNAME="Intel(R) Core(TM) i7-3940XM CPU @ 3.00GHz"<br>
      NETRX="0"<br>
      NETTX="0"<br>
      TOTALCPU="800"<br>
      TOTALMEMORY="32557228"<br>
      USEDCPU="7.2000000000000455"<br>
      USEDMEMORY="1663400"<br>
      <br>
      VIRTUAL MACHINES<br>
      <br>
          ID USER        GROUP    NAME         STAT UCPU      UMEM
      HOST        TIME<br>
          42 oneadmin oneadmin vyatta-router     32mrunn    0       768M
      <a href="http://sealion.in" target="_blank">sealion.in</a>   0d 16h48<br>
          43 oneadmin oneadmin vyatta-router-0 32mrunn    0       768M
      <a href="http://sealion.in" target="_blank">sealion.in</a>   0d 16h48<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo -u oneadmin onevm show 23<br>
      VIRTUAL MACHINE 23 INFORMATION                            <br>
      ID            : 23<br>
      NAME            : TTYLinux Now<br>
      USER            : oneadmin<br>
      GROUP            : oneadmin<br>
      STATE            : DONE<br>
      LCM_STATE        : LCM_INIT<br>
      RESCHED            : No<br>
      START TIME        : 11/12 14:03:54<br>
      END TIME        : 11/12 14:08:22<br>
      DEPLOY ID        : -<br>
      <br>
      VIRTUAL MACHINE MONITORING                              <br>
      USED MEMORY        : 0K<br>
      USED CPU        : 0<br>
      NET_TX            : 0K<br>
      NET_RX            : 0K<br>
      <br>
      PERMISSIONS                                      <br>
      OWNER            : um-<br>
      GROUP            : ---<br>
      OTHER            : ---<br>
      <br>
      VM DISKS                                      <br>
       ID TARGET IMAGE                   TYPE SAVE SAVE_AS<br>
        0 vda       ttylinux-x64-img               file   NO       -<br>
      <br>
      VM NICS                                      <br>
       ID NETWORK             VLAN BRIDGE       IP           MAC       
      <br>
        0 cloud          yes br0       192.168.122.1   02:00:c0:a8:7a:01<br>
                             fe80::400:c0ff:fea8:7a01<br>
      <br>
      VIRTUAL MACHINE HISTORY                              <br>
      SEQ HOST        ACTION         REAS        START         TIME    
      PROLOG<br>
        0 host01        none         erro  11/12 14:04:00   0d 00h00m   
      0h00m01s<br>
      <br>
      USER TEMPLATE                                      <br>
      ERROR="Tue Nov 12 14:04:01 2013 : Error deploying virtual machine:
      Could not create domain from
      /var/lib/one//datastores/0/23/deployment.0"<br>
      <br>
      VIRTUAL MACHINE TEMPLATE                              <br>
      CONTEXT=[<br>
        DISK_ID="1",<br>
        HOSTNAME="MAINHOST",<br>
        IMAGE_UNAME="oneadmin",<br>
        IP_GEN="192.168.122.23",<br>
        IP_PRIVATE="192.168.122.1",<br>
        TARGET="vdb" ]<br>
      CPU="0.3"<br>
      FEATURES=[<br>
        ACPI="no" ]<br>
      GRAPHICS=[<br>
        LISTEN="0.0.0.0",<br>
        PORT="5923",<br>
        TYPE="vnc" ]<br>
      MEMORY="128"<br>
      OS=[<br>
        ARCH="x86_64" ]<br>
      TEMPLATE_ID="21"<br>
      VMID="23"<br>
      <br>
      <a href="mailto:root@sealion.ine.corp:one" target="_blank">root@sealion.ine.corp:one</a> # sudo -u oneadmin onevm show 24<br>
      VIRTUAL MACHINE 24 INFORMATION                            <br>
      ID            : 24<br>
      NAME            : TTYLinux Now<br>
      USER            : oneadmin<br>
      GROUP            : oneadmin<br>
      STATE            : DONE<br>
      LCM_STATE        : LCM_INIT<br>
      RESCHED            : No<br>
      START TIME        : 11/12 14:09:37<br>
      END TIME        : 11/12 16:51:41<br>
      DEPLOY ID        : one-24<br>
      <br>
      VIRTUAL MACHINE MONITORING                              <br>
      USED MEMORY        : 128M<br>
      USED CPU        : 99<br>
      NET_TX            : 0K<br>
      NET_RX            : 0K<br>
      <br>
      PERMISSIONS                                      <br>
      OWNER            : um-<br>
      GROUP            : ---<br>
      OTHER            : ---<br>
      <br>
      VM DISKS                                      <br>
       ID TARGET IMAGE                   TYPE SAVE SAVE_AS<br>
        0 vda       ttylinux-x64-img               file   NO       -<br>
      <br>
      VM NICS                                      <br>
       ID NETWORK             VLAN BRIDGE       IP           MAC       
      <br>
        0 cloud          yes br0       192.168.122.1   02:00:c0:a8:7a:01<br>
                             fe80::400:c0ff:fea8:7a01<br>
      <br>
      VIRTUAL MACHINE HISTORY                              <br>
      SEQ HOST        ACTION         REAS        START         TIME    
      PROLOG<br>
        0 host01        none         erro  11/12 14:10:00   0d 00h00m   
      0h00m00s<br>
        1 host01        delete-recreate  user  11/12 14:19:30   0d
      02h21m    0h00m01s<br>
        2 host01        stop         user  11/12 16:41:00   0d 00h06m   
      0h00m01s<br>
      <br>
      USER TEMPLATE                                      <br>
      ERROR="Tue Nov 12 14:10:01 2013 : Error deploying virtual machine:
      Could not create domain from
      /var/lib/one//datastores/0/24/deployment.0"<br>
      <br>
      VIRTUAL MACHINE TEMPLATE                              a<br>
      CONTEXT=[<br>
        DISK_ID="1",<br>
        HOSTNAME="MAINHOST",<br>
        IMAGE_UNAME="oneadmin",<br>
        IP_GEN="192.168.122.24",<br>
        IP_PRIVATE="192.168.122.1",<br>
        TARGET="vdb" ]<br>
      CPU="0.3"<br>
      FEATURES=[<br>
        ACPI="no" ]<br>
      GRAPHICS=[<br>
        LISTEN="0.0.0.0",<br>
        PORT="5924",<br>
        TYPE="vnc" ]<br>
      MEMORY="128"<br>
      OS=[<br>
        ARCH="x86_64" ]<br>
      TEMPLATE_ID="22"<br>
      VMID="24"<br>
      <br>
      oneadmin@sealion:~ > onevm list<br>
          ID USER     GROUP    NAME            STAT UCPU    UMEM
      HOST             TIME<br>
          41 oneadmin oneadmin one-vr42        stop    1   
      768M              6d 00h24<br>
          42 oneadmin oneadmin vyatta-router   runn    0    768M
      <a href="http://sealion.in" target="_blank">sealion.in</a>   0d 16h48<br>
          43 oneadmin oneadmin vyatta-router-0 runn    0    768M
      <a href="http://sealion.in" target="_blank">sealion.in</a>   0d 16h48<br>
      <br>
      oneadmin@sealion:~ > onevnet show 9<br>
      VIRTUAL NETWORK 9
      INFORMATION                                                   <br>
      ID             : 9                   <br>
      NAME           : ovsnet_0_0          <br>
      USER           : oneadmin            <br>
      GROUP          : oneadmin            <br>
      CLUSTER        : -                   <br>
      TYPE           : RANGED              <br>
      BRIDGE         : vbr0                <br>
      VLAN           : Yes                 <br>
      VLAN ID        : 0                   <br>
      USED LEASES    : 3                   <br>
      <br>
      PERMISSIONS                                                                    
      <br>
      OWNER          : um-                 <br>
      GROUP          : ---                 <br>
      OTHER          : ---                 <br>
      <br>
      VIRTUAL NETWORK
      TEMPLATE                                                        <br>
      DNS="10.0.0.1"<br>
      GATEWAY="10.0.0.1"<br>
      NETWORK_ADDRESS="<a href="http://10.0.0.0/24" target="_blank">10.0.0.0/24</a>"<br>
      NETWORK_MASK="255.255.255.0"<br>
      <br>
      RANGE                                                                          
      <br>
      IP_START       : 10.0.0.1            <br>
      IP_END         : 10.0.0.254          <br>
      <br>
      USED
      LEASES                                                                    
      <br>
      LEASE=[ MAC="02:00:0a:00:00:02", IP="10.0.0.2",
      IP6_LINK="fe80::400:aff:fe00:2", USED="1", VID="41" ]<br>
      LEASE=[ MAC="02:00:0a:00:00:03", IP="10.0.0.3",
      IP6_LINK="fe80::400:aff:fe00:3", USED="1", VID="42" ]<br>
      LEASE=[ MAC="02:00:0a:00:00:04", IP="10.0.0.4",
      IP6_LINK="fe80::400:aff:fe00:4", USED="1", VID="43" ]<br>
      <br>
      VIRTUAL MACHINES<br>
      <br>
          ID USER     GROUP    NAME            STAT UCPU    UMEM
      HOST             TIME<br>
          41 oneadmin oneadmin one-vr42        stop    1   
      768M              6d 00h26<br>
          42 oneadmin oneadmin vyatta-router   runn    0    768M
      <a href="http://sealion.in" target="_blank">sealion.in</a>   0d 16h48<br>
          43 oneadmin oneadmin vyatta-router-0 runn    0    768M
      <a href="http://sealion.in" target="_blank">sealion.in</a>   0d 16h48<br>
      oneadmin@sealion:~ > exit<br>
      exit<br>
      <br>
      Script done on Wed 20 Nov 2013 04:59:17 PM EST<br>
    </tt><br>
  </div>

</blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div>Jaime Melis<br>Project Engineer<br>OpenNebula - Flexible Enterprise Cloud Made Simple<br><a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | <a href="mailto:jmelis@opennebula.org" target="_blank">jmelis@opennebula.org</a></div>

</div>
</div>