Michel Schuster
2008-Jan-30 14:40 UTC
[crossbow-discuss] vnic on top of aggr of 2 x 1 Gbit/s NICs
Hi, Can you tell why my vnic built on top of an aggregation of 2 NICs of 1 Gbit/s doesn''t report a speed of 2 GBit/s ? [root at nazgul /]# dladm show-dev bge0 link: up speed: 1000Mb duplex: full bge1 link: down speed: 0Mb duplex: unknown bge2 link: down speed: 0Mb duplex: unknown bge3 link: down speed: 0Mb duplex: unknown --- Aggregation creation: bge1 & bge2 aggregated, BW = 2 Gbps --- [root at nazgul /]# dladm create-aggr -d bge1 -d bge2 1 [root at nazgul /]# dladm show-link bge0 type: non-vlan mtu: 1500 device: bge0 bge1 type: non-vlan mtu: 1500 device: bge1 bge2 type: non-vlan mtu: 1500 device: bge2 bge3 type: non-vlan mtu: 1500 device: bge3 aggr1 type: non-vlan mtu: 1500 aggregation: key 1 --- Create Virtual NIC on top of this aggregation --- [root at nazgul /]# dladm create-vnic -d aggr1 1 [root at nazgul /]# dladm show-link bge0 type: non-vlan mtu: 1500 device: bge0 bge1 type: non-vlan mtu: 1500 device: bge1 bge2 type: non-vlan mtu: 1500 device: bge2 bge3 type: non-vlan mtu: 1500 device: bge3 aggr1 type: non-vlan mtu: 1500 aggregation: key 1 vnic1 type: non-vlan mtu: 1500 device: vnic1 --- Assign IP address to the vnic --- [root at nazgul /]# ifconfig vnic1 10.1.28.16 netmask 255.255.255.0 [root at nazgul /]# ifconfig vnic1 up [root at nazgul /]# ifconfig -a lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 bge0: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 2 inet 10.1.28.15 netmask ff000000 broadcast 10.255.255.255 ether 0:3:ba:50:ab:8d vnic1: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 6 inet 10.1.28.16 netmask ffffff00 broadcast 10.1.28.255 ether 2:8:20:a1:30:74 [root at nazgul /]# ping 10.1.28.16 10.1.28.16 is alive --- Retrieve speed of vnic1 --- [root at nazgul /]# dladm show-vnic device speed vnic1 aggr1 1000 Mbps mac: 2:8:20:a1:30:74 (random) [root at nazgul /]# dladm show-aggr key: 1 (0x0001) policy: L4 address: 0:3:ba:50:ab:8e (auto) device address speed duplex link state bge1 0:3:ba:50:ab:8e 1000Mb full up attached bge2 0:3:ba:50:ab:8f 1000Mb full up attached --- Platform details [root at nazgul /]# cat /etc/release Solaris Nevada snv_61-xb_15 SPARC Copyright 2007 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 05 September 2007 [root at nazgul /]# uname -a SunOS nazgul 5.11 snv_61-xb_15 sun4u sparc SUNW,Sun-Fire-V240 This message posted from opensolaris.org
Michel Schuster
2008-Jan-31 18:14 UTC
[crossbow-discuss] vnic on top of aggr of 2 x 1 Gbit/s NICs
Hi again, I was wondering if I there is no mistake in my analysis: [root at nazgul /]# dladm show-vnic device speed vnic1 aggr1 1000 Mbps mac: 2:8:20:a1:30:74 (random) Maybe there is a confusion between link speed and bandwidth. Btw, the 2 Gbit/s bandwidth is only available in case of several sockets established. One single connection could not take 2 Gbit/s, rather, in case of link aggregation, it would take the whole bandwidth of one interface, ie 1 Gbit/s. Can someone confirm or update this new analysis ? Thanks This message posted from opensolaris.org
Nicolas Droux
2008-Feb-04 21:10 UTC
[crossbow-discuss] vnic on top of aggr of 2 x 1 Gbit/s NICs
Michel Schuster wrote:> Hi, > > Can you tell why my vnic built on top of an aggregation of 2 NICs of 1 Gbit/s doesn''t report a speed of 2 GBit/s ?Two things: 1) aggr doesn''t report the sum of the link speed of its constituent ports, it returns the link speed of its constituent ports. 2) keep in mind that aggr in crossbow-gate was not yet ported to the Crossbow virtualized MAC, so it is not yet functional, even though dladm *-aggr commands may succeed. Nicolas.> > [root at nazgul /]# dladm show-dev > bge0 link: up speed: 1000Mb duplex: full > bge1 link: down speed: 0Mb duplex: unknown > bge2 link: down speed: 0Mb duplex: unknown > bge3 link: down speed: 0Mb duplex: unknown > --- > Aggregation creation: bge1 & bge2 aggregated, BW = 2 Gbps > --- > [root at nazgul /]# dladm create-aggr -d bge1 -d bge2 1 > [root at nazgul /]# dladm show-link > bge0 type: non-vlan mtu: 1500 device: bge0 > bge1 type: non-vlan mtu: 1500 device: bge1 > bge2 type: non-vlan mtu: 1500 device: bge2 > bge3 type: non-vlan mtu: 1500 device: bge3 > aggr1 type: non-vlan mtu: 1500 aggregation: key 1 > --- > Create Virtual NIC on top of this aggregation > --- > [root at nazgul /]# dladm create-vnic -d aggr1 1 > [root at nazgul /]# dladm show-link > bge0 type: non-vlan mtu: 1500 device: bge0 > bge1 type: non-vlan mtu: 1500 device: bge1 > bge2 type: non-vlan mtu: 1500 device: bge2 > bge3 type: non-vlan mtu: 1500 device: bge3 > aggr1 type: non-vlan mtu: 1500 aggregation: key 1 > vnic1 type: non-vlan mtu: 1500 device: vnic1 > --- > Assign IP address to the vnic > --- > [root at nazgul /]# ifconfig vnic1 10.1.28.16 netmask 255.255.255.0 > [root at nazgul /]# ifconfig vnic1 up > [root at nazgul /]# ifconfig -a > lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1 > inet 127.0.0.1 netmask ff000000 > bge0: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 2 > inet 10.1.28.15 netmask ff000000 broadcast 10.255.255.255 > ether 0:3:ba:50:ab:8d > vnic1: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 6 > inet 10.1.28.16 netmask ffffff00 broadcast 10.1.28.255 > ether 2:8:20:a1:30:74 > [root at nazgul /]# ping 10.1.28.16 > 10.1.28.16 is alive > --- > Retrieve speed of vnic1 > --- > [root at nazgul /]# dladm show-vnic > device speed > vnic1 aggr1 1000 Mbps mac: 2:8:20:a1:30:74 (random) > [root at nazgul /]# dladm show-aggr > key: 1 (0x0001) policy: L4 address: 0:3:ba:50:ab:8e (auto) > device address speed duplex link state > bge1 0:3:ba:50:ab:8e 1000Mb full up attached > bge2 0:3:ba:50:ab:8f 1000Mb full up attached > > --- Platform details > [root at nazgul /]# cat /etc/release > Solaris Nevada snv_61-xb_15 SPARC > Copyright 2007 Sun Microsystems, Inc. All Rights Reserved. > Use is subject to license terms. > Assembled 05 September 2007 > [root at nazgul /]# uname -a > SunOS nazgul 5.11 snv_61-xb_15 sun4u sparc SUNW,Sun-Fire-V240 > > > This message posted from opensolaris.org > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss-- Nicolas Droux - Solaris Networking - Sun Microsystems, Inc. nicolas.droux at sun.com - http://blogs.sun.com/droux