Harald Schmalzbauer
2012-Oct-22 19:33 UTC
kldload if_igb twice needed to bring nic into operation
Hello, when using igb as module, no packet is received. If I send out anything, I see the packet with tcpdump, also the switch learns the MAC address, but nothing comes back in - total silenc, no boradcasts, nothing. If I unload the module and load it again, everything works as expected! No matter if I load it by 4th loader, or later, I always have tio unload first then load it again. I'ts late here, I'll see tomorrow if things change when compieled into kernel. Maby somebody has an idea what the source of the problem could be. Please find atteched some info, the OS is 9-RC2-amd64 on ESXi5.1 and nics are pci-passthrough. -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: igb-info.txt URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20121022/98848ffc/attachment.txt> -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 196 bytes Desc: OpenPGP digital signature URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20121022/98848ffc/attachment.sig>
Harald Schmalzbauer
2012-Oct-22 19:48 UTC
kldload if_igb twice needed to bring nic into operation
schrieb Harald Schmalzbauer am 22.10.2012 21:33 (localtime):> Hello, > > when using igb as module, no packet is received. > If I send out anything, I see the packet with tcpdump, also the switch > learns the MAC address, but nothing comes back in - total silenc, no > boradcasts, nothing. > If I unload the module and load it again, everything works as expected! > No matter if I load it by 4th loader, or later, I always have tio unload > first then load it again. > I'ts late here, I'll see tomorrow if things change when compieled into > kernel. > Maby somebody has an idea what the source of the problem could be. > Please find atteched some info, the OS is 9-RC2-amd64 on ESXi5.1 and > nics are pci-passthrough.I found one possibly relevant difference: Non-Working state: dev.igb.0.link_irq: 0 Working state: dev.igb.0.link_irq: 2 Seems to be reproducable. If I power up the machine and load if_igb for the first time, dev.igb.0.link_irq is always "0" and after unloading and loading again, it's always "2". And tcpdump only captures anything when dev.igb.0.link_irq=2. That's also true for reboot. When I don't power off the machine, just rebooting, packets are passing right from the first kldload!!! Here's the complete dev.igb sysctl after second kldload: dev.igb.0.%desc: Intel(R) PRO/1000 Network Connection version - 2.3.4 dev.igb.0.%driver: igb dev.igb.0.%location: slot=0 function=0 handle=\_SB_.PCI0.PE60.S1F0 dev.igb.0.%pnpinfo: vendor=0x8086 device=0x10c9 subvendor=0x8086 subdevice=0xa03c class=0x020000 dev.igb.0.%parent: pci5 dev.igb.0.nvm: -1 dev.igb.0.enable_aim: 1 dev.igb.0.fc: 3 dev.igb.0.rx_processing_limit: 100 dev.igb.0.link_irq: 2 dev.igb.0.dropped: 0 dev.igb.0.tx_dma_fail: 0 dev.igb.0.rx_overruns: 0 dev.igb.0.watchdog_timeouts: 0 dev.igb.0.device_control: 1488978497 dev.igb.0.rx_control: 67272738 dev.igb.0.interrupt_mask: 4 dev.igb.0.extended_int_mask: 2147483655 dev.igb.0.tx_buf_alloc: 0 dev.igb.0.rx_buf_alloc: 0 dev.igb.0.fc_high_water: 47488 dev.igb.0.fc_low_water: 47472 dev.igb.0.queue0.no_desc_avail: 0 dev.igb.0.queue0.tx_packets: 9 dev.igb.0.queue0.rx_packets: 66 dev.igb.0.queue0.rx_bytes: 5992 dev.igb.0.queue0.lro_queued: 0 dev.igb.0.queue0.lro_flushed: 0 dev.igb.0.queue1.no_desc_avail: 0 dev.igb.0.queue1.tx_packets: 97 dev.igb.0.queue1.rx_packets: 133 dev.igb.0.queue1.rx_bytes: 14907 dev.igb.0.queue1.lro_queued: 0 dev.igb.0.queue1.lro_flushed: 0 dev.igb.0.mac_stats.excess_coll: 0 dev.igb.0.mac_stats.single_coll: 0 dev.igb.0.mac_stats.multiple_coll: 0 dev.igb.0.mac_stats.late_coll: 0 dev.igb.0.mac_stats.collision_count: 0 dev.igb.0.mac_stats.symbol_errors: 0 dev.igb.0.mac_stats.sequence_errors: 0 dev.igb.0.mac_stats.defer_count: 0 dev.igb.0.mac_stats.missed_packets: 0 dev.igb.0.mac_stats.recv_no_buff: 0 dev.igb.0.mac_stats.recv_undersize: 0 dev.igb.0.mac_stats.recv_fragmented: 0 dev.igb.0.mac_stats.recv_oversize: 0 dev.igb.0.mac_stats.recv_jabber: 0 dev.igb.0.mac_stats.recv_errs: 0 dev.igb.0.mac_stats.crc_errs: 0 dev.igb.0.mac_stats.alignment_errs: 0 dev.igb.0.mac_stats.coll_ext_errs: 0 dev.igb.0.mac_stats.xon_recvd: 0 dev.igb.0.mac_stats.xon_txd: 0 dev.igb.0.mac_stats.xoff_recvd: 0 dev.igb.0.mac_stats.xoff_txd: 0 dev.igb.0.mac_stats.total_pkts_recvd: 770 dev.igb.0.mac_stats.good_pkts_recvd: 191 dev.igb.0.mac_stats.bcast_pkts_recvd: 44 dev.igb.0.mac_stats.mcast_pkts_recvd: 19 dev.igb.0.mac_stats.rx_frames_64: 95 dev.igb.0.mac_stats.rx_frames_65_127: 74 dev.igb.0.mac_stats.rx_frames_128_255: 14 dev.igb.0.mac_stats.rx_frames_256_511: 5 dev.igb.0.mac_stats.rx_frames_512_1023: 3 dev.igb.0.mac_stats.rx_frames_1024_1522: 0 dev.igb.0.mac_stats.good_octets_recvd: 21099 dev.igb.0.mac_stats.good_octets_txd: 24521 dev.igb.0.mac_stats.total_pkts_txd: 101 dev.igb.0.mac_stats.good_pkts_txd: 101 dev.igb.0.mac_stats.bcast_pkts_txd: 3 dev.igb.0.mac_stats.mcast_pkts_txd: 0 dev.igb.0.mac_stats.tx_frames_64: 6 dev.igb.0.mac_stats.tx_frames_65_127: 24 dev.igb.0.mac_stats.tx_frames_128_255: 57 dev.igb.0.mac_stats.tx_frames_256_511: 3 dev.igb.0.mac_stats.tx_frames_512_1023: 7 dev.igb.0.mac_stats.tx_frames_1024_1522: 4 dev.igb.0.mac_stats.tso_txd: 4 dev.igb.0.mac_stats.tso_ctx_fail: 0 dev.igb.0.interrupts.asserts: 1653 dev.igb.0.interrupts.rx_pkt_timer: 191 dev.igb.0.interrupts.rx_abs_timer: 0 dev.igb.0.interrupts.tx_pkt_timer: 0 dev.igb.0.interrupts.tx_abs_timer: 191 dev.igb.0.interrupts.tx_queue_empty: 101 dev.igb.0.interrupts.tx_queue_min_thresh: 0 dev.igb.0.interrupts.rx_desc_min_thresh: 0 dev.igb.0.interrupts.rx_overrun: 0 dev.igb.0.host.breaker_tx_pkt: 0 dev.igb.0.host.host_tx_pkt_discard: 0 dev.igb.0.host.rx_pkt: 0 dev.igb.0.host.breaker_rx_pkts: 0 dev.igb.0.host.breaker_rx_pkt_drop: 0 dev.igb.0.host.tx_good_pkt: 0 dev.igb.0.host.breaker_tx_pkt_drop: 0 dev.igb.0.host.rx_good_bytes: 21099 dev.igb.0.host.tx_good_bytes: 24521 dev.igb.0.host.length_errors: 0 dev.igb.0.host.serdes_violation_pkt: 0 dev.igb.0.host.header_redir_missed: 0 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 196 bytes Desc: OpenPGP digital signature URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20121022/4a729d7a/attachment.sig>