Ok we have a weird one. We are trying to upgrade to a CWDM 10gb ethernet link to the UBR.
This is being fed by a Cisco 6504 Core router with 10gb cwdm interface. The link is Up/Up but WILL NOT pass traffic. If I put IP's on both sides I can ping the local but not the remote. When looking at the stats on the interfaces if I Ping from the UBR the 6504 counters don't increment, if I ping from the 6504 the ubr counters do increment. So the UBR is hearing the 6504 but the replies are failing. It was brought to my attention that there is a WL version of the SPA and it can do WAN-PHY as well as LAN-PHY, but the L version is only LAN-PHY supposedly. I have no ability to configure the card but it appears they wont talk. Thoughts? Ideas? Here is an article I found that sort of addresses the issue http://alexey.mezhuev.com/?x=entry:entry190116-194333
TenGigabitEthernet1/2/0 is up, line protocol is up
Hardware is TenGigEther SPA, address is 0012.43a9.86d0 (bia 0012.43a9.86d0)
Internet address is 10.123.223.2/24
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full Duplex, 10000Mbps, link type is force-up, media type is 10GBase-ER
output flow-control is on, input flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:41, output 00:00:06, output hang never
Last clearing of "show interface" counters 18:18:21
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Interface TenGigabitEthernet1/2/0 queueing strategy: PXF Class-based
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
1225 packets input, 515140 bytes, 0 no buffer
Received 1225 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 1220 multicast, 0 pause input
7703 packets output, 861427 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
TenGigabitEthernet4/2 is up, line protocol is up (connected)
Hardware is C6k 10000Mb 802.3, address is 0021.a051.1840 (bia 0021.a051.1840)
Internet address is 10.123.223.1/24
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, media type is 10Gbase-ER
input flow-control is off, output flow-control is off
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:10, output 00:00:10, output hang never
Last clearing of "show interface" counters 18:19:54
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 115 pkt, 9230 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
1337 packets input, 529802 bytes, 0 no buffer
Received 1337 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
1337 packets output, 529802 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out
Not sure if CWDM is supported ?
Table 3 says LR, ER, ZR, SR, DWDM
https://www.cisco.com/c/en/us/td/docs/interfaces_modules/shared_port_ada...
So the xfp shows up as er, and the link is up, it's just packet size issue due to this wan crap. I can try and do a local mm to a switch and then the cwdm. the cwdm module just acts like an er or zr.. no other thoughts about weird configs eh..
This does not sound good "link type is force-up"
Have you disabled autoneg or somesuch?
Can you post "sh run int ten1/2/0"
I played with flow control etc, there is no autonegotation and I here what your saying about force-up. Also I turned on CDP and they see each other with cdp but can't move IP....
show run int ten 1/2/0
Building configuration...
Current configuration : 148 bytes
!
interface TenGigabitEthernet1/2/0
description uplink
ip address 10.123.223.2 255.255.255.0
flowcontrol receive off
cdp enable
end
A few other random ideas :
What version IOS ?
Does this card work OK with non-CWDM XFP ?
Tried a different SIP / SPA slot ?
FPD firmware happy? "show hw-module all fpd"
Any useful info from controller? "show controllers ten1/2/0"
Any errors in the SIP-600 console logs? "show diag 1/0 conlog"
Looks like it will work with a multi mode xfp to a switch that has the cwdm in it..