简介
本文档介绍当发生位/字错误问题时,应验证为支持的交换机/模块/SFP和电缆的类型。
作者:Afroj Ahmad和Ed Mazurek,Cisco TAC工程师。
思科多层数据交换机(MDS)9000系列可插拔收发器产品手册
https://www.cisco.com/c/en/us/products/collateral/storage-networking/mds-9000-series-multilayer-switches/product_data_sheet09186a00801bc698.html?dtid=osscdc000283
首先,确定所涉及的电缆的确切数量、长度和类型(OM2、OM3等),以及其中的配线面板数量。
SFP实际上显示了其功能:
对于短波SFP
F241-15-09-MDS9710# show interface fc1/4 transceiver details
fc1/4 sfp is present
Name is CISCO-AVAGO
Manufacturer's part number is AFBR-57F5PZ-CS1
Revision is B2
Serial number is AVA1551J9KF
Cisco part number is 10-2666-01
Cisco pid is DS-SFP-FC16G-SW
FC Transmitter type is short wave laser w/o OFC (SN)
FC Transmitter supports short distance link length
Transmission medium is multimode laser with 62.5 um aperture (M6)
Supported speeds are - Min speed: 4000 Mb/s, Max speed: 16000 Mb/s
Nominal bit rate is 14000 Mb/s
Link length supported for 50/125um OM2 fiber is 35 m
Link length supported for 62.5/125um fiber is 15 m
Link length supported for 50/125um OM3 fiber is 100 m
Cisco extended id is unknown (0x0)
No tx fault, no rx loss, in sync state, diagnostic monitoring type is 0x68
SFP Diagnostics Information:
----------------------------------------------------------------------------
Alarms Warnings
High Low High Low
----------------------------------------------------------------------------
Temperature 33.48 C 75.00 C -5.00 C 70.00 C 0.00 C
Voltage 3.29 V 3.63 V 2.97 V 3.46 V 3.13 V
Current 7.46 mA 10.50 mA 2.50 mA 10.50 mA 2.50 mA
Tx Power -2.54 dBm 1.70 dBm -13.00 dBm -1.30 dBm -9.00 dBm
Rx Power -2.32 dBm 3.00 dBm -15.90 dBm 0.00 dBm -11.90 dBm
Transmit Fault Count = 0
----------------------------------------------------------------------------
Note: ++ high-alarm; + high-warning; -- low-alarm; - low-warning
F241-15-09-MDS9710#
以上表明SFP的类型是DS-SFP-FC16G-SW,最大长度为100米,采用50/125um(mIcron)OM3布线。
对于长波SFP
F241-15-09-MDS9710# show interface fc9/1 transceiver details
fc9/1 sfp is present
Name is CISCO-FINISAR
Manufacturer's part number is FTLF1432P3BCV-C1
Revision is B
Serial number is FNS21190B7F
Cisco part number is 10-3207-01
Cisco pid is DS-SFP-FC32G LW
FC Transmitter type is long wave laser cost reduced
FC Transmitter supports long distance link length
Transmission medium is single mode (SM) laser
Supported speeds are - Min speed: 8000 Mb/s, Max speed: 32000 Mb/s
Nominal bit rate is 28000 Mb/s
Link length supported for 9/125um fiber is 10 km
Cisco extended id is unknown (0x0)
No tx fault, no rx loss, in sync state, diagnostic monitoring type is 0x68
SFP Diagnostics Information:
----------------------------------------------------------------------------
Alarms Warnings
High Low High Low
----------------------------------------------------------------------------
Temperature 32.52 C 75.00 C -5.00 C 70.00 C 0.00 C
Voltage 3.37 V 3.63 V 2.97 V 3.46 V 3.13 V
Current 38.55 mA 70.00 mA 1.00 mA 68.00 mA 2.00 mA
Tx Power 0.49 dBm 5.00 dBm -12.40 dBm 2.00 dBm -8.40 dBm
Rx Power -7.43 dBm 5.00 dBm -18.01 dBm 2.00 dBm -14.00 dBm
Transmit Fault Count = 0
----------------------------------------------------------------------------
Note: ++ high-alarm; + high-warning; -- low-alarm; - low-warning
F241-15-09-MDS9710#
以上表明SFP的类型为DS-SFP-FC32G-LW,最大长度为10KM。
注意:图中所示的长度是在完美条件下的最大长度。配线面板和路径中附加的光纤长度可缩短距离,有时会显着缩短。
配线面板和其他中间连接通常是问题的根源。您应始终尝试消除这些作为诊断步骤。确保以系统化的方式完成此操作,每次更改的结果均记录在案。
注意上述输出中的Rx功率在可接受的范围内:
-18.01 dBm -14.00 dBm -7.43 dBm 0.00 dBm 2.00 dBm 5.00 dBm
<---------+------------+-------------------+----------------+---------------+---------------+------->
<---Error-+ Error--->
<------Warning Warning--------->
<-------------------------OK----------------------->
Rx功率在可接受的范围内,并不表示端到端光纤/跳线/配线面板连接正常。您可能仍需要逐个绕过其中的一些。
通常情况下,位/字错误过多的问题不是ASIC问题。但是,如果要将电缆移动到同一模块上的不同端口,则需要了解模块的架构(每个ASIC的端口层端口)。
例如:
MDS 9500(DS-X9248-256K9)具有4个称为Thunderbirds的FC ASIC。
这些FC ASIC每个可处理12个端口:
ASIC 0 - fc1/1-12
ASIC 1 - fc1/13-24
ASIC 2 - fc1/25-36
ASIC 3 - fc1/37-48
MDS内置可运行的ISL诊断。
测试类型
以下是在链接上运行诊断测试的方法。
延迟/电缆长度测试
这只是一个短持续时间测试,用于测量延迟和确定电缆长度。以下是操作方法:
A侧 — 称为发电机侧。它生成流量。
B面 — 叫这个反射面接收来自生成器的流量并将其发送回。
例如:
A侧(发生器)fc9/1 ---- fc6/1侧B(反射器)
1.1 B侧(反射器)
1.1.1 — 关闭要使用的接口
1.1.2 — 诊断isl反射器延迟_test环回接口fc6/1 enable
1.2 A侧(发电机)
1.2.1 — 关闭要使用的接口
1.2.2 — 诊断isl延迟测试接口fc9/1
以下是实验室交换机的外观:
F241-15-09-MDS9710# diagnostic isl latency-test interface fc9/1
Waiting for sync to be achieved on the link ....
Sync is achieved, Link has been initialized.
Starting the test ....
---------------------------------------------------------
Latency test Result for port: fc9/1
Latency in the switch (in ns): 264
Latency in the cable (in ns): 6593
Length of the cable (accuracy ± 2m): 4373 m
---------------------------------------------------------
F241-15-09-MDS9710#
流量生成器测试
这是一项长期的全线速测试。长达3600秒(1小时)
2.1 B侧(反射器)
2.1.1 — 关闭要使用的接口
2.1.2 — 诊断isl reflector traffic_test link_speed 32G环回接口fc6/1 enable
2.2 A侧(发电机)
2.2.1 — 关闭要使用的接口
2.2.2 — 诊断isl生成器接口fc9/1启动持续时间3600 rate 100% frame_size min 16 max 517 step 100 link_speed 32g
该路由器以32G全线速运行1小时。
以下是实验室交换机的外观:
F241-15-09-MDS9710# diagnostic isl generator interface fc9/1 start duration 3600 rate 100% frame_size min 16 max 517 step 100 link_speed 32g
Waiting for sync to be achieved on the link ....
Link initialized successfully. Starting the test.
F241-15-09-MDS9710#
When it end there is no message but you can see the frames on the ports:
F241-15-10-9706-2# show int fc6/1 | i fc|rate
fc6/1 is down (Administratively down)
5 minutes input rate 5754800992 bits/sec,719350124 bytes/sec, 666558 frames/sec
5 minutes output rate 5754800512 bits/sec,719350064 bytes/sec, 666558 frames/sec
F241-15-10-9706-2#
F241-15-10-9706-2# show int fc6/1 counters details | i i fc|fec|crc
fc6/1
0 invalid CRCs, 0 Delimiter Errors
regardless of the CRC/FCS error
CRC/FCS error
7262 fec corrected blocks
0 fec uncorrected blocks
F241-15-10-9706-2#
建议清除接口计数器,并在每个链路上运行该计数器一个小时。然后获取两端的上述CRC和FEC信息。
要清除接口计数器问题,请使用clear counters interface all。
配置调度程序作业
上述流量发生器测试运行最长时间1小时。要运行更长时间(例如24小时),可以配置调度程序作业:
需要配置调度程序,分为两部分:
“调度程序作业”用于配置要执行的操作,而“调度程序调度”用于配置要运行作业的时间。此调度在删除调度之前一直运行。没有简单的办法手动停止。
您需要使用交换矩阵中的接口替换这些接口。
如果配置作业时出错,则必须删除作业并重新开始。它不允许您返回进行修改。
请注意,在发电机端,发电机停止位于第一次运行的地方,您可能会看到一个错误,它可以。下次它运行时,应该运行良好。
以下是脚本:
Generator:
---------
shutdown fc1/42
feature scheduler
scheduler logfile size 1024
clear counters interface fc1/42
clear scheduler logfile
scheduler job name stats
diagnostic isl generator interface fc1/42 stop
show interface fc1/42 counters details | i i fc|fec|crc
show interface fc1/42 counters | i i fc|rate
diagnostic isl generator interface fc1/42 start duration 3600 frame_size min 64 max 517 step 1 link_speed 32G
exit
scheduler schedule name test
job name stats
time start +00:01:00 repeat 00:01:00
exit
Reflector:
---------
shutdown fc7/1
feature scheduler
scheduler logfile size 1024
clear counters interface fc7/1
clear scheduler logfile
diagnostic isl reflector traffic_test link_speed 32G loop-back interface fc7/1 enable
scheduler job name stats
show interface fc7/1 counters details | i i fc|fec|crc
show interface fc7/1 counters | i i fc|rate
exit
scheduler schedule name test
job name stats
time start +00:01:00 repeat 00:01:00
exit
At the end of 24 hours, please remove the scheduler schedule to stop it at both generator and reflector sides:
no scheduler schedule name test
You can collect the scheduler logfile which will contain all the output of the tests and the show command:
show scheduler logfile | no-more
其它命令:
- show logging onboard status
- show logging onboard module <module number>
- show logging onboard stack-trace
- show logging onboard mem-leak
- show logging onboard error-stats
- show logging onboard exception-log
- show logging onboard error-stats
- show logging onboard environmental-history