IPRAN系列產(chǎn)品

業(yè)務(wù)故障定位流程說

明書

文件編號:

文件版本：0.0.1

部門:

擬制：2013年9月16日

審核:2013年9月16H

批準(zhǔn):2013年9月16日

旗開得勝

修改記錄

序號版本號生成時(shí)間主要修改記錄作者備注

10.0.12013-9-16形成初稿李寧

李寧、陳育、劉劍華、

高軍、學(xué)匕思勤、劉波

21.0.02013-10-12添加各個(gè)模塊定位問題細(xì)節(jié)平、徐蜻、彭冠奇、

毛龍、高潞曉、鄭遠(yuǎn)、

許賽群等

3

4

5

3

4’讀萬卷書行萬里路

旗開得勝

目錄

1引言...............................................................................18

1.1文檔內(nèi)容...................................................................18

1.2研發(fā)協(xié)助福呈...............................................................18

2以太網(wǎng)單播業(yè)務(wù)應(yīng)用場景............................................................18

2.1承載方案1.2:端到端全三層轉(zhuǎn)發(fā).............................................18

2.1.1應(yīng)用場景1.2.1:(L3+L3:RSVP+RSVP)HVPN保護(hù)方案:................19

2.2承載方案1.3:2+3層到匯聚................................................21

2.2.1應(yīng)用場景雙掛環(huán)場景一L2+L3保護(hù)方案..................................22

2.2.2應(yīng)用場景(L2+L3:LDP+LDP)保護(hù)方案.................................25

2.2.3應(yīng)用場景(L2+L3:PTN+RSVP)保護(hù)方案...............................32

2.2.4應(yīng)用場景(L2+L3:RSVP+RSVP)保護(hù)方案.............................37

2.2.5應(yīng)用場景1.3.4:負(fù)載分擔(dān)場景1一端到端的負(fù)載均衡......................44

2.2.6應(yīng)用場景1.3.5:負(fù)載分擔(dān)場景2-L3VPN域內(nèi)負(fù)載分擔(dān)..................46

3L2VPN問題定位...................................................................48

3.1VPWS業(yè)務(wù)問題定位........................................................48

4

4,讀萬卷書行萬里路

旗開霄勝

3.1.1查看vpws實(shí)例：.......................................................48

3.1.2查看vc實(shí)例：.........................................................48

3.1.3查看vcfib以及當(dāng)前vc狀態(tài)：...........................................50

3.1.4查看vc的信令交互情況：...............................................51

3.1.5VPWS故障診斷流程圖:................................................54

3.2VPLS業(yè)務(wù)問題定位.........................................................58

3.2.1查看vpls實(shí)例:........................................................58

3.2.2\^plsmeshpeer6^3fil^59

3.2.3查看vplsspokepeer的fib表項(xiàng):.....................................60

3.2.4查看vpls的信令交互情況...............................................61

3.2.5VPLS故障診斷;耀圖：.................................................63

4L3VPN問題定位....................................................................64

4.1L3VPN故障定位流程........................................................64

4.1.1L3VPN故障定位流程詳細(xì)描述...........................................65

查看私網(wǎng)路由..................................................65

直看BGP鄰居關(guān)系.............................................68

查看公網(wǎng)路由..................................................68

5

4’讀萬卷書行萬里路

旗開將勝

查看公網(wǎng)IGP配置.............................................69

查看私網(wǎng)標(biāo)簽..................................................69

查看MP-BGP配置、對端PE與CE之間的路由協(xié)議配置、雙方的RT

規(guī)則配置72

查看BGP配置.................................................72

查看私網(wǎng)路由的下一跳.........................................73

有看公網(wǎng)標(biāo)簽..................................................75

0查看LDP鄰居.................................................76

1查看MPLS配置...............................................76

4.1.2TNE中輔助查看命令...................................................76

LSPTX信息....................................................76

LSPRX信息............................................77

4.2.23L3PWTX信息..........................................79

L3PWRX信息..........................................80

42.2.5VRF單播路由信息.......................................81

4.1.3常見故障匯總...........................................................83

L3PWTX綁定LSP問題........................................83

VPNFRR配置未訊問題......................................86

/6

H讀萬卷書行萬里路

旗開得勝

4.1.33VPNECMP配置未生成問題....................................92

4.13.46PE問題......................................................97

4.13.56VPE問題.....................................................99

4.1.3.64.23.6LSP1:1保護(hù)及逃生路徑問題....................99

4.13.7LDPECMP問題...............................................107

4.1.3.8靜態(tài)L3VPN問題......................................111

4.2L2VPN問題定位..........................................................113

4.2.2查看PE間LDP會話是否Up:.........................................................................114

4.2.3查看PE的AC接口是否Up:.........................................................................114

4.2.4查看PE間隧道是否存在:.............................................114

4.2.5L2VPN業(yè)務(wù)檢查.......................................................114

4.2.6信令通道檢杳..........................................................117

4.3L3VPN問題定位..........................................................119

4.3.1查看私網(wǎng)路由：.......................................................119

4.3.2查看BGP鄰居關(guān)系：..................................................120

4.3.3查看公網(wǎng)路由：.......................................................120

7

4’讀萬卷書行萬里路

旗開需勝

4.3.4查看公網(wǎng)IGP酉己置：..................................................121

4.3.5查看私網(wǎng)標(biāo)簽:......................................................121

4.3.6查看MP-BGP配置、對端PE與CE之間的路由協(xié)議配置、雙方的RT規(guī)則配置：

122

4.3.7查看BGP配置：.....................................................122

4.3.8查看私網(wǎng)路由的下一跳：..............................................124

4.3.9查看公網(wǎng)標(biāo)簽：.......................................................125

43.10查看LDP令B居：......................................................126

4.3.11查看MPLS配置：.....................................................126

5抓包分析方法......................................................................126

5.1tcpdump抓包方法........................................................127

5.2端口下pc叩抓包方法......................................................128

5.3由tcpdump抓包和pc叩抓包,分析常見的丟包問題........................129

6常見ARP問題的定位...............................................................130

7常見ping問題的定位..............................................................133

7.1Ping不通問題的一般定位...................................................133

7.1.1Ping問題的路由分析..................................................134

7.1.2Ping問題的抓包分析..................................................135

一居8

4,讀萬卷書行萬里路

旗開需勝

7.2Ping長包不通（指定包長）.................................................137

73Ping命令阻塞無法退出、無法通過Ctrl+b進(jìn)行退出等.......................138

8常見信令不通的定位方法............................................................138

9OSPF問題定位....................................................................141

9.1鄰居無法建立的處理流程...................................................141

9.2OSPF鄰居關(guān)系無法建立....................................................141

93OSPF選路窗吳.............................................................142

9.3.1OSPF非骨干區(qū)域設(shè)為完全存根區(qū)域后仍然能夠看到區(qū)域間的匯總明細(xì)。.....143

9.3.2OSPF非骨干區(qū)域中某些低端交換機(jī)或路由器出現(xiàn)不正常的轉(zhuǎn)發(fā)現(xiàn)象.......143

9.4OSPF常用操作定位命令...................................................143

9.4.1查看當(dāng)前的路由配置...................................................143

9.4.2查看接口是否啟動(dòng).....................................................144

9.4.3查看鄰接狀態(tài)信息.....................................................144

9.4.4直看OSPF概要信息...................................................145

9.4.5查看鏈接數(shù)據(jù)庫匯總信息...............................................146

9.4.6查看鏈路數(shù)據(jù)分類信息.................................................146

9.4.7指定路由器ID.................................................................................................147

9

4,讀萬卷書行萬里路

旗開霄勝

9.4.8指定網(wǎng)絡(luò)類型..........................................................147

9.4.9指定路由器優(yōu)先級.....................................................148

9.4.10OSPFLOG日志開關(guān)的設(shè)置............................................148

將日志信息保存到文件：......................................148

將日志信息在CMD命令界面顯示..............................148

9.4.103開啟/關(guān)閉debug命令debugospfXXX.......................................149

路由計(jì)算詳細(xì)過程的日志開啟..................................149

9.5.1接口配置vrf屬性不一致...............................................150

9.5.2接口配置時(shí)沒有使能noshutdown屬性................................151

9.5.3互連接口的物理mac地址相同.........................................154

9.5.4互連接口的MTU值不一致.............................................155

9.5.5互連接口參數(shù)配置不一致...............................................157

9.5.6IP棧阻塞或驅(qū)動(dòng)轉(zhuǎn)發(fā)影響鄰居狀態(tài)......................................158

9.5.7兩端設(shè)備router-id相同重復(fù)...........................................160

9.5.8Vrf接口建立鄰居失敗.................................................162

9.5.9接口網(wǎng)絡(luò)掩碼配置錯(cuò)誤.................................................164

-10

4,讀萬卷書行萬里路

旗開霄勝

9.5.10接口鄰居狀態(tài)持續(xù)在loading狀態(tài).................................165

9.6OSPF組網(wǎng)拓?fù)溴e(cuò)誤.......................................................165

9.6.1聚合屬性造成的路由環(huán)路..............................................165

9.6.2非骨干區(qū)域沒有和骨干區(qū)域相連，需要配置虛連接.......................168

故障現(xiàn)象一...................................................168

故題象二...................................................170

9.6.3stubsummary配置要求ABR,stub的配置要求.......................171

JaIIU口IIIpIytzj?????????????????????????????????????????????????????????????????????????????????????????????????????????????J-/Jh.

9.7.1接口類型不一致造成路由計(jì)算錯(cuò)誤......................................171

9.7.2接口出現(xiàn)65535值，影響路由計(jì)算.....................................174

9.7.3路由中配置access-list，路由計(jì)算不成................................176

9.7.4CE使能vrf后，無法接收PE發(fā)布路由..................................176

9.7.5ecmp等值路徑的計(jì)算.................................................177

9.7.6路由優(yōu)選的問題.......................................................177

9.7.7無法引入自治系統(tǒng)外部路由.............................................178

9.8OSPF其他故障問題：.....................................................178

9.8.1接口狀態(tài)上報(bào)功能對OSPF鄰居狀態(tài)的影響.............................178

411

4,讀萬卷書行萬里路

旗開得勝

9.8.2儀表對接中，stub區(qū)域E位option設(shè)置錯(cuò)誤...........................179

9.8.3接口認(rèn)證明文和密文的配置方法........................................179

9.83.1areaauthentication............................................................................179

9.83.2ipospfauthentication........................................................................180

9.8.33ipospfauthentication-key................................................................181

9.83.4ipospfmessage-digest-key..............................................................182

9.83.5接口密鑰明文配置分為2步：..................................183

接密鑰5）為2步1對

10ISIS故障定位流程.............................................................184

10.1ISIS基本配置..............................................................184

10.2ISIS故障的表現(xiàn)............................................................185

10.3ISIS檢查的基本淘呈.......................................................185

10.4ISIS故障定位流程詳細(xì)描述.................................................186

10.4.1準(zhǔn)備工作..........................................................186

10.4.2檢查鄰接狀態(tài)表...................................................187

接口配置檢查.................................................192

認(rèn)證配置檢查.................................................198

412

4,讀萬卷書行萬里路

旗開得勝

10.4.23協(xié)議配置檢查.................................................200

10.4.2.4總結(jié)....................................................206

10.4.3檢查鏈路狀態(tài)數(shù)據(jù)庫..............................................206

認(rèn)證配置檢查.................................................210

協(xié)議配置檢查.................................................211

10.433拓?fù)渑渲脵z查.................................................214

10.4.4檢查SPF計(jì)算結(jié)果................................................215

拓?fù)渑渲脵z查.................................................218

10.4.5檢查IP路由表....................................................218

10.5常見故障匯總.............................................................220

10.5.1接口MTU不匹配故障............................................220

10.5.2BFD聯(lián)動(dòng)導(dǎo)致的ISIS鄰接故障..........................................223

10.53ISISCSPF計(jì)算常見故障處理...........................................224

10.5.4ISISLDPIGP同步故障.................................................228

10.5.5GR常見故障..........................................................228

11BGP故障處理.................................................................228

413

4,讀萬卷書行萬里路

旗開得勝

11.1bgp鄰居無法建立連接.....................................................228

11.2bgp無法學(xué)習(xí)到對方發(fā)送的路由............................................234

11.3bgp無法將重分發(fā)的路由發(fā)送到對端........................................238

11.4BGP路由異常，例如未選中等..............................................240

11.5BGPILM表與路由表不同步................................................241

11.6BGPVRFFTN表不同步...................................................241

11.7HoVPN對應(yīng)的默認(rèn)路由故障..............................................242

12MPLSLDP故障處理..........................................................243

12.1典型組網(wǎng)環(huán)境..............................................................243

12.2配置注意事項(xiàng)..............................................................244

12.2.1LDP全局配置.........................................................244

12.2.2LDP接口配置........................................................246

12.2.3注意事項(xiàng).............................................................247

12.3故障診斷湘呈.............................................................248

12.4故障處理步驟..............................................................249

12.5MPLSLDP故障處理案例...................................................252

14

4’讀萬卷書行萬里路

旗開將勝

12.5.1不能建立LDPe?...................................................................................252

12.5.1.1阿絡(luò)環(huán)境.....................................................252

12.5.1.2故障分析.....................................................252

12.5.1.3操作步驟.....................................................253

12.5.1.4案例總結(jié).....................................................254

12.6FAQ.......................................................................................................................255

12.7故障信息采集.............................................................256

??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????

12.9debug命令...............................................................261

13RSVPTE故障處理............................................................262

13.1RSVP-TE配置注意事項(xiàng)....................................................262

13.2故障排除相關(guān)的命令行.....................................................265

13.3故障診斷潮呈..............................................................267

13.4故障處理步驟.............................................................267

13.5MPLSTE故障處理案例.....................................................269

13.5.1session一直在retry，但是沒有up（鏈路不通）.......................269

13.5.2session一直在retry，但是沒有up（ospf域不同）...................................270

-15

4,讀萬卷書行萬里路

旗開得勝

13.5.3session一直在retry，但是沒有up（path約束屬性配置錯(cuò)誤）.........271

13.5.4showrsvpsessiondetail顯示錯(cuò)誤碼為cspfconfigurationerror..........273

13.5.5showrsvpsessiondetail顯示的錯(cuò)誤為Egressconfigurationerror......274

13.5.6showrsvpsessiondetail顯示錯(cuò)誤為第一跳不可達(dá)....................275

13.5.7showrsvpsessiondetail沒有顯示任＜可錯(cuò)誤,ingress狀態(tài)顯示為等待RESV消

息，但是session一直沒有up................................................................................277

13.5.8showrsvpsessiondetail顯示PATH約束路徑酉己置專昔誤................278

13.5.9showrsvpsessiondetail顯示錯(cuò)誤類型為Hoplimitconflict.................280

14BFD常見問題.................................................................281

14.1v2.1版本，oam有bfdsession,單盤沒有bfdsession..................................281

14.2下載動(dòng)態(tài)bfd時(shí),某些bfdsession不能成功..............................282

14.3bfdforospf不能在oam........................................................................282

14.4ospf鄰居已經(jīng)刪除，但是其生成的bfdsession沒有被刪除..................282

14.5bfdsession建立不耐...................................................283

15DHCP問題定位...............................................................283

15.1DHCPclient發(fā)了discover包，但是沒看至JDHCPrelay給DHCPserver轉(zhuǎn)發(fā)

discover包問題定位...............................................................283

15.2DHCPclient每次收到ACK包之后，數(shù)據(jù)流并沒有通暢，而是又重新開始發(fā)送

國16

4,讀萬卷書行萬里路

旗開得勝

discover包，DHCPclient一直處在獲取IP地址的過程中。..........................286

15.3DHCPrelay已經(jīng)把discover包轉(zhuǎn)發(fā)給DHCPserver,但是DHCPserver并不回應(yīng)

offer包...........................................................................287

15.4DHCPclient成功獲取到IP之后，但是在client端ping不通網(wǎng)關(guān)。..........289

16VRRP常見故障定位............................................................290

16.1vrrp配置完成，出現(xiàn)狀態(tài)始終為init狀態(tài)...................................290

16.2完成vrrp配置后,狀態(tài)為master的情況下,下聯(lián)設(shè)備，或是backup設(shè)備無法ping

通虛擬ip（該問題主要出現(xiàn)在2.3版本）............................................290

16.3vrrp拓?fù)渑渲猛瓿珊?，在測試拓?fù)渲?，vrrp主備狀態(tài)不正確..................291

國’讀萬卷書行萬里路

旗開得勝

1引言

1.1文檔內(nèi)容

業(yè)務(wù)故障定位流程文檔，主要描述了常用的L2+L3各種業(yè)務(wù)場景下L2VPN及L3VPN問題的

定位及業(yè)務(wù)查看流程。

1.2研發(fā)協(xié)助流程

工程維護(hù)或升級保障，需向項(xiàng)目經(jīng)理及SE進(jìn)行電話及郵件申請，無預(yù)約及申請的技術(shù)支持,

不予保障

2以太網(wǎng)單播業(yè)務(wù)應(yīng)用場景

2.1承載方案1.2:端到端全三層轉(zhuǎn)發(fā)

從接入層到核心層采用VPN進(jìn)行業(yè)務(wù)接入與轉(zhuǎn)接，在匯聚設(shè)備上對VPN進(jìn)行分層;

在核心設(shè)備1上設(shè)置IPFRR,下一跳為核心設(shè)備2,防止核心設(shè)備1的出接口失效；

全三層轉(zhuǎn)發(fā)需要接入設(shè)備具備三層接入能力。

18

4’讀萬卷書行萬里路

旗開得勝

2.1.1應(yīng)用場景121:(L3+L3:RSVP+RSVP)HVPN保護(hù)方案：

端接入層匯聚層核心層業(yè)帚層

接入及笛2人設(shè)品?【

接入?JRNC/aGW

BTS/NodeB/eNodeBX

核心設(shè)備4

接入&斷?4-＞橫入設(shè)*5XI

A匯修設(shè)修Y

L3VPNL3VPNJ

保護(hù)方案LSPL1&VPNFRRLSP1:1&VPNFRRVRRP

d一一一"------------->

檢測技術(shù)BFDforTUNNELBFDforTUNNELBFDforlRACK

LSPWLDP/RSVP-TELDP/RSVP-TE

IGPt辦議OSPF/ISISOSPF/1SIS

封裝方式ETH

備注：如圖所示，所有檢測技術(shù)為BFDforTUNNEL&BFDforPW的地方,均可采用MPLSTPOAM的方式迸行檜測

業(yè)務(wù)正常工作路徑為：①②@次；3網(wǎng)獨(dú)

圖3.2.1應(yīng)用場景1.2.1端到端全三層轉(zhuǎn)發(fā)雙掛環(huán)場景HVPN保護(hù)方案圄

表3.2.1應(yīng)用場景1.2.1端到端全三層轉(zhuǎn)發(fā)雙掛環(huán)場景HVPN保護(hù)方案表

業(yè)務(wù)正常工作路徑：124.6810

故障點(diǎn)業(yè)務(wù)方向保護(hù)模式保護(hù)方案檢測技術(shù)迂回路徑

上行隧道保護(hù)LSPL1BFDforTUNNEL.8.10

1

下行隧道保護(hù)