Brocade Communications Systems 6505 Service manual

53-1002474-01

15 December 2011

Fabric OS FCIP

Administrator’s Guide

Supporting Fabric OS v7.0.1

Brocade, the B-wing symbol, BigIron, DCX, Fabric OS, FastIron, NetIron, SAN Health, ServerIron, and TurboIron are registered

trademarks, and Brocade Assurance, Brocade NET Health, Brocade One, CloudPlex, MLX, VCS, VDX, and When the Mission Is

Critical, the Network Is Brocade are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other

countries. Other brands, products, or service names mentioned are or may be trademarks or service marks of their respective

owners.

Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning

any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to

this document at any time, without notice, and assumes no responsibility for its use. This informational document describes

features that may not be currently available. Contact a Brocade sales office for information on feature and product availability.

Export of technical data contained in this document may require an export license from the United States government.

The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with

respect to any loss, cost, liability, or damages arising from the information contained in this book or the computer programs that

accompany it.

The product described by this document may contain “open source” software covered by the GNU General Public License or other

open source license agreements. To find out which open source software is included in Brocade products, view the licensing

terms applicable to the open source software, and obtain a copy of the programming source code, please visit

http://www.brocade.com/support/oscd.

Brocade Communications Systems, Incorporated

Corporate and Latin American Headquarters

Brocade Communications Systems, Inc.

130 Holger Way

San Jose, CA 95134

Tel: 1-408-333-8000

Fax: 1-408-333-8101

E-mail: info@brocade.com

Asia-Pacific Headquarters

Brocade Communications Systems China HK, Ltd.

No. 1 Guanghua Road

Chao Yang District

Units 2718 and 2818

Beijing 100020, China

Tel: +8610 6588 8888

Fax: +8610 6588 9999

E-mail: [email protected]

European Headquarters

Brocade Communications Switzerland Sàrl

Centre Swissair

Tour B - 4ème étage

29, Route de l'Aéroport

Case Postale 105

CH-1215 Genève 15

Switzerland

Tel: +41 22 799 5640

Fax: +41 22 799 5641

E-mail: emea-info@brocade.com

Asia-Pacific Headquarters

Brocade Communications Systems Co., Ltd. (Shenzhen WFOE)

Citic Plaza

No. 233 Tian He Road North

Unit 1308 – 13th Floor

Guangzhou, China

Tel: +8620 3891 2000

Fax: +8620 3891 2111

E-mail: [email protected]

Fabric OS FCIP Administrator’s Guide iii

53-1002474-01

Document History

Title Publication number Summary of changes Date

Fabric OS FCIP Administrator’s Guide 53-1001349-01 New document. July 2009

Fabric OS FCIP Administrator’s Guide 53-1001349-02 Various changes and

corrections.

October 2009

Fabric OS FCIP Administrator’s Guide 53-1001755-01 New document for Fabric OS

version 6.3.1.

January 2010

Fabric OS FCIP Administrator’s Guide 53-1001766-01 New document for Fabric OS

version 6.4.0.

March 2010

Fabric OS FCIP Administrator’s Guide 53-1002155-01 Updated document for

Fabric OS version 7.0.0.

April 2011

Fabric OS FCIP Administrator’s Guide 53-1002474-01 Updated document for

Fabric OS version 7.0.1.

December 2011

iv Fabric OS FCIP Administrator’s Guide

53-1002474-01

Fabric OS FCIP Administrator’s Guide v

53-1002474-01

Contents

About This Document

In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

What’s new in this document. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x

Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

Text formatting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

Command syntax conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

Notes, cautions, and warnings . . . . . . . . . . . . . . . . . . . . . . . . . . xii

Key terms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

Brocade resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

Other industry resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

Getting technical help. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

Document feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv

Chapter 1 FCIP Overview

In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

FCIP platforms and supported features . . . . . . . . . . . . . . . . . . . . . . . 1

FCIP concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

IP WAN network considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

Chapter 2 FCIP on the 7800 Switch and FX8-24 Blade

In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

7800 switch hardware overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

7800 switch license options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

VE_Ports and FCIP tunnels on the 7800 switch . . . . . . . . . . . . . 8

FCIP trunking capacity on the 7800 switch . . . . . . . . . . . . . . . . . 8

FX8-24 blade hardware overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Removing FX8-24 blades. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

FX8-24 blade license options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

VE_Ports and FCIP tunnels on the FX8-24 blade. . . . . . . . . . . . 10

FCIP trunking capacity on the FX8-24 blade . . . . . . . . . . . . . . . 11

10 GbE port considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

vi Fabric OS FCIP Administrator’s Guide

53-1002474-01

FCIP trunking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Design for redundancy and fault tolerance . . . . . . . . . . . . . . . . 16

FCIP tunnel restrictions for FCP and FICON acceleration

features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

FCIP circuits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

FCIP circuit failover capabilities . . . . . . . . . . . . . . . . . . . . . . . . . 17

Failover in TI zones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Bandwidth calculation during failover . . . . . . . . . . . . . . . . . . . . 20

Adaptive Rate Limiting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

FSPF link cost calculation when ARL is used. . . . . . . . . . . . . . . 21

QoS SID/DID priorities over an FCIP trunk . . . . . . . . . . . . . . . . . . . . 21

QoS, DSCP, and VLANs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

DSCP Quality of Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

VLANs and Layer 2 Quality of Service. . . . . . . . . . . . . . . . . . . . . 24

When both DSCP and L2CoS are used. . . . . . . . . . . . . . . . . . . . 25

DSCP and VLAN support on FCIP circuits. . . . . . . . . . . . . . . . . .25

Managing the VLAN tag table . . . . . . . . . . . . . . . . . . . . . . . . . . .26

Compression options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28

IPsec implementation over FCIP tunnels. . . . . . . . . . . . . . . . . . . . . . 28

Limitations using IPsec over FCIP tunnels . . . . . . . . . . . . . . . . . 29

IPsec for the 7800 switch and FX8-24 blade. . . . . . . . . . . . . . .29

Enabling IPsec and IKE policies . . . . . . . . . . . . . . . . . . . . . . . . . 30

Open Systems Tape Pipelining . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30

FCIP Fastwrite and OSTP configurations . . . . . . . . . . . . . . . . . . 30

Support for IPv6 addressing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

IPv6 with embedded IPv4 addresses . . . . . . . . . . . . . . . . . . . . .33

Configuration preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Configuration steps. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Setting VE_Ports to persistently disabled state . . . . . . . . . . . . .34

Configuring VEX_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34

Enabling XISL for VE_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Configuring the media type for GbE ports 0 and 1 (7800

switch only). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35

Setting the GbE port operating mode (FX8-24 blade only) . . . .35

Configuring a GbE or XGE port IP address . . . . . . . . . . . . . . . . . 36

Configuring an IP route . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

Validating IP connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38

Creating an FCIP tunnel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

Creating additional FCIP circuits . . . . . . . . . . . . . . . . . . . . . . . .44

Verifying the FCIP tunnel configuration on the Brocade 7800

FX8-24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45

Enabling persistently disabled ports on the Brocade 7800

FX8-24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45

Creating a multicircuit tunnel (example) . . . . . . . . . . . . . . . . . . . . . .46

Modifying an FCIP tunnel on a Brocade 7800 FX8-24 blade. . . . . .49

Modifying an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . .49

Deleting an IP interface on a Brocade 7800 FX8-24 blade . . . . . . . 50

Fabric OS FCIP Administrator’s Guide vii

53-1002474-01

Deleting an IP route on a Brocade 7800 FX8-24 blade . . . . . . . . . . 50

Deleting an FCIP tunnel on a Brocade 7800 FX8-24 blade . . . . . . . 50

Deleting an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . . . 51

Virtual Fabrics and the Brocade 7800 FX8-24 blade. . . . . . . . . . . . 51

Port sharing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

Chapter 3 FCIP on the FR4-18i Blade

In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

FR4-18i blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54

FR4-18i blade ports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

FCIP design considerations for the FR4-18i blade . . . . . . . . . . . . . .55

Virtual port types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Compression on FCIP tunnels . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

Traffic shaping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

FCIP services license . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

QoS implementation over FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

DSCP Quality of Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

L2CoS Quality of Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58

When both DSCP and L2CoS are used. . . . . . . . . . . . . . . . . . . . 58

IPsec implementation over FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Limitations using IPsec over FCIP tunnels . . . . . . . . . . . . . . . . . 59

Configuring IPsec . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59

IPsec parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60

Creating an IKE and IPsec policy . . . . . . . . . . . . . . . . . . . . . . . . 61

Displaying IKE and IPsec policy settings . . . . . . . . . . . . . . . . . . 61

Deleting an IKE and IPsec policy . . . . . . . . . . . . . . . . . . . . . . . . 61

Viewing IPsec information for an FCIP tunnel . . . . . . . . . . . . . . 62

Virtual Fabrics and FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

Options for enhancing tape I/O performance . . . . . . . . . . . . . . . . . .63

FCIP Fastwrite and OSTP configurations . . . . . . . . . . . . . . . . . .64

Unsupported configurations for Fastwrite and OSTP . . . . . . . .65

FCIP services configuration guidelines . . . . . . . . . . . . . . . . . . . . . . .66

Setting persistently disabled ports . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Configuring VEX_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Creating IP interfaces and routes . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Creating an FCIP tunnel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69

Verifying the FCIP tunnel configuration on the Brocade FR4-18i . . 69

Enabling persistently disabled ports on the Brocade 7500 FR4-18i70

Managing FCIP tunnels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70

Modifying and deleting QoS settings . . . . . . . . . . . . . . . . . . . . . 71

Deleting an FCIP tunnel on a Brocade 7500 FR4-18i. . . . . . . . 71

Deleting an IP route on a Brocade 7500 FR4-18i . . . . . . . . . . .72

Deleting an IP interface on a Brocade 7500 FR4-18i. . . . . . . . 72

viii Fabric OS FCIP Administrator’s Guide

53-1002474-01

Managing the VLAN tag table. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72

Chapter 4 FCIP Management and Troubleshooting

In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73

Inband management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73

IP routing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Configuring IP addresses and routes . . . . . . . . . . . . . . . . . . . . . 74

VLAN tagging support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78

IP forwarding support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

WAN performance analysis tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80

The tperf option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80

The ipperf option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .82

Ipperf performance statistics . . . . . . . . . . . . . . . . . . . . . . . . . . .83

Starting an ipperf session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83

Ipperf options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84

Using ping to test a connection. . . . . . . . . . . . . . . . . . . . . . . . . . 84

Using traceroute. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84

Portshow command usage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85

Displaying IP interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85

Displaying IP routes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85

Displaying FCIP tunnel information. . . . . . . . . . . . . . . . . . . . . . .85

Displaying IP addresses. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85

Displaying performance statistics. . . . . . . . . . . . . . . . . . . . . . . . 86

Displaying FCIP tunnel information (7800 switch and

FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .86

Displaying an FCIP tunnel with FCIP circuit information

(7800 switch and FX8-24 blade) . . . . . . . . . . . . . . . . . . . . . . . .86

Displaying FCIP tunnel performance (7800 switch and

FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87

Displaying FCIP tunnel TCP connections (7800 switch

and FX8-24 blade) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87

Displaying FCIP circuits (7800 switch and FX8-24 blade) . . . . 87

Displaying a single circuit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87

Displaying FCIP circuit performance (7800 switch and

FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87

Displaying QoS prioritization for a circuit . . . . . . . . . . . . . . . . . .88

Displaying FCIP tunnel information (FR4-18i blade) . . . . . . . . .88

FCIP tunnel issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88

FCIP links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90

Gathering additional information . . . . . . . . . . . . . . . . . . . . . . . . 90

FTRACE concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91

Index

Fabric OS FCIP Administrator’s Guide ix

53-1002474-01

About This Document

In this chapter

•How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

•Supported hardware and software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

•What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x

•Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

•Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

•Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

•Getting technical help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

•Document feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv

How this document is organized

.This document is organized to help you find the information that you want as quickly and easily as

possible. It contains the following components:

•Chapter 1, “FCIP Overview” describes FCIP concepts and features.

•Chapter 2, “FCIP on the 7800 Switch and FX8-24 Blade” describes FCIP tunnel and trunking

configuration options for the 7800 switch and FX8-24 blade.

•Chapter 3, “FCIP on the FR4-18i Blade” describes FCIP tunnel configuration options for the

FR4-18i blade.

•Chapter 4, “FCIP Management and Troubleshooting” describes FCIP management and

troubleshooting operations.

Supported hardware and software

The following hardware platforms support FCIP as described in this manual:

•Brocade DCX, DCX 8510-8, DCX-4S, and DCX 8510-4 with one or more FX8-24 blades

•Brocade 7800 switch

•Brocade DCX and DCX-4S with one or more FR4-18i blades

NOTE

FR4-18i blades are not supported on the16 Gbps DCX 8510-8 and DCX 8510-4 models.

xFabric OS FCIP Administrator’s Guide

53-1002474-01

What’s new in this document

Major new additions or deletions in this document support the following:

•Preface. Added location of serial number label for the Brocade 6505 switch.

•Chapter 1

-Added support for printer emulation in Table 1, “FCIP capabilities by platform,” under the

FICON extension row and referenced statement that this is not supported on FR4-18i

blades.

-Added note under “FCIP platforms and supported features” that FCIP connections are not

supported between the 7800 switch or FX8-24 blades and previous generation Brocade

7500 switches or FR4-18i blades.

•Chapter 2

-Under “7800 switch hardware overview,” added the following notes:

•Copper ports do not support auto-sense functions.

•With copper media, auto-negotiation must be enabled on the other end of the port

connection. 1 Gbps is the only negotiated speed.

-Under 7800 switch license options” and “FX8-24 blade license options,” added FICON

printer emulation to the list of features enabled by the Advanced FICON Acceleration

License. Also added printer and other emulation features to the Advanced FICON

Acceleration License row of Table 2, “7800 FCIP feature licenses” and Table 3, “FX8-24

blade license options.”

-Under “VE_Ports and FCIP tunnels on the 7800 switch” and “VE_Ports and FCIP tunnels

on the FX8-24 blade” added the following note:

-VE_Ports or VEX_Ports cannot connect to the same domain at the same time as Fibre

Channel E_Ports or EX_Ports.

-Under “VE_Ports and FCIP tunnels on the 7800 switch” and “VE_Ports and FCIP tunnels

on the FX8-24 blade” a note was added concerning VE_Ports.

-Under “FCIP tunnel restrictions for FCP and FICON acceleration features,” added

restrictions about FCIP tunnels not supporting DPS and that both ends of the FICON

emulating tunnel must run Fabric OS v7.0 or later if one end of tunnel runs v7.0 or later.

-Under “FCIP circuit failover capabilities, added “Failover in TI zones” section.

-Under “Limitations using IPsec over FCIP tunnels,” added limitation that IPsec is not

supported on VE group 12-21 on FX8-24 blades and that to enable IPsec with Fabric OS

v7.0 and later, both ends of the tunnel must use v7.0 and later.

-Added timeout value information under the “keep-alive timeout” option.

-Under “Creating Additional FCIP circuits,” added note about adding additional circuits to

an active tunnel when multiple FCIP tunnels are present.

-Added notes under the “Setting the GbE port operating mode (FX8-24 blade only)” section.

•Chapter 4

-Under “Inband management,” added that the following functions are not supported by the

inband management interface:

•Downloading firmware

•IPv6 addressing

Other manuals for 6505

This manual suits for next models

Table of contents

Other Brocade Communications Systems Switch manuals