Brocade Communications Systems SilkWorm 12000 Programming manual

Publication Number 53-0000251-02

Brocade SilkWorm 12000

Design, Deployment and

Management Guide

BROCADE, the Brocade B weave logo, Brocade: the Intelligent Platform for Networking Storage, SilkWorm, and

SilkWorm Express, are trademarks or registered trademarks of Brocade Communications Systems, Inc. or its

subsidiaries in the United States and/or in other countries. All other brands, products, or service names are or may be

trademarks or service marks of, and are used to identify, products or services of their respective owners.

Notice: This book was designed and written to provide information about storage area networking architectures. Every

effort has been made to make this book as complete and accurate as possible. However, the information in this book is

provided to you “AS IS,” without warranty of any kind, including, without limitation, any implied warranty of

merchantability, noninfringement or fitness for a particular purpose. Disclosure of information in this material in no way

grants a recipient any rights under Brocade's patents, copyrights, trade secrets or other intellectual property rights.

Brocade reserves the right to make changes to this document at any time, without notice, and assumes no responsibility

for its use.

IMPORTANT NOTICE

This document is the property of Brocade. This document is confidential to Brocade. It is intended solely as an aid for

installing and configuring Storage Area Networks constructed with Brocade switches. This document does not provide a

warranty to any Brocade software, equipment, or service, nor does it imply product availability. Brocade is not

responsible for the use of this document and does not guarantee the results of its use. Brocade does not warrant or

guarantee that anyone will be able to recreate or achieve the results described in this document. The installation and

configuration described in this document made use of third party software and hardware. Brocade does not make any

warranties or guarantees concerning such third party software and hardware.

The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity

with respect to any loss, cost, liability or damages arising from the information contained in this book or the computer

programs that accompany it.

Export of technical data contained in this document may require an export license from the United States Government.

Brocade Communications Systems,

Incorporated

Corporate Headquarters

1745 Technology Drive

San Jose, CA 95110

T: (408) 487-8000

F: (408) 487-8101

European Headquarters

29, route de l-Aeroport

Case Postale 105

1211 Geneva 15,

Switzerland

T: +41 22 799 56 40

F: +41 22 799 56 41

[email protected]

Asia-Pacific Headquarters

The Imperial Tower 15th Floor

1-1-1 Uchisaiwaicho

Chiyoda-ku, Tokyo 100-0011

Japan

T: +81 33507 5802

F: +81 33507 5900

[email protected]

Publication Number 53-0000251-02 iii

Contents

Preface

Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii

Audience for This Document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii

Chapter 1 Introducing the SilkWorm 12000

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2

High Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3

Reliability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4

Fault Monitoring and Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4

Intelligent Fabric Services Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5

Advanced Performance Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5

Advanced Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5

Extended Fabrics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5

Fabric Watch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-6

ISL Trunking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-6

QuickLoop/Fabric Assist (QLFA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-6

Chapter 2 SilkWorm 12000 Architecture and What Is New

Fabric OS 4.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1

Dual Switch Model. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2

Dual Control Processors For High Availability . . . . . . . . . . . . . . . . . . . . 2-3

Accessing the SilkWorm 12000 Switches . . . . . . . . . . . . . . . . . . . . . . . . 2-4

How Logical Switch Behavior Differs. . . . . . . . . . . . . . . . . . . . . . . . . . . 2-5

Port Addressing and Area Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-5

Compatibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-10

iv Publication Number 53-0000251-02

Software High Availability Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-11

Failover Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-11

Failover Details. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-12

Chapter 3 SilkWorm 12000 Based SAN Designs

Scalability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3

Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4

ISL Over Subscription . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4

Device Attachment Strategies. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5

Attaching Nodes for Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5

Attaching ISLs For Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6

Attaching Nodes for Scalability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7

Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8

SilkWorm 12000 Placement In The Fabric. . . . . . . . . . . . . . . . . . . . . . . . . . . 3-9

SilkWorm 12000 Based Fabric Topologies . . . . . . . . . . . . . . . . . . . . . . . . . . 3-10

The Continuum . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-10

Single Chassis Topology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-14

Core/Edge Topology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-16

Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-16

Device Attachment Strategies. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-16

Core & Edge Switch Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-18

Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-19

Large Fabric Support Levels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-20

SilkWorm 12000 Reference Topologies. . . . . . . . . . . . . . . . . . . . . . . . . . 3-21

Single chassis topology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-21

Two Chassis/Four Switch Partial Mesh . . . . . . . . . . . . . . . . . . . . . . . . . . 3-22

Core/edge With Maximal Config

(current support levels). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-23

Chapter 4 Deploying the SilkWorm 12000

Deployment Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1

Publication Number 53-0000251-02 v

Unpacking and Installing the SilkWorm 12000 in the Rack. . . . . . . . . . . . . . 4-2

Unpacking the Switch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2

Site Planning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2

Installing the Rack Mount Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-3

Reinstalling the Chassis Door and Cable Management Tray . . . . . . . . . . 4-4

Cable Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-5

Chapter 5 Configuring the SilkWorm 12000

Configuring the SilkWorm 12000. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-1

Basic configuration steps:. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-1

Logging into the SilkWorm 12000 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-2

Using Diagnostic Tests to Verify Hardware (Optional) . . . . . . . . . . . . . . 5-2

Configuring IP Addresses. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-3

Configuring the Switch Name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5

Setting the Domain ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5

Enabling Software Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5

Return Switches to Default Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6

Chapter 6 SilkWorm 12000 Management Interfaces

Telnet. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-1

Web Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-8

Zoning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-10

Upload/Download. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-11

Port Setting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-12

Configure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-13

Routing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-14

Extended Fabric . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-15

Fabric Manager 3.0. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-16

Console . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-17

vi Publication Number 53-0000251-02

Chapter 7 Maintaining the SilkWorm 12000

Hardware Maintenance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-6

Power Supply Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-7

Identify A Faulty Power Supply. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-9

Steps For Installation and Removal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-9

Power supply removal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-9

Power supply installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-9

Blowers Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-10

Identify A Faulty Blower Assembly. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-10

Blower Removal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-12

Blower Install . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-12

Control Processor Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-13

Identify A Faulty CP Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-14

CP Card Removal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-15

CP Card Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-16

CP Card Verification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-17

16-Port Card Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-17

Identifying A Faulty 16-Port Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-20

16-Port Card Removal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-20

To Remove A 16-Port Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-20

Installing A 16-Port Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-22

16-Port Card Verification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-22

Software Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-23

Firmware Upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-23

License upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-25

License Verification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-25

Publication Number 53-0000251-02 vii

Chapter 8 Troubleshooting/Support

Software Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-1

QuickLoop Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-2

Trunking Issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-2

Web Tools Issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-3

Zoning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-4

Other Possible Software Issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-4

Hardware Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-5

Software Command Status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-6

Cable-side LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-7

Non-cable Side LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-8

Miscellaneous Hardware Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-8

Diagnostic Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8-9

viii Publication Number 53-0000251-02

Publication Number 53-0000251-02 vii

Preface

Introduction

This document discusses the practical aspects of designing, deploying, and maintaining a SilkWorm

12000 based SAN. The SilkWorm 12000 is a new product because it has: a bladed architecture, two

logical switches in one chassis, a new Fabric OS (version 4.0), and high availability/failover features.

Several SilkWorm 12000 features, while introduced in the SilkWorm 3800, require further discussion

within the context of the SilkWorm 12000, such as Trunking and 1-2 Gbit/sec auto-sensing ports. Other

considerations include designing and deploying SilkWorm 12000 based SANs and the integration of the

SilkWorm 12000 into existing SANs built with SilkWorm 2x00 and 3x00 technology.

This document addresses these new features and capabilities in a clear and concise manner, with liberal

use of examples, and is intended to be used in conjunction with SilkWorm 12000 manuals (see

References later in this section).

While working with the SilkWorm 12000, a multitude of decisions are necessary. This guide is intended

to identify the key decision points expected during the lifecycle of a SilkWorm 12000 deployment and

the advantages and disadvantages of adopting a particular approach. Also included in this guide are tips,

shortcuts, and suggestions for the efficient operation and maintenance of the SilkWorm 12000, which

are gathered from the engineers who developed and tested the SilkWorm 12000.

Audience for This Document

This guide is intended for technically focused personnel directly or indirectly responsible for the design,

deployment, and management of SilkWorm 12000 based SANs. The reader is expected to be familiar

with and have a working knowledge of SAN technology, Brocade SilkWorm switches, and Brocade

Fabric OS.

References

The following Brocade documentation is to be used in reference to this guide.

•Building SANs With Brocade Fabric Switches (Syngress Press) (ISBN: 1-928994-30-x)

•Brocade SAN Design Guide v2.2 (publication number: 53-0000231-03)

•SilkWorm 12000 Hardware Reference Manual –Beta Draft (publication number: 53-0000148-01)

•Brocade Fabric OS Reference Version 3.0/4.0 (publication number: 53-0000182-01)

•Brocade ISL Trunking User’s Guide (publication number: 53-0000189-01)

•Brocade Zoning User’s Guide v 3.0/4.0 (publication number: 53-0000187-01)

viii Publication Number 53-0000251-02

•Web Tools User’s Guide Version 4.0 (publication number: 53-0000185-01)

•Brocade Fabric Manager User’s Guide Version 3.0 (publication number: 53-0000204-0)

•Brocade MIB Reference Version 3.0/4.0 (publication number: 53-0000184-01)

•Brocade SilkWorm 12000 Core Migration User’s Guide v1.1 (53-0000477-02)

Other manuals for SilkWorm 12000

Table of contents

Other Brocade Communications Systems Switch manuals