HP 409366-B21 - Voltaire DDR Switch Instruction sheet

HP Cluster Platform

Voltaire InfiniBand Interconnects

Read This First: Documentation Roadmap

This document roadmap describes how to access the documentation for Voltaire InfiniBand switches

and software.

This guide supports the following HP part numbers:

HP Part Number Hardware Descriptions

Voltaire 4036

519571-B21 Voltaire InfiniBand 4X QDR 36-Port Managed Switch

Voltaire 4700

590200-B21 Voltaire InfiniBand QDR 324-Port Switch Chassis

590201-B21 Voltaire InfiniBand QDR 324-Port Switch Fabric Board

590202-B21 Voltaire InfiniBand QDR 648-Port Switch Fabric Board

590203-B21 Voltaire InfiniBand QDR 324-Port Switch 18-Port Line

Board

590204-B21 Voltaire InfiniBand QDR 324-Port Switch Management

Module

Voltaire 2004/2012

409370-B21 Voltaire InfiniBand DDR 96-Port Switch Chassis

409371-B21 Voltaire InfiniBand DDR 288-Port Switch Chassis

450697-B21 Voltaire InfiniBand DDR Rev B 96-Port Switch Chassis

450699-B21 Voltaire InfiniBand DDR Rev B 288-Port Switch Chassis

450702-B21 Voltaire InfiniBand DDR Rev B 24-Port Line Board

450698-B21 Voltaire InfiniBand DDR Rev B 96-Port Fabric Board

450700-B21 Voltaire InfiniBand DDR Rev B 288-Port Fabric Board

Voltaire 9024/9096/9288

409367-B21 Voltaire InfiniBand 4X DDR 24-Port Internally Managed

Switch

409366-B21 Voltaire InfiniBand 4X DDR 24-Port Externally Managed

Switch

376166-B22 Voltaire InfiniBand 4X SDR 24-Port Internally Managed

Switch

376165-B22 Voltaire InfiniBand 4X SDR 24-Port Externally Managed

Switch

394080-B21 InfiniBand 96-Port Chassis

376170-B21 InfiniBand 288-Port Chassis

HP Part Number Software Descriptions

UFM 2.x and Newer

590643-B21 Voltaire Unified Fabric Manager Per Node RTU

BladeFM

450717-B21 GridVision BladeFM Software License for HP BladeSystem

c-Class

Voltaire Per Node Software License

450716-B21 Per Node SW License

Contents

Contents ............................................................................................................................................. 3

Overview............................................................................................................................................ 4

Voltaire InfiniBand Interconnect Documentation ....................................................................................... 5

Revision History ............................................................................................................................... 5

Voltaire QDR InfiniBand Hardware and Software .................................................................................... 7

Voltaire ISR 4036 Documentation ...................................................................................................... 7

Voltaire Grid Director 4700 Documentation ........................................................................................ 8

Unified Fabric Manager Information................................................................................................... 9

Voltaire DDR InfiniBand Hardware and Software...................................................................................10

Voltaire ISR 2004 Documentation .................................................................................................... 10

Voltaire ISR 2012 Documentation .................................................................................................... 14

GridVision BladeFM Documentation ................................................................................................. 20

Voltaire SDR InfiniBand Hardware and Software ...................................................................................21

Voltaire ISR 9096-9288 Documentation............................................................................................21

Voltaire ISR 9024 Documentation .................................................................................................... 26

Voltaire OFED 1.4 Documentation ....................................................................................................... 30

Voltaire OFED Linux 5.xDocumentation ............................................................................................... 31

GridStack 4.xDrivers for Red Hat Documentation.................................................................................. 32

GridStack 3.x(IBHOST) Drivers for Red Hat Documentation.................................................................... 35

Windows GridStack Documentation..................................................................................................... 37

Cable Management ........................................................................................................................... 41

Related Documentation....................................................................................................................... 42

For more information.......................................................................................................................... 43

Overview

This document describes the Voltaire InfiniBand interconnects and the related Cluster Platform

documentation. You can link directly to any of the documentation here to assist you in maintaining

your Cluster Platform configuration.

NOTE: Before you begin any system operations, go to the following website and download the latest

documentation updates from the High Performance Computing website:

http://www.docs.hp.com/en/highperfcomp.html

If your hardware configuration contains HP BladeSystems and enclosures, important updates are

available from this site.

Voltaire InfiniBand Interconnect Documentation

The Voltaire InfiniBand interconnects are modular systems that you can use to create large, single-

system grid/cluster fabrics, or you can use them as building blocks for larger fabrics. These

interconnects are designed to maximize performance, streamline operations, and to ensure uptime by

providing full hardware and software reliability, availability, and serviceability (RAS) features.

It is assumed that you are familiar with the Voltaire InfiniBand interconnects and have the knowledge

necessary to maintain and troubleshoot the Voltaire technology that is used in an HP Cluster Platform

configuration.

The Voltaire InfiniBand interconnects and cables were installed by an HP service representative. The

Cluster Platform and Voltaire documentation is provided for your reference and contains information

necessary for you to perform certain maintenance and troubleshooting procedures. All of the

documentation referenced in this document is currently available on the docs.hp.com and Voltaire

websites. If you have any comments about the HP document, please send them to:

http://docs.hp.com/en/feedback.html

For technical support and updates, contact your HP representative rather than using the Voltaire

Technical Assistance Center (TAC) referenced in the Voltaire documentation.

Revision History

Revision Date Changes

December 2009 Added links for:

•Voltaire 4700 switch documentation

•Unified Fabric Manager (UFM)

March 2009 Added links for:

•Voltaire 4036 switch documentation

•Voltaire GridVision Integrated For Grid Directors User Documentation, Grid

Director Software Version 5.4, ISR 9024 Grid Director Software Version:

GridVision 5.1.1

•OFED 1.4 documentation

•Host-based Subnet Manager Version 1.5 documentation

•WinOF Version 2.0 documentation

August 2008 Added links for:

•OFED 5.x release notes

•Linux GridStack User Manual Release 4.3

•GridVision Integrated for Grid Directors User Documentation, Software

Release GridVision 5.2

•Voltaire Grid Director ISR 2012 and ISR 2004 Installation Manual

•Voltaire GridVision ISR 9288/ISR 9096/ISR2012/ISR 2004 Grid Directors

Version 5.2 Release Notes

•Voltaire Grid Director ISR 2012 and ISR 2004 Installation Manual

•Getting Started Short Guide — Voltaire Solution for the ISR 9XXX, ISR 2012

•Voltaire InfiniBand-to-10 GbE Gateway (sRB-2021G Module User Manual,

Software Release 1.0.0

•Release Notes for the Voltaire GridVision Grid Switch ISR 9024, Software

Release 5.1.0

•Voltaire GridVision Integrated for Grid Directors User Documentation, Grid

Switch Software Release GridVision 5.1

May 2008 Added ISR 2004 documentation and OFED 5.x documentation.

April 2008 Added revised GridVision BladeFM Getting Started Guide Software Release

4.2.0 (March 2008), which replaces the 2007 version

March 2008 Added:

•Voltaire InfiniBand GridStack Release Notes Revision 4.3.5.c_8

•OpenMPI Release Notes Version 1.2.5 Revision VLT0

•Grid Director ISR 2012 and ISR 2004 Installation Manual Release 5.0 and

removed the Release 4.1 version

•Release Notes for the Grid Director ISR 9288/ISR9092/ISR2012/ISR 2004

GridVision Revision 5.0.0

•Voltaire GridVision Integrated User Manual, Software Release 5.0

•Voltaire GridVision Integrated Grid Directors ISR 2012/ISR2004 and ISR

9288/9096 User Documentation Suite, Software Release 5.0, which

replaces the Release 4.1 version

•Release notes for GridVision version 5.0

January 2008 First edition

Voltaire QDR InfiniBand Hardware and Software

Voltaire ISR 4036 Documentation

The Voltaire ISR 4036 documentation describes how to install and maintain the ISR 4036 product.

Go to the HP website for updates, technical assistance, and support.

The following documents are provided for your reference and contain information necessary for you

to perform certain maintenance and troubleshooting procedures on the ISR 4036 components.

For Voltaire documentation updates, go to the Voltaire Product Documentation website:

http://www.voltaire.com/SupportAndServices/Product_Documentation

Title/Publication Date/Contents

Grid Director 4036 (QDR) /2036 (DDR) Installation Manual (April 2009)

Topics covered include:

•Introduction

•Unpacking

•Getting started

•Product options

•Technical specifications and certifications

•Hardware installation

•Cabling

•Operation

•Powering on the 4036/2036

•Switch management

•Troubleshooting

•Cable and port pinout

•QSFP cable

Voltaire 4036/2036 Grid Director User Manual (April 2009)

Topics covered include:

•Introduction

•CLI Overview

•Initial System Setup (CLI)

•Built-in-Test

•Updating, Backing up, and Upgrading the Software

•Handover Mechanism and Redundancy/High Availability

•4036/2036 Device Manager

•Remote Configuration Settings

•Security Settings

•Unified Fabric Manager Support

•Factory Defaults

•QSFP Port Management

•Configuring the Subnet Manager

•Configuring Routing Algorithms

•Utilities

•Getting Started with the CLI and Top Level Structure

•Guest Mode

•Admin Mode

•Configuration (config) Mode

Voltaire Grid Director 4700 Documentation

The Voltaire Grid Director 4700 documentation describes how to install and maintain the Grid

Director 4700 product. Go to the HP website for updates, technical assistance, and support.

The following documents are provided for your reference and contain information necessary for you

to perform certain maintenance and troubleshooting procedures on the Grid Director 4700

components.

For Voltaire documentation updates, go to the Voltaire Product Documentation website:

http://www.voltaire.com/SupportAndServices/Product_Documentation

Title/Publication Date/Contents

Voltaire Grid Director 4700 Installation Manual (August 2009)

Topics covered include:

•Introduction

•System Configurations

•4700 Specifications

•Packing and Unpacking

•Preparing for Installation

•Rack-Mounting the 4700 Chassis

•Installing System Boards

•Verifying Installation

•System Cabling

•Troubleshooting

•Definitions and Acronyms

Voltaire Grid Director 4700 User Manual (August 2009)

Topics covered include:

•Introduction

•CLI Overview

•Initial System Setup (CLI)

•Built-in-Test

•Updating, Backing up, and Upgrading the Software

•Handover Mechanism and Redundancy/High Availability

•4700 Device Manager

•Remote Configuration Settings

•Security Settings

•Getting Started with the CLI and Top Level Structure

•Guest Mode

•Admin Mode

•Configuration (config) Mode

Unified Fabric Manager Information

Voltaire’s Unified Fabric Manager (UFM) allows data center operators to efficiently monitor and

operate the entire fabric, increase application performance and maximize fabric resource utilization.

When you purchase UFM from HP, you will receive instructions explaining how to download the UFM

software and obtain a License Key to activate it.

The following links are provided for your reference.

Description Link

•Unified Fabric Manager Software for Data Center Management

•Voltaire Unified Fabric Manager Software - Data Sheet, 2009

•Features & Benefits

Voltaire UFM

Voltaire DDR InfiniBand Hardware and Software

Voltaire ISR 2004 Documentation

The Voltaire ISR 2004 documentation describes how to install and maintain the ISR 2004 product.

Go to the HP website for updates, technical assistance, and support.

The following documents are provided for your reference and contain information necessary for you

to perform certain maintenance and troubleshooting procedures on the ISR 2004 components.

Title/Publication Date/Contents

Voltaire GridVision ISR 9288/ISR 9096/ISR 2012/ISR 2004 Grid Directors Version 5.2

Release Notes (June 2008)

Release notes for the Voltaire GridVision ISR 9288/ISR 9096/ISR 2012/ISR 2004 Grid

Directors, Release 5.2.

Release Notes for the Grid Director ISR 9288/ISR 9096/ISR 2012/ISR 2004 Voltaire

GridVision Software Revision 5.0.0 (March 2008)

Release notes for the ISR 9288/ISR 9096/ISR 2012/ISR 2004 GridVision, Release 5.0.0.

Voltaire InfiniBand-to-10 GbE Gateway (sRB-20210G Module) User Manual, Software Release

1.0.0 (June 2008)

Topics covered include:

•First-time configuration

•The sRB-20210G GUI Device Manager

•Device information

•Device configuration

•Advanced features and configuration tasks

•Networks

•Traffic flow management

•Static route

•Logs and statistics

•Multicast settings

•Accessing the sRB-20210G via the switch GUI VFM

•Partitioning

•sRB-20210G CLI interface reference

•Safe mode

This manual suits for next models

Table of contents

Other HP Switch manuals

HP 5920 Installation manual

HP Enterprise OfficeConnect 1405 v3 Series User manual

HP 6125XLG User manual

HP 2620 series User manual

HP ProLiant BL p-Class GbE2 User manual

HP FlexFabric 5700 User manual

HP 316095-B21 - StorageWorks Edge Switch 2/24 Instruction Manual

HP 6125XLG User manual

HP PROCURVE 2610-PWR Series User manual

HP J3188A Installation and operating manual

HP 6125XLG Installation manual

HP StorageWorks 2/140 - Director Switch Instruction Manual

HP ProCurve 1600M Setup guide

HP 6125G User manual

HP J9979A User manual

HP StorageWorks 2/8-EL - SAN Switch Instruction Manual

HP J3128A AdvanceStack 10Base-T Hub-8E Installation and operating manual

HP J4091A Installation and operating manual

HP 1410 series User manual

HP HCPL-2400 Instruction manual

HP 6125G User manual

HP ProCurve 2610-24 User manual

HP 480-0005-00-15 User manual

HP 6125XLG Installation manual

Popular Switch manuals by other brands

URC

URC Total Control MFS-8 installation manual

Azbil

Azbil HPQ-D11 user manual

Sony

Sony DFS-900M operating instructions

SICK

SICK i17S operating instructions

F&F

F&F SZR-277 quick start guide

Shure

Shure UAMS/BK user guide

Dräger

Dräger X-zone Switch Off Instructions for use

Asco

Asco Joucomatic 349 Series manual

BT Mini Hub user guide

D-Link

D-Link DES-1226G manual

Johnson Controls

Johnson Controls FS80-C installation instructions

Alcatel-Lucent

Alcatel-Lucent 7450 ESS-12 Configuration guide

MicroNet

MicroNet SP1200A user manual

Ruijie

Ruijie RG-PF2920 Series Hardware installation and reference guide

Altinex

Altinex DA1914SX user guide

MiLAN

MiLAN MIL-SM2401M user guide

RJM

RJM MASTERMIND PBC/6X user manual

Atlas

Atlas MMK-KVM8 owner's manual