Silicon Graphics UV 2000 User manual

SGI®UV 2000 System User Guide

Document Number 007-5832-002

or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI.

LIMITED RIGHTS LEGEND

The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/freesource) as specified

in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws,

treaties and conventions. This document is provided with limited rights as defined in 52.227-14.

The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any

contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR

12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto.

Contractor/manufacturer is SGI, 46600 Landing Parkway, Fremont, CA 94538.

TRADEMARKS AND ATTRIBUTIONS

Silicon Graphics, SGI, the SGI logo, NUMAlink and NUMAflex are trademarks or registered trademarks of Silicon Graphics International Corp. or its

subsidiaries in the United States and/or other countries worldwide.

Intel, Itanium and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.

Infiniband is a trademark of the InfiniBand Trade Association.

LSI, MegaRAID, and MegaRAID Storage Manager are trademarks or registered trademarks of LSI Corporation.

Linux is a registered trademark of Linus Torvalds in the U.S. and other countries.

Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries.

SUSE LINUX is a registered trademark of Novell Inc.

Windows is a registered trademark of Microsoft Corporation in the United States and other countries.

All other trademarks mentioned herein are the property of their respective owners.

007-5832-002 iii

Record of Revision

Version Description

001 June, 2012

First Release

002 May, 2013

MIC/GPU Blade and RAID updates

007-5832-002 v

Contents

List of Figures . . . . . . . . . . . . . . . . . . . . . . . . xi

List of Tables . . . . . . . . . . . . . . . . . . . . . . . . xiii

Audience. . . . . . . . . . . . . . . . . . . . . . . . . . xv

Important Information . . . . . . . . . . . . . . . . . . . . . . xv

Chapter Descriptions . . . . . . . . . . . . . . . . . . . . . . xvi

Related Publications. . . . . . . . . . . . . . . . . . . . . . .xvii

Conventions . . . . . . . . . . . . . . . . . . . . . . . . . xix

Product Support . . . . . . . . . . . . . . . . . . . . . . . . xx

Reader Comments . . . . . . . . . . . . . . . . . . . . . . . xx

1. Operation Procedures . . . . . . . . . . . . . . . . . . . . . . 1

Precautions . . . . . . . . . . . . . . . . . . . . . . . . . 1

ESD Precaution . . . . . . . . . . . . . . . . . . . . . . . 1

Safety Precautions . . . . . . . . . . . . . . . . . . . . . . 2

Power Connections Overview . . . . . . . . . . . . . . . . . . . . 2

System Connections Overview . . . . . . . . . . . . . . . . . . . . 7

Connecting to the UV System Control Network . . . . . . . . . . . . . . 7

System Controller Access . . . . . . . . . . . . . . . . . . . . 8

Serial Console Hardware Requirements . . . . . . . . . . . . . . . . 9

Establishing a Serial Connection to the CMC on SGI UV 2000 . . . . . . . . . . 9

Establishing CMC IP Hardware Connections . . . . . . . . . . . . . . . 9

Using DHCP to Establish an IP Address . . . . . . . . . . . . . . . 10

Using a Static IP Address . . . . . . . . . . . . . . . . . . . 10

vi 007-5832-002

Contents

System Control Overview . . . . . . . . . . . . . . . . . . . . . 12

Communicating with the System . . . . . . . . . . . . . . . . . . 13

The SGI Management Center Graphical User Interface . . . . . . . . . . . . 13

Powering-On and Off From the SGI Management Center Interface . . . . . . . . . 13

The Command Line Interface . . . . . . . . . . . . . . . . . . . 14

Powering On and Off from the Command Line Interface . . . . . . . . . . . 14

Command Options for Power On . . . . . . . . . . . . . . . . . 15

Power On the System From the SMN Command Line. . . . . . . . . . . . 15

Specific CLI Commands Used With the SMN . . . . . . . . . . . . . . 16

Optional Power On From the CMC Command Line . . . . . . . . . . . . . 17

Booting Directly From a CMC . . . . . . . . . . . . . . . . . . . 17

Power On the System Using the CMC Network . . . . . . . . . . . . . 17

Optional Power On Using the SMN to Connect to the CMC . . . . . . . . . . 18

Monitoring Power On . . . . . . . . . . . . . . . . . . . . . 19

Power off a UV System . . . . . . . . . . . . . . . . . . . . . 20

Additional CLI Power Command Options . . . . . . . . . . . . . . . 20

Using Embedded Support Partner (ESP). . . . . . . . . . . . . . . . . . 22

Optional Components . . . . . . . . . . . . . . . . . . . . . . 23

PCIe Cards . . . . . . . . . . . . . . . . . . . . . . . . 23

PCIe Drive Controllers in BaseIO Blade . . . . . . . . . . . . . . . . 25

RAID PCIe Disk Controller . . . . . . . . . . . . . . . . . . 25

Non-RAID PCIe Disk Controller . . . . . . . . . . . . . . . . . 26

2. System Control . . . . . . . . . . . . . . . . . . . . . . . . 27

Levels of System Control . . . . . . . . . . . . . . . . . . . . . 27

System Management Node (SMN) Overview . . . . . . . . . . . . . . . 28

CMC Overview . . . . . . . . . . . . . . . . . . . . . . . 29

BMC Overview . . . . . . . . . . . . . . . . . . . . . . . 31

System Controller Interaction . . . . . . . . . . . . . . . . . . . . 31

IRU Controllers . . . . . . . . . . . . . . . . . . . . . . . . 32

Chassis Management Controller Functions . . . . . . . . . . . . . . . . 32

1U Console Option . . . . . . . . . . . . . . . . . . . . . . 32

Flat Panel Rackmount Console Option Features . . . . . . . . . . . . . 33

Contents

007-5832-002 vii

3. System Overview . . . . . . . . . . . . . . . . . . . . . . . 35

System Models . . . . . . . . . . . . . . . . . . . . . . . . 37

System Architecture . . . . . . . . . . . . . . . . . . . . . . . 39

System Features . . . . . . . . . . . . . . . . . . . . . . . . 41

Modularity and Scalability . . . . . . . . . . . . . . . . . . . . 41

Distributed Shared Memory (DSM) . . . . . . . . . . . . . . . . . 41

Distributed Shared I/O . . . . . . . . . . . . . . . . . . . . . 43

Chassis Management Controller (CMC) . . . . . . . . . . . . . . . . 43

ccNUMA Architecture . . . . . . . . . . . . . . . . . . . . . 43

Cache Coherency . . . . . . . . . . . . . . . . . . . . . 43

Non-uniform Memory Access (NUMA) . . . . . . . . . . . . . . . 44

Reliability, Availability, and Serviceability (RAS) . . . . . . . . . . . . . 44

System Components. . . . . . . . . . . . . . . . . . . . . . . 46

Optional BaseIO SSDs . . . . . . . . . . . . . . . . . . . . . 48

MIC/GPU Enabled Compute Blade . . . . . . . . . . . . . . . . . 49

Bay (Unit) Numbering . . . . . . . . . . . . . . . . . . . . . 50

Rack Numbering . . . . . . . . . . . . . . . . . . . . . . 50

Optional System Components . . . . . . . . . . . . . . . . . . . 50

4. Rack Information . . . . . . . . . . . . . . . . . . . . . . . 51

Overview . . . . . . . . . . . . . . . . . . . . . . . . . 51

SGI UV 2000 Series Rack (42U) . . . . . . . . . . . . . . . . . . . 52

SGI UV 2000 System Rack Technical Specifications . . . . . . . . . . . . . . 56

5. Optional Octal Router Chassis Information . . . . . . . . . . . . . . . . 57

Overview . . . . . . . . . . . . . . . . . . . . . . . . . 57

SGI UV 2000 Series NUMAlink Octal Router Chassis. . . . . . . . . . . . . . 58

SGI UV 2000 External NUMAlink System Technical Specifications . . . . . . . . . . 60

6. Add or Replace Procedures . . . . . . . . . . . . . . . . . . . . 61

Maintenance Precautions and Procedures . . . . . . . . . . . . . . . . . 61

Preparing the System for Maintenance or Upgrade . . . . . . . . . . . . . 62

Returning the System to Operation. . . . . . . . . . . . . . . . . . 62

Overview of PCI Express (PCIe) Operation . . . . . . . . . . . . . . . . 63

viii 007-5832-002

Contents

Adding or Replacing PCIe Cards in the Expansion Enclosure . . . . . . . . . . . . 64

Installing Cards in the 1U PCIe Expansion Chassis. . . . . . . . . . . . . . 65

Removing and Replacing an IRU Enclosure Power Supply . . . . . . . . . . . 68

7. Troubleshooting and Diagnostics . . . . . . . . . . . . . . . . . . . 71

Troubleshooting Chart . . . . . . . . . . . . . . . . . . . . . . 72

LED Status Indicators . . . . . . . . . . . . . . . . . . . . . . 73

IRU Power Supply LEDs . . . . . . . . . . . . . . . . . . . . 73

Compute/Memory Blade LEDs . . . . . . . . . . . . . . . . . . . 74

SGI Electronic Support . . . . . . . . . . . . . . . . . . . . . . 75

A. Technical Specifications and Pinouts . . . . . . . . . . . . . . . . . . 79

System-level Specifications . . . . . . . . . . . . . . . . . . . . . 79

Physical Specifications . . . . . . . . . . . . . . . . . . . . . . 80

Environmental Specifications . . . . . . . . . . . . . . . . . . . . 81

Power Specifications . . . . . . . . . . . . . . . . . . . . . . . 82

I/O Port Specifications . . . . . . . . . . . . . . . . . . . . . . 83

BaseIO VGA Port Information . . . . . . . . . . . . . . . . . . . 83

Ethernet Port. . . . . . . . . . . . . . . . . . . . . . . . 85

Serial Ports . . . . . . . . . . . . . . . . . . . . . . . . 86

USB Type A Connector . . . . . . . . . . . . . . . . . . . . . 88

B. Safety Information and Regulatory Specifications . . . . . . . . . . . . . . 89

Safety Information . . . . . . . . . . . . . . . . . . . . . . . 89

Contents

007-5832-002 ix

Regulatory Specifications . . . . . . . . . . . . . . . . . . . . . 91

CMN Number . . . . . . . . . . . . . . . . . . . . . . . 91

CE Notice and Manufacturer’s Declaration of Conformity . . . . . . . . . . . 91

Electromagnetic Emissions. . . . . . . . . . . . . . . . . . . . 92

FCC Notice (USA Only) . . . . . . . . . . . . . . . . . . . 92

Industry Canada Notice (Canada Only) . . . . . . . . . . . . . . . 93

VCCI Notice (Japan Only). . . . . . . . . . . . . . . . . . . 93

Korean Class A Regulatory Notice . . . . . . . . . . . . . . . . 93

Shielded Cables. . . . . . . . . . . . . . . . . . . . . . . 94

Electrostatic Discharge . . . . . . . . . . . . . . . . . . . . . 94

Laser Compliance Statements . . . . . . . . . . . . . . . . . . . 95

Lithium Battery Statement . . . . . . . . . . . . . . . . . . . . 96

Table of contents

Other Silicon Graphics Server manuals

Silicon Graphics

Silicon Graphics Rackable C1000 User manual

Silicon Graphics

Silicon Graphics 1450 User manual

Silicon Graphics

Silicon Graphics InfiniteStorage 3104 User manual

Silicon Graphics

Silicon Graphics UV 30 User manual

Silicon Graphics

Silicon Graphics Origin200 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4KL1 User manual

Silicon Graphics

Silicon Graphics Rackable C1110-RP6 User manual

Silicon Graphics

Silicon Graphics UV 20 User manual

Silicon Graphics

Silicon Graphics 1400 User manual

Silicon Graphics

Silicon Graphics 1200 User manual

Silicon Graphics

Silicon Graphics UV 3000 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4RP9 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4GP3 User manual

Silicon Graphics

Silicon Graphics Rackable C1104G-RP5 User manual

Silicon Graphics

Silicon Graphics Origin 350 User manual

Silicon Graphics

Silicon Graphics Altix XE320 User manual

Silicon Graphics

Silicon Graphics 1450 User manual

Silicon Graphics

Silicon Graphics Rackable C2110G-RP5 User manual

Silicon Graphics

Silicon Graphics Origin 300 User manual

Silicon Graphics

Silicon Graphics Altix XE250 User manual

Silicon Graphics

Silicon Graphics InfiniteStorage 3500 User manual

Silicon Graphics

Silicon Graphics InfiniteStorage 3000 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4G3 User manual

Silicon Graphics

Silicon Graphics Rackable H2106-G7 User manual

Popular Server manuals by other brands

HP AlphaServer ES47 Cli reference manual

Dell

Dell PowerEdge R410 Getting started

PowerNAS

PowerNAS CMA quick start guide

Supero

Supero FatTwin F617R3-FT user manual

MSI

MSI P1-109N-L70 user manual

Dell

Dell PowerEdge XE9640 Installation and service manual

Dell

Dell PS4100 Hardware

EtroVISION

EtroVISION EV3151 user manual

NEC

NEC Express5800/T110j System configuration guide

HP ProLiant Gen9 user guide

Compaq

Compaq ProLiant 3000 Maintenance and service guide

Dell

Dell PowerEdge 3YPMN Getting started guide

iRobo

iRobo IPC2U user manual

Nortel

Nortel 1000 Con?guration guide user manual

Asus

Asus AP7500 Hardware reference guide

Avid Technology

Avid Technology AirSpeed 5000 manual

HP Integrity rx2600 overview

Milestone

Milestone Husky IVO 350T Getting started