Silicon Graphics UV 3000 User manual

SGI®UV 3000 System User Guide

Document Number 007-6402-001

or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI.

LIMITED RIGHTS LEGEND

The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source) as specified

in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws,

treaties and conventions. This document is provided with limited rights as defined in 52.227-14.

The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any

contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR

12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto.

Contractor/manufacturer is SGI, 900 North McCarthy Blvd. Milpitas, CA 95035.

TRADEMARKS AND ATTRIBUTIONS

Silicon Graphics, SGI, the SGI logo, NUMAlink, NUMAflex, FullCare, FullExpress, and HardwareCare are trademarks or registered trademarks of Silicon

Graphics International Corp. or its subsidiaries in the United States and/or other countries worldwide.

Intel, Itanium and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. 

UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd. 

Infiniband is a trademark of the InfiniBand Trade Association.

LSI, MegaRAID, and MegaRAID Storage Manager are trademarks or registered trademarks of LSI Corporation.

Linux is a registered trademark of Linus Torvalds in the U.S. and other countries.

Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries.

SUSE LINUX is a registered trademark of Novell Inc.

Windows is a registered trademark of Microsoft Corporation in the United States and other countries.

All other trademarks mentioned herein are the property of their respective owners.

007-6402-001 iii

Record of Revision

Version Description

-001 August, 2015

First Release

007-6402-001 v

Contents

List of Figures . . . . . . . . . . . . . . . . . . . . . . . . xi

List of Tables . . . . . . . . . . . . . . . . . . . . . . . . xiii

Audience. . . . . . . . . . . . . . . . . . . . . . . . . . xv

Important Information . . . . . . . . . . . . . . . . . . . . . . xv

Chapter Descriptions . . . . . . . . . . . . . . . . . . . . . . xvi

Related Publications . . . . . . . . . . . . . . . . . . . . . . .xvii

Conventions . . . . . . . . . . . . . . . . . . . . . . . . . xix

Product Support . . . . . . . . . . . . . . . . . . . . . . . . xx

Reader Comments . . . . . . . . . . . . . . . . . . . . . . . xx

1. Operation Procedures . . . . . . . . . . . . . . . . . . . . . . 1

Precautions . . . . . . . . . . . . . . . . . . . . . . . . . 1

ESD Precaution . . . . . . . . . . . . . . . . . . . . . . . 1

Safety Precautions . . . . . . . . . . . . . . . . . . . . . . 2

Power Connections Overview . . . . . . . . . . . . . . . . . . . . 2

Preparing to Power On . . . . . . . . . . . . . . . . . . . . . 3

SGI UV 3000 PDUs . . . . . . . . . . . . . . . . . . . . . 4

North America PDU Options . . . . . . . . . . . . . . . . . . 4

International PDU Options. . . . . . . . . . . . . . . . . . . 5

Additional PDU Overview information . . . . . . . . . . . . . . . 5

System Connections Overview . . . . . . . . . . . . . . . . . . . . 8

Connecting to the UV System Control Network . . . . . . . . . . . . . . 8

RMC System Control Access . . . . . . . . . . . . . . . . . . . 9

vi 007-6402-001

Contents

UV 3000 System Connections . . . . . . . . . . . . . . . . . . . . 10

Serial Port Connection to the RMC . . . . . . . . . . . . . . . . . . 10

USB-Connected Console Hardware Requirements. . . . . . . . . . . . . 11

Ethernet (LAN) Connection to the RMC . . . . . . . . . . . . . . . . 11

Establishing RMC IP Hardware Connections . . . . . . . . . . . . . . . 12

Using DHCP to Establish an IP Address . . . . . . . . . . . . . . . 12

Using a Static IP Address . . . . . . . . . . . . . . . . . . . 13

Controlling the UV 3000 System . . . . . . . . . . . . . . . . . . . 13

UV 3000 IPMI 2.x Administration Overview . . . . . . . . . . . . . . . 13

Power On Example Using the RMC Network Connection . . . . . . . . . . . . 14

The Command Line Interface . . . . . . . . . . . . . . . . . . . 14

Example CLI Commands Used. . . . . . . . . . . . . . . . . . 15

Powering On and Off from the Command Line Interface . . . . . . . . . . . . 16

Power On Example . . . . . . . . . . . . . . . . . . . . . 16

Power Down Example . . . . . . . . . . . . . . . . . . . . 16

Reset System Example . . . . . . . . . . . . . . . . . . . . 16

Power Status Check Example . . . . . . . . . . . . . . . . . . 16

Monitoring Power On Example . . . . . . . . . . . . . . . . . . . 16

Power off an SGI UV 3000 System . . . . . . . . . . . . . . . . . . 17

Optional In-Rack Console Server and Flat-Panel Interface . . . . . . . . . . . . . 19

Optional In-Rack Console Server . . . . . . . . . . . . . . . . . . 19

Optional SGI Remote Services (SGI RS) . . . . . . . . . . . . . . . . . 21

SGI Remote Services Primary Capabilities . . . . . . . . . . . . . . . . 22

SGI Remote Services Benefits . . . . . . . . . . . . . . . . . . . 22

SGI Remote Service Operations Overview . . . . . . . . . . . . . . . . 22

Optional Components . . . . . . . . . . . . . . . . . . . . . . 24

PCIe Cards . . . . . . . . . . . . . . . . . . . . . . . . 24

PCIe Drive Controllers in BaseIO Blade . . . . . . . . . . . . . . . . 26

RAID PCIe Disk Controller . . . . . . . . . . . . . . . . . . 26

Non-RAID PCIe Disk Controller . . . . . . . . . . . . . . . . . 27

Contents

007-6402-001 vii

2. System Control . . . . . . . . . . . . . . . . . . . . . . . . 29

Levels of System Control . . . . . . . . . . . . . . . . . . . . . 29

RMC and System Management Overview . . . . . . . . . . . . . . . . 30

CMC Overview . . . . . . . . . . . . . . . . . . . . . . . 31

BMC Overview . . . . . . . . . . . . . . . . . . . . . . . 32

System Controller Interaction . . . . . . . . . . . . . . . . . . . . 33

IRU Controllers . . . . . . . . . . . . . . . . . . . . . . . . 34

Chassis Management Controller Functions. . . . . . . . . . . . . . . . 34

1U Console Plus Admin Server Option . . . . . . . . . . . . . . . . 34

Flat Panel Rackmount Console Option Features . . . . . . . . . . . . . 35

3. System Overview . . . . . . . . . . . . . . . . . . . . . . . 37

System Models . . . . . . . . . . . . . . . . . . . . . . . . 39

System Architecture . . . . . . . . . . . . . . . . . . . . . . . 41

System Features . . . . . . . . . . . . . . . . . . . . . . . . 43

Modularity and Scalability . . . . . . . . . . . . . . . . . . . . 43

Distributed Shared Memory (DSM) . . . . . . . . . . . . . . . . . 43

Distributed Shared I/O . . . . . . . . . . . . . . . . . . . . . 45

Chassis Management Controller (CMC) . . . . . . . . . . . . . . . . 45

ccNUMA Architecture . . . . . . . . . . . . . . . . . . . . . 45

Cache Coherency . . . . . . . . . . . . . . . . . . . . . 45

Non-uniform Memory Access (NUMA) . . . . . . . . . . . . . . . 46

Reliability, Availability, and Serviceability (RAS) . . . . . . . . . . . . . 46

System Components . . . . . . . . . . . . . . . . . . . . . . . 48

Optional BaseIO SSDs . . . . . . . . . . . . . . . . . . . . . 50

MIC/GPU Enabled Compute Blade . . . . . . . . . . . . . . . . . 51

Bay (Unit) Numbering . . . . . . . . . . . . . . . . . . . . . 52

Rack Numbering . . . . . . . . . . . . . . . . . . . . . . 52

Optional System Components . . . . . . . . . . . . . . . . . . . 52

4. Rack Information . . . . . . . . . . . . . . . . . . . . . . . 53

Overview . . . . . . . . . . . . . . . . . . . . . . . . . 53

SGI UV 3000 Series Rack (42U) . . . . . . . . . . . . . . . . . . . 54

SGI UV 3000 42U System Rack Technical Specifications . . . . . . . . . . . . . 58

viii 007-6402-001

Contents

The 24U (Short) Rack . . . . . . . . . . . . . . . . . . . . . . 59

5. Optional Octal Router Chassis Information . . . . . . . . . . . . . . . . 61

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . 61

SGI UV 3000 Series NUMAlink Octal Router Chassis . . . . . . . . . . . . . . 62

SGI UV 3000 External NUMAlink System Technical Specifications . . . . . . . . . . 64

6. Add or Replace Procedures . . . . . . . . . . . . . . . . . . . . 65

Maintenance Precautions and Procedures . . . . . . . . . . . . . . . . . 65

Preparing the System for Maintenance or Upgrade . . . . . . . . . . . . . . 66

Returning the System to Operation . . . . . . . . . . . . . . . . . . 66

Removing and Replacing an IRU Enclosure Power Supply . . . . . . . . . . . . . 67

Replacing a System Fan (Blower) . . . . . . . . . . . . . . . . . . . 69

Replacing a Blade-Mounted Drive . . . . . . . . . . . . . . . . . . . 72

7. Troubleshooting and Diagnostics . . . . . . . . . . . . . . . . . . . 75

Troubleshooting Chart . . . . . . . . . . . . . . . . . . . . . . 76

LED Status Indicators . . . . . . . . . . . . . . . . . . . . . . 77

IRU Power Supply LEDs . . . . . . . . . . . . . . . . . . . . 77

Compute/Memory Blade LEDs . . . . . . . . . . . . . . . . . . . 78

SGI Electronic Support . . . . . . . . . . . . . . . . . . . . . . 79

SGI Remote Services (SGI RS) . . . . . . . . . . . . . . . . . . . 79

SGI Knowledgebase . . . . . . . . . . . . . . . . . . . . . . 79

SGI Warranty Levels . . . . . . . . . . . . . . . . . . . . . 79

A. Technical Specifications and Pinouts . . . . . . . . . . . . . . . . . . 81

System-level Specifications . . . . . . . . . . . . . . . . . . . . . 81

Physical Specifications . . . . . . . . . . . . . . . . . . . . . . 82

Environmental Specifications . . . . . . . . . . . . . . . . . . . . 83

Power Specifications . . . . . . . . . . . . . . . . . . . . . . . 84

I/O Port Specifications . . . . . . . . . . . . . . . . . . . . . . 85

BaseIO VGA Port Information . . . . . . . . . . . . . . . . . . . 85

Ethernet Port. . . . . . . . . . . . . . . . . . . . . . . . 87

Serial Ports . . . . . . . . . . . . . . . . . . . . . . . . 88

USB Type A Connector . . . . . . . . . . . . . . . . . . . . . 90

Contents

007-6402-001 ix

B. Safety Information and Regulatory Specifications . . . . . . . . . . . . . . 91

Safety Information . . . . . . . . . . . . . . . . . . . . . . . 91

Regulatory Specifications . . . . . . . . . . . . . . . . . . . . . 93

CMN Number . . . . . . . . . . . . . . . . . . . . . . . 93

CE Notice and Manufacturer’s Declaration of Conformity . . . . . . . . . . . 93

Electromagnetic Emissions . . . . . . . . . . . . . . . . . . . . 94

FCC Notice (USA Only) . . . . . . . . . . . . . . . . . . . 94

Industry Canada Notice (Canada Only) . . . . . . . . . . . . . . . 95

VCCI Notice (Japan Only). . . . . . . . . . . . . . . . . . . 95

Korean Class A Regulatory Notice . . . . . . . . . . . . . . . . 95

Shielded Cables . . . . . . . . . . . . . . . . . . . . . . . 96

Electrostatic Discharge . . . . . . . . . . . . . . . . . . . . . 96

Laser Compliance Statements . . . . . . . . . . . . . . . . . . . 97

Lithium Battery Statement . . . . . . . . . . . . . . . . . . . . 98

Table of contents

Other Silicon Graphics Server manuals

Silicon Graphics

Silicon Graphics Rackable C2110G-RP5 User manual

Silicon Graphics

Silicon Graphics InfiniteStorage 3104 User manual

Silicon Graphics

Silicon Graphics InfiniteStorage 3000 User manual

Silicon Graphics

Silicon Graphics Origin 300 User manual

Silicon Graphics

Silicon Graphics 1200 User manual

Silicon Graphics

Silicon Graphics InfiniteStorage 3500 User manual

Silicon Graphics

Silicon Graphics 1450 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4KL1 User manual

Silicon Graphics

Silicon Graphics 1400 User manual

Silicon Graphics

Silicon Graphics ICE X User manual

Silicon Graphics

Silicon Graphics SGI 1100 Installation and operation manual

Silicon Graphics

Silicon Graphics 1450 Operating manual

Silicon Graphics

Silicon Graphics Origin200 User manual

Silicon Graphics

Silicon Graphics Altix XE210 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4GP3 User manual

Silicon Graphics

Silicon Graphics Rackable C2112-4G3 User manual

Silicon Graphics

Silicon Graphics 2400 User manual

Silicon Graphics

Silicon Graphics Origin 350 User manual

Silicon Graphics

Silicon Graphics 1400 Installation and operation manual

Silicon Graphics

Silicon Graphics Altix XE340 User manual

Silicon Graphics

Silicon Graphics 1450 User manual

Silicon Graphics

Silicon Graphics UV 30 User manual

Silicon Graphics

Silicon Graphics POWER CHALLENGE User manual

Silicon Graphics

Silicon Graphics Rackable C1104-GP2 User manual

Popular Server manuals by other brands

HP AlphaServer ES47 Cli reference manual

Dell

Dell PowerEdge R410 Getting started

PowerNAS

PowerNAS CMA quick start guide

Supero

Supero FatTwin F617R3-FT user manual

MSI

MSI P1-109N-L70 user manual

Dell

Dell PowerEdge XE9640 Installation and service manual

Dell

Dell PS4100 Hardware

EtroVISION

EtroVISION EV3151 user manual

NEC

NEC Express5800/T110j System configuration guide

HP ProLiant Gen9 user guide

Compaq

Compaq ProLiant 3000 Maintenance and service guide

Dell

Dell PowerEdge 3YPMN Getting started guide

iRobo

iRobo IPC2U user manual

Nortel

Nortel 1000 Con?guration guide user manual

Asus

Asus AP7500 Hardware reference guide

Avid Technology

Avid Technology AirSpeed 5000 manual

HP Integrity rx2600 overview

Milestone

Milestone Husky IVO 350T Getting started