Intel SGI Altix 450 - Manuals

viii 007-4857-002 Contents System Components . . . . . . . . . . . . . . . . . . . . . . . 76 Bay (Unit) Numbering . . . . . . . . . . . . . . . . . . . . . 77 Rack Numbering. . . . . . . . . . . . . . . . . . . . . . . 77 Optional System Components . . . . . . . . . . . . . . . . . . . 78 4. System...

Contents 007-4857-002 ix Altix 42U and 20U Rack Features . . . . . . . . . . . . . . . . . . . 102 Technical Specifications. . . . . . . . . . . . . . . . . . . . . . 104 6. Maintenance and Upgrade Procedures . . . . . . . . . . . . . . . . . 107 Maintenance Precautions and Procedures . . . . . . . ...

x 007-4857-002 Contents Physical Specifications . . . . . . . . . . . . . . . . . . . . . 154 Environmental Specifications . . . . . . . . . . . . . . . . . . . 156 Power Specifications . . . . . . . . . . . . . . . . . . . . . . 157 I/O Port Specifications . . . . . . . . . . . . . . . . . . . . . ...

List of Figures 007-4857-002 xi List of Figures Figure 1-1 30-amp Single-phase Power Receptacle for North American Sites . . . 9 Figure 1-2 32-amp Single-phase Power Plug for International Sites . . . . . 11 Figure 1-3 Dimensions of Tall Rack Shipping Crate . . . . . . . . . 13 Figure 1-4 Dimensions...

xii 007-4857-002 List of Figures Figure 2-4 2D Graphics Card Location in IA2 Blade . . . . . . . . . 59 Figure 3-1 SGI Altix 450 System (Short Rack) . . . . . . . . . . . 68 Figure 3-2 SGI Altix 450 Server System (Tall Rack) . . . . . . . . . 69 Figure 3-3 Blade, IRU and Rack Components . . . . . . ...

List of Figures 007-4857-002 xiii Figure 6-23 Seating the Card in the Slot . . . . . . . . . . . . . 135 Figure 6-24 Removing the Card Access Panel From the IA Blade . . . . . . 136 Figure 6-25 Replacing the IA Blade PCI Access Door . . . . . . . . . 137 Figure 6-26 Location of Disk Drive Bays . . ....

List of Tables 007-4857-002 xv List of Tables Table 1-1 Installation Tools . . . . . . . . . . . . . . . . 7 Table 1-2 IRU Space Requirements. . . . . . . . . . . . . . 24 Table 5-1 Tall Altix Rack Technical Specifications . . . . . . . . . 104 Table 5-2 Short Altix Rack Technical Specifications . ....

007-4857-002 xvii About This Guide This guide provides an overview of the installation, architecture, general operation and descriptions of the major components that compose the SGI ® Altix ® 450 family of systems. It also provides the standard procedures for powering on and powering off the system,...

xviii 007-4857-002 About This Guide • Using the ESI/ops panel (operating panel) on optional mass storage bricks. See the user’s guide for your optional SGI mass storage enclosure. Chapter Descriptions The following topics are covered in this guide: • Chapter 1, “System Installation” guides an instal...

Related Publications 007-4857-002 xix Related Publications The following SGI documents are relevant to the Altix 450 series system: • SGI L1 and L2 Controller Software User’s Guide (P/N 007-3938-00 x ) This guide describes how to use the L1 and L2 controller commands at your system console to monito...

xx 007-4857-002 About This Guide References in the documentation to these pages include the name of the command and the section number in which the command is found. For additional information about displaying man pages using the man command, see man(1) . In addition, the apropos command locates man...

Conventions 007-4857-002 xxi Conventions The following conventions are used throughout this document: Product Support SGI provides a comprehensive product support and maintenance program for its products, as follows: • If you are in North America, contact the Technical Assistance Center at +1 800 80...

xxii 007-4857-002 About This Guide Reader Comments If you have comments about the technical accuracy, content, or organization of this document, contact SGI. Be sure to include the title and document number of the manual with your comments. (Online, the document number is located in the front matter...

007-4857-002 1 Chapter 1 1. System Installation This chapter describes how to unpack and install your Altix 450 system. Specifically, the following topics are covered: • “System Installation Overview” on page 2 • “Safety Precautions” on page 3 • “Installing a Rack” on page 6 • “Unpacking and Inspect...

2 007-4857-002 1: System Installation System Installation Overview In this chapter, different installation instructions are provided for different types of system installations. Follow the instructions for your type of installation, as follows: Note: It is assumed that you will be connecting a syste...

Safety Precautions 007-4857-002 3 • If you have ordered either a single- or dual-IRU system that you intend to install on a table top, follow the instructions in these sections: – “Safety Precautions” on page 3 – “Unpacking and Inspecting Modules” on page 22 – “Installing the IRUs in a Rack” on page...

4 007-4857-002 1: System Installation Hazard Statements During the installation of your Altix 450 system, be alert for hazard advisory statements with icons, which signify the following: • Caution indicates a potentially hazardous situation that, if not avoided, can result in minor or moderate injur...

Safety Precautions 007-4857-002 5 Safety Measures Observe the following safety measures when you install the system: • Use caution when you remove the system from the shipping crate. Failure to handle the system carefully can result in personal injury or property damage. Caution: Ensure that the shi...

6 007-4857-002 1: System Installation Installing a Rack This section describes how to install a rack that already has your system IRUs rackmounted and cabled together. The following information is provided: • “Preinstallation Activities” on page 6 • “Unloading and Moving System Equipment” on page 12...

Installing a Rack 007-4857-002 7 Tools Required Table 1-1 lists the tools that you need to complete the installation. Table 1-1 Installation Tools Tool Part Number Purpose 13-mm wrench 7260744 Adjust the leveling pads. 13-mm socket (3/8-in. drive) 7260726 Remove bracket bolts from tall rack shipping...

8 007-4857-002 1: System Installation Power Receptacle Verification Ensure that a qualified technician installs the correct power receptacles. Your Altix 450 system uses one or two single-phase power receptacles. For North American sites, the single-phase receptacle is a 30-amp, 200- to 240-volt rec...

10 007-4857-002 1: System Installation For international sites, follow these steps to ensure that a single-phase power receptacle is properly wired: 1. Set the voltmeter to a high AC voltage range. 2. Check the voltage between socket 1 and socket 2 (see Figure 1-2). The meter should read between 200...

12 007-4857-002 1: System Installation Unloading and Moving System Equipment Your Altix 450 system arrives at the site in a pallet-mounted cardboard shipping crate. For a short rack system, the documentation carton and the accessories carton are packed with the system. The documentation carton conta...

14 007-4857-002 1: System Installation Figure 1-4 shows the lift openings and dimensions of a short rack shipping crate. This figure also shows where to position the pallet jack. Figure 1-4 Dimensions of Short Rack Shipping Crate Inspecting the Shipping Crate After the system is unloaded from the tr...

Installing a Rack 007-4857-002 15 Transporting the Shipping Crate Use a pallet jack with forks that are 48 in. (122 cm) long or longer to transport the shipping crate to the designated location. See Figure 1-3 and Figure 1-4 for the crate dimensions and location to position the pallet jack. If the c...

16 007-4857-002 1: System Installation Removing a Short Rack from the Shipping Crate Warning: Be careful when you unpack and move the short rack system. Use a pallet jack to move the rack to the unpacking site. Ensure that the rack remains on a level surface and that the rack weight remains evenly d...

18 007-4857-002 1: System Installation Unpacking and Installing the Tall Rack Warning: In its maximum configuration, a (42U) tall rack system weighs approximately 1,450 lb (658 kg). Use caution when you unpack and move this rack. A pallet jack is needed to move the rack prior to unpacking. Ensure th...

Installing a Rack 007-4857-002 21 Positioning and Leveling Racks Caution: To avoid ESD damage to the electronic components, be sure to position the racks before you remove the ESD bags that cover the rack assemblies. To position and level your system racks, follow these steps: 1. Grasp the rear of e...

22 007-4857-002 1: System Installation Figure 1-9 Seismic Tie-down Attachment Points Unpacking and Inspecting Modules This section describes how to unpack and inspect individual IRUs. Follow these instructions if you plan to install individual modules in a rack or on a table top. Before unpacking yo...

24 007-4857-002 1: System Installation Installing the IRUs in a Rack This section describes how to install the IRUs that compose an Altix 450 system in a rack. This section also describes how to remove the IRUs from a rack. You can use the instructions to rackmount one or more IRUs in a 20U (short) ...

Installing the IRUs in a Rack 007-4857-002 25 Determining Where to Attach Rails in a Rack The base IRU, and any additional IRUs, each require five units (5U) of vertical space within the rack (one unit is equivalent to 1.75 inches [44.5 mm]). To determine where you should install the unit’s shelf ra...

26 007-4857-002 1: System Installation Rackmounting IRUs with Shelf Rails This section describes how to rackmount an IRU using shelf rails. The shelf rails, which are shipped with the module, support the module within the rack. To attach the shelf rails to the rack, follow these steps: 1. Locate the...

Installing the IRUs in a Rack 007-4857-002 27 Note: Even with the blades, power supplies and fan module disconnected, the IRU’s base unit is heavy. Always use two people when installing it into a rack. 7. Working from the front of the rack, set the rear edge of the IRU module on the shelf rails. The...

28 007-4857-002 1: System Installation Removing a Rackmounted IRU Module To remove an IRU that is already mounted in a rack, follow these steps: 1. Power off the module. For instructions on how to power off the module, see “Powering the System On and Off” on page 38. 2. Disconnect all of the cables ...

NUMAlink Cabling the System IRUs 007-4857-002 29 NUMAlink Cabling the System IRUs Some configurations of an Altix 450 system will consist of either two or more IRUs. This section describes how to cable together these multiple units. If your system was shipped with all the cables pre-installed, go on...

30 007-4857-002 1: System Installation Figure 1-14 NUMAlink Cabling an IRU to an Additional IRU To connect two Altix 450 compute modules to each other with NUMAlink cables, follow these steps: 1. Power off both compute modules (see “Powering the System On and Off” on page 38). 2. Connect the NUMAlin...

Cabling the System IRUs to a Power Source 007-4857-002 31 The console output should indicate that the processors and memory on both IRU modules have been discovered. If the secondary IRU module has not been discovered, use the reset L1 command to perform a reset of the system. Note: Use the network ...

34 007-4857-002 1: System Installation Connecting System Modules to a Rack Power Source If your Altix 450 system is shipped from SGI in a rack, there will be at least one power distribution unit (PDU) installed in the rack. Note that each single-phase PDU can support a maximum of two Altix 450 IRUs....

36 007-4857-002 1: System Installation Connecting the System Console This section explains how to attach and establish a connection between a system console and an Altix 450 system. The system console enables you to perform the following activities: • Start a Linux console session to set up networki...

38 007-4857-002 1: System Installation Operating Your System This section describes how to operate your Altix 450 system, as follows: • “Powering the System On and Off” on page 38 • “L1 Front Panel Controls” on page 44 • “Operating the L1 Controller” on page 45 Powering the System On and Off This se...

Operating Your System 007-4857-002 39 Powering On With Optional System Console and L1/L2 Controller To power on and boot your system using the system console, follow these steps: 1. If not yet done so, connect a system console to the server system as described in “Connecting the System Console” on p...

40 007-4857-002 1: System Installation 4. Verify that all of the L1 controllers display “L1 running.” If any L1 controllers are not running, contact your SGI system support engineer (SSE). 5. At the system console, access the L2 controller by entering the following command: $> /stand/sysco/bin/12...

Operating Your System 007-4857-002 41 Powering On Manually or With L1 Console If your system does not have a a local system console, you can manually power on and off the server by using the power button(s). To power on your system or an individual IRU manually, follow these steps: 1. If the monitor...

42 007-4857-002 1: System Installation Powering Off at the System Console To power off your system using the system console, follow these steps: Caution: If you power off the system before you halt the operating system, you can lose data. 1. Shut down the operating system by entering the following c...

Operating Your System 007-4857-002 43 Powering Off Manually To power off your system manually, follow these steps: Caution: If you power off the system before you halt the operating system, you can lose data. 1. Shut down the operating system by entering the following command: # init 0 2. Press the ...

44 007-4857-002 1: System Installation L1 Front Panel Controls The L1 front panel of the Altix 450 IRU provides the following control features, as shown in Figure 1-22: • Status LEDs. The front panel has the following LEDs: • Power button LED. This LED illuminates green when the internal components ...

Operating Your System 007-4857-002 45 Note: If your system includes an optional storage module, see the user’s guide that comes with the product for operating instructions. Operating the L1 Controller The L1 controller operates in one of the two following modes: • L1 mode . The L1 prompt ( 001c01-L1...

007-4857-002 47 Chapter 2 2. Operation Procedures This chapter explains how to operate your new system in the following sections: • “Precautions” on page 47 • “System Controller Network” on page 49 • “Powering the System On and Off” on page 51 • “Using Embedded Support Partner (ESP)” on page 56 • “M...

48 007-4857-002 2: Operation Procedures Safety Precautions Warning: Before operating or servicing any part of this product, read the “Safety Information” on page 165. Danger: Keep fingers and conductive tools away from high-voltage areas. Failure to follow these precautions will result in serious in...

System Controller Network 007-4857-002 49 System Controller Network All Altix 450 enclosures contain an embedded microprocessor board and display assembly known as the system controller. This microprocessor runs an embedded version of the Linux operating system. The system controller runs off standb...

50 007-4857-002 2: Operation Procedures Console Connections A console is defined as a connection to the system that provides access to the system controller network. A console can be a personal computer (Ethernet connection) or a dumb terminal (serial connection). The Altix 450 series supports multi...

Communicating with the System Controller 007-4857-002 51 Communicating with the System Controller Once a connection to the console is established, the user will be presented with either an L2 prompt (ethernet connection), known as L2 mode, or and L1 prompt (serial connection), known as L1 mode. From...

52 007-4857-002 2: Operation Procedures Preparing to Power On To prepare to power on your system, follow these steps: 1. Check to ensure that the cabling between the rack’s power distribution unit (PDU) and the wall power-plug receptacle is secure. 2. For each individual IRU that you want to power o...

54 007-4857-002 2: Operation Procedures Powering On and Off at the Console The power-on and off procedure at a console varies with your server setup, as follows: • If you have a console connected to a server with a serial interface, you can toggle between L1 and console mode. This enables you to pow...

Powering the System On and Off 007-4857-002 55 oo1c01-L1> * power down (* indicates all) From the L1 prompt, display the system configuration information by entering the following command: 001c01-L1> config :0 001c01 L0C :2 002r01 L1H :4 002r05 L3H 001c01-L1> In L1 mode, you can obtain only...

56 007-4857-002 2: Operation Procedures Powering-On and Off From the L2 Commands issued at the L2 prompt are typically sent to all NUMAlink connected IRU enclosures in the system. To power on a system: system-101-L2> power up To power off a system: system-101-L2> power down Using Embedded Supp...

Monitoring Your Server 007-4857-002 57 Monitoring Your Server You can monitor your Altix 450 server from the following sources: • On the L1 controller’s display at the front of the IRU as shown in Figure 2-3, you can monitor system operational status. For example, you can monitor error messages that...

58 007-4857-002 2: Operation Procedures 2D Graphics Video Interface If your system was ordered in January 2007 or later, it may come equipped with an optional 2D graphics board interface (supported with SLES 10 or later system software). This low-profile PCI interface card is installed in the base I...

Installing Optional Components 007-4857-002 59 Figure 2-4 2D Graphics Card Location in IA2 (base I/O) Blade Installing Optional Components Besides adding a system console, you can add or replace the following hardware items on your Altix 450 series server: • Peripheral component interface (PCI) card...

60 007-4857-002 2: Operation Procedures Warning: You can add or replace only the items listed in this section. For your safety and for the protection of your server system, contact your SGI system support engineer (SSE) to install any hardware items not listed in this section. Warning: Before instal...

Installing Optional Components 007-4857-002 61 Adding or Removing Disk Drives The IA/IA2 blade (base I/O blade) within the IRU supports the system boot functions and contains one or two low-profile disk drives. See “Installing or Replacing a Disk Drive in the IA Blade” on page 138 for detailed instr...

Installing Optional Components 007-4857-002 65 fs0:\> reset . . . EFI Boot Manager ver 1.10 [14.62] Partition 0: Enabled Disabled CBlades 2 Nodes 3 0 RBlades 0 CPUs 4 0 IOBlades 1 Mem(GB) 6 0 Please select a boot option EFI Shell >>> netboot Boot option maintenance menu Loading: netboot ...

66 007-4857-002 2: Operation Procedures 1 volume is active, 2 physical disks are active Volume 0 is Bus 0 Target 0, Type IM (Integrated Mirroring) Volume State: optimal, enabled Volume Settings: write caching disabled, auto configure Volume draws from Hot Spare Pools: 0 Volume Size 139898 MB, Stripe...

007-4857-002 67 Chapter 3 3. System Overview This chapter provides an overview of the physical and architectural aspects of your SGI Altix 450 system. The major components of the Altix 450 series systems are described and illustrated. The Altix 450 series is a family of multiprocessor distributed sh...

68 007-4857-002 3: System Overview Figure 3-1 SGI Altix 450 System (Short Rack) System Models The basic enclosure within the Altix 450 system is the 5U high (8.68 inch or 22 cm) “individual rack unit” (IRU). The IRU enclosure houses a maximum of four single-wide blades and one double-wide blade. Eac...

70 007-4857-002 3: System Overview Figure 3-3 Blade, IRU and Rack Components System Architecture The Altix 450 computer system is based on a distributed shared memory (DSM) architecture. The system uses a global-address-space, cache-coherent multiprocessor that scales up to 76 Intel 64-bit processor...

72 007-4857-002 3: System Overview System Features The main features of the Altix 450 series server systems are introduced in the following sections: • “Modularity and Scalability” on page 72 • “Distributed Shared Memory (DSM)” on page 72 • “Distributed Shared I/O” on page 73 • “Reliability, Availab...

System Features 007-4857-002 73 Memory latency is the amount of time required for a processor to retrieve data from memory. Memory latency is lowest when a processor accesses local memory. Distributed Shared I/O Like DSM, I/O devices are distributed among the blade nodes within the IRUs (each base I...

System Features 007-4857-002 75 • Power-on and boot: – Automatic testing occurs after you power on the system. (These power-on self-tests or POSTs are also referred to as power-on diagnostics or PODs). – Processors and memory are automatically de-allocated when a self-test failure occurs. – Boot tim...

76 007-4857-002 3: System Overview System Components The Altix 450 series system features the following major components: • 20U rack. The “short” rack is a custom rack used with the Altix 450 system. It holds up to 4 IRUs or a combination of IRUs and option modules (such as mass storage). • 42U rack...

System Components 007-4857-002 77 Figure 3-5 Altix 450 IRU System Components Example Bay (Unit) Numbering Bays in the racks are numbered using standard units. A standard unit (SU) or unit (U) is equal to 1.75 inches (4.445 cm). Because IRUs occupy multiple standard units, IRU locations within a rack...

78 007-4857-002 3: System Overview Optional System Components Availability of optional components for the SGI 450 systems may vary based on new product introductions or end-of-life components. Some options are listed in this manual, others may be introduced after this document goes to production sta...

007-4857-002 79 Chapter 4 4. System Control This chapter describes the interaction and functions of system controllers in the following sections: • “Levels of System Control” on page 80 • “System Controller Interaction” on page 81 • “L1 Controller” on page 81 • “Console Hardware Requirements” on pag...

80 007-4857-002 4: System Control Figure 4-1 SGI Altix 450 System Control Network (Example) Levels of System Control The system control network configuration of your server will depend on the size of the system and control options selected. Typically, an Ethernet connection to the system controller ...

System Controller Interaction 007-4857-002 81 The system controller is designed into all IRUs. An Ethernet connection directly from the IRU to a local private or public Ethernet allows the system to be administered directly from a local or remote console. Note that there is no interconnected system ...

82 007-4857-002 4: System Control L1 Controller Functions The following list summarizes the control and monitoring functions that the L1 controller performs: • Controls voltage margining within the IRUs • Controls and monitors IRU fan speeds • Reads system identification (ID) PROMs • Monitors voltag...

Ethernet Switch 007-4857-002 83 The front panel display contains the following items: • 2 x 12 character liquid crystal display (LCD). The display identifies the IRU, shows system status, warns of required service, and identifies a failed component. • Power (On/Off) button (insert paper clip to actu...

84 007-4857-002 4: System Control Console Hardware Requirements The console type and how these console types are connected to the Altix 450 servers is determined by what console option is chosen. If you have an Altix 450 server with a dumb terminal, you can connect the terminal via a serial cable to...

Operating the L1 007-4857-002 85 application that is always running on the system controller. When the enclosure is connected to a LAN via the L2 host connector, the system controller spawns an application that provides L2 functionality. The L1 operates in one of these two modes, which are discussed...

Operating the L1 007-4857-002 87 Commands can be targeted to other L1s by preceding the command with a rack and slot: 001c01-L1> 1.11 version The command above issues a version command to the IRU in rack 001, U position 11. Some commands can be targeted to a specific blade within an IRU. Precede ...

88 007-4857-002 4: System Control L1 Console Selection If the system contains more than one IRU and a serial connection is utilized for the console, the serial cable must be connected to the IRU that is located in the lowest rack and slot position. The select command shows the current console mode s...

L2 Operation 007-4857-002 89 001c01-L1> entering console mode 001c01 console, <CTRL-T> to escape to L1 no response from 001c01 junk bus console UART:UART_TIMEOUT When this time-out condition occurs, either the IRU is hung or the subchannel is incorrect. An IRU is identified by its rack, typ...

90 007-4857-002 4: System Control To see if the L2 is running (it will be if the LAN cable is plugged in and the cable is connected to an active LAN). At the L1 prompt type: 001c01-L1> l2 L2 Controller is running. 001c01-L1> If the L2 is not running type: 001c01-L1> ! init 4 This switches t...

L2 Operation 007-4857-002 91 Once the L2 is running, you can telnet to the L2, or use an optional SGIconsole. After the connection to the L2 controller is established, the following prompt appears, indicating that the L2 is ready to accept commands: olympic-101-L2> Common operations are discussed...

92 007-4857-002 4: System Control b is the enclosure type. ss is the slot location of the enclosure. p is the partition of the enclosure (not present if the system is not partitioned). In the example shown above, 001c01 is an IRU in rack 001 and slot position 01. Setting Command Targeting If a comma...

L2 Operation 007-4857-002 93 To target individual blades in an IRU use the following syntax: olympic-101-L2> 1.11 b1 power down Executing the above command will power down the blade in blade slot 1 of the IRU in rack 001 U position 11. Default Destination When the L2 starts, the default destinati...

94 007-4857-002 4: System Control L2> r 2-4,7 <L1 command> This is a one-time destination. Command Interpretation Some L2 commands are the same as the L1 commands. In many cases, this is intentional because the L2 provides sequencing that is necessary for a command to function correctly. Wh...

L2 Operation 007-4857-002 95 To power on or power off a specific IRU, specify a current destination: L2> r 2 s 5 power up L2> To power on or power off all IRUs in a partition, enter the following: L2> partition < partition number > < power up or power down > To reset the system,...

96 007-4857-002 4: System Control Ctrl+T escaping to L2 system controller L2> l2 L2 command processor engaged, <CTRL_D> for console mode. L2> Console Selection When in console mode, the L2 communicates with the IRU set with the select command to be the system console or global master. Al...

L2 Operation 007-4857-002 97 • Subchannel 3C specifies Blade 3, CPU C. • Subchannel console0 Blade 0 console subchannel. • Subchannel console1 Blade 1 console subchannel. The select command output: “ console input: 001c01 console0 ” shows that the L2 will send console input to IRU 001c01 blade 0 and...

98 007-4857-002 4: System Control Generally, the L2 will track the correct IRU rack, slot, blade, and subchannel for system console input and no user setting should be required. If the default value was manually overridden, it can be reset by entering the following command: 001c01-L1> select rese...

Upgrading L1 Firmware 007-4857-002 99 Upgrading L1 Firmware The L1 firmware is currently distributed as part of the snxsc_firmware package. To determine which version of the package is installed on your system console, enter the following command: $> rpm -q snxsc_firmware If the package is instal...

007-4857-002 101 Chapter 5 5. Rack Information This chapter describes the physical characteristics of the tall (42U) and short (20U) Altix racks in the following sections: • “Overview” on page 101 • “Altix 42U and 20U Rack Features” on page 102 • “Technical Specifications” on page 104 Overview At th...

102 007-4857-002 5: Rack Information Altix 42U and 20U Rack Features The Altix racks (shown in Figure 5-1 and Figure 5-2) have the following features and components: • Front and rear door . The front door is opened by grasping the wide end of the triangle-shaped door piece and pulling outward. Note ...

104 007-4857-002 5: Rack Information Figure 5-2 Short (20U) Altix Rack (Rear View) Technical Specifications Table 5-1 lists the technical specifications of the Altix 450 tall rack. Table 5-2 lists the technical specifications of the Altix 450 short rack. Table 5-1 Tall Altix Rack Technical Specifica...

007-4857-002 107 Chapter 6 6. Maintenance and Upgrade Procedures This chapter provides information about installing or removing components from your SGI system, as follows: • “Maintenance Precautions and Procedures” on page 107 • “Installing or Removing Internal Parts” on page 109 • “Adding or Repla...

108 007-4857-002 6: Maintenance and Upgrade Procedures Preparing the System for Maintenance or Upgrade To prepare the system for maintenance, follow these steps: 1. If you are logged on to the system, log out. Follow standard procedures for gracefully halting the operating system. 2. At your system ...

Installing or Removing Internal Parts 007-4857-002 109 Installing or Removing Internal Parts Caution: The components inside the system are extremely sensitive to static electricity. Always wear a wrist strap when you work with parts inside your system. To use the wrist strap, follow these steps: 1. ...

110 007-4857-002 6: Maintenance and Upgrade Procedures Replacing IRU Components While the individual rack units (IRUs) are not considered end-user replaceable, a number of their internal components can be removed and replaced. These include: • L1 controller panel • IRU power supplies • IRU cooling f...

Replacing IRU Components 007-4857-002 111 Figure 6-1 Removing the L1 Controller Panel Replace the system control panel using the following steps: 1. Position the controller panel assembly slightly above the retention screw. 2. Carefully slid it back into place, see Figure 6-2. insi de TM inside TM i...

112 007-4857-002 6: Maintenance and Upgrade Procedures 3. Be careful not to snag the ribbon cable while replacing the panel. 4. Use the T10 torx driver to tighten the retention screw holding the panel to the IRU. 5. Restart the IRU or system as applicable. Figure 6-2 Replacing the L1 Controller Pane...

Replacing IRU Components 007-4857-002 113 Removing or Adding IRU Power Supplies Under most circumstances a single power supply in an IRU can be replaced without shutting down the IRU or the complete system. In the case of a fully configured (loaded) IRU, this may not be possible. In a fully loaded s...

114 007-4857-002 6: Maintenance and Upgrade Procedures 4. Install the new power supply with the retention latch at the top of the supply. 5. Slide the power supply into the chassis until the retention latch engages. 6. Reconnect the power cord to the power supply. 7. Reattach the L1 front panel usin...

Replacing IRU Components 007-4857-002 115 3. A line will be added to the L1 system controller’s log file indicating the fan warning. 4. If ESP is used, a warning message will be sent to it also, (see “SGI Electronic Support” on page 149). The system controller monitors the temperature within each IR...

116 007-4857-002 6: Maintenance and Upgrade Procedures Figure 6-6 Removing a Fan From the IRU 3. Slide a new blower assembly completely into the open slot, see Figure 6-7. 4. Tighten the blower assembly screw to secure the new fan. Screw A C B Loosen screw

118 007-4857-002 6: Maintenance and Upgrade Procedures Removing or Replacing a System Blade From the IRU The blades installed in your SGI Altix 450 can generally be removed from or installed in an IRU without powering down the entire system. However, the operating system should be halted and the pow...

Replacing IRU Components 007-4857-002 121 Memory DIMM Group Placement and Guidelines Memory is contained on cards that are referred to as DIMMs (dual inline memory modules). Each individual memory or compute/memory blade can contain four, eight, or twelve DIMMs installed in DIMM slots located on the...

Replacing IRU Components 007-4857-002 123 Figure 6-11 DIMM Memory Slot Location Example Remove and Replace the DVD Drive Use the following steps to remove the DVD drive from an IA blade: 1. Power off the IRU, use instructions in “Powering the System On and Off” on page 51. 2. Extract the IA blade yo...

124 007-4857-002 6: Maintenance and Upgrade Procedures 8. Slide the new DVD drive assembly into the IA blade housing. 9. Connect the DVD power and data cable connectors to the replacement drive. 10. Screw in the DVD drive assembly retention screw. 11. Replace the DVD access panel and tighten the ret...

Overview of PCI Express Operation 007-4857-002 127 Overview of PCI Express Operation This section provides a brief overview of the new PCI Express (PCIe) technology that will be available as an option with your system. PCI Express has both compatibility and differences with older PCI/PCI-X technolog...

128 007-4857-002 6: Maintenance and Upgrade Procedures 1”. SGI Altix 450 technology uses an x16 connector (64 wires) or “by 16” in PCI Express card slots. This technology will support PCIe boards that use connectors up to x16 in size. Table 6-2 shows this concept. Adding or Replacing PCI/PCI-X Cards...

Adding or Replacing PCI/PCI-X Cards 007-4857-002 129 Caution: To protect the PCI cards from ESD damage, SGI recommends that you use a grounding wrist strap while installing a PCI card. Installing PCI Cards in the Three-Slot Blade Use the following instructions and illustrations to install or replace...

Adding or Replacing PCI/PCI-X Cards 007-4857-002 131 Note: If you are adding or replacing a half-height PCI card, skip ahead to step 6. 5. If the full-height card that you want to install does not fit in the carrier, follow these steps: a. Loosen the three screws on the guide bar with a Phillips scr...

132 007-4857-002 6: Maintenance and Upgrade Procedures c. Mount the card in the carrier, (see Figure 6-18) and ensure the following occurs: – The card connectors protrude through the bulkhead where the metal filler plate was located. – The edge connectors fit between the bottom guides of the carrier...

Adding or Replacing PCI/PCI-X Cards 007-4857-002 133 6. To install a half-height PCI card in a carrier, follow these steps: a. Remove the two screws from the carrier guide bar, as shown in Figure 6-19. Note: Take care not to lose the threaded inserts in the carrier guide bar. b. Loosen the third scr...

134 007-4857-002 6: Maintenance and Upgrade Procedures e. Place the PCI card bracket so that the screw holes of the bracket align with the empty screw holes of the carrier guide bar, as shown in Figure 6-21. f. Secure the bracket to the carrier guide bar with two T8 Torx screws. g. Tighten the screw...

Adding or Replacing PCI/PCI-X Cards 007-4857-002 135 7. Insert the carrier-mounted PCI card into the vacant slot, using the slot guide, as shown in Figure 6-22. Figure 6-22 Installing a Card in a Slot 8. Push in horizontally on the carrier seating bar, as shown in Figure 6-23, to seat the card secur...

136 007-4857-002 6: Maintenance and Upgrade Procedures Add or Remove a PCI Card in Base IA Blades To add or replace a PCI card in the base IA blade (base I/O), follow these steps: 1. Power off the IRU by following the power-off instructions in the “Powering the System On and Off” on page 51 if you a...

Adding or Replacing PCI/PCI-X Cards 007-4857-002 137 Figure 6-25 Replacing the IA Blade PCI Access Door 8. Replace the PCI card access door by installing it into the slotted opening and sliding it forward, as shown in Figure 6-25. 9. Reinstall the top PCI card access door screw. 10. Reinstall the fr...

138 007-4857-002 6: Maintenance and Upgrade Procedures Installing or Replacing a Disk Drive in the IA Blade The IA/IA2 blade (base I/O) in an IRU has two system disk drive bays as shown in Figure 6-26. This section describes how to install or remove the drives. Figure 6-26 Location of Disk Drive Bay...

Installing or Replacing a Disk Drive in the IA Blade 007-4857-002 139 Removing a System Disk Drive Before you remove a disk drive, you must power off the IRU or system according to the instructions in the “Powering the System On and Off” on page 51. To remove a disk drive, follow these steps: 1. Ope...

140 007-4857-002 6: Maintenance and Upgrade Procedures Installing a System Disk Drive Before you install a disk drive, you must power off the IRU that houses the IA blade (base I/O) where the disk(s) are installed, see the instructions in the “Powering the System On and Off” on page 51. Note that yo...

007-4857-002 143 Chapter 7 7. Troubleshooting and Diagnostics This chapter provides the following sections to help you troubleshoot your system: • “Troubleshooting Chart” on page 144 • “L1 Controller Error Messages” on page 145 • “SGI Electronic Support” on page 149

144 007-4857-002 7: Troubleshooting and Diagnostics Troubleshooting Chart Table 7-1 lists recommended actions for problems that can occur. To solve problems that are not listed in this table, use the SGI Electronic Support system or contact your SGI system support engineer (SSE). For more informatio...

L1 Controller Error Messages 007-4857-002 145 L1 Controller Error Messages Table 7-2 lists error messages that the L1 controller generates and displays on the L1 display. This display is located on the front of the IRU. Note: In Table 7-2, a voltage warning occurs when a supplied level of voltage is...

146 007-4857-002 7: Troubleshooting and Diagnostics Temperature messages: low alt. ATTN: <temp sensor description> advisory temperature reached @ xxC xxF The ambient temperature at the IRU’s air inlet has exceeded 30 ° C. ATTN: <temp sensor description> critical temperature reached @ xxC...

LED Status Indicators 007-4857-002 147 LED Status Indicators There are a number of LEDs on the front of the IRUs that can help you detect, identify and potentially correct functional interruptions in the system. The following subsections describe these LEDs and ways to use them to understand potenti...

148 007-4857-002 7: Troubleshooting and Diagnostics Compute/Memory Blade LEDs Each compute/memory blade installed in an IRU has a total of eight LED indicators arranged in two rows of four and behind the perforated of the blade: • One green LED shows power-on complete status for the blade. • One red...

SGI Electronic Support 007-4857-002 149 Figure 7-1 Compute Blade Status LED Locations SGI Electronic Support SGI Electronic Support provides system support and problem-solving services that function automatically, which helps resolve problems before they can affect system availability or develop int...

SGI Electronic Support 007-4857-002 151 The sequence of events can be described as follows: 1. Embedded Support Partner (ESP) monitors your system 24 hours a day. 2. When a specified system event is detected, ESP notifies SGI via e-mail (plain text or encrypted). 3. Applications that are running at ...

The following three components compose the integrated SGI Electronic Support system: SGI Embedded Support Partner (ESP) is a set of tools and utilities that are embedded in the SGI Linux ProPack release. ESP can monitor a single system or group of systems for system events, software and hardware fai...

007-4857-002 153 Appendix A A. Technical Specifications and Pinouts This appendix contains technical specification information about your system, as follows: • “System-level Specifications” on page 153 • “Physical Specifications” on page 154 • “Environmental Specifications” on page 156 • “Power Spec...

154 007-4857-002 A: Technical Specifications and Pinouts Physical Specifications Table A-2 shows the physical specifications of the Altix 450 system in a 42U rack. Table A-3 on page 155 lists the physical specifications of the Altix 450 system in a 20U rack. Table A-2 Altix 450 Tall Rack System Phys...

156 007-4857-002 A: Technical Specifications and Pinouts Environmental Specifications Table A-4 lists the environmental specifications of the 42U rack system. Table A-5 provides the environmental information for the 20U system. . Table A-4 Environmental Specifications (42U Rack) Feature Specificatio...

Power Specifications 007-4857-002 157 Power Specifications Table A-6 shows the power specifications for the system. Heat dissipation Altix 450 29.86 kBTU/hr maximum (based on 8.75 kW) Cooling requirement Ambient air cooling only Air flow: intake (front), exhaust (rear) Approximately 750 CFM (normal ...

158 007-4857-002 A: Technical Specifications and Pinouts I/O Port Specifications This section contains specifications and port pinout information for the base I/O ports of your system, as follows: • “Ethernet Port” on page 159 • “Serial Ports” on page 160 • “External SAS/SATA Port Connector” on page...

I/O Port Specifications 007-4857-002 159 Ethernet Port The system auto-selects the Ethernet port speed and type (duplex vs. half-duplex) when the server is booted, based on what it is connected to. Figure A-1 shows the Ethernet port. Figure A-1 Ethernet Port Table A-7 shows the cable pinout assignme...

160 007-4857-002 A: Technical Specifications and Pinouts Serial Ports The IRU modules have 9-pin serial interface connectors. These ports are for console interface and are capable of transferring data at rates as high as 230 kbps. Other features of the ports include the following: • Programmable dat...

162 007-4857-002 A: Technical Specifications and Pinouts External SAS/SATA Port Connector Figure A-3 shows the connector pin locations for the external single-channel Serial Attached SCSI (SAS) and Serial Advanced Technology Attachment (SATA) connector. This combined technology connector is used to ...

I/O Port Specifications 007-4857-002 163 USB Type A Connector Figure A-4 shows the USB type A connector provided on the base I/O that supports general USB applications and optional keyboard and mouse configurations. Table A-10 lists the pin assignments for the USB type A connector. Figure A-4 Pin Nu...

007-4857-002 165 Appendix B B. Safety Information and Regulatory Specifications This appendix provides safety information and regulatory specifications for your system in the following sections: • “Safety Information” on page 165 • “Regulatory Specifications” on page 167 Safety Information Read and ...

166 007-4857-002 B: Safety Information and Regulatory Specifications 9. Do not attempt to service this product yourself except as noted in this guide. Opening or removing covers of blade and switch internal components may expose you to dangerous voltage points or other risks. Refer all servicing of ...

Regulatory Specifications 007-4857-002 167 Regulatory Specifications The following topics are covered in this section: • “CMN Number” on page 167 • “CE Notice and Manufacturer’s Declaration of Conformity” on page 167 • “Electromagnetic Emissions” on page 168 • “Shielded Cables” on page 170 • “Electr...

168 007-4857-002 B: Safety Information and Regulatory Specifications Electromagnetic Emissions This section provides the contents of electromagnetic emissions notices from various countries. FCC Notice (USA Only) This equipment complies with Part 15 of the FCC Rules. Operation is subject to the foll...

Regulatory Specifications 007-4857-002 169 Industry Canada Notice (Canada Only) This Class A digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numérique német pas de perturbations radioélectriques dépassant les normes applicables aux ap...

170 007-4857-002 B: Safety Information and Regulatory Specifications Shielded Cables This SGI system is FCC-compliant under test conditions that include the use of shielded cables between the system and its peripherals. Your system and any peripherals you purchase from SGI have shielded cables. Shie...

Regulatory Specifications 007-4857-002 171 Laser Compliance Statements The DVD drive in this computer is a Class 1 laser product. The DVD drive’s classification label is located on the drive. Warning: Avoid exposure to the invisible laser radiation beam when the device is open. Warning: Attention: R...

172 007-4857-002 B: Safety Information and Regulatory Specifications Lithium Battery Statements Warning: If a lithium battery is a soldered part, only qualified SGI service personnel should replace this lithium battery. For other types, replace the battery only with the same type or an equivalent ty...

007-4857-002 173 Index A Altix server illustration , 69 Altix servers monitoring locations , 57 B battery statements , 172 block diagram IRU , 71 C cache coherency , 73 circuit breaker switches , 39 CMN number , 167 command targeting L1 mode , 86 L2 mode , 92 connector pin assignment SAS/SATA , 162 ...