Page 3 - Overview
Table of Contents 1 Overview ......................................................................................................................... 9 1.1 Minimum Requirements...................................................................................................................91.2 Rea...
Page 5 - List of Figures
List of Figures 3-1 Administration Network Connections..........................................................................................16 3-2 Console Network Connections......................................................................................................17 3-3 Gigabit Ether...
Page 7 - List of Tables
List of Tables 1-1 Minimum Requirements.................................................................................................................9 2-1 Installation and Configuration Checklist......................................................................................13 4-1 Head Node...
Page 9 - Minimum Requirements; Table 1-1 Minimum Requirements; Read the Documentation Before You Begin
1 Overview HP Server Blade c-Class servers (hereafter called server blades) are perfectly suited to form HPXC systems. Physical characteristics make it possible to have many tightly interconnected nodeswhile at the same time reducing cabling requirements. Typically, server blades are used ascompute ...
Page 10 - Supported Server Blade Combinations
If you do not have the required documentation in your possession, see the following sources: • The most current documentation for HP Server Blades, enclosures, and other server bladecomponents is available at the following Web site: http://www.hp.com/go/bladesystem/documentation • The most current e...
Page 11 - Enclosures and Onboard Administrators; HP Server Blade c7000 Enclosure
• HP ProLiant BL685c (full-height)— Up to four dual core Opteron processors— Four built-in NICs— Two hot plug drives— Three mezzanine slots • HP ProLiant BL860c (full-height) 1.4.2 Enclosures and Onboard Administrators HP Server Blade c7000 Enclosure The HP Server Blade c7000 Enclosure is the enclos...
Page 12 - Management Processor Console Management Device; Nortel GbE2c Gigabit Ethernet switch
Onboard Administrator. On server blades, iLO2 advanced features are enabled by default andinclude the following: • Full remote graphics console access including full keyboard, video, mouse (KVM) accessthrough a Web browser • Support for remote virtual media which enables you to mount a local CD or d...
Page 13 - Task Summary and Checklist; Best Practice for System Configuration; discover; Installation and Configuration Checklist; Table 2-1 Installation and Configuration Checklist
2 Task Summary and Checklist This chapter contains a summary of the steps required to configure HP server blades in an HPXC cluster. 2.1 Best Practice for System Configuration In order to function properly as an HP XC system, each component must be configured accordingto HP XC guidelines. To make co...
Page 15 - Cabling; The following topics are addressed in this chapter:; Cabling for the Administration Network
3 Cabling The following topics are addressed in this chapter: • “Network Overview ” (page 15) • “Cabling for the Administration Network” (page 15) • “Cabling for the Console Network” (page 16) • “Cabling for the Interconnect Network” (page 17) • “Cabling for the External Network” (page 19) 3.1 Netwo...
Page 16 - Figure 3-1 Administration Network Connections; Cabling for the Console Network; illustrates the connections that form the console network.
Figure 3-1 Administration Network Connections NIC 1NIC 2NIC 3NIC 4 MEZZ 1MEZZ 2MEZZ 3 iLO2 NIC 1NIC 2 MEZZ 1MEZZ 2 iLO2 Interconnect bay 1 Interconnect bay 2 Interconnect bay 3 Interconnect bay 4 Interconnect bay 5 Interconnect bay 6 Interconnect bay 7 Interconnect bay 8 ONBOARD ADMINISTRATOR MGT NI...
Page 17 - Figure 3-2 Console Network Connections; “Configuring a Gigabit Ethernet Interconnect” (page 17); Configuring a Gigabit Ethernet Interconnect
Figure 3-2 Console Network Connections NIC 1NIC 2NIC 3NIC 4 MEZZ 1MEZZ 2MEZZ 3 iLO2 NIC 1NIC 2 MEZZ 1MEZZ 2 iLO2 Interconnect bay 1 Interconnect bay 2 Interconnect bay 3 Interconnect bay 4 Interconnect bay 5 Interconnect bay 6 Interconnect bay 7 Interconnect bay 8 ONBOARD ADMINISTRATOR MGT NIC PCI S...
Page 18 - Figure 3-3 Gigabit Ethernet Interconnect Connections; Configuring an InfiniBand Interconnect; illustrates the connections for an InfiniBand interconnect.
Figure 3-3 Gigabit Ethernet Interconnect Connections NIC 1NIC 2NIC 3NIC 4 MEZZ 1MEZZ 2MEZZ 3 iLO2 NIC 1NIC 2 MEZZ 1MEZZ 2 iLO2 Interconnect bay 1 Interconnect bay 2 Interconnect bay 3 Interconnect bay 4 Interconnect bay 5 Interconnect bay 6 Interconnect bay 7 Interconnect bay 8 ONBOARD ADMINISTRATOR...
Page 19 - For information about configuring VLANs, see
3.4.3 Configuring the Interconnect Network Over the Administration Network In cases where an additional Gigabit Ethernet port or switch may not be available, the HP XCSystem Software enables you to configure the interconnect on the administration network. Whenthe interconnect is configured on the ad...
Page 21 - , and it saves the cost of an additional interconnect device in bay 2.
Figure 3-6 External Network Connections: Half-Height Server Blades and NIC1 and NIC2 in Use NIC 1NIC 2NIC 3NIC 4 MEZZ 1MEZZ 2MEZZ 3 iLO2 NIC 1NIC 2 MEZZ 1MEZZ 2 iLO2 Interconnect bay 1 Interconnect bay 2 Interconnect bay 3 Interconnect bay 4 Interconnect bay 5 Interconnect bay 6 Interconnect bay 7 I...
Page 22 - Enter
Figure 3-7 External Network Connections: Half and Full-Height Server Blades and NIC1 in Use NIC 1NIC 2NIC 3NIC 4 MEZZ 1MEZZ 2MEZZ 3 iLO2 NIC 1NIC 2 MEZZ 1MEZZ 2 iLO2 Interconnect bay 1 Interconnect bay 2 Interconnect bay 3 Interconnect bay 4 Interconnect bay 5 Interconnect bay 6 Interconnect bay 7 I...
Page 23 - Installing HP XC System Software On the Head Node; head node is an HP server blade.; Before you begin, you must have the following items available:; Connect to the Onboard Administrator; Put the Onboard Administrator on an active network:
4 Installing HP XC System Software On the Head Node The information in this chapter parallels the information in Chapter 2 in the HP XC SystemSoftware Installation Guide. At some points, you might be instructed to refer to that document. Table 4-1 lists where to find head node installation instructi...
Page 24 - Administrator
1. To provide IP addresses for the Onboard Administrator and all iLO2 devices in the enclosure,disconnect the Onboard Administrator associated with the head node from the administrationnetwork, and plug the Onboard Administrator into an active network with a DHCP server. 2. Obtain the IP address of ...
Page 25 - Table 4-2 Boot Command Line Options Based on Hardware Model
1. Insert the HP XC System Software Version 3.1 or Version 3.2 DVD into the DVD drive ofthe local laptop or PC. 2. Do the following from the Onboard Administrator management Web page:a. In the left frame, click the plus sign (+) to open the Device Bays menu. b. Click the plus sign (+) next to the no...
Page 27 - Discovering the Hardware Components; Read the information in
5 Discovering the Hardware Components This chapter describes the following tasks, which you must complete in the order shown: • “Task 1: Prepare for the System Configuration” (page 27) • “Task 2: Change the Default IP Address Base (Optional)” (page 28) • “Task 3: Use the cluster_prep Command to Prep...
Page 28 - Task 3: Use the cluster_prep Command to Prepare the System
5.2 Task 2: Change the Default IP Address Base (Optional) You may need to change the default IP address base of the HP XC private networks if the defaultvalues conflict with another IP address base at your site. The IP address base is defined in the base_addrV2.ini file. Follow this optional procedu...
Page 30 - Task 5: Set the Onboard Administrator Password; Task 6: Discover Enclosures and Nodes
Enter the MAC address of the switch the head node plugs intoin the format xx:xx:xx:xx:xx:xx : your_MAC_addressPlease enter the Procurve switch Administrator password : your_passwordPlease re-enter password: your_password Discovering Switches...Restarting dhcpdWaiting for IP addresses to stabilize .....
Page 32 - The
Starting CMF for discover...Stopping cmfd: [FAILED] 1 Starting cmfd: [ OK ]Waiting for CMF to establish console connections .......... done uploading databaseRestarting dhcpdOpening /etc/hostsOpening /etc/hosts.new.XCOpening /etc/powerd.confBuilding /etc/powerd.conf ... doneAttempting to start hpls ...
Page 33 - Making Node-Specific Settings; “Making Settings on HP ProLiant Server Blades” (page 33); Making Settings on HP ProLiant Server Blades; hosts; Address
6 Making Node-Specific Settings Running the discover process has assigned IP addresses to all hardware components. You cannow use the active administration network to access the various hardware components to makenode-specific BIOS settings that are required for HP XC. IMPORTANT: Making the required...
Page 34 - Table 6-1 Boot Order for HP ProLiant Server Blades
6. In the left frame, click the plus sign (+) next to Device Bays to display the list of nodes contained in the enclosure. 7. Click the link to the first hardware model in the list. Wait a few seconds until the frame tothe right is populated with node-specific information. 8. Click the Boot Options ...
Page 35 - Table 6-2 Additional BIOS Setting for HP ProLiant BL685c Nodes
e. Click the Apply button to save the settings. 12. Configure disks into the smart array from the remote graphics console. All server blades have smart array cards, you must add the disk or disks to the smart arraybefore attempting to image the node. To set up the smart array device, click the Remot...
Page 36 - Making Settings on HP Integrity Server Blades; DVD boot
16. Close the iLO2 utility Web page.17. Repeat this procedure from every active Onboard Administrator and make the same settings for each server blade in each enclosure. 6.3 Making Settings on HP Integrity Server Blades Use the management processor (MP) on each HP Integrity server blade to make the ...
Page 39 - Configuring the HP XC System; startsys; startsys
7 Configuring the HP XC System The information in this chapter parallels the information in Chapter 3 in the HP XC SystemSoftware Installation Guide. To configure your system, you use a combination of the instructionsin this HowTo and the instructions in the HP XC System Software Installation Guide....
Page 41 - Troubleshooting; Switch management ports; lsadmin limrestart Command Fails; lsadmin limrestart
8 Troubleshooting This chapter contains troubleshooting information to help you resolve problems you mightencounter. 8.1 One or More Ports Do not Communicate Properly on a GigabitEthernet Switch If your hardware configuration contains Gigabit Ethernet switches, verify the following if oneof more por...
Page 43 - A Configuration Examples; In; A.2 InfiniBand Interconnect With Full-Height Server Blades; In the configuration shown in
A Configuration Examples This appendix contains illustrations and descriptions of fully cabled HP XC systems based oninterconnect type and server blade height.The connections are color-coded, so consider viewing the PDF file online or printing this appendixon a color printer to take advantage of the...
Page 44 - A.3 InfiniBand Interconnect With Mixed Height Server Blades; The configuration shown in
Figure A-2 InfiniBand Interconnect With Full-Height Server Blades NIC 1NIC 2NIC 3NIC 4 MEZZ 1MEZZ 2MEZZ 3 iLO2 NIC 1NIC 2 MEZZ 1MEZZ 2 iLO2 Interconnect bay 1 Interconnect bay 2 Interconnect bay 3 Interconnect bay 4 Interconnect bays Interconnect bay 7 Interconnect bay 8 ONBOARD ADMINISTRATOR MGT NI...
Page 47 - Index
Index A administration network activating, 29as interconnect, 19defined, 15 B base_addrV2.ini file, 28boot order, 34 C checklist, 13cluster_config utility, 39cluster_prep command, 28communication problems with GigE switch ports, 41console network defined, 16 D discover command enclosures, 30nodes, 3...