Page 3 - SP Switch2 Service Guide; IBM
RS/6000 SP SP Switch2 Service Guide GA22-7444-03 IBM
Page 5 - Contents; Figures; About this book; Chapter 3. Service procedures; iii
Contents Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii Safety and environmental notices . . . . . . . . . . . . . . . . . . . . . . . . . . ixSafety notices (in English) . . . . . ....
Page 6 - Notices; iv
Removing and restoring switch resources . . . . . . . . . . . . . . . . . . . . . . . 3-9 Removing an SP Switch2 from the active configuration . . . . . . . . . . . . . . . . . 3-9Restoring an SP Switch2 to the active configuration . . . . . . . . . . . . . . . . . . 3-9 Using Perspectives to fence ...
Page 9 - Tables; vii
Tables 1-1. Switch Problem Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . 1-5 1-2. SP Switch2 supervisor LED indications . . . . . . . . . . . . . . . . . . . . . 1-6 1-3. Perspectives SP Switch2 status indicators . . . . . . . . . . . . . . . . . . . . 1-9 1-4. Fan Failure Diagnostic...
Page 10 - viii
Page 11 - Safety and environmental notices; Electrical Safety for IBM Customer Engineers; SPSFXXXX; Danger notices; DANGER; ix
Safety and environmental notices Safety notices (in English) For general information concerning safety, refer to Electrical Safety for IBM Customer Engineers (S229-8124). For a copy of this publication, contact your IBM marketing representative or the IBM branchoffice serving your locality. The foll...
Page 13 - System Service Guide; Caution notices; xi
DANGER The frame main circuit breaker and the controller must not be switched on again now. Before disconnecting the power cables from the power receptacles, ensure that the customer’sbranch distribution circuit breakers (customer power source circuit breakers) are Off and taggedwith DO NOT OPERATE ...
Page 14 - xii
CAUTION: Due to weight of each thin node (under 18 Kg [40 lbs]), use care when removing and replacing thinnodes above shoulder height. ( SPSFC005 ) CAUTION: The wide node weight may exceed 32 Kg (70.5 lbs). ( SPSFC006 ) CAUTION: Do not open more than one wide node or switch assembly drawer at a time...
Page 15 - Laser safety information; Laser Compliance; Environmental notices; xiii
CAUTION: When using step ladder or step stool, be sure that the work surface is level and the step ladder orstep stool is in good working order. ( SPSFC016 ) CAUTION: Portable ladders present a serious safety hazard if not used properly. Follow these generalguidelines: v Make sure the ladder is firm...
Page 16 - xiv
Page 17 - Who should use this book; RS/6000 SP: Uniprocessor Thin and Wide Node Service Guide; xv
About this book This book covers the SP Switch2 only. Refer to RS/6000 SP: SP Switch Service Guide , GA22-7443 for information related to the SP Switch. This book is to help you, as a customer engineer diagnose and repair an RS/6000 ® SP ™ SP Switch2 by performing the following tasks: v Identify fie...
Page 18 - User’s responsibilities; Parallel System Support Programs for AIX; How to use this book; xvi
User’s responsibilities Before calling IBM ® for service, the system administrator should use the problem determination section of the Parallel System Support Programs for AIX ® : Diagnosis Guide (GA22-7350), for initial problem determination. If there is nothing wrong with the customer operating pr...
Page 19 - Purpose of this MAP
Chapter 1. Maintenance Analysis Procedures (MAPs) This chapter provides information for identifying problems and guides you to the most likely failed FieldReplaceable Unit (FRU). The MAPs then refer you to the FRU Removal/Replacement procedures for thecorrective action. Switch MAPs v “Switch descrip...
Page 20 - Switch Assembly Description; Switch Description and Problem Determination (MAP 0590)
Switch Connection Types Standard Node Processor nodes in 9076 SP frames are attached to the switches with switch cables. Switch-to-Switch Connections between switches. Switch Assembly Description SP Switch2 Each switch chip has its own clock and all clocks communicate through the switch datacables. ...
Page 24 - Switch supervisor communications (MAP 0595)
Table 1-1. Switch Problem Diagnostics (continued) Priority Message or condition Action 2 (2 of 4) Environmental problems v Control workstation errpt file reports a switchfailure, shutdown, or warning messageassociated with a fan, power supply, ortemperature indicator v Perspectives switch environmen...
Page 34 - You tested all interposers and the circuit breaker still trips.
3. If all interposers have been tested, go to “Step 0610-004” on page 1-14. Step 0610-017 You tested all interposers and the circuit breaker still trips. 1. Replace the circuit breaker assembly. 2. Check the circuit breaker. 3. Does the circuit breaker still trip? v If yes, go to “Step 0610-018”. v ...
Page 35 - Estart has not been run by the customer; Estart
Step 0610-022 The switch’s front panel power LED remained Off after replacing the LED power extension cable. 1. Replace the switch planar. v Refer to “Removing the switch planar” on page 4-7 and “Replacing the switch planar” on page 4-8 2. Is the front panel power LED On? v If yes, go to Switch func...
Page 42 - Service Guide
b. Go to ″ Processor node diagnostics and descriptions (MAP 0130) ″ in RS/6000 SP: System Service Guide to fix problem. Step 0620-011 The Power (green) LED is lit, indicating the processor node is powered on. 1. Run advanced diagnostics in service mode on device “cssX” (where X=0 or 1) on this proce...
Page 44 - usually scattered throughout the out.top file.
1. From the node front panel on the control workstation, put the node in the SERVICE mode. 2. Power-on this processor node. 3. Go to “Step 0620-014”. Step 0620-014 At this point, you must run the advanced diagnostics in service mode on the device “cssX” (where X=0 or1) and its associated switch port...
Page 46 - dsh; not
dsh -a /usr/lpp/ssp/css/rc.switch Note: When working with a two-plane SP Switch2 system, add the adapter name to the command, as follows: dsh -a /usr/lpp/ssp/css/rc.switch -a <adapter_name> Example: dsh -w fr2n03,fr2n04,fr3n01 /usr/lpp/ssp/css/rc.switch Attention: Issuing this command on proce...
Page 47 - Example of format structure
Chapter 2. Locations Naming standard for RS/6000 SP components . . . . . . . . . . . . . . . . . . . . . 2-1 Format structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1 Example of format structure . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1Frame (WWW) . . . . . . ....
Page 48 - Examples for using complete levels of nomenclature; Location diagrams of the RS/6000 SP components
– 01 - 99 for frames 1-99 (specific to that frame) Notes: 1. E01 designates RS/6000 SP physical frame 1 2. L00 designates any/all RS/6000 SP logical frames 3. S00 designates any/all RS/6000 SP multi-switch frames 4. For locations inside a frame, the Frame (WWW) and/or Major Assembly (XXX) strings ma...
Page 49 - Front and rear views of RS/6000 SP frame
Front and rear views of RS/6000 SP frame Figure 2-1 shows a front view of the RS/6000 SP frame locations. “Frame (FRA)” on page 2-5 describesthe assembly designations for the RS/6000 SP frame. Figure notes: 1. Frames equipped with the SP Redundant Power Supply must have four power modules (books) in...
Page 51 - Frame locations
Note: See notes under Figure 2-1 on page 2-3 for processor node/switch assembly numbering. Frame locations Figure 2-1 on page 2-3 shows a front view of the RS/6000 SP frame locations, with numbered processornodes, and the three phase SEPBU. Frame (FRA) This list shows the designations specifically f...
Page 54 - Cable routing
Cable routing Figure 2-6 on page 2-9 and Figure 2-7 on page 2-9 show back views of the RS/6000 SP frame, showingthe horizontal and vertical paths of cable routing from connector-to-connector, with the depth amplified onthe drawing. Note: When attaching exterior and interior cables to a POWER3 SMP Hi...
Page 57 - Switch data cables; SP Switch2 data cables
Switch data cables SP Switch2 data cables Table 2-2 describes the attachment locations and routing for the internal SP Switch2 data cables. Table 2-2. SP Switch2 data cable chart Cable PartNumber Plug fromLocation Plug toLocation 05N6351 E00-S00-BH-J7 E00-N01-BH-PA 05N6351 E00-S00-BH-J8 E00-N02-BH-P...
Page 59 - Personal ESD requirements; Tools and files overview
Chapter 3. Service procedures Personal ESD requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1Tools and files overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1Using the css.snap script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3 css.snap ...
Page 61 - Using the css.snap script
Table 3-2. Setup output files (continued) File Location Description Directory css.snap.log All nodes Log files created by the switchsupport code /var/adm/SPlogs/css Table 3-3. Tuning output files File Location Description Directory daemon.stdout All nodes Keeps a detailed account of thetuning proces...
Page 62 - -n Assumes that the device driver or daemon has flushed the cache.; Files collected by css.snap
v -n Assumes that the device driver or daemon has flushed the cache. v -s Takes a soft snap, which does not dump the adapter state. This excludes the col_dump.out. This flagis used for temporary errors (TYPE=TEMP) where the integrity of the adapter is in doubt, or when it isnot desirable to corrupt ...
Page 64 - css.snap file package names; hostname.yymmddhhmmss; Disk space handling
Table 3-4. SP Switch2 log files (continued) Log File Information Level File Location File Contents topology.data port primary node System error messages from thedistribution of the topology file to thesecondary nodes. Note: The files ending in .out are produced by running the appropriate command to ...
Page 65 - Switch supervisor status verification using Perspectives; responding to the frame supervisor.
Self-test Conditions ?? Pass sequence 1. Both LEDs light for about 10 seconds2. Both LEDs go off3. Green LED stays off, while the yellow LED flashes the switch address4. Yellow LED goes off for about two seconds (green LED stays off)5. Both LEDs light for about one second6. Upon self-test completion...
Page 66 - Base code verification; Note: This is not a Perspectives function.; Select the second option, “List Status of Supervisors (Report Form)“; Updating the SP Switch2 supervisor code; Note: This will take at least 12 minutes to complete.
Base code verification Note: This is not a Perspectives function. Perform the following procedure to check for supervisor conditions that require action.1. From the control workstation window, enter: smitty supervisor 2. The following menu is displayed: Check For Supervisors That Require Action (Sin...
Page 67 - Restoring an SP Switch2 to the active configuration; Parallel System Support Programs for AIX:
Removing and restoring switch resources This procedure can be performed to allow customer to use a switch feature while extended service actionsare performed on an individual frame of a multi-frame system with the switch feature. DO NOT PERFORM this procedure unless the required service operation wi...
Page 68 - Fencing nodes; Unfencing nodes; Efence of primary and primary backup nodes; Service position procedures
Using Perspectives to fence and unfence nodes attached to the switch Fencing nodes 1. Bring up Hardware Perspectives for the system2. Select the node to be fenced by either: v Double clicking the node v Opening the node’s notebook 3. Select either: v Fence v Fence with autojoin Note: Selecting the a...
Page 70 - Running diagnostics on a switch port
9. On the control workstation, set the node to boot from disk. For example: spbootins -r disk 2 12 1 10. On the control workstation, use Perspectives to power off the node and then power it back on. The node will now boot from the device that you specified in step 7 with the correct time. Running di...
Page 71 - Chapter 4. FRU removals and replacements; Handling static-sensitive devices
Chapter 4. FRU removals and replacements Handling static-sensitive devices . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1 SP Switch2 service procedures . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2 Removing a fan assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4...
Page 72 - Note; Removing a fan assembly; SP Switch2 service procedures
SP Switch2 service procedures CAUTION: The unit weight exceeds 18 Kg (40 lbs) and requires two service personnel to lift. ( SPSFC002 ) Note This chapter describes removal and replacement procedures for the following SP Switch2 FRUs: v Circuit breaker assembly v LED bracket assembly v LED power exten...
Page 74 - Removing the LED bracket assembly; Replacing the LED bracket assembly
Removing the LED bracket assembly Note: The LED bracket assembly is hot-pluggable. Note: Refer to “Handling static-sensitive devices” on page 4-1. 1. Remove the fan assembly housing the LED bracket assembly. v Refer to “Removing a fan assembly” on page 4-2. 2. Remove the LED bracket mounting screw f...
Page 75 - Removing the switch supervisor card
Removing the switch supervisor card Note: The switch supervisor card is hot-pluggable. Note: Refer to “Handling static-sensitive devices” on page 4-1. 1. Remove the switch supervisor cable from the supervisor card located in slot J2. 2. Loosen the captive screw holding the card retention bracket to ...
Page 76 - Note: An interposer card may be either a:
Replacing the switch supervisor card 1. Position and hold the switch supervisor card at the far end of the hot-plug actuator. 2. Insert the far end of the actuator into the actuator guides of switch slot J2. 3. Push the actuator to the end of the guide track. 4. Push the actuator handle inward and s...
Page 77 - Replacing an interposer card; Removing the switch planar; Note: The new planar assembly is supplied as a chassis mounted unit.
Note: Refer to “Handling static-sensitive devices” on page 4-1. Note: If multiple cards are to be removed, label and record the position of each card and its associated I/O cable. 1. If the interposer card is a switch interposer, remove the I/O cable. v Only switch interposer cards have an attached ...
Page 80 - Replacing the LED power extension cable
8. Remove the front top-cover from the chassis as follows: a. Remove the cover mounting screws. b. Slide the front top-cover toward the center of the chassis. c. Remove the cover when it disengages from the chassis framework. 9. Cut the tie-wrap securing the LED power extension cable to the cover mo...
Page 81 - Chapter 5. Parts catalog
Chapter 5. Parts catalog SP Switch2 assembly (view 1) . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-2 SP Switch2 assembly (view 2) . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-4 Switch cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6 SP Switch2 Frame ...
Page 97 - Trademarks
Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries.Consult your local IBM representative for information on the products and services currently available inyour are...
Page 98 - Notice to customers; Industry Canada compliance statement
Electronic emissions notices Federal Communications Commission (FCC) statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuantto Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmfulinterference ...
Page 99 - For installations in Japan:; Radio protection for Germany
For installations in Japan: The following is a summary of the VCCI Japanese statement in the box above. This is a Class A productbased on the standard of the Voluntary Control Council for Interference by Information TechnologyEquipment (VCCI). If this equipment is used in a domestic environment, rad...
Page 105 - Reader’s comments – We’d like to hear from you
Reader’s comments – We’d like to hear from you RS/6000 SPSP Switch2 Service Guide Publication No. GA22-7444-03 Overall, how satisfied are you with the information in this book? Very Satisfied Satisfied Neutral Dissatisfied Very Dissatisfied Overall satisfaction h h h h h How satisfied are you that t...
Page 106 - Readers’ Comments — We’d Like to Hear from You; IBMR; BUSINESS REPLY MAIL
Readers’ Comments — We’d Like to Hear from You GA22-7444-03 GA22-7444-03 IBMR Cut or FoldAlong Line Cut or FoldAlong Line Fold and Tape Please do not staple Fold and Tape Fold and Tape Please do not staple Fold and Tape NO POSTAGENECESSARYIF MAILED IN THEUNITED STATES BUSINESS REPLY MAIL FIRST-CLASS...