Sun Microsystems CP3240 - Manuals

viii Sun Netra CP3240 Switch Installation Guide • September 2009 3.1.2 P6(1-2) Fabric Zero Reset Configuration Word 3–3 3.1.3 P6(3-4) Base Zero Reset Configuration Word 3–3 3.1.4 P8(1-2) Base Write Protect 3–3 3.1.5 P8(3-4) Fabric Write Protect 3–4 3.1.6 P9 IPMC Firmware Program 3–4 3.1.7 P10(1-2) I...

x Sun Netra CP3240 Switch Installation Guide • September 2009 4.11.2 Firmware Upgrades 4–24 4.12 Fiber Optic RTM Configuration 4–25 4.12.1 Module Support 4–25 4.12.2 Backplane Ports Versus RTM Optical Ports 4–25 4.12.3 10G Configuration for RTM Optical Port 4–25 4.12.4 1G Configuration for RTM Optic...

Contents xi B.14 ATCA Zone 3 RTM Connector (J6-Bottom) B–12 C. Datasheet Reference C–1 D. Agency Certifications D–1 D.1 CE Certification D–1 D.2 NEBS/ETSI D–1 D.3 Safety D–2 D.4 Emissions Test Regulations D–3 D.4.1 EN 50081-1 Emissions D–3 D.4.2 EN 55024 Immunity D–3 D.5 Regulatory Information D–4 D...

xiii Figures FIGURE 1-1 Switch and RTM Faceplates 1–6 FIGURE 1-2 Netra CP3240H-RTM-CU Airflow (Pa) 1–8 FIGURE 1-3 Netra CP3240H-RTM-CU Airflow (InchesH20) 1–8 FIGURE 1-4 Netra CP3240H-RTM-OP Airflow (Pa) 1–9 FIGURE 1-5 Netra CP3240H-RTM-OP Airflow (InchesH20) 1–9 FIGURE 1-6 Front Cable Management Br...

xv Tables TABLE 1-1 Power Requirements 1–2 TABLE 1-2 Airflow Requirements 1–7 TABLE 1-3 ATCA Board Status LEDs 1–15 TABLE 1-4 Hot-Swap LED States 1–16 TABLE 2-1 Switch External Ports 2–18 TABLE 2-2 Zone 3 RTM Ports 2–18 TABLE 2-3 Copper RTM External Ports 2–20 TABLE 2-4 Copper RTM Port Restrictions ...

xix Preface The Sun Netra CP3240 Switch Installation Guide describes the installation and configuration of the Sun Netra CP3240 switch. This guide also includes informationabout software, environment specifications, connectors, and certifications. Before You Read This Document Obtain and read the fo...

xx Sun Netra CP3240 Switch Installation Guide • September 2009 How This Document Is Organized Chapter 1 provides unpacking instructions and initial setup information for the switch. It provides information and procedures needed to install and make the SunNetra CP3240 switch operational. Chapter 2 in...

Preface xxi Typographic Conventions Note – Characters display differently depending on browser settings. If characters do not display correctly, change the character encoding in your browser to UnicodeUTF-8. Typeface Meaning Examples AaBbCc123 The names of commands, files,and directories; on-screenc...

xxii Sun Netra CP3240 Switch Installation Guide • September 2009 Related Documentation The following table lists the documentation for this product. The onlinedocumentation is available at: http://docs.sun.com/app/docs/prod/cp3240.switch?l=en#hic The following table lists the documentation that is r...

Preface xxiii . Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mentioned in thisdocument. Sun does not endorse and is not responsible or liable for any content,advertising, products, or other materials that are available on or through such sitesor resource...

1-1 C H A P T E R 1 Getting Started This chapter provides information and procedures needed to install and make theSun Netra CP3240 switch operational. This chapter should be read before using theboard. In addition to this chapter, refer to the following safety documentation: ■ Netra CP3X20 Switch S...

1-2 Sun Netra CP3240 Switch Installation Guide • September 2009 1.1 System Requirements The following sections briefly describe the minimum system requirements and theconfigurable features. Links are provided to other chapters and appendicescontaining more detailed information. 1.1.1 Connectivity Th...

1-4 Sun Netra CP3240 Switch Installation Guide • September 2009 1.2 Unpacking Check the shipping carton for damage. If the shipping carton or contents aredamaged, notify the carrier and Sun. Retain the shipping carton and packingmaterial for inspection by the carrier. Obtain authorization before ret...

Chapter 1 Getting Star ted 1-5 Caution – The heat sinks on a switch can be damaged by incorrect handling. Do not touch the heat sinks while installing or removing a switch. Hold a switch only by theedges. If a heat sink is loose or broken, obtain a replacement switch. Caution – The heat sinks on a s...

1-6 Sun Netra CP3240 Switch Installation Guide • September 2009 1.6 Switch and RTM Faceplates The following shows the Sun Netra CP3240 switch and the copper RTM(XCP3240H-RTM-CU-Z) and the fiber optic RTM (XCP3240H-RTM-OP-Z). FIGURE 1-1 Switch and RTM Faceplates Copper RTM Fiber Optic RTM Switch Face...

Chapter 1 Getting Star ted 1-7 1.6.1 Base 10/100/1000 Uplink Ports (RJ-45) There are two front panel Base 10/100/1000Base-T Ethernet uplink ports on thefaceplate. They are ports number 18 and 19 on the Base network. 1.6.2 10/100 Management Port (RJ-45) There is a 10/100 management Ethernet port on t...

1-10 Sun Netra CP3240 Switch Installation Guide • September 2009 1.8 Removing and Installing Switches This section describes how to remove and install switches. If you are hot-swapping the rear transition module for a switch, you must removethe switch from the front of the system before removing the...

Chapter 1 Getting Star ted 1-11 1.8.1.1 Removing a Switch From the Front of the Server 1. Move the front cable management bracket to the lower position ( FIGURE 1-6 ). FIGURE 1-6 Front Cable Management Bracket in Lower Position 2. Disengage the injector/ejector mechanisms at the top and bottom of th...

Chapter 1 Getting Star ted 1-13 Note – As long as the switch is removed from the slot, and the system is running with only the single remaining switch, you do not have redundancy for thatcomponent. Both switches must be installed and running to have redundancy forthat component. 1.8.1.2 Removing a R...

1-14 Sun Netra CP3240 Switch Installation Guide • September 2009 1.8.2 Installing a Switch Set If you have a rear-access server, you must install the rear transition module beforeinstalling the front switch. ■ If you want to install the rear transition module, go to Section 1.8.2.1, “Installing the ...

Chapter 1 Getting Star ted 1-15 4. Prepare the switch by opening its injector/ejector handles ( FIGURE 1-7 ). 5. Carefully align the edges of the board with the guides in the slot. Look into the enclosure to verify correct alignment of the rails in the guides. 6. Keeping the board aligned in the gui...

2-2 Sun Netra CP3240 Switch Installation Guide • September 2009 2.1 Features Part of Sun’s ATCA platform, the Sun Netra CP3240 switch complies with PICMG3.0 R2.0 ECN002 and PCIMG 3.1 Option 1 and Option 9. The Sun Netra CP3240switch implements two separate switched networks on a single PCB. By separ...

Chapter 2 Overview 2-3 2.1.2 Base Interface ■ Broadcom BCM56503-based design ■ Full gigabit non-blocking, wire-speed switching/routing ■ Layer 2 switching ■ Layer 3 routing ■ 27 ports: ■ 14 10/100/1000Base-T Ethernet ports for node slots ■ 1 10/100/1000Base-T Ethernet port for redundant switch ■ 2 1...

2-4 Sun Netra CP3240 Switch Installation Guide • September 2009 2.1.3 Fabric Gigabit Interface ■ Broadcom BCM56800-based design ■ Full gigabit non-blocking, wire-speed switching/routing ■ Layer 2 switching ■ Layer 3 routing ■ 20 total ports: ■ 14 10GBase-BX4 Ethernet ports for node slots ■ 1 10GBase...

Chapter 2 Overview 2-5 2.1.4 AMC Sites ■ Site 1 1000Base-BX to 3.0 network (AMC port 0) is ethernet port 22 ■ Site 2 1000Base-BX to 3.0 network (AMC port 0) is ethernet port 23 ■ Site 2 10GBase-BX to 3.1 network (AMC port 8-11) is ethernet port 16 ■ Site 3 1000Base-BX to 3.0 network (AMC port 0) is ...

2-6 Sun Netra CP3240 Switch Installation Guide • September 2009 2.2 Switch Components The following sections list and describe key components of the Sun Netra CP3240switch. 2.2.1 Broadcom StrataXGS 3 BCM56503 Ethernet Switch The Sun Netra CP3240 switch uses Broadcom StrataXGS 3 BCM56503 for BaseEthe...

2-8 Sun Netra CP3240 Switch Installation Guide • September 2009 2.3 Protocols, RFCs, and MIBs Support The Sun Netra CP3240 switch features Level7 FastPath 2340 switching software,version 4.4.4 and newer. This software provides layer 2 switching, quality of service,IPv4 routing, IPv6 routing, and IP ...

Chapter 2 Overview 2-9 2.3.1.1 Additional Layer 2 Functionality ■ Broadcast/Multicast/Unknown Unicast storm recovery ■ Double VLAN/vMAN tagging ■ DHCP filtering ■ Jumbo Ethernet frames ■ Many-to-one port mirroring (Tx, Rx, both) ■ Static MAC filtering ■ MAC-based VLANs ■ IP subnet-based VLANs ■ Port...

2-10 Sun Netra CP3240 Switch Installation Guide • September 2009 ■ RFC 3164—BSD Syslog protocol ■ RFC 3396—Encoding long options in the Dynamic Host Configuration Protocol(DHCPv4) ■ RFC 3580—802.1X RADIUS usage guidelines 2.3.1.3 Switching MIBs ■ RFC 1213 — MIB-II ■ RFC 1493 — Bridge MIB ■ RFC 1643 ...

Chapter 2 Overview 2-11 2.3.2 FASTPATH Routing ■ RFC 826—Ethernet ARP ■ RFC 894—Transmission of IP Datagrams over Ethernet networks ■ RFC 896—Congestion control in IP/TCP networks ■ RFC 919—IP Broadcast ■ RFC 922—IP Broadcast in the presence of subnets ■ RFC 950—IP subnetting ■ RFC 1027—Using ARP to...

2-12 Sun Netra CP3240 Switch Installation Guide • September 2009 2.3.3 FASTPATH Quality of Service 2.3.3.1 DiffServ ■ RFC 2474—Definition of the Differentiated Services field (DS field) in the IPv4and IPv6 headers ■ RFC 2475—Architecture for differentiated services ■ RFC 2597—Assured Forwarding PHB ...

Chapter 2 Overview 2-13 2.3.3.3 Class of Service (CoS) Direct user configuration of the following: ■ IP DSCP to traffic-class mapping ■ Interface trust mode: 802.1p, IP DSCP, or untrusted ■ Interface traffic-shaping rate ■ Minimum and maximum bandwidth per queue ■ Strict priority versus weighted (WR...

2-14 Sun Netra CP3240 Switch Installation Guide • September 2009 2.3.4.1 Multicast MIBs ■ RFC 2932—IPv4 multicast routing MIB ■ RFC 2933—IGMP MIB ■ RFC 2934—PIM MIB for IPv4 ■ Draft-ietf-magma-mgmd-mib-03.txt—Multicast Group Membership DiscoveryMIB ■ Draft-ietf-idmr-dvmrp-mib-11.txt—DVMRP MIB ■ IANA...

Chapter 2 Overview 2-15 2.3.5.1 IPv6 Routing MIBs ■ RFC 2465—IPv6 MIB ■ RFC 2466—ICMPv6 MIB ■ FASTPATH Enterprise MIBs supporting IPv6 features 2.3.6 FASTPATH Management ■ RFC 854—Telnet ■ RFC 855—Telnet option specifications ■ RFC 1155—SMI v1 ■ RFC 1157—SNMP ■ RFC 1212—Concise MIB definitions ■ RFC...

2-16 Sun Netra CP3240 Switch Installation Guide • September 2009 ■ RFC 3417—Transport mappings for SNMP ■ RFC 3418—MIB for SNMP ■ Configurable management VLAN 2.3.6.1 SSL 3.0 and TLS 1.0 ■ RFC 2246—TLS protocol, version 1.0 ■ RFC 2346—AES Ciphersuites for transport layer security ■ RFC 2818—HTTP ove...

Chapter 2 Overview 2-17 2.4 Functional Diagrams and Port Maps 2.4.1 Switch FIGURE 2-1 Switch Functional Block Diagram

Chapter 2 Overview 2-19 2.4.2.1 Copper RTM The XCP3240H-RTM-CU-Z is the Sun Netra CP3240 switch’s copper RTM pairing. This RTM supports all the ports the Sun Netra CP3240 switch provides using10GBase-CX4 for the 10Gigabyte and 10/100/1000Base-T for the 1Gigabyte ports. FIGURE 2-2 Copper RTM Function...

Chapter 2 Overview 2-21 2.4.2.2 Fiber Optic RTM The XCP3240H-RTM-OP-Z is the Sun Netra CP3240 switch’s fiber optic RTM pairing. This RTM supports all the ports the Netra CP3240 switch provides using 10GBase-Xfor the 10Gigabyte and 1000Base-X for the 1Gigabyte ports. FIGURE 2-3 Fiber Optic RTM Functi...

Chapter 2 Overview 2-25 2.4.5 AdvancedMC Sites PICMG AdvancedMC AMC.0 defines hot-swappable daughter cards to be used inPICMG architectures. The Sun Netra CP3240 switch supports three AMC sites sothat the functionality of the Sun Netra CP3240 switch can be expanded. AMC.2(Ethernet) AMCs are supporte...

2-26 Sun Netra CP3240 Switch Installation Guide • September 2009 2.4.5.1 AMC Port Maps FIGURE 2-6 AMC Port Map Diagram

2-30 Sun Netra CP3240 Switch Installation Guide • September 2009 2.4.5.2 AMC Module Support by Site 2.4.5.3 AMC Port Restrictions for RTMs The following tables list AMC port restrictions for RTMs TABLE 2-11 AMC Modules by Site AMC Module Site 1 (top mostwhen the board isvertical) Site 2 (middle) Sit...

3-2 Sun Netra CP3240 Switch Installation Guide • September 2009 3.1 Jumper Settings The following jumper settings are available for configuring the switch. Each ofjumper settings is described in the subsections. 3.1.1 P4 Cross-Connect Control This jumper is used to control ShMC cross connect. ShMC c...

3-4 Sun Netra CP3240 Switch Installation Guide • September 2009 3.1.5 P8(3-4) Fabric Write Protect This jumper configures write protection on the Fabric reset configuration word. 3.1.6 P9 IPMC Firmware Program These jumpers configure IPMC firmware write actions via the debug serial port. 3.1.7 P10(1...

3-6 Sun Netra CP3240 Switch Installation Guide • September 2009 3.1.11 P12(1-2) and P12 (3-4) EMI Ground to LogicGround The switch and the entire AdvancedTCA shelf separate the ground of the chassisitself from digital ground for EMI protection. This jumper configures the twogrounds. 3.1.12 P13 Seria...

Chapter 3 Configuring Jumper Settings 3-7 3.2 Jumper Locations FIGURE 3-1 shows the locations of the jumper settings. FIGURE 3-1 Switch Jumper Locations

4-2 Sun Netra CP3240 Switch Installation Guide • September 2009 4.1 IPMI Firmware Sensors This section describes the IPMI firmware sensors. 4.1.1 State Sensors TABLE 4-1 IPMI State Sensors Sensor Name Type Description Discrete States Returned TABLE 4-2 0 FRU 0 HOT_SWAP State hotswap discretestate M ...

4-4 Sun Netra CP3240 Switch Installation Guide • September 2009 4.1.2 Threshold Sensors TABLE 4-4 IPMI Thresold Sensors Sensor Name Type Description Units LowerThresholds UpperThresholds # Minor Major Critical Minor Major Critical 7 +12.0V Thresh +12Vmainpower Volts 11.016 10.21 9.02 13.45 13.72 13....

Chapter 4 Configuring Switch Software 4-5 4.2 uBoot uBoot is the boot loader. Much like a BIOS, it brings the system to a usable state forthe operating system (OS) to boot. It also performs a POST of the CPU subsystem. Itcan be used as a recovery console if the firmware image becomes corrupt or afir...

4-6 Sun Netra CP3240 Switch Installation Guide • September 2009 There is only a one-second delay to press a key. When the uBoot prompt is displayed, you can then enter any of the followingcommands. 4.2.2 E-Keying Control in uBoot See the Section 4.3.1, “e-Keying” on page 4-7 for a description of e-K...

Chapter 4 Configuring Switch Software 4-7 4.2.3 Serial-Baud Rate Control in uBoot You can change the serial baud rate from within FASTPATH, the boot menu, or inuBoot. Changing it in uBoot is the only method that allows it to persist through areset. Only standard baud rates are accepted. Note – Chang...

4-8 Sun Netra CP3240 Switch Installation Guide • September 2009 4.3.2 e-Keying Bypass e-Keying can be ignored by creating a uBoot environment variable as described in Section 4.2.2, “E-Keying Control in uBoot” on page 4-6 . When e-Keying is bypassed, ports are no longer enabled or disabled based on ...

Chapter 4 Configuring Switch Software 4-9 4.5 Serial Location The switch supports running its serial port to both the front panel and the RTM. Itdoes not support both the front panel and RTM at the same time. You mustconfigure the port to go to the location needed. By default, the port is routed to ...

4-10 Sun Netra CP3240 Switch Installation Guide • September 2009 4.6 Boot Sequence The following is an example of a boot sequence. CODE EXAMPLE 4-3 Boot Sequence Example CPU: 400 MHz DRAM: 256 MB FLASH: 64 MB, Base, Primary Flash ### JFFS2 loading 'image1' to 0x400000 Scanning JFFS2 FS: . done. ### ...

Chapter 4 Configuring Switch Software 4-11 The switch takes approximately 50 seconds to boot to a console and be fullyfunctional. 4.6.1 Boot Utility Menu There is a utility menu that can be used before FASTPATH boots. During boot thereis a two-option menu displayed for five seconds. This menu allows...

4-12 Sun Netra CP3240 Switch Installation Guide • September 2009 4.6.1.1 Load Code Update Package using TFTP/FTP FASTPATH can be updated from within FASTPATH itself, but it can also be updatedfrom this menu. ■ The update image must be on a TFTP server or FTP server. ■ The server must be on the same ...

Chapter 4 Configuring Switch Software 4-13 4.6.1.5 Start Diagnostic Application This option boots the Broadcom diag shell, currently SDK version 5.4.1. Thisenvironment is provided as is , with no support. Several commands provided in this shell are not supported and will not work. This shell is prov...

4-14 Sun Netra CP3240 Switch Installation Guide • September 2009 4.8.2 Updating the Non-Active Image All of the update methods supported by the active image (image1 by default) arealso supported for the non-active image (image2). 4.8.3 Fabric 1G/10G Auto-negotiation The Fabric networks support both ...

4-18 Sun Netra CP3240 Switch Installation Guide • September 2009 4.10 FASTPATH The switch features LVL7 Systems’ FASTPATH 2340 software, version 4.4.FASTPATH is a software package providing the robust management needed tocontrol a modern switch-router. This section serves as a quick primer on usingF...

4-20 Sun Netra CP3240 Switch Installation Guide • September 2009 4.10.3 Logins and Prompts FASTPATH supports multiple users with different security levels. By default, there is one admin user with no password. In the CLI, privilege mode is password-protected separately from the default mode, but als...

Chapter 4 Configuring Switch Software 4-21 4.10.3.3 SNMP Defaults SNMP is enabled by default. The default read-only community string is public . The default read-write community string is private . 4.10.4 Secure Remote Access 4.10.4.1 SSH and SSL/TLS Keys The switch supports SSH for a secure CLI con...

4-22 Sun Netra CP3240 Switch Installation Guide • September 2009 4.10.5 Default Settings The switch comes configured with a default configuration. This configuration bootsthe board to Layer 2 switching. This configuration is very basic and should beupdated for your environment. The default settings ...

4-24 Sun Netra CP3240 Switch Installation Guide • September 2009 4.11 Firmware Updates All of the firmware listed in this section is field upgradeable. There is a singleupdate image that supports the Base firmware, Fabric firmware, and IPMCfirmware. This update image must be installed twice though, ...

Chapter 4 Configuring Switch Software 4-25 4.12 Fiber Optic RTM Configuration For the fiber optic RTM (XCP3240H-RTM-OP-Z) to work correctly, switch firmware 1.2.1.0 or newer is required. The following sections describe support andrequirements for configuring the RTM. 4.12.1 Module Support The Fiber ...

4-26 Sun Netra CP3240 Switch Installation Guide • September 2009 4.12.4 1G Configuration for RTM Optical Port For 1G operation, an SFP module must be used and the port (17-20) must be set to auto-negotiate . When you enable auto-negotiation, 1G operation is automatically enabled and 10G operation is...

A-1 A P P E N D I X A Environment Specifications This appendix describes the electrical, environmental, and mechanical specifications.It includes connector descriptions and pin outs, as well as illustrations of the boarddimensions and connector locations.

A-2 Sun Netra CP3240 Switch Installation Guide • September 2009 A.1 Electrical and Environmental The following sections provide tables and illustrations showing the electrical andenvironmental specifications. A.1.1 Absolute Maximum Ratings The following values are stress ratings only. Do not operate...

Appendix A Environment Specifications A-3 A.2Reliability Reliability prediction was done using Issue 6, Method I, Case 3 of the BellcoreIndustrial Reliability program. The prediction assumed 25% operating temperaturewith 100% duty cycle, in a ground benign, controlled environment. ■ MTBF: 122,173 ho...

B-10 Sun Netra CP3240 Switch Installation Guide • September 2009 B.9 Serial Cable The switch uses RJ-45 connectors for its serial ports. To connect to a PC’s DB9connector, a special cable or adapter is needed. These cables and adapters areavailable through various sources or can be made easily. The ...

Appendix B Connectors B-11 B.10 10/100/1000Base-T RJ-45 Connector (J133 rd , J13 Bottom) B.11 10/100Base-TX RJ-45 Connector (J132nd) TABLE B-10 10/100/1000Base-T RJ-45 Connector (J13-3rd and Bottom) Signal 1 MDI_0+ 2 MDI_0- 3 MDI_1+ 4 MDI_2+ 5 MDI_2- 6 MDI_1- 7 MDI_3+ 8 MDI_3- TABLE B-11 10/100Base-...

C-1 A P P E N D I X C Datasheet Reference This appendix provides links to datasheets, standards, and specifications for thetechnology designed into the switch. IEEE 802.3-2002 CDMA/CD (Ethernet) and Other IEEE 802.3/802.1Documents This document defines Ethernet and several of the protocols used in E...

C-2 Sun Netra CP3240 Switch Installation Guide • September 2009 Broadcom Datasheets A non-disclosure agreement (NDA) with Broadcom is required to view theirdatasheets. Contact Broadcom for more information. http://www.broadcom.com/ MPC8272 PowerQUICC II Family Reference Manual This and other Freesca...

D-1 A P P E N D I X D Agency Certifications This appendix lists standards agencies and the certifications related to the switch. D.1 CE Certification The Sun Netra CP3240 switch and RTM meets the intent of Directive 89/336/EECfor Electromagnetic Compatibility [EN55024:1998, EN55022:1998] and Low-Vol...

D-2 Sun Netra CP3240 Switch Installation Guide • September 2009 ■ ETSI EN 300 132-2, September 1996, Equipment Engineering Power SupplyInterface At The Input To Telecommunications Equipment; Part 2: Operated bydirect current (dc) ■ ETSI EN 300 753, October 1997, Acoustic Noise Emitted By Telecommuni...

Appendix D Agency Cer tifications D-3 D.4 Emissions Test Regulations ■ FCC Part 15, Subpart B Class A Commercial Equipment ■ Industry Canada ICES-003 Class A Commercial Equipment ■ CISPR 22/EN 55022:1998 Class A Radiated, Power line Conducted ■ Telcordia GR-1089-CORE EMC For Network Telecommunicatio...

D-4 Sun Netra CP3240 Switch Installation Guide • September 2009 ■ IEC 61000-4-3:2003 EMC - Part 4. Testing and measurement techniques - Section 3:Radiated, radio-frequency, electromagnetic field immunity test ■ IEC 61000-4-4:2004 EMC - Part 4: Testing and measurement techniques - Section 4:Electrica...