Sun Microsystems Ethernet PCI-X Adapter - Manuals

Page 3 - Contents; Preface

iii Contents Preface xiii 1. Product Overview 1 Product Description 1 Hardware and Software Requirements 2 Features 3 2. Installing the Adapter 5 Installing the Adapter Without Dynamic Reconfiguration 5 ▼ To Install the Adapter 6 ▼ To Install the Optical Transceiver 7 ▼ To Verify the Hardware Instal...

Page 4 - Configuring VLANs

iv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10-Gigabit Ethernet Driver Parameter Values and Definitions 20 Flow Control Parameters 20 Interrupt Parameters 21 Jumbo Frames 22 ▼ To Configure Jumbo Frames Using ndd 22 ▼ To Configure Jumbo Frames in a Linux Env...

Page 5 - Diagnostic Software; netlbtest; Installing the Software Manually; ixge; Index

Contents v B. Diagnostic Software 45 SunVTS Diagnostic Software 45 Updating SunVTS to Recognize the Adapter 46 ▼ To Update SunVTS to Recognize the Adapter 46 Using the SunVTS netlbtest 47 ▼ To Use the netlbtest 47 C. Installing the Software Manually 49 ▼ To Install the Driver Software Manually 49 D....

Page 7 - Tables

vii Tables TABLE 1-1 Hardware and Software Requirements for Sun SPARC Servers 2 TABLE 3-1 ixge Driver Parameter, Status, and Descriptions 20 TABLE 3-2 Read-Write Flow Control Keyword Descriptions 21 TABLE 3-3 RX Blanking Register for Alias Read 21 TABLE 3-4 accept-jumbo Parameters 22 TABLE 3-5 Read-...

Page 9 - Figures

ix Figures FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed 2 FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels 3 FIGURE 4-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters 38 FIGURE 4-2 Ethernet Tag Header Format 40

Page 11 - Declaration of Conformity; EMC; Supplementary Information:

xi Declaration of Conformity EMC USA—FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:1. This equipment may not cause harmful interference.2. This equipment must accept any interference that may cause undesired operation. Europea...

Page 13 - The; How This Book Is Organized; Appendix C describes how to install the driver software manually.

xiii Preface The Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide provides installation instructions for the Sun 10-Gigabit Ethernet PCI-X adapter. Thisdocument also describes how to configure the driver software. These instructions are designed for enterprise system administrator...

Page 14 - Using UNIX Commands; This document might not contain information on basic UNIX; Shell Prompts

xiv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Using UNIX Commands This document might not contain information on basic UNIX ® commands and procedures such as shutting down the system, booting the system, and configuringdevices. Refer to the following for thi...

Page 15 - Typographic Conventions; su

Preface xv Typographic Conventions Accessing Sun Documentation You can view, print, or purchase a broad selection of Sun documentation, includinglocalized versions, at: http://www.sun.com/documentation Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mention...

Page 16 - Contacting Sun Technical Support

xvi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Contacting Sun Technical Support If you have technical questions about this product that are not answered in thisdocument, go to: http://www.sun.com/service/contacting Sun Welcomes Your Comments Sun is interested...

Page 17 - Product Overview; Product Description; Note –; first

1 C H A P T E R 1 Product Overview This chapter contains an overview of the Sun 10-Gigabit Ethernet PCI-X adapter,including: ■ “Product Description” on page 1 ■ “Hardware and Software Requirements” on page 2 ■ “Features” on page 3 Product Description The Sun 10-Gigabit Ethernet PCI-X adapter is a lo...

Page 18 - Hardware and Software Requirements; lists the supported hardware and software for Sun SPARC; Visit Sun on the World Wide Web at

2 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed Hardware and Software Requirements Before installing the adapter, make sure your system meets the required hardwareand software. T...

Page 19 - Features; kstat

Chapter 1 Product Overview 3 FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels Features The Sun 10-Gigabit Ethernet PCI-X adapter addresses the following requirementsand provides additional features and benefits: ■ One full-duplex 10 gigabit Ethernet interface that uses a small f...

Page 21 - Installing the Adapter; not; Caution –; must

5 C H A P T E R 2 Installing the Adapter This chapter describes how to install the Sun 10-Gigabit Ethernet PCI-X adapter inyour system and verify that it has been installed correctly. The chapter thendescribes how to install the driver software using the automated script. Finally, thischapter descri...

Page 22 - To Install the Adapter; Power off all of the peripherals connected to your system.; Save the filler panel screw for Step 9.; Insert the adapter into the PCI opening.; Green LEDs do not light until the correct driver is installed.

6 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Install the Adapter The following instructions describe the basic tasks required to install the adapter.Refer to your system installation or service manual for detailed PCI adapterinstallation instructions. 1....

Page 23 - To Install the Optical Transceiver; Pull the white locking handle into the full horizontal position.

Chapter 2 Installing the Adapter 7 ▼ To Install the Optical Transceiver The Sun 10-Gigabit Ethernet PCI-Xadapter requires an optical transceiver to createand Ethernet connection. The optical transceiver Part Number: 135-1172-01 isavailable from Sun Microsystems. 1. Pull the white locking handle into...

Page 24 - Push the handle closed to lock the optical transceiver in place.

8 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 4. Push the handle closed to lock the optical transceiver in place. 5. Detach the wrist strap. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver...

Page 25 - To Verify the Hardware Installation; before; sequence to interrupt the boot process and display the OpenBoot (; ok; List the network devices on your system.; network

Chapter 2 Installing the Adapter 9 ▼ To Verify the Hardware Installation After you have installed the Sun 10-Gigabit Ethernet adapter, but before you boot your system, perform the following tasks to verify the installation. Refer to the yourSolaris documentation for the detailed instructions. Note –...

Page 26 - file for a list of device properties.; properties; Type the following when you finish looking at the; Rebooting the System; After verifying the adapter installation, use the

10 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 4. View the .properties file for a list of device properties. The . properties command displays the specific information about the installed adapter. If you are using the Sun 10-Gigabit Ethernet adapter, your outp...

Page 27 - cfgadm; Sun Enterprise Dynamic Reconfiguration User’s Guide; Using the Installation Script; connected to your system.

Chapter 2 Installing the Adapter 11 Installing the Adapter With DynamicReconfiguration If you have a Sun Enterprise™ system that supports dynamic reconfiguration (DR),you do not have to reboot your system after installing the adapter. The process of adding and configuring an adapter with DR involves...

Page 28 - download instructions.; Change to the directory were the installation script resides:; unzipped; You’ll see the following output

12 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is running Sun Enterprise Volume Manager™, it shouldautomatically mount the CD-ROM to the /cdrom/cdrom0 directory. ■ If your system is not running Sun Enterprise Volume Manager, mount the CD-ROM a...

Page 30 - Verifying the Software Installation; Use the; modinfo; command to verify that you have the current driver (v1.30 or; If you type

14 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 5. Reboot the system to load the driver: 6. Verify the installation to ensure that the driver installed and loaded properly. Verifying the Software Installation Unless you have the latest version of the driver sof...

Page 31 - Configuring the Network Host Files; number; command to search the

Chapter 2 Installing the Adapter 15 Configuring the Network Host Files After installing the driver software, you must create a hostname.ixge number file where number = the instance number of the ixge interface.) for the adapter ’s Ethernet interface. You must also create both an IP address and a hos...

Page 33 - Create an appropriate entry in the

Chapter 2 Installing the Adapter 17 3. Create an appropriate entry in the /etc/hosts file for each active ixge interface. For example: # cat /etc/hosts # # Internet host table # 127.0.0.1 localhost 129.144.10.57 zardoz loghost 129.144.11.83 zardoz-11

Page 35 - Configuring Driver Parameters

19 C H A P T E R 3 Configuring Driver Parameters This chapter describes how to configure the driver parameters used by the Sun 10-Gigabit Ethernet PCI-Xadapter. This chapter contains the following sections: ■ “10-Gigabit Ethernet Device Driver Parameters” on page 19 ■ “Setting ixge Driver Parameters...

Page 36 - Flow Control Parameters

20 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10-Gigabit Ethernet Driver Parameter Values andDefinitions TABLE 3-1 describes the parameters and settings for the ixge device driver. Flow Control Parameters The ixge device sources (transmits) and terminates (re...

Page 37 - provides flow control keywords and describes their function.; Interrupt Parameters; describes the receive interrupt blanking values.

Chapter 3 Configuring Driver Parameters 21 TABLE 3-2 provides flow control keywords and describes their function. Interrupt Parameters TABLE 3-3 describes the receive interrupt blanking values. TABLE 3-2 Read-Write Flow Control Keyword Descriptions Keyword Description adv_asmpause_cap The adapter su...

Page 38 - Jumbo Frames; The variable; To Configure Jumbo Frames Using; Unplumb the interface you want to configure Jumbo Frames on.; snoop; or; netstat; processes running over the interface to be configured.; In this example, the instance number set is 0.; Set the instance to accept jumbo frames:; where; % ifconfig ixge0 plumb

22 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Jumbo Frames The variable accept-jumbo enables the driver to instruct the upper layers that the driver is operating in Jumbo-frame mode. Refer to the documentation that came with your switch for exact commands toc...

Page 39 - software is installed.; Setting; Setting Parameters Using the; up

Chapter 3 Configuring Driver Parameters 23 ▼ To Configure Jumbo Frames in a LinuxEnvironment 1. Ensure that the ixge software is installed. 2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface: where xxx.xxx.xx.xxx = the IP address of the interface. Setting ixge Driver Parameters You can set the ixg...

Page 40 - file to identify the instance associated with a; Noninteractive and Interactive Modes; ndd; To Use the

24 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Specify Device Instances for the ndd Utility Before you use the ndd utility to get or set a parameter for a ixge device, you must specify the device instance for the utility. 1. Check the /etc/path_to_inst fi...

Page 41 - To modify a parameter value, use the; To modify a parameter value in interactive mode, specify

Chapter 3 Configuring Driver Parameters 25 ● To modify a parameter value, use the -set option. If you invoke the ndd utility with the -set option, the utility passes value , which must be specified, down to the named /dev/ixge driver instance, and assigns the value to the parameter: When you change ...

Page 42 - To list all the parameters supported by the; off; To access any man page, type the; man; command plus the name of the man page.

26 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ● To list all the parameters supported by the ixge driver, type ? . See TABLE 3-1 through TABLE 3-6 for parameter descriptions. Note – By default, autonegotiation is set to off . This adapter operates only at full...

Page 43 - To Set Driver Parameters Using a; Obtain the hardware path names for the; devices in the device tree.; b. Locate the path names and the associated instance numbers in the

Chapter 3 Configuring Driver Parameters 27 ▼ To Set Driver Parameters Using a ixge.conf File 1. Obtain the hardware path names for the ixge devices in the device tree. a. Check the /etc/driver_aliases file to identify the name associated with a particular device: Note – ixge "pci8086,1048.108e.7...

Page 44 - pci; Set the parameters for the above devices in the; parent

28 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 In this example: ■ The first part within the double quotes specifies the hardware node name inthe device tree. ■ The number not enclosed in quotes is the instance number (shown in bolditalics). ■ The last part in ...

Page 45 - These statistics are part of the statistics presented by the k

Chapter 3 Configuring Driver Parameters 29 10-Gigabit Ethernet Driver OperatingStatistics These statistics are part of the statistics presented by the k stat command. TABLE 3-5 describes the read-only Media Independent Interface (MII) capabilities. These parameters define the capabilities of the har...

Page 46 - describes the

30 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Table describes the read-only ixge device capabilities. TABLE 3-6 describes the kstat ixge:1 receive and transmit parameters: cap_10hdx Local interface half-duplex capability0 = Not 10 Mbit/sec half-duplex capable...

Page 48 - To Check Link Partner Settings; Type the

32 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Check Link Partner Settings Type the kstat command as superuser: xcvr_id GMII/MII physical layer device Identification Decimal copy ofMII registers 2 and 3. xcvr_inits Number of physical layer re-initializati...

Page 50 - To Discover Device Capabilities; command to discover device capabilities.

34 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Discover Device Capabilities ● Use the kstat command to discover device capabilities. rx_taskq_waits 0 snaptime 7883.09014984 trunk_mode 0 tx_allocb_fail 0 tx_ddi_pkts 0 tx_dma_bind_fail 0 tx_dvma_pkts 0 tx_h...

Page 51 - To Discover Link Settings; command to discover link settings.; Configuration Checking; Layer 2 Configuration Checking; Layer 3 Configuration Checking; ifconfig

Chapter 3 Configuring Driver Parameters 35 ▼ To Discover Link Settings ● Use the kstat command to discover link settings. Configuration Checking The jumbo frame configuration checking occurs at Layer 2 or Layer 3, depending onthe configuration method. Layer 2 Configuration Checking You can view the ...

Page 53 - “Overview of VLANs” on page 37; Overview of VLANs

37 C H A P T E R 4 Configuring VLANs This chapter explains Virtual Local Area Networks (VLANs) in detail and providesconfiguration instructions and examples. It contains the following sections: ■ “Overview of VLANs” on page 37 ■ “Configuring VLANs” on page 39 With multiple VLANs on an adapter, a ser...

Page 56 - shows the Ethernet Tag Header format.; received by that adapter must be in VLAN-tagged format.; To Configure Static VLANs; file for each VLAN that will be configured for; Device PPA

40 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 subnets when setting up a VLAN network interface. This means that each VIDassigned to a VLAN interface of a physical network interface will belong to differentsubnets. Tagging an Ethernet frame requires the additi...

Page 57 - to configure a VLAN virtual device, for example:; The output of; you’ve set up on the server.; # ifconfig ixge4000 plumb up

Chapter 4 Configuring VLANs 41 2. Use the ifconfig(1M) to configure a VLAN virtual device, for example: The output of ifconfig -a on a system having VLAN devices ixge123000 and ixge224000 : 3. On the switch, set VLAN tagging and set VLAN ports to coincide with the VLANs you’ve set up on the server. ...

Page 59 - Specifications; “Performance Specifications” on page 43

43 A P P E N D I X A Specifications This appendix provides specifications for the Sun 10-Gigabit Ethernet PCI-X adapter. ■ “Performance Specifications” on page 43 ■ “Physical Characteristics” on page 44 ■ “Power Requirements” on page 44 Performance Specifications TABLE A-1 Performance Specifications...

Page 61 - SunVTS Diagnostic Software; nettest

45 A P P E N D I X B Diagnostic Software This appendix provides an overview of the SunVTS diagnostic application andinstructions for updating the SunVTS software to recognize the adapter. Thisappendix contains the following sections: ■ “SunVTS Diagnostic Software” on page 45 ■ “Updating SunVTS to Re...

Page 62 - Select the document for the Solaris release on your system.; To Update SunVTS to Recognize the Adapter; Ensure that the SunVTS software and the; driver are installed on your

46 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 http://www.sun.com/products-n-solutions/hardware/docs/Software /system_administration/tools/testing_valid/sunvts/index.html Select the document for the Solaris release on your system. Updating SunVTS to Recognize ...

Page 63 - Using the SunVTS; command to bring the Ethernet device down before running; Ensure that the SunVTS software and the; Where; is the instance number of the interface.; down; unplumb

Appendix B Diagnostic Software 47 Using the SunVTS netlbtest You must have the Ethernet card and the device driver installed, a loopbackconnector in place, and Intervention mode enabled before running netlbtest . netlbtest cannot run if the network interface is connected to a live network, and requi...

Page 65 - To Install the Driver Software Manually

49 A P P E N D I X C Installing the Software Manually This appendix describes how to install the driver software manually. The Sun 10-Gigabit Ethernet Adapter CD contains the driver software required to operate the adapter. When you update your Solaris operating system, refer to thedocumentation tha...

Page 66 - If you intend to use VLAN, you must install VLAN packages when you

50 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is not running Volume Manager, mount the CD-ROM as follows: You will see the following files and directories in the /cdrom/sun_10-gigabit_ethernet_driver directory or the /cdrom/cdrom0 directory, ...

Page 67 - vlan; drivers are installed on the system:; replacing the; ARCH

Appendix C Installing the Software Manually 51 4. Install the patch: 5. Check to see if vlan drivers are installed on the system: ■ If you are using a Solaris SPARC system: ■ If you do not see the previous output, the VLAN Utility software is not installed on your system. You may install the optiona...

Page 68 - Select the packages you want to install:; all

52 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is running Solaris 9 x86 software type the following: A menu similar to the following displays: 7. Select the packages you want to install: ■ Press Return or type all to accept the default and ins...

Page 69 - “Setting Up the Driver in a Linux Platform” on page 53; To Set Up the Driver in a Linux Platform; where the

53 A P P E N D I X D Installing the Sun 10-GigabitEthernet Device Driver on LinuxPlatforms This appendix explains how to install the Sun 10-Gigabit Ethernet PCI-X devicedriver in a Linux environment. This appendix contains the following sections: ■ “Setting Up the Driver in a Linux Platform” on page...

Page 70 - command to register the Sun 10-Gigabit Ethernet module:; driver for all instances:

54 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 2. Build the man pages (optional): 3. Change to the rpm directory: ■ For RedHat, use the following command: ■ For SuSe Linux Enterprise Server, use the following command: 4. Install the 10-Gigabit Ethernet rpms, u...

Page 71 - In the following example, the ixge driver is shown in; command to see which devices the; driver was mapped to:; interfaces to the; alias eth2 ixge

Appendix D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 55 7. Verify that the driver is loaded. In the following example, the ixge driver is shown in bold italic . On your system the driver will be indistinguishable from the other modules. 8. Run the dmesg command to see w...

Page 72 - ethtool; command to check the parameter configurations that apply to

56 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10. Use the ethtool command to check the parameter configurations that apply to the ixge driver. Setting Driver Parameters in a LinuxEnvironment In a Linux operating system, the driver parameters can only be set a...

Page 73 - To Set; or you can use the

Appendix D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 57 ▼ To Set ixge Parameters in a Linux Environment 1. Remove the Sun 10-Gigabit Ethernet PCI-X device driver, if it is already loaded. 2. Load the Sun 10-Gigabit Ethernet PCI-X device driver: or you can use the insmod...

Page 75 - To Configure VLANs in a Linux Environment

Appendix D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 59 ▼ To Configure VLANs in a Linux Environment 1. Ensure that the ixge module is loaded: 2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface: where xxx.xxx.xx.xxx = the IP address of the interface. 3. Insert the vlan...

Page 76 - file by adding these lines:; mode; # ip link set dev bond0 up

60 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Configure Bonding for Multiple ixge Interfaces 1. Modify /etc/modules.conf file by adding these lines: Where: bond0 is the bonding device. max_bonds is the number of bond interfaces to be created. mode specif...