Page 3 - Contents; Preface
iii Contents Preface xiii 1. Product Overview 1 Product Description 1 Hardware and Software Requirements 2 Features 3 2. Installing the Adapter 5 Installing the Adapter Without Dynamic Reconfiguration 5 ▼ To Install the Adapter 6 ▼ To Install the Optical Transceiver 7 ▼ To Verify the Hardware Instal...
Page 4 - Configuring VLANs
iv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10-Gigabit Ethernet Driver Parameter Values and Definitions 20 Flow Control Parameters 20 Interrupt Parameters 21 Jumbo Frames 22 ▼ To Configure Jumbo Frames Using ndd 22 ▼ To Configure Jumbo Frames in a Linux Env...
Page 5 - Diagnostic Software; netlbtest; Installing the Software Manually; ixge; Index
Contents v B. Diagnostic Software 45 SunVTS Diagnostic Software 45 Updating SunVTS to Recognize the Adapter 46 ▼ To Update SunVTS to Recognize the Adapter 46 Using the SunVTS netlbtest 47 ▼ To Use the netlbtest 47 C. Installing the Software Manually 49 ▼ To Install the Driver Software Manually 49 D....
Page 7 - Tables
vii Tables TABLE 1-1 Hardware and Software Requirements for Sun SPARC Servers 2 TABLE 3-1 ixge Driver Parameter, Status, and Descriptions 20 TABLE 3-2 Read-Write Flow Control Keyword Descriptions 21 TABLE 3-3 RX Blanking Register for Alias Read 21 TABLE 3-4 accept-jumbo Parameters 22 TABLE 3-5 Read-...
Page 9 - Figures
ix Figures FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed 2 FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels 3 FIGURE 4-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters 38 FIGURE 4-2 Ethernet Tag Header Format 40
Page 11 - Declaration of Conformity; EMC; Supplementary Information:
xi Declaration of Conformity EMC USA—FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:1. This equipment may not cause harmful interference.2. This equipment must accept any interference that may cause undesired operation. Europea...
Page 13 - The; How This Book Is Organized; Appendix C describes how to install the driver software manually.
xiii Preface The Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide provides installation instructions for the Sun 10-Gigabit Ethernet PCI-X adapter. Thisdocument also describes how to configure the driver software. These instructions are designed for enterprise system administrator...
Page 14 - Using UNIX Commands; This document might not contain information on basic UNIX; Shell Prompts
xiv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Using UNIX Commands This document might not contain information on basic UNIX ® commands and procedures such as shutting down the system, booting the system, and configuringdevices. Refer to the following for thi...
Page 15 - Typographic Conventions; su
Preface xv Typographic Conventions Accessing Sun Documentation You can view, print, or purchase a broad selection of Sun documentation, includinglocalized versions, at: http://www.sun.com/documentation Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mention...
Page 16 - Contacting Sun Technical Support
xvi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Contacting Sun Technical Support If you have technical questions about this product that are not answered in thisdocument, go to: http://www.sun.com/service/contacting Sun Welcomes Your Comments Sun is interested...
Page 17 - Product Overview; Product Description; Note –; first
1 C H A P T E R 1 Product Overview This chapter contains an overview of the Sun 10-Gigabit Ethernet PCI-X adapter,including: ■ “Product Description” on page 1 ■ “Hardware and Software Requirements” on page 2 ■ “Features” on page 3 Product Description The Sun 10-Gigabit Ethernet PCI-X adapter is a lo...
Page 18 - Hardware and Software Requirements; lists the supported hardware and software for Sun SPARC; Visit Sun on the World Wide Web at
2 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed Hardware and Software Requirements Before installing the adapter, make sure your system meets the required hardwareand software. T...
Page 19 - Features; kstat
Chapter 1 Product Overview 3 FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels Features The Sun 10-Gigabit Ethernet PCI-X adapter addresses the following requirementsand provides additional features and benefits: ■ One full-duplex 10 gigabit Ethernet interface that uses a small f...
Page 21 - Installing the Adapter; not; Caution –; must
5 C H A P T E R 2 Installing the Adapter This chapter describes how to install the Sun 10-Gigabit Ethernet PCI-X adapter inyour system and verify that it has been installed correctly. The chapter thendescribes how to install the driver software using the automated script. Finally, thischapter descri...
Page 22 - To Install the Adapter; Power off all of the peripherals connected to your system.; Save the filler panel screw for Step 9.; Insert the adapter into the PCI opening.; Green LEDs do not light until the correct driver is installed.
6 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Install the Adapter The following instructions describe the basic tasks required to install the adapter.Refer to your system installation or service manual for detailed PCI adapterinstallation instructions. 1....
Page 23 - To Install the Optical Transceiver; Pull the white locking handle into the full horizontal position.
Chapter 2 Installing the Adapter 7 ▼ To Install the Optical Transceiver The Sun 10-Gigabit Ethernet PCI-Xadapter requires an optical transceiver to createand Ethernet connection. The optical transceiver Part Number: 135-1172-01 isavailable from Sun Microsystems. 1. Pull the white locking handle into...
Page 24 - Push the handle closed to lock the optical transceiver in place.
8 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 4. Push the handle closed to lock the optical transceiver in place. 5. Detach the wrist strap. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver...
Page 25 - To Verify the Hardware Installation; before; sequence to interrupt the boot process and display the OpenBoot (; ok; List the network devices on your system.; network
Chapter 2 Installing the Adapter 9 ▼ To Verify the Hardware Installation After you have installed the Sun 10-Gigabit Ethernet adapter, but before you boot your system, perform the following tasks to verify the installation. Refer to the yourSolaris documentation for the detailed instructions. Note –...
Page 26 - file for a list of device properties.; properties; Type the following when you finish looking at the; Rebooting the System; After verifying the adapter installation, use the
10 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 4. View the .properties file for a list of device properties. The . properties command displays the specific information about the installed adapter. If you are using the Sun 10-Gigabit Ethernet adapter, your outp...
Page 27 - cfgadm; Sun Enterprise Dynamic Reconfiguration User’s Guide; Using the Installation Script; connected to your system.
Chapter 2 Installing the Adapter 11 Installing the Adapter With DynamicReconfiguration If you have a Sun Enterprise™ system that supports dynamic reconfiguration (DR),you do not have to reboot your system after installing the adapter. The process of adding and configuring an adapter with DR involves...
Page 28 - download instructions.; Change to the directory were the installation script resides:; unzipped; You’ll see the following output
12 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is running Sun Enterprise Volume Manager™, it shouldautomatically mount the CD-ROM to the /cdrom/cdrom0 directory. ■ If your system is not running Sun Enterprise Volume Manager, mount the CD-ROM a...
Page 30 - Verifying the Software Installation; Use the; modinfo; command to verify that you have the current driver (v1.30 or; If you type
14 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 5. Reboot the system to load the driver: 6. Verify the installation to ensure that the driver installed and loaded properly. Verifying the Software Installation Unless you have the latest version of the driver sof...
Page 31 - Configuring the Network Host Files; number; command to search the
Chapter 2 Installing the Adapter 15 Configuring the Network Host Files After installing the driver software, you must create a hostname.ixge number file where number = the instance number of the ixge interface.) for the adapter ’s Ethernet interface. You must also create both an IP address and a hos...
Page 33 - Create an appropriate entry in the
Chapter 2 Installing the Adapter 17 3. Create an appropriate entry in the /etc/hosts file for each active ixge interface. For example: # cat /etc/hosts # # Internet host table # 127.0.0.1 localhost 129.144.10.57 zardoz loghost 129.144.11.83 zardoz-11
Page 35 - Configuring Driver Parameters
19 C H A P T E R 3 Configuring Driver Parameters This chapter describes how to configure the driver parameters used by the Sun 10-Gigabit Ethernet PCI-Xadapter. This chapter contains the following sections: ■ “10-Gigabit Ethernet Device Driver Parameters” on page 19 ■ “Setting ixge Driver Parameters...
Page 36 - Flow Control Parameters
20 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10-Gigabit Ethernet Driver Parameter Values andDefinitions TABLE 3-1 describes the parameters and settings for the ixge device driver. Flow Control Parameters The ixge device sources (transmits) and terminates (re...
Page 37 - provides flow control keywords and describes their function.; Interrupt Parameters; describes the receive interrupt blanking values.
Chapter 3 Configuring Driver Parameters 21 TABLE 3-2 provides flow control keywords and describes their function. Interrupt Parameters TABLE 3-3 describes the receive interrupt blanking values. TABLE 3-2 Read-Write Flow Control Keyword Descriptions Keyword Description adv_asmpause_cap The adapter su...
Page 38 - Jumbo Frames; The variable; To Configure Jumbo Frames Using; Unplumb the interface you want to configure Jumbo Frames on.; snoop; or; netstat; processes running over the interface to be configured.; In this example, the instance number set is 0.; Set the instance to accept jumbo frames:; where; % ifconfig ixge0 plumb
22 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Jumbo Frames The variable accept-jumbo enables the driver to instruct the upper layers that the driver is operating in Jumbo-frame mode. Refer to the documentation that came with your switch for exact commands toc...
Page 39 - software is installed.; Setting; Setting Parameters Using the; up
Chapter 3 Configuring Driver Parameters 23 ▼ To Configure Jumbo Frames in a LinuxEnvironment 1. Ensure that the ixge software is installed. 2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface: where xxx.xxx.xx.xxx = the IP address of the interface. Setting ixge Driver Parameters You can set the ixg...
Page 40 - file to identify the instance associated with a; Noninteractive and Interactive Modes; ndd; To Use the
24 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Specify Device Instances for the ndd Utility Before you use the ndd utility to get or set a parameter for a ixge device, you must specify the device instance for the utility. 1. Check the /etc/path_to_inst fi...
Page 41 - To modify a parameter value, use the; To modify a parameter value in interactive mode, specify
Chapter 3 Configuring Driver Parameters 25 ● To modify a parameter value, use the -set option. If you invoke the ndd utility with the -set option, the utility passes value , which must be specified, down to the named /dev/ixge driver instance, and assigns the value to the parameter: When you change ...
Page 42 - To list all the parameters supported by the; off; To access any man page, type the; man; command plus the name of the man page.
26 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ● To list all the parameters supported by the ixge driver, type ? . See TABLE 3-1 through TABLE 3-6 for parameter descriptions. Note – By default, autonegotiation is set to off . This adapter operates only at full...
Page 43 - To Set Driver Parameters Using a; Obtain the hardware path names for the; devices in the device tree.; b. Locate the path names and the associated instance numbers in the
Chapter 3 Configuring Driver Parameters 27 ▼ To Set Driver Parameters Using a ixge.conf File 1. Obtain the hardware path names for the ixge devices in the device tree. a. Check the /etc/driver_aliases file to identify the name associated with a particular device: Note – ixge "pci8086,1048.108e.7...
Page 44 - pci; Set the parameters for the above devices in the; parent
28 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 In this example: ■ The first part within the double quotes specifies the hardware node name inthe device tree. ■ The number not enclosed in quotes is the instance number (shown in bolditalics). ■ The last part in ...
Page 45 - These statistics are part of the statistics presented by the k
Chapter 3 Configuring Driver Parameters 29 10-Gigabit Ethernet Driver OperatingStatistics These statistics are part of the statistics presented by the k stat command. TABLE 3-5 describes the read-only Media Independent Interface (MII) capabilities. These parameters define the capabilities of the har...
Page 46 - describes the
30 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 Table describes the read-only ixge device capabilities. TABLE 3-6 describes the kstat ixge:1 receive and transmit parameters: cap_10hdx Local interface half-duplex capability0 = Not 10 Mbit/sec half-duplex capable...
Page 48 - To Check Link Partner Settings; Type the
32 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Check Link Partner Settings Type the kstat command as superuser: xcvr_id GMII/MII physical layer device Identification Decimal copy ofMII registers 2 and 3. xcvr_inits Number of physical layer re-initializati...
Page 50 - To Discover Device Capabilities; command to discover device capabilities.
34 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Discover Device Capabilities ● Use the kstat command to discover device capabilities. rx_taskq_waits 0 snaptime 7883.09014984 trunk_mode 0 tx_allocb_fail 0 tx_ddi_pkts 0 tx_dma_bind_fail 0 tx_dvma_pkts 0 tx_h...
Page 51 - To Discover Link Settings; command to discover link settings.; Configuration Checking; Layer 2 Configuration Checking; Layer 3 Configuration Checking; ifconfig
Chapter 3 Configuring Driver Parameters 35 ▼ To Discover Link Settings ● Use the kstat command to discover link settings. Configuration Checking The jumbo frame configuration checking occurs at Layer 2 or Layer 3, depending onthe configuration method. Layer 2 Configuration Checking You can view the ...
Page 53 - “Overview of VLANs” on page 37; Overview of VLANs
37 C H A P T E R 4 Configuring VLANs This chapter explains Virtual Local Area Networks (VLANs) in detail and providesconfiguration instructions and examples. It contains the following sections: ■ “Overview of VLANs” on page 37 ■ “Configuring VLANs” on page 39 With multiple VLANs on an adapter, a ser...
Page 56 - shows the Ethernet Tag Header format.; received by that adapter must be in VLAN-tagged format.; To Configure Static VLANs; file for each VLAN that will be configured for; Device PPA
40 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 subnets when setting up a VLAN network interface. This means that each VIDassigned to a VLAN interface of a physical network interface will belong to differentsubnets. Tagging an Ethernet frame requires the additi...
Page 57 - to configure a VLAN virtual device, for example:; The output of; you’ve set up on the server.; # ifconfig ixge4000 plumb up
Chapter 4 Configuring VLANs 41 2. Use the ifconfig(1M) to configure a VLAN virtual device, for example: The output of ifconfig -a on a system having VLAN devices ixge123000 and ixge224000 : 3. On the switch, set VLAN tagging and set VLAN ports to coincide with the VLANs you’ve set up on the server. ...
Page 59 - Specifications; “Performance Specifications” on page 43
43 A P P E N D I X A Specifications This appendix provides specifications for the Sun 10-Gigabit Ethernet PCI-X adapter. ■ “Performance Specifications” on page 43 ■ “Physical Characteristics” on page 44 ■ “Power Requirements” on page 44 Performance Specifications TABLE A-1 Performance Specifications...
Page 61 - SunVTS Diagnostic Software; nettest
45 A P P E N D I X B Diagnostic Software This appendix provides an overview of the SunVTS diagnostic application andinstructions for updating the SunVTS software to recognize the adapter. Thisappendix contains the following sections: ■ “SunVTS Diagnostic Software” on page 45 ■ “Updating SunVTS to Re...
Page 62 - Select the document for the Solaris release on your system.; To Update SunVTS to Recognize the Adapter; Ensure that the SunVTS software and the; driver are installed on your
46 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 http://www.sun.com/products-n-solutions/hardware/docs/Software /system_administration/tools/testing_valid/sunvts/index.html Select the document for the Solaris release on your system. Updating SunVTS to Recognize ...
Page 63 - Using the SunVTS; command to bring the Ethernet device down before running; Ensure that the SunVTS software and the; Where; is the instance number of the interface.; down; unplumb
Appendix B Diagnostic Software 47 Using the SunVTS netlbtest You must have the Ethernet card and the device driver installed, a loopbackconnector in place, and Intervention mode enabled before running netlbtest . netlbtest cannot run if the network interface is connected to a live network, and requi...
Page 65 - To Install the Driver Software Manually
49 A P P E N D I X C Installing the Software Manually This appendix describes how to install the driver software manually. The Sun 10-Gigabit Ethernet Adapter CD contains the driver software required to operate the adapter. When you update your Solaris operating system, refer to thedocumentation tha...
Page 66 - If you intend to use VLAN, you must install VLAN packages when you
50 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is not running Volume Manager, mount the CD-ROM as follows: You will see the following files and directories in the /cdrom/sun_10-gigabit_ethernet_driver directory or the /cdrom/cdrom0 directory, ...
Page 67 - vlan; drivers are installed on the system:; replacing the; ARCH
Appendix C Installing the Software Manually 51 4. Install the patch: 5. Check to see if vlan drivers are installed on the system: ■ If you are using a Solaris SPARC system: ■ If you do not see the previous output, the VLAN Utility software is not installed on your system. You may install the optiona...
Page 68 - Select the packages you want to install:; all
52 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ■ If your system is running Solaris 9 x86 software type the following: A menu similar to the following displays: 7. Select the packages you want to install: ■ Press Return or type all to accept the default and ins...
Page 69 - “Setting Up the Driver in a Linux Platform” on page 53; To Set Up the Driver in a Linux Platform; where the
53 A P P E N D I X D Installing the Sun 10-GigabitEthernet Device Driver on LinuxPlatforms This appendix explains how to install the Sun 10-Gigabit Ethernet PCI-X devicedriver in a Linux environment. This appendix contains the following sections: ■ “Setting Up the Driver in a Linux Platform” on page...
Page 70 - command to register the Sun 10-Gigabit Ethernet module:; driver for all instances:
54 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 2. Build the man pages (optional): 3. Change to the rpm directory: ■ For RedHat, use the following command: ■ For SuSe Linux Enterprise Server, use the following command: 4. Install the 10-Gigabit Ethernet rpms, u...
Page 71 - In the following example, the ixge driver is shown in; command to see which devices the; driver was mapped to:; interfaces to the; alias eth2 ixge
Appendix D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 55 7. Verify that the driver is loaded. In the following example, the ixge driver is shown in bold italic . On your system the driver will be indistinguishable from the other modules. 8. Run the dmesg command to see w...
Page 72 - ethtool; command to check the parameter configurations that apply to
56 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 10. Use the ethtool command to check the parameter configurations that apply to the ixge driver. Setting Driver Parameters in a LinuxEnvironment In a Linux operating system, the driver parameters can only be set a...
Page 73 - To Set; or you can use the
Appendix D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 57 ▼ To Set ixge Parameters in a Linux Environment 1. Remove the Sun 10-Gigabit Ethernet PCI-X device driver, if it is already loaded. 2. Load the Sun 10-Gigabit Ethernet PCI-X device driver: or you can use the insmod...
Page 75 - To Configure VLANs in a Linux Environment
Appendix D Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 59 ▼ To Configure VLANs in a Linux Environment 1. Ensure that the ixge module is loaded: 2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface: where xxx.xxx.xx.xxx = the IP address of the interface. 3. Insert the vlan...
Page 76 - file by adding these lines:; mode; # ip link set dev bond0 up
60 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005 ▼ To Configure Bonding for Multiple ixge Interfaces 1. Modify /etc/modules.conf file by adding these lines: Where: bond0 is the bonding device. max_bonds is the number of bond interfaces to be created. mode specif...
