Page 3 - Table of Contents
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 3 Table of Contents Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3List of Tables . . . . . ...
Page 4 - List of Tables
Rev 1.0 Mellanox Technologies 4 List of Tables Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Table 2: Documents List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ....
Page 5 - List of Figures
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 5 List of Figures Figure 1: 0J05YT Label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Figure 2: Board Label . . . . . . ...
Page 6 - Revision History; This document was first printed on February 14, 2012
Rev 1.0 Mellanox Technologies 6 Revision History This document was first printed on February 14, 2012 Table 1 - Revision History Table Date Rev Comments/Changes February 2012 1.0 Initial Release .
Page 7 - About this Manual; This; Intended Audience; The manual assumes basic familiarity with the InfiniBand; Related Documentation; Online Resources; • Mellanox Technologies Web pages:; Document Conventions; to people or damage to the equipment.
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 7 About this Manual This User Manual describes ConnectX®-3 Dual QSFP Port mezzanine card for the Dell Blade Servers. It provides details as to the interfaces of the board, specifications, requir...
Page 9 - Overview; This document is a; Cards Covered in this Manual; Finding the GUID/MAC and Serial Number on the Mezzanine Cards; on the print side of the card.
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 9 1 Overview This document is a User Manual for the Mellanox Technologies ConnectX®-3 40Gb/s and 56Gb/ s InfiniBand dual-port mezzanine cards for the Dell Blade Servers. The cards described in t...
Page 11 - Card Interfaces; Each mezzanine card includes the following interfaces:
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 11 2 Card Interfaces 2.1 I/O Interfaces Each mezzanine card includes the following interfaces: • PCI Express (PCIe) • I 2 C-compatible connector (for debug) Figure 5: 0J05YT/0K6V3V Card 2.1.1 In...
Page 12 - C-compatible Interface; A three-pin header on the mezzanine cards is provided as the I; Power; mation on the system memory.
Card Interfaces Rev 1.0 Mellanox Technologies 12 2.1.2 PCI Express Interface The ConnectX®-3 mezzanine cards support PCI Express 3.0 (1.1 and 2.0 compatible) . The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations. 2.1.3 I 2 C-compati...
Page 13 - Flash device is to be used or not. Table
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 13 A jumper inserted into the drill on each adapter card indicates to the device whether an on-board Flash device is to be used or not. Table 4 provides information on this jumper. Table 4 - Jum...
Page 18 - Card Installation; Hardware RequirementsTBD; Installation Kit
Card Installation Rev 1.0 Mellanox Technologies 18 3 Card Installation 3.1 Hardware RequirementsTBD Before installing the mezzanine card, make sure that the system meets the hardware and software requirements listed in Table 7 - Jumper Configuration Requirement Description Hardware Used with Dell Bl...
Page 19 - DIMMS
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 19 Use the documentation supplied with the Dell Blade Servers to remove and replace the blade from the chassis. The card shown below has grounding clips that must come in contact with the chassi...
Page 20 - Remove the blade from the chassis.
DIMMS can be hot. Allow sufficient time for the blade components to cool before starting this procedure. Card Installation Rev 1.0 Mellanox Technologies 20 1. Remove the blade from the chassis. 2. Remove the cover from the blade. 3. Open the retaining clip. The card can be placed in either of the tw...
Page 21 - Close the retaining clip.
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 21 Figure 10: Remove the Cover Hold the mezzanine card by the edges only. Line up the mezzanine card so that the pins of the mezzanine card are over the sockets in the blade server.5. Plug the c...
Page 22 - Replace the blade server cover.
Card Installation Rev 1.0 Mellanox Technologies 22 Figure 12: Single Card in Slot C Figure 13: Two Cards Installed 7. Replace the blade server cover. 8. Replace the blade server into the chassis
Page 23 - Safety Warnings; Installation Instructions; Installation of Equipment
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 23 3.3 Safety Warnings 1. Installation Instructions Read all installation instructions before connecting the equipment to the power source. 2. Over Temperature This equipment should not be opera...
Page 24 - Driver Software and Firmware; Driver Software; Check the link status
Driver Software and Firmware Rev 1.0 Mellanox Technologies 24 4 Driver Software and Firmware 4.1 Driver Software 4.1.1 Linux For Linux, download and install the latest OpenFabrics Enterprise Distribution (OFED) software package available via the Mellanox web site at: http://www.mellanox.com => Pr...
Page 25 - Check the OFED version
Rate: 56 Base lid: 8 LMC: 0 SM lid: 12 Capability mask: 0x02514868 Port GUID: 0x0002c903002fefe2 Link layer: InfiniBand ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 25 Check the OFED version To get the version of the running Mellanox OFED/...
Page 26 - FlexBoot; Firmware can be updated on the stand alone single card using the; flint; tool of the
Driver Software and Firmware Rev 1.0 Mellanox Technologies 26 Figure 14: Device Manager (example) Note: If the cards are connected to a managed switch, there is no need to run openSM. Only one OpenSM should run per subnet.In InfiniBand interfaces, OpenSM is installed as a disabled Windows service. T...
Page 27 - Retrieve the PSID and firmware version:
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 27 number. Please contact Mellanox System Support if you cannot find the firmware binary for your mezzanine card. The following steps describe how to retrieve the PSID (firmware identification) ...
Page 29 - Appendix A: Specifications; A.1 Board Mechanical Drawing and Dimensions
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 29 Appendix A: Specifications A.1 Board Mechanical Drawing and Dimensions The ConnectX®-3 mezzanine card mechanical drawing is depicted in Figure 16. All dimensions are in millimeters.All the me...
Page 30 - Specifications
Rev 1.0 Mellanox Technologies 30 A.2 Specifications Table 8 - ConnectX-3 0J05YT/0K6V3V Specifications Table Physical Size: 3.11in. x3.46 in. (78.91mm X 88mm) Protocol Support InfiniBand: IBTA v1.2.1 QDR (10Gb/s per lane) or FDR (14.0625Gb/s per lane) port Data Rate: Up to 56Gb/s FDR– InfiniBand PCI ...
Page 31 - Appendix B: Avertissements de sécurité d’installation; Pendant un orage, il ne faut pas utiliser le matériel.
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 31 Appendix B: Avertissements de sécurité d’installation (French) 1. Instructions d’installation Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimenta...
Page 32 - Installationsanleitungen
Rev 1.0 Mellanox Technologies 32 Appendix C: Installation - Sicherheitshinweise (German) 1. Installationsanleitungen Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromvers-orgung anschließen. 2. Übertemperatur Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstempe...
Page 33 - Appendix D: Advertencias de seguridad para la instalación
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Mellanox Technologies 33 Appendix D: Advertencias de seguridad para la instalación (Warnings in Spanish) 1. Instrucciones de instalación Antes de conectar el equipo a la fuente de alimentación, leer todas las instruc...
