Dell Mellanox Family of Adapters- User Manual

Dell Mellanox Family of Adapters

Dell Mellanox Family of Adapters– User Manual, read for free online in PDF format. We hope this helps you resolve any issues you may have. If you have further questions, please contact us through the contact form.

1 Page 1
2 Page 2
3 Page 3
4 Page 4
5 Page 5
6 Page 6
7 Page 7
8 Page 8
9 Page 9
10 Page 10
11 Page 11
12 Page 12
13 Page 13
14 Page 14
15 Page 15
16 Page 16
17 Page 17
18 Page 18
19 Page 19
20 Page 20
21 Page 21
22 Page 22
23 Page 23
24 Page 24
25 Page 25
26 Page 26
27 Page 27
28 Page 28
29 Page 29
30 Page 30
31 Page 31
32 Page 32
33 Page 33
34 Page 34
35 Page 35
36 Page 36
37 Page 37
38 Page 38
39 Page 39
40 Page 40
41 Page 41
42 Page 42
43 Page 43
44 Page 44
45 Page 45
46 Page 46
47 Page 47
48 Page 48
49 Page 49
50 Page 50
51 Page 51
52 Page 52
53 Page 53
54 Page 54
55 Page 55
56 Page 56
57 Page 57
58 Page 58
59 Page 59
60 Page 60
61 Page 61
62 Page 62
63 Page 63
64 Page 64
65 Page 65
66 Page 66
67 Page 67
68 Page 68
69 Page 69
70 Page 70
71 Page 71
72 Page 72
73 Page 73
74 Page 74
75 Page 75
76 Page 76
77 Page 77
78 Page 78
79 Page 79
80 Page 80
81 Page 81
82 Page 82
83 Page 83
84 Page 84
85 Page 85
86 Page 86
87 Page 87
88 Page 88
89 Page 89
90 Page 90
91 Page 91
92 Page 92
93 Page 93
94 Page 94
95 Page 95
96 Page 96
97 Page 97
98 Page 98
99 Page 99
100 Page 100
101 Page 101
102 Page 102
103 Page 103
104 Page 104
105 Page 105
106 Page 106
107 Page 107
108 Page 108
109 Page 109
110 Page 110
111 Page 111
112 Page 112
113 Page 113
114 Page 114
115 Page 115
Page: / 115

Table of Contents:

  • Page 3 – Restrictions and Disclaimers
  • Page 4 – Table of Contents
  • Page 8 – List of Tables
  • Page 9 – List of Figures
  • Page 10 – Revision History; This document was printed on August 12, 2014.
  • Page 11 – About this Manual; This; Intended Audience; This manual is intended for the installer and user of these cards.; Related Documentation; Document Conventions; This document uses the following conventions:; Technical Support
  • Page 12 – Introduction; Functional Description
  • Page 14 – Supported Operating Systems/Distributions; OpenFabrics Enterprise Distribution (OFED)
  • Page 15 – Adapter Card Interfaces; Each adapter card includes the following interfaces:; LED Assignment; Table 3; Function
  • Page 16 – Port 1 Activity
  • Page 17 – Port 2 Link
  • Page 18 – Installing the Hardware; System Requirements; Hardware; Please refer to; Software Stacks; Safety Precautions; Remove any metallic objects from your hands and wrists.
  • Page 19 – Pre-installation Checklist; After shutting down the system, turn off power and unplug the cord.; Installation Instructions; For Adapters; The adapter can be placed in an available slot.; For Mezzanine Cards; The card can be placed in an available slot.
  • Page 20 – Secure the blade mezzanine card with the mezzanine card latch.; Connecting the Network Cables; Inserting a Cable into the Adapter Card; cable holder or tying the cable to the rack.; Removing a Cable from the Adapter Card; Identifying the Card in A System; On Linux
  • Page 21 – Driver Installation and Configuration; Linux Driver; Installation Requirements; Required Disk Space for Installation; Downloading Mellanox OFED
  • Page 22 – Installation Script; Table 5; mst
  • Page 23 – Installation Procedure; Login to the installation machine as root.
  • Page 24 – Installation Results; Software
  • Page 25 – Post-installation Notes; Linux Driver Features; iSER Initiator
  • Page 26 – Plain Ethernet
  • Page 28 – “Strict Priority”; Strict Priority
  • Page 30 – Get Current Configuration:
  • Page 31 – to UP mapping, using the; In kernels that do not support; to UP
  • Page 32 – Additional Tools; tc tool compiled with the; interface is available.; Ethernet Time-Stamping; Time-stamping is off by default and should be enabled before use.
  • Page 34 – To enable time stamping for a net device:
  • Page 35 – Receive side time sampling:
  • Page 36 – To display Time Stamping capabilities via ethtool:; RoCE Time Stamping
  • Page 37 – Polling a CQ for time stamp is done via the
  • Page 38 – Flow Steering; To enable Flow Steering:
  • Page 39 – User Verbs
  • Page 40 – Ethtool
  • Page 41 – All of the rest
  • Page 42 – PFs not included in the above list will not have SR-
  • Page 43 – The protocol types are:; PFs not included in the above list will not activate any
  • Page 44 – To enable SR-IOV and Para Virtualization on the same setup:; Assigning the SR-IOV Virtual Function to the Red Hat KVM VM Server; Double click on the virtual machine and open its Properties.
  • Page 45 – If the Virtual Machine is up reboot it, otherwise start it.; Please be aware
  • Page 49 – Options
  • Page 50 – Ethernet Performance Counters
  • Page 51 – Counter
  • Page 55 – VMware Driver; Installing and Running the Driver; » To verify that the driver is loaded, run:
  • Page 56 – » To query network uplinks installed on your machine, run:
  • Page 57 – You can install the driver in one of the following ways:; Windows
  • Page 58 – Microsoft Windows Server operating system; Downloading Mellanox WinOF; Verify that the machine architecture.; Installing Mellanox WinOF
  • Page 59 – From a CMD console, execute the Dell Update Package silently.; Uninstalling Mellanox WinOF; affect Ethernet performance.; WinOF Features; To install the Data Center Bridging using the Server Manager:
  • Page 60 – To configure QoS on the host:
  • Page 61 – To add the script to the local machine startup scripts:; RDMA over Converged Ethernet; Prerequisites
  • Page 62 – If VLANs are used, Mark the egress traffic with the relevant VlanID.
  • Page 63 – Copying Port Control Protocol (PCP) between Subnets
  • Page 64 – To verify the SMB connection on the SMB client:
  • Page 65 – Remote Boot; iSCSI Boot; To configure the iSCSI target:
  • Page 66 – Start the iSCSI target service.; Specialized Storage Devices; Click on the; + Add Advanced Target
  • Page 67 – In the Advanced Storage Options window perform the following:; Bind targets to network interfaces; Enter the IP address of iSCSI target.
  • Page 68 – Login; Make sure a new storage LUN appears in the; Other AN Devices; Next; Select; Fresh Installation; and proceed with the Installation
  • Page 70 – . Allow the installation to reach completion.; Booting Windows from an iSCSI Target; Configuring the WDS Server; To configure the WDS server:
  • Page 71 – Add the Mellanox driver to install.wim; Configuring iSCSI Target; To configure iSCSI Target:; Configuring the DHCP Server; To configure the DHCP server:; Option
  • Page 72 – firm that the Option ROM setting is set to Enabled.
  • Page 73 – Choose the Operating System to install.
  • Page 74 – Create the IQN in the ietd configuration file.
  • Page 76 – Reboot the client and invoke PXE boot with the Mellanox boot agent.
  • Page 77 – Configure iSCSI Disks; Choose; Connected Targets
  • Page 78 – Add; Enter the IP address of the iSCSI storage target.
  • Page 79 – Connect; onboot; to exit the discovery screen.
  • Page 81 – Physical Machine
  • Page 82 – Complete post installation configuration steps.; PXE Boot; The following are examples of PXE server configuration:; Discover and connect to a remote iSCSI storage.
  • Page 83 – The following is known to work with Mellanox NIC:
  • Page 84 – Firmware
  • Page 85 – Dell Lifecycle Controller; Troubleshooting; General
  • Page 86 – Linux
  • Page 88 – Specifications; Physical; Protocol Support; Power and; Regulatory
  • Page 91 – Regulatory Statements; This device may not cause harmful interference, and
  • Page 92 – Warning
  • Page 94 – Appendix A: Configuration for Mellanox Adapters through
  • Page 95 – Shows general info regarding the adapter.
  • Page 97 – Main Configuration Page - Firmware Image Properties; The below provides Firmware the uEFI versions numbers.; Main Configuration Page - NIC Configuration; Allows configuration of Virtual LAN Mode and Virtual LAN ID.
  • Page 100 – Main Configuration Page - iSCSI Configuration
  • Page 103 – Main Configuration Page - Device Level Configuration
  • Page 104 – SR-IOV Configuration
  • Page 105 – Enable
  • Page 107 – . Reboot the server for the SR-IOV configuration to take effect.
  • Page 108 – Appendix B: Safety Warnings; Installation Instructions
  • Page 110 – Appendix C: Avertissements de sécurité d’installation
  • Page 112 – Installationsanleitungen
  • Page 114 – Appendix E: Advertencias de seguridad para la insta-
Loading the manual

www.mellanox.com

User Manual for Mellanox ConnectX

®

-3 10/40

Gigabit Ethernet Adapters for Dell PowerEdge

Servers

Rev 1.1

"Loading the manual" means you need to wait until the file loads and becomes available for online reading. Some manuals are very large, and the time they take to appear depends on your internet speed.

Summary

Page 3 - Restrictions and Disclaimers

User Manual for Mellanox ConnectX®-3 10/40 Gigabit Ethernet Adapters for Dell PowerEdge Servers Rev 1.1 Mellanox Technologies 3 Restrictions and Disclaimers The information contained in this document, including all instructions, cautions, and regulatory approvals and certifications, is provided by t...

Page 4 - Table of Contents

Rev 1.1 Mellanox Technologies 4 Table of Contents Restrictions and Disclaimers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Export Regulations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Table of Contents ...

Page 8 - List of Tables

Rev 1.1 Mellanox Technologies 8 List of Tables Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Table 2: Documents List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ...

Other Dell Models