Mellanox Technologies MCX313A-BCCT User manual

www.mellanox.com

ConnectX®-3 Pro Ethernet Single and Dual

QSFP+ Port Adapter Card User Manual

P/N:

MCX313A-BCCT, MCX314A-BCCT

Rev 1.7

Document Number: MLNX-15-845

Rev 1.4

Mellanox Technologies

350 Oakmead Parkway Suite 100

Sunnyvale, CA 94085

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox®, Mellanox logo, Accelio®, BridgeX®, CloudX logo, CompustorX®, Connect-IB®, ConnectX®,

CoolBox®, CORE-Direct®, EZchip®, EZchip logo, EZappliance®, EZdesign®, EZdriver®, EZsystem®,

GPUDirect®, InfiniHost®, InfiniBridge®, InfiniScale®, Kotura®, Kotura logo, Mellanox CloudRack®, Mellanox

CloudXMellanox®, Mellanox Federal Systems®, Mellanox HostDirect®, Mellanox Multi-Host®, Mellanox Open

Ethernet®, Mellanox OpenCloud®, Mellanox OpenCloud Logo®, Mellanox PeerDirect®, Mellanox ScalableHPC®,

Mellanox StorageX®, Mellanox TuneX®, Mellanox Connect Accelerate Outperform logo, Mellanox Virtual Modular

Switch®, MetroDX®, MetroX®, MLNX-OS®, NP-1c®, NP-2®, NP-3®, NPS®, Open Ethernet logo, PhyX®,

PlatformX®, PSIPHY® , SiPhy®, StoreX®, SwitchX®, Tilera®, Tilera logo, TestX®, TuneX®, The Generation of

Open Ethernet logo, UFM®, Unbreakable Link®, Virtual Protocol Interconnect®, Voltaire® and Voltaire logo are

registered trademarks of Mellanox Technologies, Ltd.

All other trademarks are property of their respective owners.

For the most updated list of Mellanox trademarks, visit http://www.mellanox.com/page/trademarks

NOTE :

THIS HARDWARE , SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT (S) ) AND ITS RELATED

DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS-ISﺴ WITH ALL FAULTS OF ANY

KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT

USE THE PRODUCTS IN DESIGNATED SOLUTIONS . THE CUSTOMER 'S MANUFACTURING TEST

ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY

QUALIFY THE PRODUCT (S) AND/OR THE SYSTEM USING IT . THEREFORE , MELLANOX TECHNOLOGIES

CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE

HIGHEST QUALITY . ANY EXPRESS OR IMPLIED WARRANTIES , INCLUDING, BUT NOT LIMITED TO , THE

IMPLIED WARRANTIES OF MERCHANTABILITY , FITNESS FOR A PARTICULAR PURPOSE AND

NONINFRINGEMENT ARE DISCLAIMED . IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR

ANY THIRD PARTIES FOR ANY DIRECT , INDIRECT , SPECIAL, EXEMPLARY , OR CONSEQUENTIAL

DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO , PAYMENT FOR PROCUREMENT OF

SUBSTITUTE GOODS OR SERVICES ; LOSS OF USE , DATA, OR PROFITS ; OR BUSINESS INTERRUPTION )

HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY , WHETHER IN CONTRACT , STRICT LIABILITY ,

OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE ) ARISING IN ANY WAY FROM THE USE OF THE

PRODUCT (S) AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH

DAMAGE .

ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7

Mellanox Technologies 3

Table of Contents

Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

List of Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Related Documentation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Document Conventions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Firmware and Software Updates. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Chapter 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

1.1 Product Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10

1.2 Features and Benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11

1.3 Operating Systems/Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12

1.4 Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12

Chapter 2 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

2.1 Ethernet Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13

2.2 PCI Express Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13

2.3 I2C-compatible Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14

2.4 LED Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14

Chapter 3 Hardware Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1 System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15

3.1.1 Hardware. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1.2 Operating Systems/Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1.3 Software Stacks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.2 Safety Precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15

3.3 Pre-installation Checklist . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15

3.4 Bracket Installation Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15

3.4.1 Removing the Existing Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.4.2 Installing the New Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.5 Card Installation Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17

3.6 Cables and Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18

3.6.1 Cable Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.7 Identify the Card in Your System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19

3.7.1 On Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

3.7.2 On Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Chapter 4 Driver Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1 Linux Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21

4.1.1 Hardware and Software Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1.2 Installing the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1.3 Loading the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7

Mellanox Technologies 4

4.1.4 Unloading the Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

4.1.5 Uninstalling the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

4.2 Windows Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23

4.2.1 Downloading MLNX_WinOF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

4.2.2 Extracting Files Without Running Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

4.2.3 Installing MLNX_WinOF. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

4.2.3.1 Attended Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

4.2.3.2 Unattended Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

4.2.4 Upgrading MLNX_WinOF. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

4.2.5 Installation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

4.2.6 OpenSM Activation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

4.2.7 Uninstalling MLNX_WinOF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.2.7.1 Attended Uninstall. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.2.7.2 Unattended Uninstall. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.2.8 Assigning Port IP After Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.2.9 Port Type Management on Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

4.3 Performance Tuning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38

4.4 VMware Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38

4.4.1 Installing and Running the VBI Driver on ESXi-5.x . . . . . . . . . . . . . . . . . . . . . . 38

4.4.2 Installing and Running the offline_bundle Driver on ESXi-5.x . . . . . . . . . . . . . . 39

4.4.3 Removing the VIB/offline_bundle Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39

4.5 FlexBoot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40

Chapter 5 Updating Adapter Card Firmware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

Chapter 6 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43

6.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43

6.2 Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44

6.3 Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45

Chapter 7 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

7.1 MCX313A-BCCT Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46

7.2 MCX314A-BCCT Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47

7.3 Adapter Led Operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48

7.4 Board Mechanical Drawing and Dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . .48

7.5 Bracket Mechanical Drawing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50

7.6 Regulatory Statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51

Appendix A Interface Connectors Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

A.1 QSFP+ Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

A.2 PCI Express x8 Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54

A.3 I2C-compatible Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

Appendix B Finding the MAC and Serial Number on the Adapter Card . . . . . . . . . . 56

B.1 Retrieving Adapter Card GUID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Appendix C Safety Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Appendix D Avertissements de sécurité d’installation (Warnings in French) . . . . . . 60

Appendix E Sicherheitshinweise (Warnings in German) . . . . . . . . . . . . . . . . . . . . . . . 62

Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) . 64

ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7

Mellanox Technologies 5

List of Tables

Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

Table 2: Documents List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Table 3: Single and Dual-port 40/56 Gigabit Ethernet Adapter Cards . . . . . . . . . . . . . . . . . . . . . 10

Table 4: Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

Table 5: Software and Hardware Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Table 6: Software and Hardware Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Table 7: MCX313A-BCCT Specifications Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Table 8: MCX314A-BCCT Specifications Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Table 9: Physical and Logical Link Indication (Ethernet Mode) . . . . . . . . . . . . . . . . . . . . . . . . . 48

ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7

Mellanox Technologies 6

List of Figures

Figure 1: MCX314A-BCCT Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13

Figure 2: Bracket Screws . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16

Figure 3: EMI Fingers (Example) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16

Figure 4: Placing the Bracket on the Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17

Figure 5: PCI Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19

Figure 6: Support Download Assistant . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42

Figure 7: Mechanical Drawing of the Single-port MCX313A-BCCT Adapter Card . . . . . . . . . . .48

Figure 8: Mechanical Drawing of the Dual-port MCX314A-BCCT Adapter Card . . . . . . . . . . . .49

Figure 9: Dual-port Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50

Figure 10: Single-port Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51

Figure 11: Connector and Cage Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52

Figure 12: PCIe Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54

Figure 13: Compatible Connector Plug and Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55

Figure 14: Card Product Label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56

ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7

Mellanox Technologies 7

Revision History

This document was printed on May 15, 2017.

Table 1 - Revision History Table

Date Rev Comments/Changes

May 2017 1.7 • Updated Card Product Label on page 56.

August 2016 1.6 • Added Figure 7,“Mechanical Drawing of the Single-port MCX313A-BCCT

Adapter Card”.

• Updated Section 3.4.2, “Installing the New Bracket,” on page 16.

December 2015 1.5 • Updated non-operational temperature in the following specifications tables:

•Section 7.1, “MCX313A-BCCT Specifications,” on page 46

•Section 7.2, “MCX314A-BCCT Specifications,” on page 47

October 2015 1.4 • Updated Device ID. See Product Overview on page 10.

August 2016 1.4 • Updated Section 3.4.2, “Installing the New Bracket,” on page 16.

• Updated Figure 10, “Mechanical Drawing of the Dual-port MCX312B-XCCT

Adapter Card,” on page 50.

• Added Figure 12, “Mechanical Drawing of the Single-port MCX311A-XCCT

Adapter Card,” on page 51.

• Added Figure 11, “Mechanical Drawing of the Dual-port MCX312C-XCCT

Adapter Card,” on page 51.

May 2014 1.3 • Added note on bracket replacement. See Section 3.4, “Bracket Installation Instruc-

tions,” on page 15.

April 2014 1.2 • Added Section 4.3, “Performance Tuning,” on page 38

• Added Performance Tuning Guidelines to “Related Documentation” on page 8

December 2013 1.1 • Added the following note to Chapter 5,“Updating Adapter Card Firmware” on

page 41

- Note: The shown versions and/or parameter values in the example below may not

reflect the latest or actual values for this product, and are included here for illustra-

tion purposes only.

• Specified max power available through QSFP+ ports in all specification tables. See

Chapter 7,“Specifications” on page 46.

• Updated link to approved cables list in all specification tables. See Chapter 7,“Spec-

ifications” on page 46.

• Added “GUID of ConnectX-3 Ethernet adapter cards” to Section 6.1, “General,” on

page 43

• Added Appendix B.1, “Retrieving Adapter Card GUID,” on page 56

June 2013 1.0 First Release

ConnectX®-3 Pro Ethernet Dual SFP+ Port Adapter Card User ManualRev 1.7

Mellanox Technologies 8

About this Manual

This User Manual describes Mellanox Technologies ConnectX®-3 Pro 40/56 Gigabit Ethernet

Single and Dual QSFP+ port PCI Express x8 adapter cards. It provides details as to the interfaces

of the board, specifications, required software and firmware for operating the board, and relevant

documentation.

Intended Audience

This manual is intended for the installer and user of these cards.

The manual assumes basic familiarity with Ethernet network and architecture specifications.

Related Documentation

Table 2 - Documents List

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in mega

Bytes. The use of Mb or Mbits (small b) indicates size in mega bits. In this document PCIe is

used to mean PCI Express.

Mellanox Firmware Tools (MFT) User

Manual

Document no. 2204UG

User Manual describing the set of MFT firmware management

tools for a single node.

See http://www.mellanox.com => Products => Software => Firm-

ware Tools

MLNX_EN for Linux README Driver Kit

for Mellanox Adapter Cards with 10/

40GigE Support

Document no. 2950

User Manual providing information on the MLNX_EN Linux

driver and instructions for installing the driver on Mellanox Con-

nectX-3 adapter cards supporting 10/40GigE. See http://www.mel-

lanox.com => Products => Software => Ethernet Drivers =>

Linux Driver

WinOF VPI for Windows

User Manual

Document no.3280

User Manual describing WinOF features, performance, InfiniBand

diagnostic, tools content and configuration. See http://www.mella-

nox.com => Products => Software => Windows SW/Drivers

Mellanox MLX4_EN Driver for VMware

README

Document no. 3527

User Manual describing MLX4_EN driver for VMware features,

performance, diagnostic, tools content and configuration. See

http://www.mellanox.com => Products => Software => Ethernet

Drivers => VMware Drivers

Performance Tuning Guidelines

for Mellanox Network Adapters

Document no. 3368

Manual describes important tuning parameters and settings that

can improve performance for Mellanox drivers.

IEEE Std 802.3 Specification This is the IEEE Ethernet specification

http://standards.ieee.org/getieee802

PCI Express 3.0 Specifications Industry Standard PCI Express 3.0 Base and Card Electromechan-

ical Specifications

ConnectX®-3 Pro Ethernet Dual SFP+ Port Adapter Card User ManualRev 1.7

Mellanox Technologies 9

Technical Support

Customers who purchased Mellanox products directly from Mellanox are invited to contact us

through the following methods.

•URL: http://www.mellanox.com => Support

• E-mail: [email protected]om

• Tel: +1.408.916.0055

Customers who purchased Mellanox M-1 Global Support Services, please see your contract for

details regarding Technical Support.

Customers who purchased Mellanox products through a Mellanox approved reseller should first

seek assistance through their reseller.

Firmware and Software Updates

The Mellanox support downloader contains software, firmware and knowledge database infor-

mation for Mellanox products. Access the database from the Mellanox Support web page,

http://www.mellanox.com => Support

or use the following link to go directly to the Mellanox Support Download Assistant page,

http://www.mellanox.com/supportdownloader/.

ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7

Mellanox Technologies 10

1 Introduction

This is the User Guide for Mellanox Technologies Ethernet adapter cards based on the Con-

nectX®-3 Pro EN integrated circuit device. These adapters connectivity provide the highest per-

forming and most flexible interconnect solution for PCI Express Gen3 servers used in Enterprise

Data Centers, High-Performance Computing, and Embedded environments.

This chapter covers the following topics:

•Section 1.1, “Product Overview,” on page 10

•Section 1.2, “Features and Benefits,” on page 11

•Section 1.3, “Operating Systems/Distributions,” on page 12

•Section 1.4, “Connectivity,” on page 12

1.1 Product Overview

The following section provides the ordering part number, port speed, number of ports, and PCI

Express speed. Each adapter comes with two bracket heights - short and tall.

Table 3 - Single and Dual-port 40/56 Gigabit Ethernet Adapter Cards

Ordering Part Number (OPN) MCX313A-BCCT - single-port card

MCX314A-BCCT - dual-port card

Data Transmission Rate 40/56 GbE

Number of ports MCX314A-BCCT - dual-port QSFP+

MCX313A-BCCT - single-port QSFP+

PCI Express SERDES Speed PCIe 3.0 x8 8GT/s

RoHS R6

Adapter IC Part Number MT27528A0-FCCR-FV

Device ID (decimal) 4103 for Physical Function

4100 for Virtual Function

This manual suits for next models

Table of contents

Other Mellanox Technologies Computer Hardware manuals

Mellanox Technologies

Mellanox Technologies ConnectX-5 Ex User manual

Mellanox Technologies

Mellanox Technologies MCX313A-BCBT? MCX314A-BCBT User manual

Mellanox Technologies

Mellanox Technologies MCX453A-FCAT User manual

Mellanox Technologies

Mellanox Technologies MTS3610Q-6UNC User manual

Mellanox Technologies

Mellanox Technologies ConnectX-5 Ex User manual

Mellanox Technologies

Mellanox Technologies ConnectX-5 Ex User manual

Mellanox Technologies

Mellanox Technologies 0068F2 User manual

Mellanox Technologies

Mellanox Technologies SX1710 User manual

Mellanox Technologies

Mellanox Technologies MCX312B-XCCS User manual

Mellanox Technologies

Mellanox Technologies MCX454A-FCAT User manual

Mellanox Technologies

Mellanox Technologies MCX4131A-BCAT User manual

Mellanox Technologies

Mellanox Technologies Innova IPsec 4 Lx User manual

Mellanox Technologies

Mellanox Technologies MCX313A-BCBT? MCX314A-BCBT User manual

Mellanox Technologies

Mellanox Technologies 0NHYP5 User manual

Mellanox Technologies

Mellanox Technologies ConnectX-6 User manual

Mellanox Technologies

Mellanox Technologies ConnectX-3 MCX312A-XCBT User manual

Mellanox Technologies

Mellanox Technologies BridgeX BX4010 User manual

Mellanox Technologies

Mellanox Technologies MCX353A-FCCT User manual

Mellanox Technologies

Mellanox Technologies MCX456M-ECAT User manual

Mellanox Technologies

Mellanox Technologies 90Y3572 User manual

Mellanox Technologies

Mellanox Technologies MCX453A-FCAT User manual

Mellanox Technologies

Mellanox Technologies Mellanox ConnectX MCX556M-ECAT-S25 User manual

Mellanox Technologies

Mellanox Technologies MCX4111A-XCAT User manual

Mellanox Technologies

Mellanox Technologies ConnectX 3 Pro User manual

Popular Computer Hardware manuals by other brands

EMC2

EMC2 VNX Series Hardware Information Guide

Panasonic

Panasonic DV0PM20105 Operation manual

Mitsubishi Electric

Mitsubishi Electric Q81BD-J61BT11 user manual

Gigabyte

Gigabyte B660M DS3H AX DDR4 user manual

Raidon

Raidon iT2300 Quick installation guide

National Instruments

National Instruments PXI-8186 user manual

Hauppauge

Hauppauge WinTV-HVR-2250 Quick installation guide

Kontron

Kontron CP6002 user guide

Manhattan

Manhattan 702843 user manual

Aphex

Aphex 230 instruction manual

AMD

AMD Phenom II Product data sheet

Intel

Intel NUC 12 Pro user guide

dbx

dbx Zone Pro 1260 user manual

Galaxy

Galaxy GHDX2-2430S-24F4D Installation and hardware reference manual

Intel

Intel AXXRMFBU4 Quick installation user's guide

Kontron

Kontron DIMM-PC/MD product manual

ST X-NUCLEO-SAFEA1B How to use

STEINWAY LYNGDORF

STEINWAY LYNGDORF SP-1 installation manual