Mellanox Technologies MSX6036F-1SFR Manuel d'utilisateur

www.mellanox.comSwitchX 36-Port QSFP FDR InfiniBand System Hardware User ManualP/N: MSX6025T-1SFR, MSX6025T-1BRR, MSX6025F-1SFR, MSX6025F-1BRR, MSX60

Rev 2.0Mellanox Technologies10AbbreviationsFDR — Fourteen Data RateThis icon indicates information that is helpful to the user.This icon indicates a s

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies11Mellanox Part Numbering Legend Place Field DecoderM Mellanox Technol

OverviewRev 2.0Mellanox Technologies121 OverviewMellanox SX60XX4.032, Tb/s switch systems provide the highest performing fabric solution by delivering

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies131.1 Features 1.1.1 Full Feature List* This feature will be available

OverviewRev 2.0Mellanox Technologies14Figure 2: Pull Out TabS/N: MT1117X00014P/N: MSX6036F-1BFRGUID: 0002C9020040DDB0Made in ILMGT 1:00:02:C9:11:A2:01

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies152 FDR Transmission RateMellanox SX60XX switch systems support FDR (f

Internally Managed Vs. Externally ManagedRev 2.0Mellanox Technologies163 Internally Managed Vs. Externally ManagedThe following table shows which swit

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies174 Basic Operation and Installation4.1 Switch Platform Hardware Overv

Basic Operation and InstallationRev 2.0Mellanox Technologies18Figure 5: System Status Indicators The system status indicators should display as follo

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies19Figure 6: Power, Fan, and System LEDs 4.1.1.2 Fan Status Indicators

Document Number: 3410Rev 2.0Mellanox Technologies2Mellanox Technologies350 Oakmead Parkway Suite 100Sunnyvale, CA 94085U.S.A.www.mellanox.comTel: (408

Basic Operation and InstallationRev 2.0Mellanox Technologies20Figure 7: Fan Status LED Connector Side The LED indicator on the Fan Module is on the ri

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies214.1.1.3 Power Supply Status Indicators The SX60XX switch is availabl

Basic Operation and InstallationRev 2.0Mellanox Technologies22Figure 10: PS Unit Status LEDs 4.1.1.4 Bad Port LED Figure 11: Bad Port LED The Bad Port

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies23This LED shows symbol errors. Possible causes for this are:• Bad cab

Basic Operation and InstallationRev 2.0Mellanox Technologies24The LED indicator, corresponding to each data port, will light orange when the physical

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies254.3 QSFP Cable Power Budget ClassificationAll SwitchX QSFP switches

Basic Operation and InstallationRev 2.0Mellanox Technologies26Figure 13: Port Numbering Figure 14: Top and Bottom QSFP Port Orientation 4.4.2 Manage

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies27DB9 connection on a host PC. Connecting to a local host PC and follo

Basic Operation and InstallationRev 2.0Mellanox Technologies284.4.2.4 USB interfaceThere is a single USB connector. This connector can be used to inst

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies29Figure 17: Reset Button This button resets both the CPU of the switc

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies3Table of ContentsTable of Contents . . . . . . . . . . . . . . . . .

Basic Operation and InstallationRev 2.0Mellanox Technologies302. Over-temperature3. Stacking the Chassis4. Redundant Power Supply Connection - Electri

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies319. Equipment Disposal10. Local and National Electrical Codes11. Haza

Basic Operation and InstallationRev 2.0Mellanox Technologies3214. WEEE Directive 4.5.2 Mechanical InstallationThe switch platform can be rack mounted

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies33• A single power cord for each power supply unit can be ordered at n

Basic Operation and InstallationRev 2.0Mellanox Technologies34Figure 18: Rack Rail Kit Parts 1. Place the ESD mat on the floor where you will be work

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies35Figure 19: Placement of Switch in RackThings to consider before choo

Basic Operation and InstallationRev 2.0Mellanox Technologies36Figure 20: Mounting Options 3. Decide which mounting option you want to use. 4. Screw

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies37Figure 22: Inserting the Caged Nuts5. Clip 6 caged nuts into the hol

Basic Operation and InstallationRev 2.0Mellanox Technologies389. Slide the switch into the rails.10.Tighten the bolts to 9.2 Nm or 81.5 pound inches.

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies39tacle. The input voltage is auto-adjusting for 100 - 240 VAC, 50-60H

Rev 2.0Mellanox Technologies44.16 Resetting the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 454.17 Chassis

Basic Operation and InstallationRev 2.0Mellanox Technologies404.9 Extracting and Inserting the Power Supply UnitWith both power supplies installed in

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies41Figure 28: PS Unit Pulled OutTo extract a PS unit:1. Remove the powe

Basic Operation and InstallationRev 2.0Mellanox Technologies424.11 Cable InstallationAll cables can be inserted or removed with the unit powered on. T

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies434.12 Extracting and Inserting the Fan UnitThis switch can operate i

Basic Operation and InstallationRev 2.0Mellanox Technologies442. Insert the fan unit by sliding it into the opening until slight resistance is felt. C

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies454.16 Resetting the SwitchOn the connector side panel under the syste

Basic Operation and InstallationRev 2.0Mellanox Technologies46The IB Subnet Manager running on the SX6036 switches supports up to 648 nodes. If the fa

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies474.19 Fabric Inspector (Diagnostics)Fabric Inspector is a plug &

Basic Operation and InstallationRev 2.0Mellanox Technologies48See the “Installation Guide” of the SX6036 switches for full instructions regarding ini

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies494.21.1 I2C ConnectorThe I2C connection provides access to Flash and

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies5List of FiguresFigure 1: Connector Side View of the Switch . . .

Basic Operation and InstallationRev 2.0Mellanox Technologies50Figure 34: MTUSB-1 with CablesThe MTUSB adapter comes with three cables, but has only tw

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies514. Run the burn command:5. Power cycle the switch, by unplugging and

TroubleshootingRev 2.0Mellanox Technologies525 TroubleshootingAs soon as a switch is plugged in make sure that the green power LEDs on the PS units ar

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies534. If the switch does not come on, check the power supplies.5. If th

TroubleshootingRev 2.0Mellanox Technologies545. Select the image to boot.PCIE1: successfully set as root-complex 01 00 15b3 bd34 0c06 00Ne

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies55Appendix A: SpecificationTable 11 - SX60[25][36]Specification Data

Rev 2.0Mellanox Technologies56Shock and Vibration/HumidityShock and Vibration: ETSI EN 300 019-2-2: 1999-09Humidity:Operating 5% - 95% non-condensing

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies57A.1 Approved CablesFor a list of all approved cables see:http://www.

Rev 2.0Mellanox Technologies58A.3 China CCC Warning Statement

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies59Appendix B: Transferring the Power Cord To use the rail kit to tran

Rev 2.0Mellanox Technologies6Figure 36: Transfer Power Cord . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Rev 2.0Mellanox Technologies60Figure 38: Screw the Switch Slide to the SwitchFigure 39: Transfer Power Cord Finished6. Return to step 2 on page 22 and

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies61Appendix C: QSFP InterfaceGNDRx2nGND1234567891011121314151617181920

Rev 2.0Mellanox Technologies62Figure 40: QSFP Connector Male and Female Views18.358.50TopResetL SDA SCLModSelLRX3pTX2nGNDVccRx12345678910123456789TX2

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies63Appendix D: RJ-45 CONSOLE and Ethernet interfacesThe RJ-45 CONSOLE

Rev 2.0Mellanox Technologies64Appendix E: Replacement Parts Ordering NumbersTable 14 - Replacement Parts Ordering NumbersPart Description OPNI2C DB9

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies65Appendix F: Avertissements de sécurité d’installation (French)1. In

Rev 2.0Mellanox Technologies667. Branchement/débranchement des câbles en cuivre 8. Risque de choc et de danger9. Montage et entretien sur baie 10.

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies6713. Installation du matériel 14. Elimination du matériel 15. Cod

Rev 2.0Mellanox Technologies6819. S’assurer que les enceintes sont appropriées 20. Cordons électriques CA homologués UL 21.22. Conformément

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies69Appendix G: Installation - Sicherheitshinweise (German)1. Installat

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies7List of TablesTable 1: Revision History Table . . . . . . . . . . .

Rev 2.0Mellanox Technologies708. Rack-Montage und Wartung 9. Geräteinstallation 10. Geräteentsorgung 11. Regionale und nationale elektrische Bes

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies7114. UL-und CSA Certified Netzkabel 15. Ableitstrom> 3.5m

Rev 2.0Mellanox Technologies7220. Bodily Injury Due to Weight Use enough people to safely lift this product. <40 lbs<18 kgs40 - 70 lbs18 - 32 kg

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies73Appendix H: Advertencias de seguridad para la insta-lación (Spanish

Rev 2.0Mellanox Technologies747. Cuando hay rayos: peligro de descarga eléctrica 8. Conexión y desconexión del cable Copper 9. Montaje y mantenimient

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies7514. Cable de alimentación homologado por UL y con certificación CSA

Rev 2.0Mellanox Technologies8Revision History Table 1 - Revision History TableDate Revision DescriptionNovember 2012 2.0 Fixed Figure 1October 2012 1

SwitchX® FDR InfiniBand Switch Hardware User Manual Rev 2.0Mellanox Technologies9About this ManualThis manual describes the installation and basic use