Hi! I could be wrong but it seems to me that the initial request goes really beyond the simple fact of ensuring that a particular form of connectivity (QSFP-DD or QSFP112) is supported or not on a particular HPE Networking ArubaOS-CX or HPE Networking Comware operating system based (thus ensuring that a desired connectivity to "a" desired Server equipped with "a" particular network interface card will work flawlessly, simply speaking).
If so, what Server exactly? for what purpose? what requirements the OP's client has?
Original Message:
Sent: Mar 17, 2025 06:21 PM
From: shpat
Subject: QSFP-DD
So this means that QSFP56 and QSFP28 would be supported according to this statement:
Not offered with OSFP or QSFP-DDs
QSFP112 cages accept 200G QSFP56 and 100G QSFP28
Which means Aruba CX series with QSFP28 should work.
But also, in this case should this work as well?
Aruba CX9300 <- 400G QSFP-DD --- 2xQSFP56 --> BlueField-3
---------------------------------
Shpat | ACEP | ACMP | ACCP | ACDP
Just an Aruba enthusiast and contributor by cases
If you find my comment helpful, KUDOS are appreciated.
Original Message:
Sent: Mar 17, 2025
From: parnassus
Subject: RE: QSFP-DD
Yes and also the information available here:
https://docs.nvidia.com/networking/display/400g50gpam4ovpub
would shed some light on the topic.
Original Message:
Sent: Mar 17, 2025 05:21 PM
From: shpat
Subject: QSFP-DD
I totally agree with your details provided. I also managed to find this info which is Release Date Nov 28, 2024
https://support.hpe.com/connect/s/softwaredetails?language=en_US&collectionId=MTX-1e15cd3d3cd84fd5&tab=releaseNotes
HPE NVIDIA Bluefield Bootstream (BFB) image for HPE Data Processing Unit InfiniBand NDR/Ethernet 400Gb 1-port QSFP112 HHHL B3140H Adapter (HPE Part Number P66387-H21)
Also in the User Guide of the Bluefield-3: https://docs.nvidia.com/networking/display/nvidia-bluefield-3-networking-platform-user-guide.pdf
It states that:
Seems it would be necessary to have InfiniBand NDR 400Gb/s as per the Supported Platforms and Interoperability
https://docs.nvidia.com/networking/display/bluefielddpuosv460/supported+platforms+and+interoperability
HPE InfiniBand Switches are Mellanox (which means NVIDIA since they bought Mellanox in 2019), so i suppose the idea of having NVIDA Switches supporting NVIDA BlueField-3 B324
https://buy.hpe.com/us/en/options/enterprise-networking-products/switches/infiniband-switches/hpe-infiniband-ndr-switches/p/1014668195
But i also deep dived into this https://docs.nvidia.com/networking/display/bluefield3firmwarev32401000/firmware+compatible+products
It states that the BlueField-3 with firmware compatibility supports Ethernet Protocols, 400GbE - (Speed that supports PAM4 mode only).
If that would be the case, Aruba CX9300-32D supports Port Speeds of 400G PAM4
https://arubanetworking.hpe.com/assets/eo/AAG_Aruba-CX-9300-Switch-Series.pdf
I am not sure if i am missing a point here somewhere, so i opened a Case in NVIDIA Partner portal to cross-check with their support and see their feedback on this.
------------------------------
Shpat | ACEP | ACMP | ACCP | ACDP
Just an Aruba enthusiast and contributor by cases
If you find my comment helpful, KUDOS are appreciated.
Original Message:
Sent: Mar 17, 2025 12:46 PM
From: parnassus
Subject: QSFP-DD
Hi, that's very interesting.
Let me consider only the (hypotetical) usage of an ArubaOS-CX based Switch family (let me not be too specific about the exact model with its very specific requirements/restrictions <- QuickSpecs speak for themself), a Switch family generically supporting the QSFP-DD (Q-DD) 400GbE.
Given the above I found (an it is just an example) the Aruba CX 9300.
Looking at the supported options on latest QuickSpecs (03/2025) I was able to compose this long list of supported Transceivers and DAC/AOC (Splitting cables too):
SKUs of HPE Aruba Networking QSFP-DD Transceivers:
R9B41A HPE Aruba Networking 400G QSFP-DD MPO-16 SR8 MMF Transceiver 100 m
R9B42A HPE Aruba Networking 400G QSFP-DD MPO-12 eDR4 SMF Transceiver 2 km
S3N90A HPE Aruba Networking 400G DR QSFP-DD SN SMF Transceiver 500 m
S3N91A HPE Aruba Networking 400G FR QSFP-DD SN SMF Transceiver 2 km
S3N92A HPE Aruba Networking 400G LR QSFP-DD SN SMF Transceiver 10 km
S3N93A HPE Aruba Networking 400G DR4 QSFP-DD MPO12 SMF Transceiver 500 m
S3N94A HPE Aruba Networking 400G PLR4 QSFP-DD MPO12 SMF Transceiver 10 km
S3N95A HPE Aruba Networking 400G FR4 QSFP-DD LC SMF Transceiver 2 km
S3N96A HPE Aruba Networking 400G LR4 QSFP-DD LC SMF Transceiver 10 km
S4B35A HPE Aruba Networking 400G PLR8 QSFP-DD 2xMPO12 SMF Transceiver 10 km
S4B38A HPE Aruba Networking 400G ZR QSFP-DD SMF Digital Coherent Tunable Transceiver 80 km
SKUs of HPE Aruba Networking QSFP-DD (running in 200G mode) to 8x SFP28 DAC cables:
S4B39A HPE Aruba Networking 200G QSFP-DD to 8x SFP28 DAC 2 m
S4B40A HPE Aruba Networking 200G QSFP-DD to 8x SFP28 DAC 3 m
SKUs of HPE Aruba Networking QSFP-DD to QSFP-DD AOC cables:
R9B45A HPE Aruba Networking 400G QSFP-DD to QSFP-DD AOC 3 m
R9B43A HPE Aruba Networking 400G QSFP-DD to QSFP-DD AOC 7 m
R9B47A HPE Aruba Networking 400G QSFP-DD to QSFP-DD AOC 15 m
R9B46A HPE Aruba Networking 400G QSFP-DD to QSFP-DD AOC 30 m
R9B44A HPE Aruba Networking 400G QSFP-DD to QSFP-DD AOC 50 m
SKUs of HPE Aruba Networking QSFP-DD to 2x QSFP56 AOC cables:
R9B55A HPE Aruba Networking 400G QSFP-DD to 2x QSFP56 AOC 3 m
R9B53A HPE Aruba Networking 400G QSFP-DD to 2x QSFP56 AOC 7 m
R9B57A HPE Aruba Networking 400G QSFP-DD to 2x QSFP56 AOC 15 m
R9B56A HPE Aruba Networking 400G QSFP-DD to 2x QSFP56 AOC 30 m
R9B54A HPE Aruba Networking 400G QSFP-DD to 2x QSFP56 AOC 50 m
SKUs of HPE Aruba Networking QSFP-DD to 4x QSFP56 AOC cables:
R9B50A HPE Aruba Networking 400G QSFP-DD to 4x QSFP56 AOC 3 m
R9B48A HPE Aruba Networking 400G QSFP-DD to 4x QSFP56 AOC 7 m
R9B52A HPE Aruba Networking 400G QSFP-DD to 4x QSFP56 AOC 15 m
R9B51A HPE Aruba Networking 400G QSFP-DD to 4x QSFP56 AOC 30 m
R9B49A HPE Aruba Networking 400G QSFP-DD to 4x QSFP56 AOC 50 m
SKUs of HPE Aruba Networking QSFP-DD to 8x SFP56 AOC cables:
S4B41A HPE Aruba Networking 400G QSFP-DD to 8x SFP56 DAC 1 m
S4B42A HPE Aruba Networking 400G QSFP-DD to 8x SFP56 DAC 2 m
SKUs of HPE Aruba Networking QSFP-DD (running in 200G mode) to 2x QSFP28 AOC cables:
R9B60A HPE Aruba Networking 200G QSFP-DD to 2x QSFP28 AOC 3 m
R9B58A HPE Aruba Networking 200G QSFP-DD to 2x QSFP28 AOC 7 m
R9B62A HPE Aruba Networking 200G QSFP-DD to 2x QSFP28 AOC 15 m
R9B61A HPE Aruba Networking 200G QSFP-DD to 2x QSFP28 AOC 30 m
R9B59A HPE Aruba Networking 200G QSFP-DD to 2x QSFP28 AOC 50 m
The above can be cross-checked (any error is mine!) on the latest Aruba Transceivers and DAC cables guide (19th edition, to date) and one can exclude those options not fitting a typical computing datacenter interconnectivity (say working within few meters bewteen a Server and its Ethernet switch).
Nowhere it's cited the QSFP112, maybe I'm wrong but I don't take for granted that one of the above supported option can be exchanged like-for-like (and be recognized by the Switch) with a QSFP112 (400G)...and that because, to my totally uneducated eyes, the QSFP112 (400G) is not necessarily equal to a QSFP-DD (400G)...otherwise HPE Aruba should have very well detailed that (or not?). I repeat, maybe I'm wrong.
Not to speak the relationship of an HPE ProLiant Server (as example) supporting that NVIDIA DPU (BlueField-3) and the requirement of interconnecting such computing solution (as for the OP post) with an HPE Ethernet (high-end) switch...and this to have a fully certified Server <-> Networking Switch scenario.
Original Message:
Sent: Mar 17, 2025 01:04 AM
From: shpat
Subject: QSFP-DD
I haven't tried it myself to be honest but, according to the datasheet of the BlueField-3 B3240. https://docs.nvidia.com/networking/display/bf3dpu/specifications
Networking Connector: Dual-port QSFP112 (copper and optical)
Protocol Support: Ethernet: 200GAUI-2 C2M, 200GAUI-4 C2M, 200GBASE-CR4, 100GAUI-2 C2M, 100GAUI-1 C2M, 100GBASE-CR4, 100GBASE-CR2, 100GBASE-CR1, 50GAUI-2 C2M, 50GAUI-1 C2M, 50GBASE-CR, 50GBASE-R2 , 40GBASE-CR4, 40GBASE-R2, 25GBASE-R, 10GBASE-R, 10GBASE-CX4, 1000BASE-CX, CAUI-4 C2M, 25GAUI C2M, XLAUI C2M , XLPPI, SFI
Aruba has: 200GBASE-CR4
Also, i have checked this:
http://qsfp112.com/#:~:text=The%20QSFP112%20connectors%20and%20cages,QSFP%2DDD%20connector%20and%20cage.
States: " The QSFP112 connectors and cages will be backward compatible with legacy QSFP 40G(4x10G), 100G(4x25G) and 200G(4x56G-PAM4) modules, including optical transceivers and copper cables. "
Also: https://www.fs.com/blog/what-is-qsfp112-and-400g-qsfp112-transceiver-565.html
So from this point, my understanding is that it should work.
------------------------------
Shpat | ACEP | ACMP | ACCP | ACDP
Just an Aruba enthusiast and contributor by cases
If you find my comment helpful, KUDOS are appreciated.
Original Message:
Sent: Mar 16, 2025 02:43 PM
From: parnassus
Subject: QSFP-DD
Hi! are we sure about that? maybe I'm wrong and I haven't searched too deeply but I feel some difficulties to find documentation about interoperability between (and, moreover, supportability by HPE Aruba Networking - ArubaOS-CX or HPE Comware based - high-end Switches and HPE Servers with that nVidia option) QSFP-DD and QSFP112, especially related to Server (NIC) to Switch scenario.
Original Message:
Sent: Mar 16, 2025 09:32 AM
From: shpat
Subject: QSFP-DD
The QSFP112 connectors and cages will be backward compatible with legacy QSFP 40G(4x10G), 100G(4x25G) and 200G(4x56G-PAM4) modules, including optical transceivers and copper cables. The QSFP112 modules will also be able to be accepted by QSFP-DD connector and cage.
You can also get a DAC Cable with QSFP-112 to QSFP-DD
What type of aruba switch do you have? You need to check compatibility of Modules or DACs.
---------------------------------
Shpat | ACEP | ACMP | ACCP | ACDP
Just an Aruba enthusiast and contributor by cases
If you find my comment helpful, KUDOS are appreciated.
Original Message:
Sent: Mar 14, 2025
From: CellarRat
Subject: QSFP-DD
Hello.
I would like to ask you about the compatability between QSFP-DD and QSFP112.
My client is trying to build NVIDIA's GPU server and the model of the NIC on that server is BlueField-3 B3240.
According to the data sheet, this NIC seems to use QSFP112 specification for form factor and 400GBASE-CR4 for Ethernet standard.
But even if I look at all the HPE Aruba switch products, there is only the QSFP-DD standard, but it doesn't say it supports the QSFP112 standard. There is no optical transceiver with the QSFP112 standard.
I easily found that QSFP-DD cage is down compatible with QSFP112 transceiver, but this also doesn't seem to help in the current situation.
If I want to connect this GPU server to the switch with 400GbE, what should I do?