[libfabric-users] psm3 for Mellanox NIC

[Łukasz Ślusarczyk]

Hi!

It is supported. There is Intel Infiniband Package: 
https://www.intel.com/content/www/us/en/download/768193/intel-basic-infiniband-package.html

In section 4.5 of document describing installation of Intel's PSM3 
https://downloadmirror.intel.com/818023/632484_Intel_Ethernet_Fabric_Software_Install_Guide_v1.7.pdf 
there are described optional steps for packages which support MellanoxOFED.

Note that not all Linux distributions work with IB (e.g. Ubuntu does 
not). See section 1.11 of 
https://downloadmirror.intel.com/812204/N36141_Intel%20Ethernet%20Fabric%20Software%20Release%20Notes_11.5.1.2_v1.2.pdf 
for supported distributions.

Regards,

Łukasz

On 20.06.2024 03:08, Niyaz Murshed wrote:
>
> Hello All,
>
> Do PSM3 provider support Mellanox NIC?
>
> Root#/libfabric# lshw -c net -businfo -numeric
> Bus info          Device          Class          Description
> ============================================================
> pci at 0000 
> <https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:01:00.0<mailto:pci 
> at 0000 
> <https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:01:00.0>  
> eno1            network        I210 Gigabit Network Connection [8086:1533]
> pci at 0000 
> <https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:40:00.0<mailto:pci 
> at 0000 
> <https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:40:00.0>  
> ens2f0np0       network        MT2910 Family [ConnectX-7] [15B3:1021] 
> (Mellanox Technologies MT2910 Family [ConnectX-7])
>
> When I run fi_info, psm3 is only enabled on for the intel nic
> root#fi_info -p psm3
> provider: psm3
>     fabric: TCP-10.118.91.0/24
>     domain: eno1
>     version: 306.10
>     type: FI_EP_RDM
>     protocol: FI_PROTO_PSMX3
> provider: psm3
>     fabric: TCP-10.118.91.0/24
>     domain: eno1
>     version: 306.10
>     type: FI_EP_RDM
>     protocol: FI_PROTO_PSMX3
> provider: psm3
>     fabric: TCP-10.118.91.0/24
>     domain: eno1
>     version: 306.10
>     type: FI_EP_RDM
>     protocol: FI_PROTO_PSMX3
>
> root # ibv_devinfo
>
> hca_id: mlx5_0
>
> transport:              InfiniBand (0)
>
> fw_ver:                       28.39.3004
>
> node_guid:              946d:ae03:007d:a230
>
> sys_image_guid:              946d:ae03:007d:a230
>
> vendor_id:              0x02c9
>
> vendor_part_id:              4129
>
> hw_ver:                       0x0
>
> board_id:               MT_0000000834
>
> phys_port_cnt:               1
>
> port: 1
>
> state:                  PORT_ACTIVE (4)
>
> max_mtu:          4096 (5)
>
> active_mtu:       1024 (3)
>
> sm_lid:                 0
>
> port_lid:         0
>
> port_lmc:         0x00
>
> link_layer:       Ethernet
>
> root # lscpu
> Architecture:            x86_64
>   CPU op-mode(s):        32-bit, 64-bit
> Vendor ID:               GenuineIntel
>   Model name:            Intel(R) Xeon(R) Platinum 8480+
>
> Is this expected?
>
>
> _______________________________________________
> Libfabric-users mailing list
> Libfabric-users at lists.openfabrics.org
> https://lists.openfabrics.org/mailman/listinfo/libfabric-users
---------------------------------------------------------------------
Intel Technology Poland sp. z o.o.
ul. Slowackiego 173 | 80-298 Gdansk | Sad Rejonowy Gdansk Polnoc | VII Wydzial Gospodarczy Krajowego Rejestru Sadowego - KRS 101882 | NIP 957-07-52-316 | Kapital zakladowy 200.000 PLN.
Spolka oswiadcza, ze posiada status duzego przedsiebiorcy w rozumieniu ustawy z dnia 8 marca 2013 r. o przeciwdzialaniu nadmiernym opoznieniom w transakcjach handlowych.

Ta wiadomosc wraz z zalacznikami jest przeznaczona dla okreslonego adresata i moze zawierac informacje poufne. W razie przypadkowego otrzymania tej wiadomosci, prosimy o powiadomienie nadawcy oraz trwale jej usuniecie; jakiekolwiek przegladanie lub rozpowszechnianie jest zabronione.
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). If you are not the intended recipient, please contact the sender and delete all copies; any review or distribution by others is strictly prohibited.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20240620/9af2152d/attachment-0001.htm>