[libfabric-users] psm3 for Mellanox NIC

[Niyaz Murshed]

Thank you so much for the reply.
I will try this.

From: Łukasz Ślusarczyk <lukasz.slusarczyk at intel.com>
Date: Thursday, June 20, 2024 at 12:57 AM
To: Niyaz Murshed <Niyaz.Murshed at arm.com>, libfabric-users at lists.openfabrics.org <libfabric-users at lists.openfabrics.org>
Cc: nd <nd at arm.com>
Subject: Re: [libfabric-users] psm3 for Mellanox NIC

Hi!

It is supported. There is Intel Infiniband Package: https://www.intel.com/content/www/us/en/download/768193/intel-basic-infiniband-package.html

In section 4.5 of document describing installation of Intel's PSM3 https://downloadmirror.intel.com/818023/632484_Intel_Ethernet_Fabric_Software_Install_Guide_v1.7.pdf there are described optional steps for packages which support Mellanox OFED.

Note that not all Linux distributions work with IB (e.g. Ubuntu does not). See section 1.11 of https://downloadmirror.intel.com/812204/N36141_Intel%20Ethernet%20Fabric%20Software%20Release%20Notes_11.5.1.2_v1.2.pdf for supported distributions.

Regards,

Łukasz

On 20.06.2024 03:08, Niyaz Murshed wrote:
Hello All,

Do PSM3 provider support Mellanox NIC?


Root#/libfabric# lshw -c net -businfo -numeric

Bus info          Device          Class          Description

============================================================

pci at 0000<https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:01:00.0<mailto:pci at 0000<https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:01:00.0>  eno1            network        I210 Gigabit Network Connection [8086:1533]



pci at 0000<https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:40:00.0<mailto:pci at 0000<https://lists.openfabrics.org/mailman/listinfo/libfabric-users>:40:00.0>  ens2f0np0       network        MT2910 Family [ConnectX-7] [15B3:1021] (Mellanox Technologies MT2910 Family [ConnectX-7])



When I run fi_info, psm3 is only enabled on for the intel nic



root#fi_info -p psm3

provider: psm3

    fabric: TCP-10.118.91.0/24

    domain: eno1

    version: 306.10

    type: FI_EP_RDM

    protocol: FI_PROTO_PSMX3

provider: psm3

    fabric: TCP-10.118.91.0/24

    domain: eno1

    version: 306.10

    type: FI_EP_RDM

    protocol: FI_PROTO_PSMX3

provider: psm3

    fabric: TCP-10.118.91.0/24

    domain: eno1

    version: 306.10

    type: FI_EP_RDM

    protocol: FI_PROTO_PSMX3




root # ibv_devinfo
hca_id:     mlx5_0
      transport:              InfiniBand (0)
      fw_ver:                       28.39.3004
      node_guid:              946d:ae03:007d:a230
      sys_image_guid:              946d:ae03:007d:a230
      vendor_id:              0x02c9
      vendor_part_id:              4129
      hw_ver:                       0x0
      board_id:               MT_0000000834
      phys_port_cnt:               1
            port: 1
                  state:                  PORT_ACTIVE (4)
                  max_mtu:          4096 (5)
                  active_mtu:       1024 (3)
                  sm_lid:                 0
                  port_lid:         0
                  port_lmc:         0x00
                  link_layer:       Ethernet




root # lscpu

Architecture:            x86_64

  CPU op-mode(s):        32-bit, 64-bit

Vendor ID:               GenuineIntel

  Model name:            Intel(R) Xeon(R) Platinum 8480+


Is this expected?




_______________________________________________

Libfabric-users mailing list

Libfabric-users at lists.openfabrics.org<mailto:Libfabric-users at lists.openfabrics.org>

https://lists.openfabrics.org/mailman/listinfo/libfabric-users

________________________________
Intel Technology Poland sp. z o.o.
ul. Słowackiego 173 | 80-298 Gdańsk | Sąd Rejonowy Gdańsk Północ | VII Wydział Gospodarczy Krajowego Rejestru Sądowego - KRS 101882 | NIP 957-07-52-316 | Kapitał zakładowy 200.000 PLN.
Spółka oświadcza, że posiada status dużego przedsiębiorcy w rozumieniu ustawy z dnia 8 marca 2013 r. o przeciwdziałaniu nadmiernym opóźnieniom w transakcjach handlowych.

Ta wiadomość wraz z załącznikami jest przeznaczona dla określonego adresata i może zawierać informacje poufne. W razie przypadkowego otrzymania tej wiadomości, prosimy o powiadomienie nadawcy oraz trwałe jej usunięcie; jakiekolwiek przeglądanie lub rozpowszechnianie jest zabronione.
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). If you are not the intended recipient, please contact the sender and delete all copies; any review or distribution by others is strictly prohibited.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20240620/4773afb0/attachment-0001.htm>