Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openib无法支持 #22

Open
oleotiger opened this issue Jun 1, 2021 · 1 comment
Open

openib无法支持 #22

oleotiger opened this issue Jun 1, 2021 · 1 comment

Comments

@oleotiger
Copy link

Background information

What version of Open MPI are you using? (e.g., v1.10.3, v2.1.0, git branch name and hash, etc.)

从仓库直接git pull,分支huawei

Describe how Open MPI was installed (e.g., from a source/distribution tarball, from a git clone, from an operating system distribution package, etc.)

git clone

Please describe the system on which you are running

  • Operating system/version: CentOS Linux release 7.6.1810 (AltArch)
  • Computer hardware: 1620 4P,Oceanstor 100D
  • Network type: 业务走MLX CX5 ib,管理走1822

Details of the problem

安装了hucx,然后安装hmpi。
安装hmpi时,执行configure,根据log打印,openib不编译。

configure:115308: checking if MCA component btl:openib can compile
configure:115310: result: no

发现需要加上--with-verbs
./configure --prefix=/opt/libs/hmpi --with-verbs --with-platform=contrib/platform/mellanox/optimized --enable-mpi1-compatibility --with-ucx=/opt/libs/hucx 2>&1 | tee config.log
加上后,根据config log还是不编译openib。根据打印的log,是with-verbs识别为no。

如果取消其他多余的options,
``./configure --with-verbs `
根据log打印,会编译openib,with-verbs为yes。

查看了configure里面的内容,发现第一种情况无法识别--with-verbs,强制修改with-verbs为yes,打印的log可见

configure:115308: checking if MCA component btl:openib can compile
configure:115310: result: yes

make -j && make install后,ompi_info|grep btl发现无openib。

如何编译才可以使能openib?mlx网卡驱动是正常安装的。

@oleotiger oleotiger changed the title openip无法支持 openib无法支持 Jun 1, 2021
@razor1991
Copy link
Collaborator

ucx支持ib,不需要走openib。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants