Build FAISS with specific compiler and link with LDFLAGS

[ns-wxin]

Hi, I tried to build libfaiss.so myself using an earlier version of FAISS source (1.7.2) but the shared lib are linked with un-wanted libs. I used the following cmake options

wxin@localhost:/opt/ns/wayne/toolchain_build/faiss/build$ echo $LDFLAGS
-Wl,--rpath,/opt/gcc-12/lib64,-L/opt/gcc-12/lib64
[email protected]:/opt/ns/wayne/toolchain_build/faiss/build$ echo $CXX
/opt/gcc-12/bin/g++

  $CMAKE \
    -DCMAKE_PREFIX_PATH=/opt/3p \
    -DCMAKE_INSTALL_PREFIX=/opt/3p \
    -DFAISS_ENABLE_GPU=OFF \
    -DFAISS_ENABLE_PYTHON=OFF \
    -DBUILD_TESTING=OFF \
    -DBUILD_SHARED_LIBS=ON \
    -DBLA_VENDOR=Intel10_64_dyn \
    -DMKL_LIBRARIES=/opt/3p/lib/libopenblas.so \
    -DCMAKE_BUILD_TYPE=Release ..

which generated

wxin@localhost:~$ ldd /opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so
/opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by /opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so)
/opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so)
/opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `CXXABI_1.3.13' not found (required by /opt/ns/wayne/toolchain_build/faiss/build/faiss/libfaiss.so)
	linux-vdso.so.1 =>  (0x00007fffde7a6000)
	libopenblas.so.0 => /opt/3p/lib/libopenblas.so.0 (0x00007f39eac45000)
	libgomp.so.1 => /usr/lib/x86_64-linux-gnu/libgomp.so.1 (0x00007f39eaa0e000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f39ea7f1000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f39ea40d000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f39ea104000)

I have gcc-11, gcc-12, gcc-13, gcc-14 and they are install under /opt/gcc-??/ and I would like to build with specific compiler but looks like LDFLAGS and maybe even CXXFLAGS are ignored by FAISS build. I would like link to say, the gcc-12's /opt/3p/lib64/libstdc++.so.6 and libgomp.so.1 rather than the system's /usr/lib/x86_64-linux-gnu/libstdc++.so.6 and /usr/lib/x86_64-linux-gnu/libgomp.so.1.

Any help would be greatly appreciated.

[ns-wxin]

With added debugging, I found the link command is as following. As you can see the linkage path is correctly specified as -Wl,--rpath,/opt/gcc-12/lib64,-L/opt/gcc-12/lib64. Since I have to specify a particular OpenBlas lib -DMKL_LIBRARIES=/opt/3p/lib/libopenblas.so, the Cmake seems to have added -Wl,-rpath,/opt/3p/lib: /opt/3p/lib/libopenblas.so but the /opt/gcc-12/lib64/libgomp.so wasn't linked correctly.

cd /opt/ns/wayne/toolchain_build/faiss/build/faiss && /opt/3p/bin/cmake -E cmake_link_script CMakeFiles/faiss.dir/link.txt --verbose=1
/opt/gcc-12/bin/g++ -fPIC -O3 -DNDEBUG -Wl,--rpath,/opt/gcc-12/lib64,-L/opt/gcc-12/lib64 -shared -Wl,-soname,libfaiss.so -o libfaiss.so CMakeFiles/faiss.dir/AutoTune.cpp.o CMakeFiles/faiss.dir/Clustering.cpp.o CMakeFiles/faiss.dir/IVFlib.cpp.o CMakeFiles/faiss.dir/Index.cpp.o CMakeFiles/faiss.dir/Index2Layer.cpp.o CMakeFiles/faiss.dir/IndexAdditiveQuantizer.cpp.o CMakeFiles/faiss.dir/IndexBinary.cpp.o CMakeFiles/faiss.dir/IndexBinaryFlat.cpp.o CMakeFiles/faiss.dir/IndexBinaryFromFloat.cpp.o CMakeFiles/faiss.dir/IndexBinaryHNSW.cpp.o CMakeFiles/faiss.dir/IndexBinaryHash.cpp.o CMakeFiles/faiss.dir/IndexBinaryIVF.cpp.o CMakeFiles/faiss.dir/IndexFlat.cpp.o CMakeFiles/faiss.dir/IndexFlatCodes.cpp.o CMakeFiles/faiss.dir/IndexHNSW.cpp.o CMakeFiles/faiss.dir/IndexIVF.cpp.o CMakeFiles/faiss.dir/IndexIVFAdditiveQuantizer.cpp.o CMakeFiles/faiss.dir/IndexIVFFlat.cpp.o CMakeFiles/faiss.dir/IndexIVFPQ.cpp.o CMakeFiles/faiss.dir/IndexIVFPQFastScan.cpp.o CMakeFiles/faiss.dir/IndexIVFPQR.cpp.o CMakeFiles/faiss.dir/IndexIVFSpectralHash.cpp.o CMakeFiles/faiss.dir/IndexLSH.cpp.o CMakeFiles/faiss.dir/IndexNNDescent.cpp.o CMakeFiles/faiss.dir/IndexLattice.cpp.o CMakeFiles/faiss.dir/IndexNSG.cpp.o CMakeFiles/faiss.dir/IndexPQ.cpp.o CMakeFiles/faiss.dir/IndexPQFastScan.cpp.o CMakeFiles/faiss.dir/IndexPreTransform.cpp.o CMakeFiles/faiss.dir/IndexRefine.cpp.o CMakeFiles/faiss.dir/IndexReplicas.cpp.o CMakeFiles/faiss.dir/IndexScalarQuantizer.cpp.o CMakeFiles/faiss.dir/IndexShards.cpp.o CMakeFiles/faiss.dir/MatrixStats.cpp.o CMakeFiles/faiss.dir/MetaIndexes.cpp.o CMakeFiles/faiss.dir/VectorTransform.cpp.o CMakeFiles/faiss.dir/clone_index.cpp.o CMakeFiles/faiss.dir/index_factory.cpp.o CMakeFiles/faiss.dir/impl/AuxIndexStructures.cpp.o CMakeFiles/faiss.dir/impl/FaissException.cpp.o CMakeFiles/faiss.dir/impl/HNSW.cpp.o CMakeFiles/faiss.dir/impl/NSG.cpp.o CMakeFiles/faiss.dir/impl/PolysemousTraining.cpp.o CMakeFiles/faiss.dir/impl/ProductQuantizer.cpp.o CMakeFiles/faiss.dir/impl/AdditiveQuantizer.cpp.o CMakeFiles/faiss.dir/impl/ResidualQuantizer.cpp.o CMakeFiles/faiss.dir/impl/LocalSearchQuantizer.cpp.o CMakeFiles/faiss.dir/impl/ScalarQuantizer.cpp.o CMakeFiles/faiss.dir/impl/index_read.cpp.o CMakeFiles/faiss.dir/impl/index_write.cpp.o CMakeFiles/faiss.dir/impl/io.cpp.o CMakeFiles/faiss.dir/impl/kmeans1d.cpp.o CMakeFiles/faiss.dir/impl/lattice_Zn.cpp.o CMakeFiles/faiss.dir/impl/pq4_fast_scan.cpp.o CMakeFiles/faiss.dir/impl/pq4_fast_scan_search_1.cpp.o CMakeFiles/faiss.dir/impl/pq4_fast_scan_search_qbs.cpp.o CMakeFiles/faiss.dir/impl/NNDescent.cpp.o CMakeFiles/faiss.dir/invlists/BlockInvertedLists.cpp.o CMakeFiles/faiss.dir/invlists/DirectMap.cpp.o CMakeFiles/faiss.dir/invlists/InvertedLists.cpp.o CMakeFiles/faiss.dir/invlists/InvertedListsIOHook.cpp.o CMakeFiles/faiss.dir/utils/Heap.cpp.o CMakeFiles/faiss.dir/utils/WorkerThread.cpp.o CMakeFiles/faiss.dir/utils/distances.cpp.o CMakeFiles/faiss.dir/utils/distances_simd.cpp.o CMakeFiles/faiss.dir/utils/extra_distances.cpp.o CMakeFiles/faiss.dir/utils/hamming.cpp.o CMakeFiles/faiss.dir/utils/partitioning.cpp.o CMakeFiles/faiss.dir/utils/quantize_lut.cpp.o CMakeFiles/faiss.dir/utils/random.cpp.o CMakeFiles/faiss.dir/utils/utils.cpp.o CMakeFiles/faiss.dir/invlists/OnDiskInvertedLists.cpp.o  -Wl,-rpath,/opt/3p/lib: /opt/3p/lib/libopenblas.so /opt/gcc-12/lib64/libgomp.so -lpthread
make[2]: Leaving directory '/opt/ns/wayne/toolchain_build/faiss/build'

[ns-wxin]

OK. A coworker helped to figure out that I should've used "-DMKL_LIBRARIES=-lopenblas" and then I was able to link it to gcc-13 libs. Of course we had to patch faiss.h to make it compile for gcc-13.