ollama - 💡(How to fix) Fix Build failure: infiniband/verbs.h not found when building MLX preset on macOS [2 comments, 2 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
ollama/ollama#16088Fetched 2026-05-11 03:13:17
View on GitHub
Comments
2
Participants
2
Timeline
2
Reactions
0
Timeline (top)
commented ×2

Error Message

(base) ➜ ollama git:(main) cmake -B build --preset MLX -- The C compiler identification is Clang 20.1.4 -- The CXX compiler identification is Clang 20.1.4 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /Users/admin/miniconda3/bin/arm64-apple-darwin20.0.0-clang - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /Users/admin/miniconda3/bin/arm64-apple-darwin20.0.0-clang++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success -- Found Threads: TRUE -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF -- CMAKE_SYSTEM_PROCESSOR: arm64 -- GGML_SYSTEM_ARCH: ARM -- Including CPU backend -- ARM detected -- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E -- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E - Failed -- Checking for ARM features using flags: -- Performing Test HAVE_DOTPROD -- Performing Test HAVE_DOTPROD - Success -- Performing Test HAVE_SVE -- Performing Test HAVE_SVE - Failed -- Performing Test HAVE_MATMUL_INT8 -- Performing Test HAVE_MATMUL_INT8 - Failed -- Performing Test HAVE_FMA -- Performing Test HAVE_FMA - Success -- Performing Test HAVE_FP16_VECTOR_ARITHMETIC -- Performing Test HAVE_FP16_VECTOR_ARITHMETIC - Success -- Performing Test HAVE_SME -- Performing Test HAVE_SME - Failed -- Adding CPU backend variant ggml-cpu:
-- Looking for a CUDA compiler -- Looking for a CUDA compiler - NOTFOUND -- Looking for a HIP compiler -- Looking for a HIP compiler - NOTFOUND -- Setting up MLX (this takes a while...) -- Building MLX for arm64 processor on Darwin -- Metal found /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Metal.framework -- Building with macOS SDK version 26.4 -- Accelerate found /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework -- Downloading json -- Using the multi-header code from /Users/admin/go/src/ollama/build/_deps/json-src/include/ -- Downloading json for JACCL -- {fmt} version: 12.1.0 -- Build type: Release -- Performing Test HAS_NULLPTR_WARNING -- Performing Test HAS_NULLPTR_WARNING - Success -- Regenerating MLX Go wrappers Parsing MLX-C headers from: ../../mlxrunner/mlx/include/mlx/c Found 29 header files Found 619 unique function declarations Generated mlx.h and mlx.c successfully Generating generated.c Generating generated.h -- MLX version (local dev): 0.31.2-7-ge8ebdeb -- Could not find nvcc, please set CUDAToolkit_ROOT. -- Configuring done (18.1s) -- Generating done (0.1s) -- Build files have been written to: /Users/admin/go/src/ollama/build (base) ➜ ollama git:(main) cmake --build build --preset MLX --parallel [ 0%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/tcp.cpp.o [ 1%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/mesh.cpp.o [ 2%] Building steel_attention_nax.air [ 2%] Generating jit/gather.cpp [ 4%] Building steel_gemm_splitk_nax.air [ 5%] Building arg_reduce.air [ 5%] Building unary.air [ 5%] Building fp_quantized_nax.air [ 6%] Building steel_gemm_segmented_nax.air [ 8%] Building steel_conv_general.air [ 9%] Building fp_quantized.air [ 9%] Building scan.air [ 9%] Building steel_gemm_segmented.air [ 10%] Building logsumexp.air [ 10%] Building steel_gemm_masked.air [ 12%] Generating jit/gather_front.cpp [ 12%] Building fft.air [ 13%] Building gemv_masked.air [ 13%] Generating compiled_preamble.cpp [ 13%] Generating jit/reduce_utils.cpp [ 14%] Generating jit/ternary_ops.cpp [ 14%] Generating jit/unary_ops.cpp [ 14%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/ring.cpp.o [ 14%] Generating jit/binary_ops.cpp [ 16%] Generating jit/utils.cpp [ 16%] Building random.air [ 17%] Building CXX object _deps/mlx-build/mlx/CMakeFiles/mlx_version.dir/version.cpp.o [ 17%] Building layer_norm.air [ 18%] Building steel_gemm_fused_nax.air [ 18%] Building arange.air [ 18%] Building steel_conv_3d.air [ 18%] Generating jit/scatter_axis.cpp [ 18%] Building rope.air [ 18%] Building softmax.air [ 20%] Generating jit/scatter.cpp [ 21%] Building gemv.air [ 21%] Building quantized_nax.air [ 22%] Building steel_gemm_gather_nax.air [ 22%] Building binary.air [ 24%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/jaccl.cpp.o [ 25%] Building binary_two.air [ 26%] Generating jit/hadamard.cpp [ 26%] Building steel_attention.air [ 26%] Building copy.air [ 29%] Building rms_norm.air [ 29%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/rdma.cpp.o [ 29%] Building fence.air [ 29%] Building reduce.air [ 29%] Building steel_gemm_splitk.air [ 29%] Building quantized.air [ 29%] Building steel_gemm_fused.air [ 30%] Building sort.air [ 32%] Building scaled_dot_product_attention.air [ 32%] Building conv.air [ 33%] Generating jit/masked_scatter.cpp [ 33%] Building ternary.air [ 33%] Building steel_gemm_gather.air [ 33%] Building steel_conv.air [ 33%] Generating jit/gather_axis.cpp [ 33%] Built target mlx_version [ 33%] Built target cpu_compiled_preamble [ 33%] Built target binary_ops [ 33%] Built target ternary_ops [ 33%] Built target gather [ 33%] Built target reduce_utils [ 33%] Built target scatter [ 33%] Built target hadamard [ 33%] Built target gather_front [ 33%] Built target utils [ 33%] Built target unary_ops [ 33%] Built target gather_axis [ 33%] Built target scatter_axis [ 33%] Built target masked_scatter In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/ring.cpp:3: In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/ring.h:6: /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found 5 | #include <infiniband/verbs.h> | ^~~~~~~~~~~~~~~~~~~~ In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.cpp:3: In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.h:6: In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh_impl.h:8: /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found 5 | #include <infiniband/verbs.h> | ^~~~~~~~~~~~~~~~~~~~ 1 error generated. make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:121: jaccl/CMakeFiles/jaccl.dir/jaccl/ring.cpp.o] Error 1 make[3]: *** Waiting for unfinished jobs.... 1 error generated. make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:107: jaccl/CMakeFiles/jaccl.dir/jaccl/mesh.cpp.o] Error 1 In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.cpp:8: /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found 5 | #include <infiniband/verbs.h> | ^~~~~~~~~~~~~~~~~~~~ 1 error generated. make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:93: jaccl/CMakeFiles/jaccl.dir/jaccl/rdma.cpp.o] Error 1 In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/jaccl.cpp:9: In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.h:6: In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh_impl.h:8: /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found 5 | #include <infiniband/verbs.h> | ^~~~~~~~~~~~~~~~~~~~ 1 error generated. make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:135: jaccl/CMakeFiles/jaccl.dir/jaccl/jaccl.cpp.o] Error 1 make[2]: *** [CMakeFiles/Makefile2:729: jaccl/CMakeFiles/jaccl.dir/all] Error 2 make[2]: *** Waiting for unfinished jobs.... [ 33%] Building mlx.metallib [ 33%] Built target mlx-metallib make[1]: *** [CMakeFiles/Makefile2:691: _deps/mlx-build/CMakeFiles/mlx.dir/rule] Error 2 make: *** [Makefile:221: mlx] Error 2

Code Example

xcodebuild -downloadComponent MetalToolchain
xcrun metal
cmake -B build --preset MLX
cmake --build build --preset MLX --parallel

---

(base) ➜  ollama git:(main) cmake -B build --preset MLX
-- The C compiler identification is Clang 20.1.4
-- The CXX compiler identification is Clang 20.1.4
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /Users/admin/miniconda3/bin/arm64-apple-darwin20.0.0-clang - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /Users/admin/miniconda3/bin/arm64-apple-darwin20.0.0-clang++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: arm64
-- GGML_SYSTEM_ARCH: ARM
-- Including CPU backend
-- ARM detected
-- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E
-- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E - Failed
-- Checking for ARM features using flags:
-- Performing Test HAVE_DOTPROD
-- Performing Test HAVE_DOTPROD - Success
-- Performing Test HAVE_SVE
-- Performing Test HAVE_SVE - Failed
-- Performing Test HAVE_MATMUL_INT8
-- Performing Test HAVE_MATMUL_INT8 - Failed
-- Performing Test HAVE_FMA
-- Performing Test HAVE_FMA - Success
-- Performing Test HAVE_FP16_VECTOR_ARITHMETIC
-- Performing Test HAVE_FP16_VECTOR_ARITHMETIC - Success
-- Performing Test HAVE_SME
-- Performing Test HAVE_SME - Failed
-- Adding CPU backend variant ggml-cpu:  
-- Looking for a CUDA compiler
-- Looking for a CUDA compiler - NOTFOUND
-- Looking for a HIP compiler
-- Looking for a HIP compiler - NOTFOUND
-- Setting up MLX (this takes a while...)
-- Building MLX for arm64 processor on Darwin
-- Metal found /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Metal.framework
-- Building with macOS SDK version 26.4
-- Accelerate found /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework
-- Downloading json
-- Using the multi-header code from /Users/admin/go/src/ollama/build/_deps/json-src/include/
-- Downloading json for JACCL
-- {fmt} version: 12.1.0
-- Build type: Release
-- Performing Test HAS_NULLPTR_WARNING
-- Performing Test HAS_NULLPTR_WARNING - Success
-- Regenerating MLX Go wrappers
Parsing MLX-C headers from: ../../mlxrunner/mlx/include/mlx/c
Found 29 header files
Found 619 unique function declarations
Generated mlx.h and mlx.c successfully
Generating generated.c
Generating generated.h
-- MLX version (local dev): 0.31.2-7-ge8ebdeb
-- Could not find nvcc, please set CUDAToolkit_ROOT.
-- Configuring done (18.1s)
-- Generating done (0.1s)
-- Build files have been written to: /Users/admin/go/src/ollama/build
(base) ➜  ollama git:(main) cmake --build build --preset MLX --parallel
[  0%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/tcp.cpp.o
[  1%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/mesh.cpp.o
[  2%] Building steel_attention_nax.air
[  2%] Generating jit/gather.cpp
[  4%] Building steel_gemm_splitk_nax.air
[  5%] Building arg_reduce.air
[  5%] Building unary.air
[  5%] Building fp_quantized_nax.air
[  6%] Building steel_gemm_segmented_nax.air
[  8%] Building steel_conv_general.air
[  9%] Building fp_quantized.air
[  9%] Building scan.air
[  9%] Building steel_gemm_segmented.air
[ 10%] Building logsumexp.air
[ 10%] Building steel_gemm_masked.air
[ 12%] Generating jit/gather_front.cpp
[ 12%] Building fft.air
[ 13%] Building gemv_masked.air
[ 13%] Generating compiled_preamble.cpp
[ 13%] Generating jit/reduce_utils.cpp
[ 14%] Generating jit/ternary_ops.cpp
[ 14%] Generating jit/unary_ops.cpp
[ 14%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/ring.cpp.o
[ 14%] Generating jit/binary_ops.cpp
[ 16%] Generating jit/utils.cpp
[ 16%] Building random.air
[ 17%] Building CXX object _deps/mlx-build/mlx/CMakeFiles/mlx_version.dir/version.cpp.o
[ 17%] Building layer_norm.air
[ 18%] Building steel_gemm_fused_nax.air
[ 18%] Building arange.air
[ 18%] Building steel_conv_3d.air
[ 18%] Generating jit/scatter_axis.cpp
[ 18%] Building rope.air
[ 18%] Building softmax.air
[ 20%] Generating jit/scatter.cpp
[ 21%] Building gemv.air
[ 21%] Building quantized_nax.air
[ 22%] Building steel_gemm_gather_nax.air
[ 22%] Building binary.air
[ 24%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/jaccl.cpp.o
[ 25%] Building binary_two.air
[ 26%] Generating jit/hadamard.cpp
[ 26%] Building steel_attention.air
[ 26%] Building copy.air
[ 29%] Building rms_norm.air
[ 29%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/rdma.cpp.o
[ 29%] Building fence.air
[ 29%] Building reduce.air
[ 29%] Building steel_gemm_splitk.air
[ 29%] Building quantized.air
[ 29%] Building steel_gemm_fused.air
[ 30%] Building sort.air
[ 32%] Building scaled_dot_product_attention.air
[ 32%] Building conv.air
[ 33%] Generating jit/masked_scatter.cpp
[ 33%] Building ternary.air
[ 33%] Building steel_gemm_gather.air
[ 33%] Building steel_conv.air
[ 33%] Generating jit/gather_axis.cpp
[ 33%] Built target mlx_version
[ 33%] Built target cpu_compiled_preamble
[ 33%] Built target binary_ops
[ 33%] Built target ternary_ops
[ 33%] Built target gather
[ 33%] Built target reduce_utils
[ 33%] Built target scatter
[ 33%] Built target hadamard
[ 33%] Built target gather_front
[ 33%] Built target utils
[ 33%] Built target unary_ops
[ 33%] Built target gather_axis
[ 33%] Built target scatter_axis
[ 33%] Built target masked_scatter
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/ring.cpp:3:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/ring.h:6:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.cpp:3:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.h:6:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh_impl.h:8:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:121: jaccl/CMakeFiles/jaccl.dir/jaccl/ring.cpp.o] Error 1
make[3]: *** Waiting for unfinished jobs....
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:107: jaccl/CMakeFiles/jaccl.dir/jaccl/mesh.cpp.o] Error 1
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.cpp:8:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:93: jaccl/CMakeFiles/jaccl.dir/jaccl/rdma.cpp.o] Error 1
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/jaccl.cpp:9:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.h:6:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh_impl.h:8:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:135: jaccl/CMakeFiles/jaccl.dir/jaccl/jaccl.cpp.o] Error 1
make[2]: *** [CMakeFiles/Makefile2:729: jaccl/CMakeFiles/jaccl.dir/all] Error 2
make[2]: *** Waiting for unfinished jobs....
[ 33%] Building mlx.metallib
[ 33%] Built target mlx-metallib
make[1]: *** [CMakeFiles/Makefile2:691: _deps/mlx-build/CMakeFiles/mlx.dir/rule] Error 2
make: *** [Makefile:221: mlx] Error 2
RAW_BUFFERClick to expand / collapse

Build failure: infiniband/verbs.h not found when building MLX preset on macOS

Environment

  • OS: macOS Tahoe 26.4.1
  • Hardware: Apple M2, 24 GB unified memory
  • Ollama branch: main

Describe the bug

I follow the instructions in the development document (MLX Engine (Optional) ) https://github.com/ollama/ollama/blob/main/docs/development.md. But get error below.

Steps to reproduce

xcodebuild -downloadComponent MetalToolchain
xcrun metal
cmake -B build --preset MLX
cmake --build build --preset MLX --parallel

Error output

(base) ➜  ollama git:(main) cmake -B build --preset MLX
-- The C compiler identification is Clang 20.1.4
-- The CXX compiler identification is Clang 20.1.4
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /Users/admin/miniconda3/bin/arm64-apple-darwin20.0.0-clang - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /Users/admin/miniconda3/bin/arm64-apple-darwin20.0.0-clang++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: arm64
-- GGML_SYSTEM_ARCH: ARM
-- Including CPU backend
-- ARM detected
-- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E
-- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E - Failed
-- Checking for ARM features using flags:
-- Performing Test HAVE_DOTPROD
-- Performing Test HAVE_DOTPROD - Success
-- Performing Test HAVE_SVE
-- Performing Test HAVE_SVE - Failed
-- Performing Test HAVE_MATMUL_INT8
-- Performing Test HAVE_MATMUL_INT8 - Failed
-- Performing Test HAVE_FMA
-- Performing Test HAVE_FMA - Success
-- Performing Test HAVE_FP16_VECTOR_ARITHMETIC
-- Performing Test HAVE_FP16_VECTOR_ARITHMETIC - Success
-- Performing Test HAVE_SME
-- Performing Test HAVE_SME - Failed
-- Adding CPU backend variant ggml-cpu:  
-- Looking for a CUDA compiler
-- Looking for a CUDA compiler - NOTFOUND
-- Looking for a HIP compiler
-- Looking for a HIP compiler - NOTFOUND
-- Setting up MLX (this takes a while...)
-- Building MLX for arm64 processor on Darwin
-- Metal found /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Metal.framework
-- Building with macOS SDK version 26.4
-- Accelerate found /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework
-- Downloading json
-- Using the multi-header code from /Users/admin/go/src/ollama/build/_deps/json-src/include/
-- Downloading json for JACCL
-- {fmt} version: 12.1.0
-- Build type: Release
-- Performing Test HAS_NULLPTR_WARNING
-- Performing Test HAS_NULLPTR_WARNING - Success
-- Regenerating MLX Go wrappers
Parsing MLX-C headers from: ../../mlxrunner/mlx/include/mlx/c
Found 29 header files
Found 619 unique function declarations
Generated mlx.h and mlx.c successfully
Generating generated.c
Generating generated.h
-- MLX version (local dev): 0.31.2-7-ge8ebdeb
-- Could not find nvcc, please set CUDAToolkit_ROOT.
-- Configuring done (18.1s)
-- Generating done (0.1s)
-- Build files have been written to: /Users/admin/go/src/ollama/build
(base) ➜  ollama git:(main) cmake --build build --preset MLX --parallel
[  0%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/tcp.cpp.o
[  1%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/mesh.cpp.o
[  2%] Building steel_attention_nax.air
[  2%] Generating jit/gather.cpp
[  4%] Building steel_gemm_splitk_nax.air
[  5%] Building arg_reduce.air
[  5%] Building unary.air
[  5%] Building fp_quantized_nax.air
[  6%] Building steel_gemm_segmented_nax.air
[  8%] Building steel_conv_general.air
[  9%] Building fp_quantized.air
[  9%] Building scan.air
[  9%] Building steel_gemm_segmented.air
[ 10%] Building logsumexp.air
[ 10%] Building steel_gemm_masked.air
[ 12%] Generating jit/gather_front.cpp
[ 12%] Building fft.air
[ 13%] Building gemv_masked.air
[ 13%] Generating compiled_preamble.cpp
[ 13%] Generating jit/reduce_utils.cpp
[ 14%] Generating jit/ternary_ops.cpp
[ 14%] Generating jit/unary_ops.cpp
[ 14%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/ring.cpp.o
[ 14%] Generating jit/binary_ops.cpp
[ 16%] Generating jit/utils.cpp
[ 16%] Building random.air
[ 17%] Building CXX object _deps/mlx-build/mlx/CMakeFiles/mlx_version.dir/version.cpp.o
[ 17%] Building layer_norm.air
[ 18%] Building steel_gemm_fused_nax.air
[ 18%] Building arange.air
[ 18%] Building steel_conv_3d.air
[ 18%] Generating jit/scatter_axis.cpp
[ 18%] Building rope.air
[ 18%] Building softmax.air
[ 20%] Generating jit/scatter.cpp
[ 21%] Building gemv.air
[ 21%] Building quantized_nax.air
[ 22%] Building steel_gemm_gather_nax.air
[ 22%] Building binary.air
[ 24%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/jaccl.cpp.o
[ 25%] Building binary_two.air
[ 26%] Generating jit/hadamard.cpp
[ 26%] Building steel_attention.air
[ 26%] Building copy.air
[ 29%] Building rms_norm.air
[ 29%] Building CXX object jaccl/CMakeFiles/jaccl.dir/jaccl/rdma.cpp.o
[ 29%] Building fence.air
[ 29%] Building reduce.air
[ 29%] Building steel_gemm_splitk.air
[ 29%] Building quantized.air
[ 29%] Building steel_gemm_fused.air
[ 30%] Building sort.air
[ 32%] Building scaled_dot_product_attention.air
[ 32%] Building conv.air
[ 33%] Generating jit/masked_scatter.cpp
[ 33%] Building ternary.air
[ 33%] Building steel_gemm_gather.air
[ 33%] Building steel_conv.air
[ 33%] Generating jit/gather_axis.cpp
[ 33%] Built target mlx_version
[ 33%] Built target cpu_compiled_preamble
[ 33%] Built target binary_ops
[ 33%] Built target ternary_ops
[ 33%] Built target gather
[ 33%] Built target reduce_utils
[ 33%] Built target scatter
[ 33%] Built target hadamard
[ 33%] Built target gather_front
[ 33%] Built target utils
[ 33%] Built target unary_ops
[ 33%] Built target gather_axis
[ 33%] Built target scatter_axis
[ 33%] Built target masked_scatter
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/ring.cpp:3:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/ring.h:6:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.cpp:3:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.h:6:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh_impl.h:8:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:121: jaccl/CMakeFiles/jaccl.dir/jaccl/ring.cpp.o] Error 1
make[3]: *** Waiting for unfinished jobs....
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:107: jaccl/CMakeFiles/jaccl.dir/jaccl/mesh.cpp.o] Error 1
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.cpp:8:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:93: jaccl/CMakeFiles/jaccl.dir/jaccl/rdma.cpp.o] Error 1
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/jaccl.cpp:9:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh.h:6:
In file included from /Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/mesh_impl.h:8:
/Users/admin/go/src/ollama/build/_deps/mlx-src/mlx/distributed/jaccl/lib/jaccl/rdma.h:5:10: fatal error: 'infiniband/verbs.h' file not found
    5 | #include <infiniband/verbs.h>
      |          ^~~~~~~~~~~~~~~~~~~~
1 error generated.
make[3]: *** [jaccl/CMakeFiles/jaccl.dir/build.make:135: jaccl/CMakeFiles/jaccl.dir/jaccl/jaccl.cpp.o] Error 1
make[2]: *** [CMakeFiles/Makefile2:729: jaccl/CMakeFiles/jaccl.dir/all] Error 2
make[2]: *** Waiting for unfinished jobs....
[ 33%] Building mlx.metallib
[ 33%] Built target mlx-metallib
make[1]: *** [CMakeFiles/Makefile2:691: _deps/mlx-build/CMakeFiles/mlx.dir/rule] Error 2
make: *** [Makefile:221: mlx] Error 2

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

ollama - 💡(How to fix) Fix Build failure: infiniband/verbs.h not found when building MLX preset on macOS [2 comments, 2 participants]