Unable to install Erlang/OTP 27.1 and 26.2.5.3 on Apple Silicon macOS and Xcode 16.0 #319

zacky1972 · 2024-09-18T18:15:34Z

Hi,

I tried to build Erlang/OTP 27.1 on Apple Silicon macOS Sonoma and Sequoia, but got the following error:

In file included from sys/unix/erl_unix_sys.h:65:
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/unistd.h:525:10: fatal error: cannot open file 'aarch64-apple-darwin24.0.0/opt/jit/_ctermid.h': Too many open files
  525 | #include <_ctermid.h>
      |          ^
1 error generated.
make[4]: *** [obj/aarch64-apple-darwin24.0.0/opt/jit/beam_asm_module.o] Error 1
make[4]: *** Waiting for unfinished jobs....
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [jit] Error 2
make: *** [emulator] Error 2

zacky1972 · 2024-09-18T18:26:12Z

The new Xcode (16.0) on Apple Silicon may be the culprit, because building Erlang/OTP 26.2.5.3 on Apple Silicon Sequoia also failed.

mlooney · 2024-09-18T18:27:17Z

similar issue here, but with different error:

In file included from aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/globals.h:9:
aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/../core/api-config.h:45:10: fatal error: 'initializer_list' file not found
   45 | #include <initializer_list>
      |          ^~~~~~~~~~~~~~~~~~
1 error generated.
make[4]: *** [aarch64-apple-darwin24.0.0/opt/jit/asmjit/asmjit.hpp.gch] Error 1
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [jit] Error 2
make: *** [emulator] Error 2

The header file on my system is found in the llvm & gcc flavors:

 find /opt -name initializer_list\*
/opt/homebrew/Cellar/llvm/18.1.8/include/c++/v1/initializer_list
/opt/homebrew/Cellar/llvm/18.1.8/share/libc++/v1/std/initializer_list.inc
/opt/homebrew/Cellar/gcc/14.2.0/include/c++/14/initializer_list
/opt/homebrew/Cellar/gcc/13.2.0/include/c++/13/initializer_list

Also fails for otp-26 builds, complaining about a different header file

In file included from aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/globals.h:9:
aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/../core/api-config.h:42:10: fatal error: 'iterator' file not found
   42 | #include <iterator>
        |          ^~~~~~~~~~
1 error generated.
make[4]: *** [aarch64-apple-darwin24.0.0/opt/jit/asmjit/asmjit.hpp.gch] Error 1
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [jit] Error 2
make: *** [emulator] Error 2

I assume the Xcode tool update is the culprit as well.

mlooney · 2024-09-19T15:37:53Z

fatal error: cannot open file 'aarch64-apple-darwin24.0.0/opt/jit/_ctermid.h': Too many open files

@zacky1972 this seems to be your issue, which is different than mine. make sure your system isn't running out of file handles (you may need to tweak your kernel, or shut down some processes etc)

BlueHotDog · 2024-09-22T08:37:47Z

hello folks, anyone managed to overcome this?

chulkilee · 2024-09-23T06:43:59Z

Hitting similar error:

/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/unistd.h:525:10: fatal error: cannot open file 'aarch64-apple-darwin24.0.0/opt/jit/_ctermid.h': Too many open files
  525 | #include <_ctermid.h>
      |          ^
1 error generated.
make[4]: *** [obj/aarch64-apple-darwin24.0.0/opt/jit/beam_asm_module.o] Error 1

Environment info:

$ which gcc
/usr/bin/gcc

$ gcc --version
Apple clang version 16.0.0 (clang-1600.0.26.3)
Target: arm64-apple-darwin24.0.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

$ clang --version
Apple clang version 16.0.0 (clang-1600.0.26.3)
Target: arm64-apple-darwin24.0.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

zacky1972 · 2024-09-23T08:11:22Z

@mlooney No, its' not my issue, because I tried to build it just after rebooting my Mac, but I couldn't build it with similar messages:

% asdf install erlang latest
asdf_27.1 is not a kerl-managed Erlang/OTP installation
The asdf_27.1 build has been deleted
Extracting source code
Building Erlang/OTP 27.1 (asdf_27.1), please wait...
APPLICATIONS DISABLED (See: /Users/zacky/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1/otp_build_27.1.log)
 * odbc           : ODBC library - link check failed

Build failed.
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/unistd.h:525:10: fatal error: cannot open file 'aarch64-apple-darwin24.0.0/opt/jit/_ctermid.h': Too many open files
  525 | #include <_ctermid.h>
      |          ^
1 error generated.
make[4]: *** [obj/aarch64-apple-darwin24.0.0/opt/jit/beam_asm_module.o] Error 1
make[4]: *** Waiting for unfinished jobs....
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [jit] Error 2
make: *** [emulator] Error 2

Please see /Users/zacky/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1/otp_build_27.1.log for full details.
Removing all artifacts except the logfile
(Use KERL_AUTOCLEAN=0 to keep build on failure, if desired)
Cleaning up compilation products for asdf_27.1
Cleaned up compilation products for asdf_27.1 under /Users/zacky/.asdf/plugins/erlang/kerl-home/builds

obieewan · 2024-09-23T09:08:19Z

Hello, I encountered the same problem. I resolved it by doing these steps.

I uninstalled xcode by following these commands:
https://mac.install.guide/commandlinetools/6

After that I ran these commands cleaning up my environment.
asdf uninstall erlang <version>
asdf uninstall elixir <version>
rm -rf .asdf/
brew uninstall asdf

Then, I tried to re-install asdf with homebrew but it requires me to reinstall xcode so I reinstall xcode again by running this command: xcode-select --install

After installation
I installed asdf with homebrew: brew install asdf

Installed plugin Elixir: asdf plugin-add elixir https://github.com/asdf-vm/asdf-elixir.git
Installed plugin Erlang: asdf plugin-add erlang https://github.com/asdf-vm/asdf-erlang.git

Installed erlang: asdf install erlang 27.1
Installed elixir: asdf install elixir 1.17.3-otp-27
set global erlang: asdf global erlang 1.17.3-otp-27
set global elixir : asdf global elixir 1.17.3-otp-27

Then I go to my project directory and run mix assets.deploy and mix phx.server and it worked. Hope this helps.

haavars · 2024-09-23T09:49:55Z

I encountered the same issue on Apple Silicon with Xcode 16.0. A temporary fix that worked for me was adjusting the ulimit to increase the number of allowed open files. Here’s what I did:

Open terminal.
Run ulimit -n 65536 to increase the limit.
Retry the installation.

This is a temporary solution, and if needed, the change can be made permanent by modifying system configuration files.

Hope this helps!

zacky1972 · 2024-09-23T11:13:54Z

@haavars Thanks! I did install according to your approach!!!

redac · 2024-09-24T08:19:48Z

I'm getting a different error on Apple Silicon with Xcode 16.0, any ideas?

Extracting source code
Building Erlang/OTP 27.1 (asdf_27.1), please wait...
APPLICATIONS DISABLED (See: /Users/redacted/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1/otp_build_27.1.log)
 * jinterface     : No Java compiler found
 * odbc           : ODBC library - link check failed

APPLICATIONS INFORMATION (See: /Users/redacted/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1/otp_build_27.1.log)
 * wx             : wxWidgets was not compiled with --enable-webview or wxWebView developer package is not installed, wxWebView will NOT be available
 * wxWidgets was not compiled with --enable-compat30, wx will NOT be useable
 * wxWidgets don't have gl support, wx will NOT be useable
 * Can not link wx program are all developer packages installed?

Build failed.
In file included from aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/globals.h:9:
aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/../core/api-config.h:45:10: fatal error: 'initializer_list' file not found
   45 | #include <initializer_list>
      |          ^~~~~~~~~~~~~~~~~~
1 error generated.
make[4]: *** [aarch64-apple-darwin24.0.0/opt/jit/asmjit/asmjit.hpp.gch] Error 1
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [jit] Error 2
make: *** [emulator] Error 2

obieewan · 2024-09-24T08:36:10Z

I'm getting a different error on Apple Silicon with Xcode 16.0, any ideas?

Extracting source code
Building Erlang/OTP 27.1 (asdf_27.1), please wait...
APPLICATIONS DISABLED (See: /Users/redacted/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1/otp_build_27.1.log)
 * jinterface     : No Java compiler found
 * odbc           : ODBC library - link check failed

APPLICATIONS INFORMATION (See: /Users/redacted/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1/otp_build_27.1.log)
 * wx             : wxWidgets was not compiled with --enable-webview or wxWebView developer package is not installed, wxWebView will NOT be available
 * wxWidgets was not compiled with --enable-compat30, wx will NOT be useable
 * wxWidgets don't have gl support, wx will NOT be useable
 * Can not link wx program are all developer packages installed?

Build failed.
In file included from aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/globals.h:9:
aarch64-apple-darwin24.0.0/opt/jit/asmjit/./core/../core/../core/../core/../core/api-config.h:45:10: fatal error: 'initializer_list' file not found
   45 | #include <initializer_list>
      |          ^~~~~~~~~~~~~~~~~~
1 error generated.
make[4]: *** [aarch64-apple-darwin24.0.0/opt/jit/asmjit/asmjit.hpp.gch] Error 1
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [jit] Error 2
make: *** [emulator] Error 2

If running ulimit -n 65536 didn't worked. You can try this #319 (comment). Don't update your xcode until issue is resolved.

jdsampayo · 2024-09-25T03:20:27Z

@redac I encountered the same issue ('initializer_list' file not found). I can confirm that reinstalling Xcode Command Line Tools resolved it. I followed these instructions to uninstall and then reinstall.

m13m · 2024-10-07T10:56:29Z

reinstalling xcode fixed the issue for me i have M1 Pro

ansd · 2024-10-08T07:10:12Z

Same for me.

On Apple M2 Pro, Sonoma 14.7, kerl 4.3.0 (without using any asdf)

kerl build-install 27.1.1

resulted in:

In file included from aarch64-apple-darwin23.6.0/opt/jit/asmjit/asmjit.hpp:27:
In file included from aarch64-apple-darwin23.6.0/opt/jit/asmjit/./core.h:1932:
In file included from aarch64-apple-darwin23.6.0/opt/jit/asmjit/./core/archtraits.h:9:
In file included from aarch64-apple-darwin23.6.0/opt/jit/asmjit/./core/../core/operand.h:9:
In file included from aarch64-apple-darwin23.6.0/opt/jit/asmjit/./core/../core/../core/archcommons.h:13:
In file included from aarch64-apple-darwin23.6.0/opt/jit/asmjit/./core/../core/../core/../core/globals.h:9:
aarch64-apple-darwin23.6.0/opt/jit/asmjit/./core/../core/../core/../core/../core/api-config.h:45:10: fatal error: 'initializer_list' file not found
   45 | #include <initializer_list>
      |          ^~~~~~~~~~~~~~~~~~
1 error generated.
gmake[4]: *** [aarch64-apple-darwin23.6.0/Makefile:958: aarch64-apple-darwin23.6.0/opt/jit/asmjit/asmjit.hpp.gch] Error 1
gmake[4]: Leaving directory '/Users/dansari/.kerl/builds/27.1.1/otp_src_27.1.1/erts/emulator'
gmake[3]: *** [/Users/dansari/.kerl/builds/27.1.1/otp_src_27.1.1/make/run_make.mk:35: opt] Error 2
gmake[3]: Leaving directory '/Users/dansari/.kerl/builds/27.1.1/otp_src_27.1.1/erts/emulator'
gmake[2]: *** [Makefile:45: opt] Error 2
gmake[2]: Leaving directory '/Users/dansari/.kerl/builds/27.1.1/otp_src_27.1.1/erts'
gmake[1]: *** [Makefile:60: jit] Error 2
gmake[1]: Leaving directory '/Users/dansari/.kerl/builds/27.1.1/otp_src_27.1.1/erts'
gmake: *** [Makefile:483: emulator] Error 2

Re-installing xcode fixed this issue.

jbcaprell · 2024-10-18T13:08:53Z

It seems like reinstalling Xcode fixes this for a while, asterisk. When installing asdf_27.1.1 weeks back, I encountered the error, re-installed Xcode, and things were right-as-rain. When I tried to install asdf_27.1.2 this morning, though, I hit the same wall.

That said, this is also on the other side of updating macOS from one 15.1 Beta build to another, so it may be that some interplay between updating macOS and Xcode is the culprit?

Edit: Bumping the file descriptor limit temporarily via ulimit still works in this scenario, obv.

imcosta · 2024-11-01T13:58:42Z

Hello! 👋 I'm getting a different error with OTP 27.1.2 on Apple M3 Max with Sequoia:

❯ KERL_CONFIGURE_OPTIONS="--disable-parallel-configure" asdf install erlang 27.1.2

ERROR: 'asdf_27.1.2' is not a kerl-managed Erlang/OTP installation.
Build 'asdf_27.1.2' has been deleted.
Extracting source code for normal build...
Building (normal) Erlang/OTP 27.1.2 (asdf_27.1.2); please wait...
Initializing (build) log file at /Users/imcosta/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1.2/otp_build_27.1.2.log.
Attempting to use Homebrew OpenSSL from /usr/local/opt/[email protected]...
... found!
APPLICATIONS DISABLED (See: /Users/imcosta/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1.2/otp_build_27.1.2.log)
 * jinterface     : No Java compiler found
 * odbc           : ODBC library - link check failed

APPLICATIONS INFORMATION (See: /Users/imcosta/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1.2/otp_build_27.1.2.log)
 * wx             : wxWidgets was not compiled with --enable-webview or wxWebView developer package is not installed, wxWebView will NOT be available
 * Can not link wx program are all developer packages installed?

ERROR: build failed.
=== Leaving application mnesia
=== Entering application crypto
make[3]: Nothing to be done for `opt'.
 MAKE   opt
make[4]: aarch64-apple-darwin24.0.0/Makefile: No such file or directory
make[4]: *** No rule to make target `aarch64-apple-darwin24.0.0/Makefile'.  Stop.
make[3]: *** [opt] Error 2
make[2]: *** [opt] Error 2
make[1]: *** [opt] Error 2
make: *** [libs] Error 2

I tried different things:

Reinstall Xcode Command Line Tools following this
Change ulimits
Use CPP=cpp EGREP=egrep KERL_CONFIGURE_OPTIONS="--enable-darwin-64bit --disable-parallel-configure"
Remove the --disable-parallel-configure but in that case I got a different error:

checking for OpenSSL header in /usr/local/opt/[email protected]... yes
checking for OpenSSL in /usr/local/opt/[email protected]... configure: error: neither static nor dynamic crypto library found in /usr/local/opt/[email protected]
ERROR: /Users/imcosta/.asdf/plugins/erlang/kerl-home/builds/asdf_27.1.2/otp_src_27.1.2/lib/crypto/configure failed!

At this point I don't know what to do. Any ideas? Thanks!

prodis · 2024-11-06T09:30:46Z

I solved my Erlang installation with the following:

$ KERL_CONFIGURE_OPTIONS="--disable-jit" asdf install erlang 25.1.2

Refernce: erlang/otp#7687 (comment)

conradwt · 2024-11-07T06:52:23Z

This is an odd issue because I do not see this issue on my Intel MacBook Pro 11.7 (Big Sur). Here are my findings:

Intel MacBook Pro using Apple Terminal app

➜ ulimit -n 
256
➜ sysctl -a | grep maxfiles
kern.maxfiles: 49152
kern.maxfilesperproc: 24576

asdf install erlang 26.2.5.5 (SUCCESS)
asdf install erlang 27.1.2 (SUCCESS)

Apple Silicon MacBook Pro using Apple Terminal app

➜ ulimit -n 
256
➜ sysctl -a | grep maxfiles
kern.maxfiles: 491520
kern.maxfilesperproc: 245760

asdf install erlang 26.2.5.5 (FAILURE)
asdf install erlang 27.1.2 (FAILURE)

Apple Silicon MacBook Pro using Warp terminal app

➜ ulimit -n
2560
➜ sysctl -a | grep maxfiles
kern.maxfiles: 491520
kern.maxfilesperproc: 245760

asdf install erlang 26.2.5.5 (SUCCESS)
asdf install erlang 27.1.2 (SUCCESS)

This appears to be an issue with the number of default file descriptors on the Terminal app. When I switched the terminal app to Warp, the issue, 'Too many open files', disappeared.

Finally, I did file an issue via the Feedback Assistant app.

kasvith · 2024-11-09T09:02:19Z

I encountered the same issue on Apple Silicon with Xcode 16.0. A temporary fix that worked for me was adjusting the ulimit to increase the number of allowed open files. Here’s what I did:

Open terminal.

Run ulimit -n 65536 to increase the limit.

Retry the installation.

This is a temporary solution, and if needed, the change can be made permanent by modifying system configuration files.

Hope this helps!

this worked for me

shribe · 2024-11-09T21:12:26Z

ulimit worked for me as well, with 27.1.2, on macOS Sonoma 14.7.1, Xcode 15

zacky1972 · 2024-11-10T04:25:52Z

My friend succeeded to install Erlang/OTP 27.1.2 to M4 Mac mini.

- macOS Sequoia에서 erlang 26 빌드 실패 - erlang 26이 안정화 될때까지 25를 사용해도 지장 없음 - asdf-vm/asdf-erlang#319 - 비슷한 문제를 겪는 사람들

jeramyRR · 2024-12-08T17:18:30Z

Running ulimit -n 65536 worked for me as well, Sequoia 15.1.1, Xcode 16.1

conradwt · 2024-12-09T00:47:31Z

I'm no longer having build issues with macOS 15.1.1 and Xcode 16.1. For example,

Apple Silicon MacBook Pro using Apple Terminal app

➜ ulimit -n 
256
➜ sysctl -a | grep maxfiles
kern.maxfiles: 491520
kern.maxfilesperproc: 245760

asdf install erlang 26.2.5.6 (SUCCESS)
asdf install erlang 27.1.3 (SUCCESS)

zacky1972 changed the title ~~Unable to install Erlang/OTP 27.1 on Apple Silicon macOS~~ Unable to install Erlang/OTP 27.1 and 26.2.5.3 on Apple Silicon macOS and Xcode 16.0 Sep 18, 2024

Napolskih mentioned this issue Nov 19, 2024

Can't install Erlang-24 due to openssl issues kerl/kerl#371

Closed

This was referenced Dec 8, 2024

Too slow parallel execution with :crypto.strong_rand_bytes/1 erlef/otp_builds#41

Open

fix: issue on building with Xcode 16.0+ erlef/otp_builds#42

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unable to install Erlang/OTP 27.1 and 26.2.5.3 on Apple Silicon macOS and Xcode 16.0 #319

Unable to install Erlang/OTP 27.1 and 26.2.5.3 on Apple Silicon macOS and Xcode 16.0 #319

zacky1972 commented Sep 18, 2024

zacky1972 commented Sep 18, 2024

mlooney commented Sep 18, 2024 •

edited

Loading

mlooney commented Sep 19, 2024 •

edited

Loading

BlueHotDog commented Sep 22, 2024

chulkilee commented Sep 23, 2024

zacky1972 commented Sep 23, 2024 •

edited

Loading

obieewan commented Sep 23, 2024 •

edited

Loading

haavars commented Sep 23, 2024

zacky1972 commented Sep 23, 2024

redac commented Sep 24, 2024

obieewan commented Sep 24, 2024 •

edited

Loading

jdsampayo commented Sep 25, 2024

m13m commented Oct 7, 2024

ansd commented Oct 8, 2024

jbcaprell commented Oct 18, 2024 •

edited

Loading

imcosta commented Nov 1, 2024

prodis commented Nov 6, 2024 •

edited

Loading

conradwt commented Nov 7, 2024

kasvith commented Nov 9, 2024

shribe commented Nov 9, 2024

zacky1972 commented Nov 10, 2024

jeramyRR commented Dec 8, 2024

conradwt commented Dec 9, 2024 •

edited

Loading

Unable to install Erlang/OTP 27.1 and 26.2.5.3 on Apple Silicon macOS and Xcode 16.0 #319

Unable to install Erlang/OTP 27.1 and 26.2.5.3 on Apple Silicon macOS and Xcode 16.0 #319

Comments

zacky1972 commented Sep 18, 2024

zacky1972 commented Sep 18, 2024

mlooney commented Sep 18, 2024 • edited Loading

mlooney commented Sep 19, 2024 • edited Loading

BlueHotDog commented Sep 22, 2024

chulkilee commented Sep 23, 2024

zacky1972 commented Sep 23, 2024 • edited Loading

obieewan commented Sep 23, 2024 • edited Loading

haavars commented Sep 23, 2024

zacky1972 commented Sep 23, 2024

redac commented Sep 24, 2024

obieewan commented Sep 24, 2024 • edited Loading

jdsampayo commented Sep 25, 2024

m13m commented Oct 7, 2024

ansd commented Oct 8, 2024

jbcaprell commented Oct 18, 2024 • edited Loading

imcosta commented Nov 1, 2024

prodis commented Nov 6, 2024 • edited Loading

conradwt commented Nov 7, 2024

kasvith commented Nov 9, 2024

shribe commented Nov 9, 2024

zacky1972 commented Nov 10, 2024

jeramyRR commented Dec 8, 2024

conradwt commented Dec 9, 2024 • edited Loading

mlooney commented Sep 18, 2024 •

edited

Loading

mlooney commented Sep 19, 2024 •

edited

Loading

zacky1972 commented Sep 23, 2024 •

edited

Loading

obieewan commented Sep 23, 2024 •

edited

Loading

obieewan commented Sep 24, 2024 •

edited

Loading

jbcaprell commented Oct 18, 2024 •

edited

Loading

prodis commented Nov 6, 2024 •

edited

Loading

conradwt commented Dec 9, 2024 •

edited

Loading