You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
How to build the libllama.so file for Android? The .so file in this repository is for 64 bit machines and my Android phone is 32 bit. I would like to build a so file to work for my phone. Please share the steps to build a libllama.so file.
Thanks
The text was updated successfully, but these errors were encountered:
When I experimented with the app update here: #12
I found that it was not trivial to build llama.cpp using the Android 32 bit toolchain. It was making too many assumptions around aarch64 with the neon optimizations etc. Not sure if that situation has improved in recent months.
32bit android phones would be way to weak in any case
Could run, but probably not even 7B models (max 4gb ram while android uses 2+gb), and would be minutes per tokens
Hi,
How to build the libllama.so file for Android? The .so file in this repository is for 64 bit machines and my Android phone is 32 bit. I would like to build a so file to work for my phone. Please share the steps to build a libllama.so file.
Thanks
The text was updated successfully, but these errors were encountered: