Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Building libllama.so file for Android #16

Open
abusaadp opened this issue Aug 1, 2023 · 2 comments
Open

Building libllama.so file for Android #16

abusaadp opened this issue Aug 1, 2023 · 2 comments

Comments

@abusaadp
Copy link

abusaadp commented Aug 1, 2023

Hi,
How to build the libllama.so file for Android? The .so file in this repository is for 64 bit machines and my Android phone is 32 bit. I would like to build a so file to work for my phone. Please share the steps to build a libllama.so file.

Thanks

@dsd
Copy link

dsd commented Aug 30, 2023

When I experimented with the app update here: #12
I found that it was not trivial to build llama.cpp using the Android 32 bit toolchain. It was making too many assumptions around aarch64 with the neon optimizations etc. Not sure if that situation has improved in recent months.

@Foul-Tarnished
Copy link

Foul-Tarnished commented Aug 31, 2023

32bit android phones would be way to weak in any case
Could run, but probably not even 7B models (max 4gb ram while android uses 2+gb), and would be minutes per tokens

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants