Skip to content

llm_bench crashed with opencl backend #3502

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
franklei01 opened this issue May 7, 2025 · 1 comment
Open

llm_bench crashed with opencl backend #3502

franklei01 opened this issue May 7, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@franklei01
Copy link

Hi, I have just quickly tried new introduced llm_bench with latest version (16bc909) on Android (vivo x200 pro and xiaomi 15), and it works fine for cpu backend, but crashed for opencl backend during tg128 test.

Command to build MNN:

/path/to/build_64.sh "-DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true -DMNN_ARM82=true -DMNN_OPENCL=true -DMNN_USE_LOGCAT=true"

Command to run llm_bench on Android:

/path/to/llm_bench -m /path/to/Qwen2-1.5B-Instruct-MNN/ -a opencl

Not sure if the issue is already tracked, hope this helps.

@jxt1234 jxt1234 added the bug Something isn't working label May 9, 2025
@jxt1234
Copy link
Collaborator

jxt1234 commented May 9, 2025

The bug has been fixed. Wait for sync.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants