We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cd /workspace/Pai-Megatron-Patch/examples/llava/ sh run_pretrain_megatron_llava.sh dsw /workspace/Pai-Megatron-Patch 7B 4 32 1e-3 1e-4 2048 2048 0 bf16 1 1 sel true true true true 100000 /workspace/data/LLaVA-Pretrain/blip_laion_cc_sbu_558k.json /workspace/model_ckpts/vicuna-7b-v1.5-to-mg-tp1-pp1 10000000000 100000000 /workspace/output_patch_test
The text was updated successfully, but these errors were encountered:
您好,在run_pretrain_megatron_llava.sh下面加一个--dataset LLava-Pretrain-Raw 试试
Sorry, something went wrong.
No branches or pull requests
cd /workspace/Pai-Megatron-Patch/examples/llava/
sh run_pretrain_megatron_llava.sh
dsw
/workspace/Pai-Megatron-Patch
7B
4
32
1e-3
1e-4
2048
2048
0
bf16
1
1
sel
true
true
true
true
100000
/workspace/data/LLaVA-Pretrain/blip_laion_cc_sbu_558k.json
/workspace/model_ckpts/vicuna-7b-v1.5-to-mg-tp1-pp1
10000000000
100000000
/workspace/output_patch_test
The text was updated successfully, but these errors were encountered: