iomgaa/Minimind
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

在两个sh文件中设置knowlwdge_num与knowlwdge_length

Browse Source
This commit is contained in:
Jax922 2025-05-14 00:26:12 +08:00
parent 7a0ac5a639
commit 21f3c8099e
2 changed files with 6 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
run_file/DynamicKV-LLM_Mini_Minimind.sh
View File

@ -44,4 +44,6 @@ CUDA_VISIBLE_DEVICES=0 accelerate launch \
--max_seq_len 512 \ --max_seq_len 512 \
--use_flash_attn \ --use_flash_attn \
--profile \ --profile \
--profile_interval 10 --profile_interval 10\
--knowlwdge_num 64*64 \
--knowlwdge_length 8

4
run_file/DynamicKV-LLM_Small_Minimind.sh
View File

@ -45,4 +45,6 @@ CUDA_VISIBLE_DEVICES=0,1,2,3 accelerate launch \
--max_seq_len 1024 \ --max_seq_len 1024 \
--use_flash_attn \ --use_flash_attn \
--profile \ --profile \
--profile_interval 10 --profile_interval 10\
--knowlwdge_num 32*32 \
--knowlwdge_length 8