iomgaa/Minimind
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update readme

Browse Source
This commit is contained in:
gongjy 2024-09-10 21:27:10 +08:00
parent 5908503449
commit 54af1ddd03
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -193,13 +193,13 @@ streamlit run fast_inference.py
🍭 【Tip】预训练和全参微调pretrain和full_sft均支持多卡加速 🍭 【Tip】预训练和全参微调pretrain和full_sft均支持多卡加速
* 单机N卡启动训练(ddp) * 单机N卡启动训练(DDP)
```bash ```bash
torchrun --nproc_per_node N 1-pretrain.py torchrun --nproc_per_node N 1-pretrain.py
# and # and
torchrun --nproc_per_node N 3-full_sft.py torchrun --nproc_per_node N 3-full_sft.py
``` ```
* 单机N卡启动训练(deepspeed) * 单机N卡启动训练(DeepSpeed)
```bash ```bash
deepspeed --master_port 29500 --num_gpus=N 1-pretrain.py deepspeed --master_port 29500 --num_gpus=N 1-pretrain.py
# and # and