From 54af1ddd030a237d38709568e08796f5ba248daf Mon Sep 17 00:00:00 2001 From: gongjy <2474590974@qq.com> Date: Tue, 10 Sep 2024 21:27:10 +0800 Subject: [PATCH] update readme --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 3d9420c..5705574 100644 --- a/README.md +++ b/README.md @@ -193,13 +193,13 @@ streamlit run fast_inference.py 🍭 【Tip】预训练和全参微调pretrain和full_sft均支持多卡加速 -* 单机N卡启动训练(ddp) +* 单机N卡启动训练(DDP) ```bash torchrun --nproc_per_node N 1-pretrain.py # and torchrun --nproc_per_node N 3-full_sft.py ``` -* 单机N卡启动训练(deepspeed) +* 单机N卡启动训练(DeepSpeed) ```bash deepspeed --master_port 29500 --num_gpus=N 1-pretrain.py # and