217 Commits

Author SHA1 Message Date
gongjy
a8ae342775 Update data preprocessing methods 2024-09-27 16:19:30 +08:00
gongjy
d57037624b update batchsize 2024-09-25 12:35:29 +08:00
gongjy
89d260145f fix dtype bug 2024-09-25 10:07:30 +08:00
jingyaogong
13105cfa0c
Merge pull request #44 from iomgaa-ycz/wandb
修复wandb bug & 添加了argparse
2024-09-24 14:10:05 +08:00
jingyaogong
5dd4e15aa2
Merge branch 'master' into wandb 2024-09-24 14:09:54 +08:00
d7a056a545 更新了ReadMe 2024-09-24 12:45:21 +08:00
51dcf51c5d 添加了argparse,方便命令行输入参数 2024-09-24 12:41:58 +08:00
ef9a592d14 修复了wandb的bug,避免了多次产生项目 2024-09-24 11:43:30 +08:00
gongjy
7947fa17fb update wandb monitor 2024-09-23 22:16:21 +08:00
gongjy
235b6c6fd3 update wandb monitor 2024-09-23 22:14:52 +08:00
jingyaogong
15f8242ba7
Merge pull request #43 from iomgaa-ycz/wandb
use wandb to monitor training process
2024-09-23 21:54:48 +08:00
06a66d88c9 添加了wandb 2024-09-23 20:11:45 +08:00
gongjy
b4359b3335 fix data_process bug 2024-09-23 20:11:19 +08:00
jingyaogong
5f8279f661
Merge pull request #42 from iomgaa-ycz/wandb
修复data_process.py文件追加的bug
2024-09-23 20:08:13 +08:00
0fa4d17d26 更新了忽视列表 2024-09-23 18:36:04 +08:00
6fb569abd8 修复了process_seq_monkey写入错误的bug 2024-09-23 18:34:58 +08:00
gongjy
bf64ffb056 update data_process 2024-09-22 21:17:05 +08:00
gongjy
8ff2ccae4c update readme 2024-09-22 14:49:05 +08:00
gongjy
d41b39c88c update readme 2024-09-22 14:45:37 +08:00
gongjy
cbdea6bd9f update readme 2024-09-21 23:11:02 +08:00
gongjy
7115a98453 update data_process Chunk_size Read 2024-09-21 22:57:22 +08:00
gongjy
6759da45c1 update model mask 2024-09-21 20:00:25 +08:00
gongjy
02297df3c1 Efficient implementation of Inference KV cache 2024-09-21 00:01:05 +08:00
gongjy
0cd7d4b2c2 update readme 2024-09-20 21:21:25 +08:00
gongjy
b969382f0a update readme 2024-09-20 21:19:59 +08:00
gongjy
6c1118ab86 update readme 2024-09-20 21:15:55 +08:00
gongjy
19523a121f update readme 2024-09-20 21:15:14 +08:00
gongjy
1c493e8c2a update readme 2024-09-20 20:33:46 +08:00
gongjy
9093519c37 Updated some explanations 2024-09-20 17:07:51 +08:00
gongjy
39423c6a14 Updated some explanations 2024-09-20 17:05:50 +08:00
gongjy
ee218402cd update some explain of the code 2024-09-20 17:04:16 +08:00
jingyaogong
b4170e3766
Merge pull request #34 from chuanzhubin/master
对主要代码添加逐行注释,方便学习者快速理解
2024-09-20 16:51:32 +08:00
jingyaogong
95b1ee8175
Merge branch 'master' into master 2024-09-20 16:51:03 +08:00
gongjy
c81c17dab7 update others 2024-09-19 09:35:02 +08:00
gongjy
48ea6a4cbf update readme 2024-09-19 09:32:31 +08:00
gongjy
c28664dac8 update minimind-v1-moe 2024-09-18 23:51:56 +08:00
Ben
2dceaf4a92 添加注释,方便学习者快速理解 2024-09-18 21:53:39 +08:00
gongjy
61cb61a46a update minimind-v1-moe 2024-09-17 11:33:31 +08:00
gongjy
c404941677 add accumulation_grad for pretrain 2024-09-16 20:58:46 +08:00
gongjy
8c18b324d0 update model 2024-09-16 16:59:52 +08:00
gongjy
e4ad822c40 update model 2024-09-16 15:29:57 +08:00
gongjy
e1f68b5e37 update readme 2024-09-16 09:31:44 +08:00
gongjy
3db31aeba3 update readme 2024-09-16 09:29:40 +08:00
gongjy
07150c7b57 update readme 2024-09-15 22:58:40 +08:00
gongjy
5000e2e30a update contributor 2024-09-15 20:59:52 +08:00
gongjy
846b37d6f4 update contributor 2024-09-15 18:13:52 +08:00
jingyaogong
30b498f0c3
Merge pull request #29 from chuanzhubin/master
Update my_openai_api.py 忽略客户端传来的未知字段
2024-09-15 17:34:57 +08:00
Ben
f5966fe69e
Update my_openai_api.py 忽略客户端传来的未知字段
像dify这样的客户端,会传入一个用户序列号, 需要兼容一下,避免报错.
```
request.json={'model': 'minimind-small-T', 'stream': True, 'temperature': 0.7, 'messages': [{'role': 'user', 'content': '1'}], 'user': 'cdc1f28b-4bb3-4326-ac4b-1cf78e0a6a3b'}
```
2024-09-15 07:37:24 +00:00
gongjy
16928c1231 update some config 2024-09-15 15:12:47 +08:00
gongjy
aa5d70321f update config 2024-09-15 15:09:21 +08:00