Commit Graph

Select branches

Hide Pull Requests

Gary_Lu

cy

init_test

master

old/HPC

old/SLM

old/lzn

old/master

pretrain

triple-extraction

archive/HPC

archive/SLM

archive/original/model

Mono Color

• 3d69ae866e Experiment 1.4.10 pretrain Aurora 2025-09-11 00:10:08 +08:00
• e06f94b5f5 update iomgaa 2025-09-07 22:41:30 +08:00
• 8379b45d80 update iomgaa 2025-09-06 18:34:17 +08:00
• b5dcf0c576 update iomgaa 2025-09-06 18:29:32 +08:00
• 7b42ea2f93 update iomgaa 2025-09-06 18:16:46 +08:00
• 8cbcbb9367 update Aurora 2025-09-06 17:57:33 +08:00
• 3e0477fd79 update iomgaa 2025-09-06 17:25:46 +08:00
• b27334f5b1 update iomgaa 2025-09-06 17:06:12 +08:00
• 57138a5a79 Merge branch 'pretrain' of ssh://110.42.53.85:222/iomgaa/Minimind into pretrain iomgaa 2025-09-06 17:00:30 +08:00
• 1ca2f10e65 update iomgaa 2025-09-06 16:59:08 +08:00
• 6590cef358 Merge branch 'pretrain' of http://110.42.53.85:3000/iomgaa/Minimind into pretrain Aurora 2025-09-06 16:17:25 +08:00
• 654fa17923 update Aurora 2025-09-06 16:17:22 +08:00
• f33476bc76 update iomgaa 2025-09-06 16:16:12 +08:00
• 2f6995d667 update iomgaa 2025-09-06 15:12:05 +08:00
• cb3152dc94 update iomgaa 2025-09-06 12:12:08 +08:00
• afd4fd1f0f Experiment 1.4.9: Memory Bank优化 - 顺序冻结 + 相似度Loss + 维度修复 iomgaa 2025-09-05 14:24:48 +08:00
• c4c72ac154 Clean up temporary debugging and analysis files Yu Chengzhang 2025-09-01 15:40:49 +08:00
• 495fc412cd Experiment 1.4.8: Memory Bank多样性检查 + knowledge_num优化 Yu Chengzhang 2025-09-01 15:35:14 +08:00
• e00df32e55 update Yu Chengzhang 2025-08-20 13:46:42 +08:00
• 5bb71e3fad Update dependencies: add superclaude package Yu Chengzhang 2025-08-19 19:33:10 +08:00
• 44fe6259ec Experiment 1.4.7: Memory Bank文本初始化 + 部分冻结机制 Yu Chengzhang 2025-08-19 19:32:52 +08:00
• cf9acb2064 Experiment 1.4.6: Token-based Memory架构实现 Yu Chengzhang 2025-08-14 23:04:52 +08:00
• d07c2aa2e6 Experiment 1.4.6: Token-based Memory架构实现 Yu Chengzhang 2025-08-12 11:07:23 +08:00
• a7fe947a35 Experiment 1.4.5:使用VQ-VAE的EMA来更新数据库 Yu Chengzhang 2025-08-09 10:47:35 +08:00
• 9244d47c39 Experiment 1.4.4:负载平衡有效 Yu Chengzhang 2025-08-07 11:51:55 +08:00
• e61d92c4bc Experiment 1.4.4:负载平衡有效 Yu Chengzhang 2025-08-07 11:43:23 +08:00
• fcdbd220a8 Experiment 1.4.3:极度过拟合 Yu Chengzhang 2025-08-06 11:55:36 +08:00
• 57d6d768e1 Experiment 1.4.2: 门控MLP融合串型连接验证连接方式对记忆库性能的影响 Yu Chengzhang 2025-08-04 20:11:52 +08:00
• bba325ef7e Experiment 1_4_1 Yu Chengzhang 2025-08-03 14:25:26 +08:00
• c0424644f5 Experiment_1_4_0 Yu Chengzhang 2025-08-01 15:54:21 +08:00
• d9d281967e 修复了一些bug master Yu Chengzhang 2025-07-17 12:06:28 +08:00
• d701003f8a pretrain过程中会打印10个token以方便观察 Yu Chengzhang 2025-07-17 00:05:34 +08:00
• 2797b76939 experiment_1.3.0-1.3.2 Yu Chengzhang 2025-07-13 21:28:46 +08:00
• 5e464bbd3f 添加了对于多种模型的支持 Yu Chengzhang 2025-07-12 18:00:53 +08:00
• 8e24730407 Merge remote-tracking branch 'origin/master' into triple-extraction triple-extraction Gary 2025-07-06 07:02:15 +00:00
• 75265f6652 使用分类来获取谓词 Yu Chengzhang 2025-07-05 22:18:32 +08:00
• 972b36e51a update Gary 2025-07-05 03:38:16 +00:00
• 77d298c3c6 update Gary 2025-07-05 03:03:43 +00:00
• ee7aaba91d update infer Gary 2025-07-02 12:46:37 +00:00
• 7ce71f24bc update Gary 2025-06-30 15:13:44 +00:00
• fcab661af9 更新了配置文件 Yu Chengzhang 2025-06-30 19:51:07 +08:00
• 31eff0e3de 更新了两个模型 Yu Chengzhang 2025-06-30 18:54:42 +08:00
• 74e9293c9a DynamicKV-LLM Extra v1.0.0 Yu Chengzhang 2025-06-29 16:01:36 +08:00
• d6617702a5 DynamicKV-LLM Pretrain v1.2.2:新数据集；使用uv；消除内存泄漏 iomgaa 2025-06-25 20:27:28 +08:00
• a90209af5f Merge branch 'cy' of http://110.42.53.85:3000/iomgaa/Minimind into cy cy Cy 2025-06-17 13:07:22 +08:00
• 4b9c5e29ae modified by wcy Cy 2025-06-17 13:01:20 +08:00
• 770c34f0e3 DynamicKV-LLM Pretrain v1.2.1 iomgaa 2025-06-08 02:20:36 +00:00
• 1678e739b6 DynamicKV-LLM Pretrain v1.2.0 iomgaa 2025-06-07 02:41:45 +00:00
• 000e17a93f 修正了key分解、负载均衡等错误 iomgaa 2025-06-06 11:25:59 +08:00
• 47b120be3a 更新了key和value的更新方式 cy 2025-06-03 07:36:34 +00:00
• 7d726c5b20 添加直接语义匹配功能，优化数据库检索模块，支持实时计算和动态负载均衡 init_test iomgaa 2025-05-30 14:57:32 +08:00
• 0b53e1b951 数据库实现语义相关性优先 + 动态平衡 iomgaa 2025-05-29 23:59:08 +08:00
• 64e92473c3 数据初始化使用了缓存 iomgaa 2025-05-29 20:29:45 +08:00
• 6932e5fa8e 使用TREx数据集生成数据库初始化问题 iomgaa 2025-05-29 19:30:19 +08:00
• c5d0a3aba3 更新了忽视列表 iomgaa 2025-05-29 19:28:39 +08:00
• 67c632d010 update iomgaa 2025-05-27 11:46:18 +08:00
• c96a9c35d5 对数据库进行了初始化 iomgaa 2025-05-26 23:09:03 +08:00
• c09cd63794 基于trex数据集构建知识库单初始值预处理 iomgaa 2025-05-23 15:47:17 +08:00
• 45da3b383b DynamicKV-LLM Pretrain v1.1.2 Gary_Lu Jax922 2025-05-23 01:18:08 +08:00
• 00d3c24e03 构建了数据库解码模型 iomgaa 2025-05-22 11:32:15 +08:00
• feeccf733c DynamicKV-LLM Pretrain v1.1.1 Jax922 2025-05-22 10:05:31 +08:00
• 42e3d38a3f 使用变量代替固定值 Jax922 2025-05-21 08:14:36 +00:00
• d7fe504e1e update Gary 2025-05-16 08:38:59 +00:00
• 5841f8b4e5 DynamicKV-LLM Pretrain v1.1.0 Jax922 2025-05-14 00:42:50 +08:00
• 089afd6728 DynamicKV-LLM Pretrain v1.1.0 old/master iomgaa 2025-05-14 00:01:40 +08:00
• decec67b78 update old/HPC iomgaa 2025-05-12 12:24:03 +08:00
• 77cf24c925 update archive/SLM old/SLM iomgaa 2025-05-12 12:16:35 +08:00
• 6eaca41018 update iomgaa 2025-05-12 12:11:29 +08:00
• d93889194d update archive/HPC Jax922 2025-05-12 11:53:10 +08:00
• a3ea93597c DynamicKV-LLM Pretrain v1.1.0 iomgaa 2025-05-12 00:21:07 +08:00
• da5ac6a5c0 Merge branch 'SLM' into HPC iomgaa 2025-05-12 00:05:45 +08:00
• 8dd7cfaf72 修正了loss为nan的错误 iomgaa 2025-05-11 23:57:34 +08:00
• eba4311ac5 修复了loss为nan的错误 old/lzn iomgaa 2025-05-11 15:45:17 +00:00
• 5351ae8a6a 正常尺寸 archive/original/model iomgaa 2025-05-11 11:58:13 +08:00
• cb286d26d1 wandb包含config信息 iomgaa 2025-05-10 20:23:52 +08:00
• 0c8c6e5d1a 添加了忽视数据库模式 iomgaa 2025-05-09 15:19:41 +08:00
• b6bd97aaaa 抽取self.downsample_v与self.downsample_q的共同部分，并使用可分离卷积降低参数量 iomgaa 2025-05-09 15:01:06 +08:00
• bed6faa379 DynamicKV-LLM 1.0.1 交叉注意力添加多头；bf16代替fp16 iomgaa 2025-05-08 15:47:00 +00:00
• 10f15724b4 添加了train_embedding用于预训练嵌入模型 iomgaa 2025-05-08 15:41:04 +00:00
• 0859f54a88 DynamicKV-LLM 1.0.0 完成了核心架构，模型可以正常训练 iomgaa 2025-04-25 16:49:05 +08:00
• e3120f5e62 fix iomgaa 2025-04-25 16:29:28 +08:00
• 1ddfd310ec 将Million MoE的思想加入 Jax922 2025-04-24 21:29:33 +08:00
• c55dfc0b46 添加了注释 Jax922 2025-04-24 15:58:39 +08:00
• 21fdaaa59e 更新了忽视列表 Jax922 2025-04-24 15:58:33 +08:00
• 7da201a944 update chat-openai-api jingyaogong 2025-04-18 12:43:57 +08:00
• d9453ed9a3 update moe note jingyaogong 2025-04-09 17:38:31 +08:00
• d503093ec4 update eval jingyaogong 2025-04-09 16:56:57 +08:00
• 4a758564e4 fix top_p float bug jingyaogong 2025-04-09 16:52:20 +08:00
• 4a7c1c49e8 update rlaif jingyaogong 2025-04-05 16:06:08 +08:00
• 9e67798397 update generate jingyaogong 2025-04-05 15:53:55 +08:00
• 399d526fbd add hidden state jingyaogong 2025-04-05 14:39:56 +08:00
• 885661f47d update inference jingyaogong 2025-04-05 12:04:38 +08:00
• ed01c5d84a update inference jingyaogong 2025-04-05 12:03:04 +08:00
• 7fcc46b39a update seed set jingyaogong 2025-04-04 11:39:41 +08:00
• 08e9a22a25 update web_demo jingyaogong 2025-04-04 11:25:40 +08:00
• 278ec760a1 update dpo_loss jingyaogong 2025-04-01 17:32:50 +08:00
• 4f95e23a98 update structure image jingyaogong 2025-04-01 16:15:26 +08:00
• edc8d26189 update structure image jingyaogong 2025-04-01 16:11:54 +08:00
• bf81fd5f5e rmsnorm float convert jingyaogong 2025-04-01 16:03:44 +08:00
• e369b33265 fix chat mask bug jingyaogong 2025-04-01 13:44:55 +08:00