Commit Graph

Select branches

Hide Pull Requests

Gary_Lu

cy

init_test

master

old/HPC

old/SLM

old/lzn

old/master

archive/HPC

archive/SLM

archive/original/model

Mono Color

• 770c34f0e3 DynamicKV-LLM Pretrain v1.2.1 master iomgaa 2025-06-08 02:20:36 +00:00
• 1678e739b6 DynamicKV-LLM Pretrain v1.2.0 iomgaa 2025-06-07 02:41:45 +00:00
• 000e17a93f 修正了key分解、负载均衡等错误 iomgaa 2025-06-06 11:25:59 +08:00
• 47b120be3a 更新了key和value的更新方式 cy cy 2025-06-03 07:36:34 +00:00
• 7d726c5b20 添加直接语义匹配功能，优化数据库检索模块，支持实时计算和动态负载均衡 init_test iomgaa 2025-05-30 14:57:32 +08:00
• 0b53e1b951 数据库实现语义相关性优先 + 动态平衡 iomgaa 2025-05-29 23:59:08 +08:00
• 64e92473c3 数据初始化使用了缓存 iomgaa 2025-05-29 20:29:45 +08:00
• 6932e5fa8e 使用TREx数据集生成数据库初始化问题 iomgaa 2025-05-29 19:30:19 +08:00
• c5d0a3aba3 更新了忽视列表 iomgaa 2025-05-29 19:28:39 +08:00
• 67c632d010 update iomgaa 2025-05-27 11:46:18 +08:00
• c96a9c35d5 对数据库进行了初始化 iomgaa 2025-05-26 23:09:03 +08:00
• c09cd63794 基于trex数据集构建知识库单初始值预处理 iomgaa 2025-05-23 15:47:17 +08:00
• 45da3b383b DynamicKV-LLM Pretrain v1.1.2 Gary_Lu Jax922 2025-05-23 01:18:08 +08:00
• 00d3c24e03 构建了数据库解码模型 iomgaa 2025-05-22 11:32:15 +08:00
• feeccf733c DynamicKV-LLM Pretrain v1.1.1 Jax922 2025-05-22 10:05:31 +08:00
• 42e3d38a3f 使用变量代替固定值 Jax922 2025-05-21 08:14:36 +00:00
• d7fe504e1e update Gary 2025-05-16 08:38:59 +00:00
• 5841f8b4e5 DynamicKV-LLM Pretrain v1.1.0 Jax922 2025-05-14 00:42:50 +08:00
• 089afd6728 DynamicKV-LLM Pretrain v1.1.0 old/master iomgaa 2025-05-14 00:01:40 +08:00
• decec67b78 update old/HPC iomgaa 2025-05-12 12:24:03 +08:00
• 77cf24c925 update archive/SLM old/SLM iomgaa 2025-05-12 12:16:35 +08:00
• 6eaca41018 update iomgaa 2025-05-12 12:11:29 +08:00
• d93889194d update archive/HPC Jax922 2025-05-12 11:53:10 +08:00
• a3ea93597c DynamicKV-LLM Pretrain v1.1.0 iomgaa 2025-05-12 00:21:07 +08:00
• da5ac6a5c0 Merge branch 'SLM' into HPC iomgaa 2025-05-12 00:05:45 +08:00
• 8dd7cfaf72 修正了loss为nan的错误 iomgaa 2025-05-11 23:57:34 +08:00
• eba4311ac5 修复了loss为nan的错误 old/lzn iomgaa 2025-05-11 15:45:17 +00:00
• 5351ae8a6a 正常尺寸 archive/original/model iomgaa 2025-05-11 11:58:13 +08:00
• cb286d26d1 wandb包含config信息 iomgaa 2025-05-10 20:23:52 +08:00
• 0c8c6e5d1a 添加了忽视数据库模式 iomgaa 2025-05-09 15:19:41 +08:00
• b6bd97aaaa 抽取self.downsample_v与self.downsample_q的共同部分，并使用可分离卷积降低参数量 iomgaa 2025-05-09 15:01:06 +08:00
• bed6faa379 DynamicKV-LLM 1.0.1 交叉注意力添加多头；bf16代替fp16 iomgaa 2025-05-08 15:47:00 +00:00
• 10f15724b4 添加了train_embedding用于预训练嵌入模型 iomgaa 2025-05-08 15:41:04 +00:00
• 0859f54a88 DynamicKV-LLM 1.0.0 完成了核心架构，模型可以正常训练 iomgaa 2025-04-25 16:49:05 +08:00
• e3120f5e62 fix iomgaa 2025-04-25 16:29:28 +08:00
• 1ddfd310ec 将Million MoE的思想加入 Jax922 2025-04-24 21:29:33 +08:00
• c55dfc0b46 添加了注释 Jax922 2025-04-24 15:58:39 +08:00
• 21fdaaa59e 更新了忽视列表 Jax922 2025-04-24 15:58:33 +08:00
• 7da201a944 update chat-openai-api jingyaogong 2025-04-18 12:43:57 +08:00
• d9453ed9a3 update moe note jingyaogong 2025-04-09 17:38:31 +08:00
• d503093ec4 update eval jingyaogong 2025-04-09 16:56:57 +08:00
• 4a758564e4 fix top_p float bug jingyaogong 2025-04-09 16:52:20 +08:00
• 4a7c1c49e8 update rlaif jingyaogong 2025-04-05 16:06:08 +08:00
• 9e67798397 update generate jingyaogong 2025-04-05 15:53:55 +08:00
• 399d526fbd add hidden state jingyaogong 2025-04-05 14:39:56 +08:00
• 885661f47d update inference jingyaogong 2025-04-05 12:04:38 +08:00
• ed01c5d84a update inference jingyaogong 2025-04-05 12:03:04 +08:00
• 7fcc46b39a update seed set jingyaogong 2025-04-04 11:39:41 +08:00
• 08e9a22a25 update web_demo jingyaogong 2025-04-04 11:25:40 +08:00
• 278ec760a1 update dpo_loss jingyaogong 2025-04-01 17:32:50 +08:00
• 4f95e23a98 update structure image jingyaogong 2025-04-01 16:15:26 +08:00
• edc8d26189 update structure image jingyaogong 2025-04-01 16:11:54 +08:00
• bf81fd5f5e rmsnorm float convert jingyaogong 2025-04-01 16:03:44 +08:00
• e369b33265 fix chat mask bug jingyaogong 2025-04-01 13:44:55 +08:00
• 258507ff89 delete __pycache__ jingyaogong 2025-04-01 11:51:54 +08:00
• 04b56ea86c update readme gongjy 2025-02-23 20:07:26 +08:00
• e34d4e9371 update tokenizer load gongjy 2025-02-19 23:24:29 +08:00
• 45c0d12049 update images gongjy 2025-02-19 22:59:42 +08:00
• f475e4e407 update images gongjy 2025-02-19 22:54:57 +08:00
• ef7dff9fd4 update structure figure gongjy 2025-02-18 23:35:16 +08:00
• dcf5fcdb08 update structure figure gongjy 2025-02-18 23:24:51 +08:00
• 844e79148c update generate args gongjy 2025-02-15 23:56:09 +08:00
• 19b388cd87 update generate args gongjy 2025-02-15 23:55:10 +08:00
• 5b65bc767e update cis init gongjy 2025-02-15 20:26:34 +08:00
• c1a77f5c0f update web_demo gongjy 2025-02-14 19:38:55 +08:00
• d519d2a233 update web_demo gongjy 2025-02-14 19:37:27 +08:00
• e7ed05834b fix bug gongjy 2025-02-13 21:07:43 +08:00
• b5d10d9a7d fix bugs gongjy 2025-02-13 20:56:14 +08:00
• 416cc90b58 update ckp-path gongjy 2025-02-12 20:34:47 +08:00
• bab480073e update lr gongjy 2025-02-11 23:53:48 +08:00
• d2f5ef4355 update lr gongjy 2025-02-11 23:52:40 +08:00
• fea5b0eafc update readme gongjy 2025-02-10 23:34:52 +08:00
• 291c19dc5e update markdown gongjy 2025-02-10 23:22:53 +08:00
• 6f383e29fb update markdown gongjy 2025-02-10 23:19:23 +08:00
• 97886fef2e update readme gongjy 2025-02-10 22:25:35 +08:00
• be9b434379 update readme gongjy 2025-02-10 22:22:35 +08:00
• ddb7e666a3 update readme gongjy 2025-02-10 13:32:01 +08:00
• 0c5104885a update readme gongjy 2025-02-10 13:30:55 +08:00
• dd7a7ef730 update readme gongjy 2025-02-10 11:55:09 +08:00
• fe2f1199ac update readme gongjy 2025-02-10 11:44:43 +08:00
• c2e67c25f7 update readme gongjy 2025-02-10 11:14:52 +08:00
• b60fd11f85 update track gongjy 2025-02-10 00:32:33 +08:00
• 4c2b283b93 update readme gongjy 2025-02-10 00:16:54 +08:00
• c9ca0f57dc update config gongjy 2025-02-10 00:14:11 +08:00
• 30f8614c97 update online demo gongjy 2025-02-09 23:55:59 +08:00
• 29d6cd9cd2 update scripts file gongjy 2025-02-09 23:52:50 +08:00
• 58e3af0359 add minimind2 gongjy 2025-02-09 23:49:47 +08:00
• 6e9cd28ef9 update readme gongjy 2024-12-13 20:08:59 +08:00
• f7127e4310 update lora-sft gongjy 2024-11-10 20:40:49 +08:00
• 1240829c89 update train_tokenizer gongjy 2024-11-06 17:48:33 +08:00
• 7c67ba0b92 update fast_inference gongjy 2024-10-30 15:26:28 +08:00
• db39571493 update readme gongjy 2024-10-30 10:39:29 +08:00
• 0bce9e5a31 update eval-chat gongjy 2024-10-28 12:57:25 +08:00
• 6d7a988365 update readme gongjy 2024-10-27 21:25:55 +08:00
• 0d10efeeed update process gongjy 2024-10-27 17:21:29 +08:00
• 517e0a4e7c update readme gongjy 2024-10-26 14:35:22 +08:00
• d63c525d04 update readme gongjy 2024-10-26 14:32:55 +08:00
• a9e65969c8 update sft-lr gongjy 2024-10-24 08:58:31 +08:00
• 42bd06e55d update data_process gongjy 2024-10-23 12:25:45 +08:00
• 69bcb8dc90 update data_process gongjy 2024-10-23 12:02:28 +08:00