Yu Chengzhang 495fc412cd Experiment 1.4.8: Memory Bank多样性检查 + knowledge_num优化 ...

- 修改 model_memory_1_4_8.py: 增加记忆选择多样性监控机制
- 优化 ds_config.json: 调整DeepSpeed配置以支持更大知识库
- 更新 experiment_1_4_8.sh: 配置knowledge_num=1048576提升记忆容量
- 新增 experiment_1_4_7-04.sh: 补充实验对比脚本
- 模型版本管理: 创建model_memory_1_4_8.py用于后续评估

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>

2025-09-01 15:35:14 +08:00

..

DynamicKV-LLM_Mini_Minimind.sh

DynamicKV-LLM Pretrain v1.2.2:新数据集；使用uv；消除内存泄漏

2025-06-25 20:27:28 +08:00

DynamicKV-LLM_Small_Minimind.sh

DynamicKV-LLM Pretrain v1.1.1

2025-05-22 10:05:31 +08:00

experiment_1_4_0.sh

Experiment_1_4_0

2025-08-01 15:54:21 +08:00

experiment_1_4_1.sh

Experiment 1_4_1

2025-08-03 14:25:26 +08:00

experiment_1_4_2.sh

Experiment 1.4.2: 门控MLP融合串型连接验证连接方式对记忆库性能的影响

2025-08-04 20:12:00 +08:00

experiment_1_4_3.sh

Experiment 1.4.3:极度过拟合

2025-08-06 11:55:36 +08:00

experiment_1_4_4.sh

Experiment 1.4.4:负载平衡有效

2025-08-07 11:43:23 +08:00

experiment_1_4_5.sh

Experiment 1.4.5:使用VQ-VAE的EMA来更新数据库

2025-08-09 10:47:35 +08:00

experiment_1_4_6.sh

Experiment 1.4.6: Token-based Memory架构实现

2025-08-12 11:07:23 +08:00

experiment_1_4_7-04.sh

Experiment 1.4.8: Memory Bank多样性检查 + knowledge_num优化

2025-09-01 15:35:14 +08:00

experiment_1_4_7.sh

Experiment 1.4.7: Memory Bank文本初始化 + 部分冻结机制

2025-08-19 19:32:52 +08:00

experiment_1_4_8.sh

Experiment 1.4.8: Memory Bank多样性检查 + knowledge_num优化

2025-09-01 15:35:14 +08:00

experiment_1.3.0.sh

pretrain过程中会打印10个token以方便观察

2025-07-17 00:05:34 +08:00

experiment_1.3.1.sh

experiment_1.3.0-1.3.2

2025-07-13 21:28:46 +08:00

experiment_1.3.2.sh

experiment_1.3.0-1.3.2

2025-07-13 21:28:46 +08:00

experiment_1.4.0.sh

修复了一些bug

2025-07-17 12:06:28 +08:00

experiment_template.sh

Experiment_1_4_0

2025-08-01 15:54:21 +08:00