Skip to content

Commit

Permalink
Merge branch 'main' of https://github.com/wyf3/llm_related
Browse files Browse the repository at this point in the history
  • Loading branch information
wyf3 committed Dec 20, 2024
2 parents 8731f00 + 893356f commit d286d09
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions train_multimodal_from_scratch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@

## 下载模型及数据
### 下载qwen2.5-0.5b和siglip
qwen2.5-0.5b:\
https://hf-mirror.com/Qwen/Qwen2.5-0.5B-Instruct\
siglip:\
qwen2.5-0.5b: \
https://hf-mirror.com/Qwen/Qwen2.5-0.5B-Instruct \
siglip: \
此处使用的是如下版本的siglip(模型小,但是效果可能没那么好,训练更快,显存要求更低):\
https://hf-mirror.com/google/siglip-base-patch16-224

Expand All @@ -14,12 +14,12 @@ https://hf-mirror.com/google/siglip-so400m-patch14-384
### 下载数据集
1、预训练数据:\
图片数据:\
https://hf-mirror.com/datasets/liuhaotian/LLaVA-CC3M-Pretrain-595K\
https://hf-mirror.com/datasets/liuhaotian/LLaVA-CC3M-Pretrain-595K \
中文文本数据:\
https://hf-mirror.com/datasets/LinkSoul/Chinese-LLaVA-Vision-Instructions
https://hf-mirror.com/datasets/LinkSoul/Chinese-LLaVA-Vision-Instructions \
2、SFT数据:\
图片数据:\
https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset\
https://hf-mirror.com/datasets/jingyaogong/minimind-v_dataset \
中文文本数据:\
https://hf-mirror.com/datasets/LinkSoul/Chinese-LLaVA-Vision-Instructions

Expand Down

0 comments on commit d286d09

Please sign in to comment.