Hugging Face's logo

danish-foundation-models
/
dfm-decoder-open-v0-7b-pt

Text Generation
Safetensors
Danish
English
llama
Model card Files
xet
 Community
6
peter-sk commited on
Commit
6421191
·
1 Parent(s): 7dfc40f

updated model card

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -11,6 +11,6 @@ base_model:
11
  pipeline_tag: text-generation
12
  ---
13
 
14
- | Stage | Batch size | Steps | HF path | Data mix | Comments |
15
- |--------|----------------|-------|-----------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
16
- | stage1 | 262,144 tok | 37,852| [subfolder="stage1"](https://huggingface.co/danish-foundation-models/munin-7b-open-pt/tree/main/stage1) | 2/3 [DynaWord](https://huggingface.co/datasets/danish-foundation-models/danish-dynaword/tree/9e230b35e31a510e5ab909112ad5bfc9463b2c23) <br> 1/3 [Common-Pile](https://huggingface.co/common-pile/comma_v0.1_training_dataset/5afc546db324e7f39f297ba757c9a60547151e7c/) | Excludes depbank, jvj, nordjyllandnews, synne for DynaWord; uses subsets and weighting from [Comma-v0.1-2T](https://huggingface.co/common-pile/comma-v0.1-2t) cooldown phase for Common-Pile. |
 
11
  pipeline_tag: text-generation
12
  ---
13
 
14
+ | Stage | Batch size | Steps | HF path | Data mix | Comments |
15
+ |-|-|-|-|-|-|
16
+ | stage1 | 262,144 tok | 37,852| [subfolder="stage1"](https://huggingface.co/danish-foundation-models/munin-7b-open-pt/tree/main/stage1) | 2/3 [DynaWord](https://huggingface.co/datasets/danish-foundation-models/danish-dynaword/tree/9e230b35e31a510e5ab909112ad5bfc9463b2c23); <br> 1/3 [Common-Pile](https://huggingface.co/common-pile/comma_v0.1_training_dataset/5afc546db324e7f39f297ba757c9a60547151e7c/) | Excludes depbank, jvj, nordjyllandnews, synne for DynaWord; <br> uses subsets and weighting from [Comma-v0.1-2T](https://huggingface.co/common-pile/comma-v0.1-2t) cooldown phase for Common-Pile. |