cnedwards commited on
Commit
5cfc9cb
·
verified ·
1 Parent(s): 10a47d3

Update config.json

Browse files

The vocab size should be set to 151667 like in Qwen and then extended later to match the molecule tokenizer.

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "vocab_size": 152624,
3
  "max_position_embeddings": 32768,
4
  "hidden_size": 2048,
5
  "intermediate_size": 11008,
 
1
  {
2
+ "vocab_size": 151667,
3
  "max_position_embeddings": 32768,
4
  "hidden_size": 2048,
5
  "intermediate_size": 11008,