Hugging Face's logo

Debk
/
AgriFair-GRAFT-adapters

PEFT
Safetensors
English
fairness
bias-mitigation
lora
agriculture
india
difference-awareness
Model card Files
xet
 Community
Debk commited on
Commit
61a0fff
·
verified ·
1 Parent(s): a483a83

AgriFair GRAFT adapters: 110 adapters

Browse files
Files changed (8) hide show
  1. README.md +2 -2
  2. general-instruct/baseline_dart/seed_42/README.md +207 -0
  3. general-instruct/baseline_dart/seed_42/adapter_config.json +716 -0
  4. general-instruct/baseline_dart/seed_42/adapter_model.safetensors +3 -0
  5. general-instruct/baseline_pedal/seed_42/README.md +207 -0
  6. general-instruct/baseline_pedal/seed_42/adapter_config.json +716 -0
  7. general-instruct/baseline_pedal/seed_42/adapter_model.safetensors +3 -0
  8. manifest.json +25 -1
README.md CHANGED
@@ -29,7 +29,7 @@ census records a real difference, using Integrated Gradients. It places LoRA ada
29
  layers alone with rank proportional to attribution, and trains them with a condition-adaptive,
30
  rationale-aware objective.
31
 
32
- This repository holds **108 adapters** so that every number in the paper can be
33
  recomputed rather than taken on trust.
34
 
35
  ## Layout
@@ -42,7 +42,7 @@ manifest.json base model, revision, rank range and trainable sha
42
  | Tier | Base model | Adapters |
43
  |---|---|---|
44
  | `broad-instruct` | Qwen/Qwen3-4B-Instruct-2507 | 33 |
45
- | `general-instruct` | google/gemma-3-12b-it | 23 |
46
  | `general-instruct-2` | mistralai/Ministral-8B-Instruct-2410 | 19 |
47
  | `small-instruct` | meta-llama/Llama-3.2-3B-Instruct | 33 |
48
 
 
29
  layers alone with rank proportional to attribution, and trains them with a condition-adaptive,
30
  rationale-aware objective.
31
 
32
+ This repository holds **110 adapters** so that every number in the paper can be
33
  recomputed rather than taken on trust.
34
 
35
  ## Layout
 
42
  | Tier | Base model | Adapters |
43
  |---|---|---|
44
  | `broad-instruct` | Qwen/Qwen3-4B-Instruct-2507 | 33 |
45
+ | `general-instruct` | google/gemma-3-12b-it | 25 |
46
  | `general-instruct-2` | mistralai/Ministral-8B-Instruct-2410 | 19 |
47
  | `small-instruct` | meta-llama/Llama-3.2-3B-Instruct | 33 |
48
 
general-instruct/baseline_dart/seed_42/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: /workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.20.0
general-instruct/baseline_dart/seed_42/adapter_config.json ADDED
@@ -0,0 +1,716 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {
4
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.down_proj": 50,
5
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.gate_proj": 50,
6
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.k_proj": 50,
7
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.o_proj": 50,
8
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.q_proj": 50,
9
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.up_proj": 50,
10
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.v_proj": 50,
11
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 48,
12
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 48,
13
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 48,
14
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 48,
15
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 48,
16
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 48,
17
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 48,
18
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 48,
19
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 48,
20
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 48,
21
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 48,
22
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 48,
23
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 48,
24
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 48,
25
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.down_proj": 48,
26
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.gate_proj": 48,
27
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.k_proj": 48,
28
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.o_proj": 48,
29
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.q_proj": 48,
30
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.up_proj": 48,
31
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.v_proj": 48,
32
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.down_proj": 48,
33
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.gate_proj": 48,
34
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.k_proj": 48,
35
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.o_proj": 48,
36
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.q_proj": 48,
37
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.up_proj": 48,
38
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.v_proj": 48,
39
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.down_proj": 48,
40
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.gate_proj": 48,
41
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.k_proj": 48,
42
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.o_proj": 48,
43
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.q_proj": 48,
44
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.up_proj": 48,
45
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.v_proj": 48,
46
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.down_proj": 48,
47
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.gate_proj": 48,
48
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.k_proj": 48,
49
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.o_proj": 48,
50
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.q_proj": 48,
51
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.up_proj": 48,
52
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.v_proj": 48,
53
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.down_proj": 48,
54
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.gate_proj": 48,
55
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.k_proj": 48,
56
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.o_proj": 48,
57
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.q_proj": 48,
58
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.up_proj": 48,
59
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.v_proj": 48,
60
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 48,
61
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 48,
62
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 48,
63
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 48,
64
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 48,
65
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 48,
66
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 48,
67
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 48,
68
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 48,
69
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 48,
70
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 48,
71
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 48,
72
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 48,
73
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 48,
74
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.down_proj": 48,
75
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.gate_proj": 48,
76
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.k_proj": 48,
77
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.o_proj": 48,
78
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.q_proj": 48,
79
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.up_proj": 48,
80
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.v_proj": 48,
81
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 48,
82
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 48,
83
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 48,
84
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 48,
85
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 48,
86
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 48,
87
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 48,
88
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 48,
89
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 48,
90
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 48,
91
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 48,
92
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 48,
93
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 48,
94
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 48,
95
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.down_proj": 48,
96
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.gate_proj": 48,
97
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.k_proj": 48,
98
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.o_proj": 48,
99
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.q_proj": 48,
100
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.up_proj": 48,
101
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.v_proj": 48,
102
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 48,
103
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 48,
104
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 48,
105
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 48,
106
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 48,
107
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 48,
108
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 48,
109
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.down_proj": 48,
110
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.gate_proj": 48,
111
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.k_proj": 48,
112
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.o_proj": 48,
113
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.q_proj": 48,
114
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.up_proj": 48,
115
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.v_proj": 48,
116
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 48,
117
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 48,
118
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 48,
119
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 48,
120
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 48,
121
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 48,
122
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 48,
123
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.down_proj": 48,
124
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.gate_proj": 48,
125
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.k_proj": 48,
126
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.o_proj": 48,
127
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.q_proj": 48,
128
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.up_proj": 48,
129
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.v_proj": 48,
130
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.down_proj": 48,
131
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.gate_proj": 48,
132
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.k_proj": 48,
133
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.o_proj": 48,
134
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.q_proj": 48,
135
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.up_proj": 48,
136
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.v_proj": 48,
137
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.down_proj": 48,
138
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.gate_proj": 48,
139
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.k_proj": 48,
140
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.o_proj": 48,
141
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.q_proj": 48,
142
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.up_proj": 48,
143
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.v_proj": 48,
144
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 48,
145
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 48,
146
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 48,
147
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 48,
148
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 48,
149
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 48,
150
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 48,
151
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.down_proj": 48,
152
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.gate_proj": 48,
153
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.k_proj": 48,
154
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.o_proj": 48,
155
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.q_proj": 48,
156
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.up_proj": 48,
157
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.v_proj": 48,
158
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 48,
159
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 48,
160
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 48,
161
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 48,
162
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 48,
163
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 48,
164
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 48,
165
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.down_proj": 48,
166
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.gate_proj": 48,
167
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.k_proj": 48,
168
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.o_proj": 48,
169
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.q_proj": 48,
170
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.up_proj": 48,
171
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.v_proj": 48,
172
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.down_proj": 48,
173
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.gate_proj": 48,
174
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.k_proj": 48,
175
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.o_proj": 48,
176
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.q_proj": 48,
177
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.up_proj": 48,
178
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.v_proj": 48,
179
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 48,
180
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 48,
181
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 48,
182
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 48,
183
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 48,
184
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 48,
185
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 48,
186
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.down_proj": 48,
187
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.gate_proj": 48,
188
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.k_proj": 48,
189
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.o_proj": 48,
190
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.q_proj": 48,
191
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.up_proj": 48,
192
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.v_proj": 48,
193
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 48,
194
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 48,
195
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 48,
196
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 48,
197
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 48,
198
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 48,
199
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 48,
200
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.down_proj": 48,
201
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.gate_proj": 48,
202
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.k_proj": 48,
203
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.o_proj": 48,
204
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.q_proj": 48,
205
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.up_proj": 48,
206
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.v_proj": 48,
207
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 48,
208
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 48,
209
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 48,
210
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 48,
211
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 48,
212
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 48,
213
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 48,
214
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 48,
215
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 48,
216
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 48,
217
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 48,
218
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 48,
219
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 48,
220
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 48,
221
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.down_proj": 48,
222
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.gate_proj": 48,
223
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.k_proj": 48,
224
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.o_proj": 48,
225
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.q_proj": 48,
226
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.up_proj": 48,
227
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.v_proj": 48,
228
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.down_proj": 48,
229
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.gate_proj": 48,
230
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.k_proj": 48,
231
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.o_proj": 48,
232
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.q_proj": 48,
233
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.up_proj": 48,
234
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.v_proj": 48,
235
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.down_proj": 48,
236
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.gate_proj": 48,
237
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.k_proj": 48,
238
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.o_proj": 48,
239
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.q_proj": 48,
240
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.up_proj": 48,
241
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.v_proj": 48,
242
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.down_proj": 48,
243
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.gate_proj": 48,
244
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.k_proj": 48,
245
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.o_proj": 48,
246
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.q_proj": 48,
247
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.up_proj": 48,
248
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.v_proj": 48,
249
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.down_proj": 48,
250
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.gate_proj": 48,
251
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.k_proj": 48,
252
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.o_proj": 48,
253
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.q_proj": 48,
254
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.up_proj": 48,
255
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.v_proj": 48,
256
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.down_proj": 48,
257
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.gate_proj": 48,
258
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.k_proj": 48,
259
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.o_proj": 48,
260
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.q_proj": 48,
261
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.up_proj": 48,
262
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.v_proj": 48,
263
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 48,
264
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 48,
265
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 48,
266
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 48,
267
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 48,
268
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 48,
269
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 48,
270
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.down_proj": 48,
271
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.gate_proj": 48,
272
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.k_proj": 48,
273
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.o_proj": 48,
274
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.q_proj": 48,
275
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.up_proj": 48,
276
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.v_proj": 48,
277
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.down_proj": 48,
278
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.gate_proj": 48,
279
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.k_proj": 48,
280
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.o_proj": 48,
281
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.q_proj": 48,
282
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.up_proj": 48,
283
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.v_proj": 48,
284
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 48,
285
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 48,
286
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 48,
287
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 48,
288
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 48,
289
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 48,
290
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 48,
291
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 48,
292
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 48,
293
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 48,
294
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 48,
295
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 48,
296
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 48,
297
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 48,
298
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 48,
299
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 48,
300
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 48,
301
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 48,
302
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 48,
303
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 48,
304
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 48,
305
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.down_proj": 48,
306
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.gate_proj": 48,
307
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.k_proj": 48,
308
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.o_proj": 48,
309
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.q_proj": 48,
310
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.up_proj": 48,
311
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.v_proj": 48,
312
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.down_proj": 48,
313
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.gate_proj": 48,
314
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.k_proj": 48,
315
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.o_proj": 48,
316
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.q_proj": 48,
317
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.up_proj": 48,
318
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.v_proj": 48,
319
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.down_proj": 48,
320
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.gate_proj": 48,
321
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.k_proj": 48,
322
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.o_proj": 48,
323
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.q_proj": 48,
324
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.up_proj": 48,
325
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.v_proj": 48,
326
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 48,
327
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 48,
328
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 48,
329
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 48,
330
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 48,
331
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 48,
332
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 48,
333
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.down_proj": 48,
334
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.gate_proj": 48,
335
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.k_proj": 48,
336
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.o_proj": 48,
337
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.q_proj": 48,
338
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.up_proj": 48,
339
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.v_proj": 48
340
+ },
341
+ "arrow_config": null,
342
+ "auto_mapping": null,
343
+ "base_model_name_or_path": "/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it",
344
+ "bias": "none",
345
+ "corda_config": null,
346
+ "ensure_weight_tying": false,
347
+ "eva_config": null,
348
+ "exclude_modules": null,
349
+ "fan_in_fan_out": false,
350
+ "inference_mode": true,
351
+ "init_lora_weights": true,
352
+ "layer_replication": null,
353
+ "layers_pattern": null,
354
+ "layers_to_transform": null,
355
+ "loftq_config": {},
356
+ "lora_alpha": 48,
357
+ "lora_bias": false,
358
+ "lora_dropout": 0.05,
359
+ "lora_ga_config": null,
360
+ "megatron_config": null,
361
+ "megatron_core": "megatron.core",
362
+ "modules_to_save": null,
363
+ "monteclora_config": null,
364
+ "peft_type": "LORA",
365
+ "peft_version": "0.20.0",
366
+ "qalora_group_size": 16,
367
+ "r": 24,
368
+ "rank_pattern": {
369
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.down_proj": 25,
370
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.gate_proj": 25,
371
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.k_proj": 25,
372
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.o_proj": 25,
373
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.q_proj": 25,
374
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.up_proj": 25,
375
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.v_proj": 25,
376
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 24,
377
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 24,
378
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 24,
379
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 24,
380
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 24,
381
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 24,
382
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 24,
383
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 24,
384
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 24,
385
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 24,
386
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 24,
387
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 24,
388
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 24,
389
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 24,
390
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.down_proj": 24,
391
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.gate_proj": 24,
392
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.k_proj": 24,
393
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.o_proj": 24,
394
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.q_proj": 24,
395
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.up_proj": 24,
396
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.v_proj": 24,
397
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.down_proj": 24,
398
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.gate_proj": 24,
399
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.k_proj": 24,
400
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.o_proj": 24,
401
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.q_proj": 24,
402
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.up_proj": 24,
403
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.v_proj": 24,
404
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.down_proj": 24,
405
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.gate_proj": 24,
406
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.k_proj": 24,
407
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.o_proj": 24,
408
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.q_proj": 24,
409
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.up_proj": 24,
410
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.v_proj": 24,
411
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.down_proj": 24,
412
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.gate_proj": 24,
413
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.k_proj": 24,
414
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.o_proj": 24,
415
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.q_proj": 24,
416
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.up_proj": 24,
417
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.v_proj": 24,
418
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.down_proj": 24,
419
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.gate_proj": 24,
420
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.k_proj": 24,
421
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.o_proj": 24,
422
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.q_proj": 24,
423
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.up_proj": 24,
424
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.v_proj": 24,
425
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 24,
426
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 24,
427
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 24,
428
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 24,
429
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 24,
430
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 24,
431
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 24,
432
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 24,
433
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 24,
434
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 24,
435
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 24,
436
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 24,
437
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 24,
438
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 24,
439
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.down_proj": 24,
440
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.gate_proj": 24,
441
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.k_proj": 24,
442
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.o_proj": 24,
443
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.q_proj": 24,
444
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.up_proj": 24,
445
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.v_proj": 24,
446
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 24,
447
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 24,
448
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 24,
449
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 24,
450
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 24,
451
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 24,
452
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 24,
453
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 24,
454
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 24,
455
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 24,
456
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 24,
457
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 24,
458
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 24,
459
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 24,
460
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.down_proj": 24,
461
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.gate_proj": 24,
462
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.k_proj": 24,
463
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.o_proj": 24,
464
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.q_proj": 24,
465
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.up_proj": 24,
466
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.v_proj": 24,
467
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 24,
468
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 24,
469
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 24,
470
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 24,
471
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 24,
472
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 24,
473
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 24,
474
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.down_proj": 24,
475
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.gate_proj": 24,
476
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.k_proj": 24,
477
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.o_proj": 24,
478
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.q_proj": 24,
479
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.up_proj": 24,
480
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.v_proj": 24,
481
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 24,
482
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 24,
483
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 24,
484
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 24,
485
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 24,
486
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 24,
487
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 24,
488
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.down_proj": 24,
489
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.gate_proj": 24,
490
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.k_proj": 24,
491
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.o_proj": 24,
492
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.q_proj": 24,
493
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.up_proj": 24,
494
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.v_proj": 24,
495
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.down_proj": 24,
496
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.gate_proj": 24,
497
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.k_proj": 24,
498
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.o_proj": 24,
499
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.q_proj": 24,
500
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.up_proj": 24,
501
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.v_proj": 24,
502
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.down_proj": 24,
503
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.gate_proj": 24,
504
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.k_proj": 24,
505
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.o_proj": 24,
506
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.q_proj": 24,
507
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.up_proj": 24,
508
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.v_proj": 24,
509
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 24,
510
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 24,
511
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 24,
512
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 24,
513
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 24,
514
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 24,
515
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 24,
516
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.down_proj": 24,
517
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.gate_proj": 24,
518
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.k_proj": 24,
519
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.o_proj": 24,
520
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.q_proj": 24,
521
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.up_proj": 24,
522
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.v_proj": 24,
523
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 24,
524
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 24,
525
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 24,
526
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 24,
527
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 24,
528
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 24,
529
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 24,
530
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.down_proj": 24,
531
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.gate_proj": 24,
532
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.k_proj": 24,
533
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.o_proj": 24,
534
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.q_proj": 24,
535
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.up_proj": 24,
536
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.v_proj": 24,
537
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.down_proj": 24,
538
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.gate_proj": 24,
539
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.k_proj": 24,
540
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.o_proj": 24,
541
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.q_proj": 24,
542
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.up_proj": 24,
543
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.v_proj": 24,
544
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 24,
545
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 24,
546
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 24,
547
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 24,
548
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 24,
549
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 24,
550
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 24,
551
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.down_proj": 24,
552
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.gate_proj": 24,
553
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.k_proj": 24,
554
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.o_proj": 24,
555
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.q_proj": 24,
556
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.up_proj": 24,
557
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.v_proj": 24,
558
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 24,
559
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 24,
560
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 24,
561
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 24,
562
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 24,
563
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 24,
564
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 24,
565
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.down_proj": 24,
566
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.gate_proj": 24,
567
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.k_proj": 24,
568
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.o_proj": 24,
569
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.q_proj": 24,
570
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.up_proj": 24,
571
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.v_proj": 24,
572
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 24,
573
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 24,
574
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 24,
575
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 24,
576
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 24,
577
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 24,
578
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 24,
579
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 24,
580
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 24,
581
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 24,
582
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 24,
583
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 24,
584
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 24,
585
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 24,
586
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.down_proj": 24,
587
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.gate_proj": 24,
588
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.k_proj": 24,
589
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.o_proj": 24,
590
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.q_proj": 24,
591
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.up_proj": 24,
592
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.v_proj": 24,
593
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.down_proj": 24,
594
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.gate_proj": 24,
595
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.k_proj": 24,
596
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.o_proj": 24,
597
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.q_proj": 24,
598
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.up_proj": 24,
599
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.v_proj": 24,
600
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.down_proj": 24,
601
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.gate_proj": 24,
602
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.k_proj": 24,
603
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.o_proj": 24,
604
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.q_proj": 24,
605
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.up_proj": 24,
606
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.v_proj": 24,
607
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.down_proj": 24,
608
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.gate_proj": 24,
609
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.k_proj": 24,
610
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.o_proj": 24,
611
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.q_proj": 24,
612
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.up_proj": 24,
613
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.v_proj": 24,
614
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.down_proj": 24,
615
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.gate_proj": 24,
616
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.k_proj": 24,
617
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.o_proj": 24,
618
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.q_proj": 24,
619
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.up_proj": 24,
620
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.v_proj": 24,
621
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.down_proj": 24,
622
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.gate_proj": 24,
623
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.k_proj": 24,
624
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.o_proj": 24,
625
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.q_proj": 24,
626
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.up_proj": 24,
627
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.v_proj": 24,
628
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 24,
629
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 24,
630
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 24,
631
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 24,
632
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 24,
633
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 24,
634
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 24,
635
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.down_proj": 24,
636
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.gate_proj": 24,
637
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.k_proj": 24,
638
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.o_proj": 24,
639
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.q_proj": 24,
640
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.up_proj": 24,
641
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.v_proj": 24,
642
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.down_proj": 24,
643
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.gate_proj": 24,
644
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.k_proj": 24,
645
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.o_proj": 24,
646
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.q_proj": 24,
647
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.up_proj": 24,
648
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.v_proj": 24,
649
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 24,
650
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 24,
651
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 24,
652
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 24,
653
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 24,
654
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 24,
655
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 24,
656
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 24,
657
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 24,
658
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 24,
659
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 24,
660
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 24,
661
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 24,
662
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 24,
663
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 24,
664
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 24,
665
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 24,
666
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 24,
667
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 24,
668
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 24,
669
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 24,
670
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.down_proj": 24,
671
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.gate_proj": 24,
672
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.k_proj": 24,
673
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.o_proj": 24,
674
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.q_proj": 24,
675
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.up_proj": 24,
676
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.v_proj": 24,
677
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.down_proj": 24,
678
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.gate_proj": 24,
679
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.k_proj": 24,
680
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.o_proj": 24,
681
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.q_proj": 24,
682
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.up_proj": 24,
683
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.v_proj": 24,
684
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.down_proj": 24,
685
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.gate_proj": 24,
686
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.k_proj": 24,
687
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.o_proj": 24,
688
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.q_proj": 24,
689
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.up_proj": 24,
690
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.v_proj": 24,
691
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 24,
692
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 24,
693
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 24,
694
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 24,
695
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 24,
696
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 24,
697
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 24,
698
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.down_proj": 24,
699
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.gate_proj": 24,
700
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.k_proj": 24,
701
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.o_proj": 24,
702
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.q_proj": 24,
703
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.up_proj": 24,
704
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.v_proj": 24
705
+ },
706
+ "revision": null,
707
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
708
+ "target_parameters": null,
709
+ "task_type": "CAUSAL_LM",
710
+ "trainable_token_indices": null,
711
+ "use_bdlora": null,
712
+ "use_dora": false,
713
+ "use_qalora": false,
714
+ "use_rslora": false,
715
+ "velora_config": null
716
+ }
general-instruct/baseline_dart/seed_42/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36fa1a45dccfdba12c69df6bfa299c007701444a52d15f72e19771ad88c2a33f
3
+ size 393264536
general-instruct/baseline_pedal/seed_42/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: /workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.20.0
general-instruct/baseline_pedal/seed_42/adapter_config.json ADDED
@@ -0,0 +1,716 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {
4
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.down_proj": 50,
5
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.gate_proj": 50,
6
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.k_proj": 50,
7
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.o_proj": 50,
8
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.q_proj": 50,
9
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.up_proj": 50,
10
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.v_proj": 50,
11
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 48,
12
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 48,
13
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 48,
14
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 48,
15
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 48,
16
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 48,
17
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 48,
18
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 48,
19
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 48,
20
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 48,
21
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 48,
22
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 48,
23
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 48,
24
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 48,
25
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.down_proj": 48,
26
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.gate_proj": 48,
27
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.k_proj": 48,
28
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.o_proj": 48,
29
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.q_proj": 48,
30
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.up_proj": 48,
31
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.v_proj": 48,
32
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.down_proj": 48,
33
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.gate_proj": 48,
34
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.k_proj": 48,
35
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.o_proj": 48,
36
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.q_proj": 48,
37
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.up_proj": 48,
38
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.v_proj": 48,
39
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.down_proj": 48,
40
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.gate_proj": 48,
41
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.k_proj": 48,
42
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.o_proj": 48,
43
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.q_proj": 48,
44
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.up_proj": 48,
45
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.v_proj": 48,
46
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.down_proj": 48,
47
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.gate_proj": 48,
48
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.k_proj": 48,
49
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.o_proj": 48,
50
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.q_proj": 48,
51
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.up_proj": 48,
52
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.v_proj": 48,
53
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.down_proj": 48,
54
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.gate_proj": 48,
55
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.k_proj": 48,
56
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.o_proj": 48,
57
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.q_proj": 48,
58
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.up_proj": 48,
59
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.v_proj": 48,
60
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 48,
61
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 48,
62
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 48,
63
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 48,
64
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 48,
65
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 48,
66
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 48,
67
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 48,
68
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 48,
69
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 48,
70
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 48,
71
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 48,
72
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 48,
73
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 48,
74
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.down_proj": 48,
75
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.gate_proj": 48,
76
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.k_proj": 48,
77
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.o_proj": 48,
78
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.q_proj": 48,
79
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.up_proj": 48,
80
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.v_proj": 48,
81
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 48,
82
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 48,
83
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 48,
84
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 48,
85
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 48,
86
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 48,
87
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 48,
88
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 48,
89
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 48,
90
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 48,
91
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 48,
92
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 48,
93
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 48,
94
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 48,
95
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.down_proj": 48,
96
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.gate_proj": 48,
97
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.k_proj": 48,
98
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.o_proj": 48,
99
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.q_proj": 48,
100
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.up_proj": 48,
101
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.v_proj": 48,
102
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 48,
103
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 48,
104
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 48,
105
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 48,
106
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 48,
107
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 48,
108
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 48,
109
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.down_proj": 48,
110
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.gate_proj": 48,
111
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.k_proj": 48,
112
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.o_proj": 48,
113
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.q_proj": 48,
114
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.up_proj": 48,
115
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.v_proj": 48,
116
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 48,
117
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 48,
118
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 48,
119
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 48,
120
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 48,
121
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 48,
122
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 48,
123
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.down_proj": 48,
124
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.gate_proj": 48,
125
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.k_proj": 48,
126
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.o_proj": 48,
127
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.q_proj": 48,
128
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.up_proj": 48,
129
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.v_proj": 48,
130
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.down_proj": 48,
131
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.gate_proj": 48,
132
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.k_proj": 48,
133
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.o_proj": 48,
134
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.q_proj": 48,
135
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.up_proj": 48,
136
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.v_proj": 48,
137
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.down_proj": 48,
138
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.gate_proj": 48,
139
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.k_proj": 48,
140
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.o_proj": 48,
141
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.q_proj": 48,
142
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.up_proj": 48,
143
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.v_proj": 48,
144
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 48,
145
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 48,
146
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 48,
147
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 48,
148
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 48,
149
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 48,
150
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 48,
151
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.down_proj": 48,
152
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.gate_proj": 48,
153
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.k_proj": 48,
154
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.o_proj": 48,
155
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.q_proj": 48,
156
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.up_proj": 48,
157
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.v_proj": 48,
158
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 48,
159
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 48,
160
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 48,
161
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 48,
162
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 48,
163
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 48,
164
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 48,
165
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.down_proj": 48,
166
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.gate_proj": 48,
167
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.k_proj": 48,
168
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.o_proj": 48,
169
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.q_proj": 48,
170
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.up_proj": 48,
171
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.v_proj": 48,
172
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.down_proj": 48,
173
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.gate_proj": 48,
174
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.k_proj": 48,
175
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.o_proj": 48,
176
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.q_proj": 48,
177
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.up_proj": 48,
178
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.v_proj": 48,
179
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 48,
180
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 48,
181
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 48,
182
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 48,
183
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 48,
184
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 48,
185
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 48,
186
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.down_proj": 48,
187
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.gate_proj": 48,
188
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.k_proj": 48,
189
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.o_proj": 48,
190
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.q_proj": 48,
191
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.up_proj": 48,
192
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.v_proj": 48,
193
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 48,
194
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 48,
195
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 48,
196
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 48,
197
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 48,
198
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 48,
199
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 48,
200
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.down_proj": 48,
201
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.gate_proj": 48,
202
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.k_proj": 48,
203
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.o_proj": 48,
204
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.q_proj": 48,
205
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.up_proj": 48,
206
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.v_proj": 48,
207
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 48,
208
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 48,
209
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 48,
210
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 48,
211
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 48,
212
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 48,
213
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 48,
214
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 48,
215
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 48,
216
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 48,
217
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 48,
218
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 48,
219
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 48,
220
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 48,
221
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.down_proj": 48,
222
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.gate_proj": 48,
223
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.k_proj": 48,
224
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.o_proj": 48,
225
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.q_proj": 48,
226
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.up_proj": 48,
227
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.v_proj": 48,
228
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.down_proj": 48,
229
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.gate_proj": 48,
230
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.k_proj": 48,
231
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.o_proj": 48,
232
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.q_proj": 48,
233
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.up_proj": 48,
234
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.v_proj": 48,
235
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.down_proj": 48,
236
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.gate_proj": 48,
237
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.k_proj": 48,
238
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.o_proj": 48,
239
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.q_proj": 48,
240
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.up_proj": 48,
241
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.v_proj": 48,
242
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.down_proj": 48,
243
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.gate_proj": 48,
244
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.k_proj": 48,
245
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.o_proj": 48,
246
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.q_proj": 48,
247
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.up_proj": 48,
248
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.v_proj": 48,
249
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.down_proj": 48,
250
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.gate_proj": 48,
251
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.k_proj": 48,
252
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.o_proj": 48,
253
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.q_proj": 48,
254
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.up_proj": 48,
255
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.v_proj": 48,
256
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.down_proj": 48,
257
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.gate_proj": 48,
258
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.k_proj": 48,
259
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.o_proj": 48,
260
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.q_proj": 48,
261
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.up_proj": 48,
262
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.v_proj": 48,
263
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 48,
264
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 48,
265
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 48,
266
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 48,
267
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 48,
268
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 48,
269
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 48,
270
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.down_proj": 48,
271
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.gate_proj": 48,
272
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.k_proj": 48,
273
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.o_proj": 48,
274
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.q_proj": 48,
275
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.up_proj": 48,
276
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.v_proj": 48,
277
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.down_proj": 48,
278
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.gate_proj": 48,
279
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.k_proj": 48,
280
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.o_proj": 48,
281
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.q_proj": 48,
282
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.up_proj": 48,
283
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.v_proj": 48,
284
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 48,
285
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 48,
286
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 48,
287
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 48,
288
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 48,
289
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 48,
290
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 48,
291
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 48,
292
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 48,
293
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 48,
294
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 48,
295
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 48,
296
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 48,
297
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 48,
298
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 48,
299
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 48,
300
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 48,
301
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 48,
302
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 48,
303
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 48,
304
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 48,
305
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.down_proj": 48,
306
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.gate_proj": 48,
307
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.k_proj": 48,
308
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.o_proj": 48,
309
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.q_proj": 48,
310
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.up_proj": 48,
311
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.v_proj": 48,
312
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.down_proj": 48,
313
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.gate_proj": 48,
314
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.k_proj": 48,
315
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.o_proj": 48,
316
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.q_proj": 48,
317
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.up_proj": 48,
318
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.v_proj": 48,
319
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.down_proj": 48,
320
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.gate_proj": 48,
321
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.k_proj": 48,
322
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.o_proj": 48,
323
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.q_proj": 48,
324
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.up_proj": 48,
325
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.v_proj": 48,
326
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 48,
327
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 48,
328
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 48,
329
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 48,
330
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 48,
331
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 48,
332
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 48,
333
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.down_proj": 48,
334
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.gate_proj": 48,
335
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.k_proj": 48,
336
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.o_proj": 48,
337
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.q_proj": 48,
338
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.up_proj": 48,
339
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.v_proj": 48
340
+ },
341
+ "arrow_config": null,
342
+ "auto_mapping": null,
343
+ "base_model_name_or_path": "/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it",
344
+ "bias": "none",
345
+ "corda_config": null,
346
+ "ensure_weight_tying": false,
347
+ "eva_config": null,
348
+ "exclude_modules": null,
349
+ "fan_in_fan_out": false,
350
+ "inference_mode": true,
351
+ "init_lora_weights": true,
352
+ "layer_replication": null,
353
+ "layers_pattern": null,
354
+ "layers_to_transform": null,
355
+ "loftq_config": {},
356
+ "lora_alpha": 48,
357
+ "lora_bias": false,
358
+ "lora_dropout": 0.05,
359
+ "lora_ga_config": null,
360
+ "megatron_config": null,
361
+ "megatron_core": "megatron.core",
362
+ "modules_to_save": null,
363
+ "monteclora_config": null,
364
+ "peft_type": "LORA",
365
+ "peft_version": "0.20.0",
366
+ "qalora_group_size": 16,
367
+ "r": 24,
368
+ "rank_pattern": {
369
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.down_proj": 25,
370
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.gate_proj": 25,
371
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.k_proj": 25,
372
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.o_proj": 25,
373
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.q_proj": 25,
374
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.up_proj": 25,
375
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.0\\.[^.]+\\.v_proj": 25,
376
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 24,
377
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 24,
378
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 24,
379
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 24,
380
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 24,
381
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 24,
382
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 24,
383
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 24,
384
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 24,
385
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 24,
386
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 24,
387
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 24,
388
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 24,
389
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 24,
390
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.down_proj": 24,
391
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.gate_proj": 24,
392
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.k_proj": 24,
393
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.o_proj": 24,
394
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.q_proj": 24,
395
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.up_proj": 24,
396
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.v_proj": 24,
397
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.down_proj": 24,
398
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.gate_proj": 24,
399
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.k_proj": 24,
400
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.o_proj": 24,
401
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.q_proj": 24,
402
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.up_proj": 24,
403
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.v_proj": 24,
404
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.down_proj": 24,
405
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.gate_proj": 24,
406
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.k_proj": 24,
407
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.o_proj": 24,
408
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.q_proj": 24,
409
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.up_proj": 24,
410
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.v_proj": 24,
411
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.down_proj": 24,
412
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.gate_proj": 24,
413
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.k_proj": 24,
414
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.o_proj": 24,
415
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.q_proj": 24,
416
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.up_proj": 24,
417
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.15\\.[^.]+\\.v_proj": 24,
418
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.down_proj": 24,
419
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.gate_proj": 24,
420
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.k_proj": 24,
421
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.o_proj": 24,
422
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.q_proj": 24,
423
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.up_proj": 24,
424
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.v_proj": 24,
425
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 24,
426
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 24,
427
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 24,
428
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 24,
429
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 24,
430
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 24,
431
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 24,
432
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 24,
433
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 24,
434
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 24,
435
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 24,
436
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 24,
437
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 24,
438
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 24,
439
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.down_proj": 24,
440
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.gate_proj": 24,
441
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.k_proj": 24,
442
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.o_proj": 24,
443
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.q_proj": 24,
444
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.up_proj": 24,
445
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.v_proj": 24,
446
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 24,
447
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 24,
448
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 24,
449
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 24,
450
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 24,
451
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 24,
452
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 24,
453
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 24,
454
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 24,
455
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 24,
456
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 24,
457
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 24,
458
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 24,
459
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 24,
460
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.down_proj": 24,
461
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.gate_proj": 24,
462
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.k_proj": 24,
463
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.o_proj": 24,
464
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.q_proj": 24,
465
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.up_proj": 24,
466
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.v_proj": 24,
467
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 24,
468
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 24,
469
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 24,
470
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 24,
471
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 24,
472
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 24,
473
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 24,
474
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.down_proj": 24,
475
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.gate_proj": 24,
476
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.k_proj": 24,
477
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.o_proj": 24,
478
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.q_proj": 24,
479
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.up_proj": 24,
480
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.v_proj": 24,
481
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 24,
482
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 24,
483
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 24,
484
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 24,
485
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 24,
486
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 24,
487
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 24,
488
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.down_proj": 24,
489
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.gate_proj": 24,
490
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.k_proj": 24,
491
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.o_proj": 24,
492
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.q_proj": 24,
493
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.up_proj": 24,
494
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.v_proj": 24,
495
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.down_proj": 24,
496
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.gate_proj": 24,
497
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.k_proj": 24,
498
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.o_proj": 24,
499
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.q_proj": 24,
500
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.up_proj": 24,
501
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.v_proj": 24,
502
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.down_proj": 24,
503
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.gate_proj": 24,
504
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.k_proj": 24,
505
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.o_proj": 24,
506
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.q_proj": 24,
507
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.up_proj": 24,
508
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.27\\.[^.]+\\.v_proj": 24,
509
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 24,
510
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 24,
511
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 24,
512
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 24,
513
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 24,
514
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 24,
515
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 24,
516
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.down_proj": 24,
517
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.gate_proj": 24,
518
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.k_proj": 24,
519
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.o_proj": 24,
520
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.q_proj": 24,
521
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.up_proj": 24,
522
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.29\\.[^.]+\\.v_proj": 24,
523
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 24,
524
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 24,
525
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 24,
526
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 24,
527
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 24,
528
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 24,
529
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 24,
530
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.down_proj": 24,
531
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.gate_proj": 24,
532
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.k_proj": 24,
533
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.o_proj": 24,
534
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.q_proj": 24,
535
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.up_proj": 24,
536
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.v_proj": 24,
537
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.down_proj": 24,
538
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.gate_proj": 24,
539
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.k_proj": 24,
540
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.o_proj": 24,
541
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.q_proj": 24,
542
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.up_proj": 24,
543
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.v_proj": 24,
544
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 24,
545
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 24,
546
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 24,
547
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 24,
548
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 24,
549
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 24,
550
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 24,
551
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.down_proj": 24,
552
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.gate_proj": 24,
553
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.k_proj": 24,
554
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.o_proj": 24,
555
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.q_proj": 24,
556
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.up_proj": 24,
557
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.33\\.[^.]+\\.v_proj": 24,
558
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 24,
559
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 24,
560
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 24,
561
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 24,
562
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 24,
563
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 24,
564
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 24,
565
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.down_proj": 24,
566
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.gate_proj": 24,
567
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.k_proj": 24,
568
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.o_proj": 24,
569
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.q_proj": 24,
570
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.up_proj": 24,
571
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.v_proj": 24,
572
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 24,
573
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 24,
574
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 24,
575
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 24,
576
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 24,
577
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 24,
578
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 24,
579
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 24,
580
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 24,
581
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 24,
582
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 24,
583
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 24,
584
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 24,
585
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 24,
586
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.down_proj": 24,
587
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.gate_proj": 24,
588
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.k_proj": 24,
589
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.o_proj": 24,
590
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.q_proj": 24,
591
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.up_proj": 24,
592
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.v_proj": 24,
593
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.down_proj": 24,
594
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.gate_proj": 24,
595
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.k_proj": 24,
596
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.o_proj": 24,
597
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.q_proj": 24,
598
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.up_proj": 24,
599
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.39\\.[^.]+\\.v_proj": 24,
600
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.down_proj": 24,
601
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.gate_proj": 24,
602
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.k_proj": 24,
603
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.o_proj": 24,
604
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.q_proj": 24,
605
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.up_proj": 24,
606
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.v_proj": 24,
607
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.down_proj": 24,
608
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.gate_proj": 24,
609
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.k_proj": 24,
610
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.o_proj": 24,
611
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.q_proj": 24,
612
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.up_proj": 24,
613
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.v_proj": 24,
614
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.down_proj": 24,
615
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.gate_proj": 24,
616
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.k_proj": 24,
617
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.o_proj": 24,
618
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.q_proj": 24,
619
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.up_proj": 24,
620
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.v_proj": 24,
621
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.down_proj": 24,
622
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.gate_proj": 24,
623
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.k_proj": 24,
624
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.o_proj": 24,
625
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.q_proj": 24,
626
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.up_proj": 24,
627
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.v_proj": 24,
628
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 24,
629
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 24,
630
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 24,
631
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 24,
632
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 24,
633
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 24,
634
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 24,
635
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.down_proj": 24,
636
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.gate_proj": 24,
637
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.k_proj": 24,
638
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.o_proj": 24,
639
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.q_proj": 24,
640
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.up_proj": 24,
641
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.v_proj": 24,
642
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.down_proj": 24,
643
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.gate_proj": 24,
644
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.k_proj": 24,
645
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.o_proj": 24,
646
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.q_proj": 24,
647
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.up_proj": 24,
648
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.v_proj": 24,
649
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 24,
650
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 24,
651
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 24,
652
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 24,
653
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 24,
654
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 24,
655
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 24,
656
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 24,
657
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 24,
658
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 24,
659
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 24,
660
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 24,
661
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 24,
662
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 24,
663
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 24,
664
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 24,
665
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 24,
666
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 24,
667
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 24,
668
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 24,
669
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 24,
670
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.down_proj": 24,
671
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.gate_proj": 24,
672
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.k_proj": 24,
673
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.o_proj": 24,
674
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.q_proj": 24,
675
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.up_proj": 24,
676
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.5\\.[^.]+\\.v_proj": 24,
677
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.down_proj": 24,
678
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.gate_proj": 24,
679
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.k_proj": 24,
680
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.o_proj": 24,
681
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.q_proj": 24,
682
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.up_proj": 24,
683
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.v_proj": 24,
684
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.down_proj": 24,
685
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.gate_proj": 24,
686
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.k_proj": 24,
687
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.o_proj": 24,
688
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.q_proj": 24,
689
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.up_proj": 24,
690
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.v_proj": 24,
691
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 24,
692
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 24,
693
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 24,
694
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 24,
695
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 24,
696
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 24,
697
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 24,
698
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.down_proj": 24,
699
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.gate_proj": 24,
700
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.k_proj": 24,
701
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.o_proj": 24,
702
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.q_proj": 24,
703
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.up_proj": 24,
704
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.v_proj": 24
705
+ },
706
+ "revision": null,
707
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
708
+ "target_parameters": null,
709
+ "task_type": "CAUSAL_LM",
710
+ "trainable_token_indices": null,
711
+ "use_bdlora": null,
712
+ "use_dora": false,
713
+ "use_qalora": false,
714
+ "use_rslora": false,
715
+ "velora_config": null
716
+ }
general-instruct/baseline_pedal/seed_42/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55375c3fe054dd075f7686d2b329fe39dbf654f6a9d0b1a8e6b1dfaace33d9ab
3
+ size 393264536
manifest.json CHANGED
@@ -560,6 +560,18 @@
560
  "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
561
  "trainable_parameter_percentage": 0.1676
562
  },
 
 
 
 
 
 
 
 
 
 
 
 
563
  {
564
  "path_in_repo": "general-instruct/baseline_fairnet/seed_42",
565
  "model_tier": "general-instruct",
@@ -608,6 +620,18 @@
608
  "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
609
  "trainable_parameter_percentage": null
610
  },
 
 
 
 
 
 
 
 
 
 
 
 
611
  {
612
  "path_in_repo": "general-instruct/graft_proposed/seed_42",
613
  "model_tier": "general-instruct",
@@ -1457,5 +1481,5 @@
1457
  "trainable_parameter_percentage": null
1458
  }
1459
  ],
1460
- "count": 108
1461
  }
 
560
  "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
561
  "trainable_parameter_percentage": 0.1676
562
  },
563
+ {
564
+ "path_in_repo": "general-instruct/baseline_dart/seed_42",
565
+ "model_tier": "general-instruct",
566
+ "base_model": "google/gemma-3-12b-it",
567
+ "base_model_revision": "96b6f1eccf38110c56df3a15bffe176da04bfd80",
568
+ "method": "baseline_dart",
569
+ "random_seed": 42,
570
+ "lora_rank_range": "24-25",
571
+ "lora_alpha": 48,
572
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
573
+ "trainable_parameter_percentage": null
574
+ },
575
  {
576
  "path_in_repo": "general-instruct/baseline_fairnet/seed_42",
577
  "model_tier": "general-instruct",
 
620
  "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
621
  "trainable_parameter_percentage": null
622
  },
623
+ {
624
+ "path_in_repo": "general-instruct/baseline_pedal/seed_42",
625
+ "model_tier": "general-instruct",
626
+ "base_model": "google/gemma-3-12b-it",
627
+ "base_model_revision": "96b6f1eccf38110c56df3a15bffe176da04bfd80",
628
+ "method": "baseline_pedal",
629
+ "random_seed": 42,
630
+ "lora_rank_range": "24-25",
631
+ "lora_alpha": 48,
632
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
633
+ "trainable_parameter_percentage": null
634
+ },
635
  {
636
  "path_in_repo": "general-instruct/graft_proposed/seed_42",
637
  "model_tier": "general-instruct",
 
1481
  "trainable_parameter_percentage": null
1482
  }
1483
  ],
1484
+ "count": 110
1485
  }