Hugging Face's logo

Debk
/
AgriFair-GRAFT-adapters

PEFT
Safetensors
English
fairness
bias-mitigation
lora
agriculture
india
difference-awareness
Model card Files
xet
 Community
Debk commited on
Commit
dec1850
·
verified ·
1 Parent(s): d1ec339

AgriFair GRAFT adapters: 45 adapters

Browse files
Files changed (8) hide show
  1. README.md +2 -2
  2. general-instruct/ablation_placement_random_draw2/seed_42/README.md +207 -0
  3. general-instruct/ablation_placement_random_draw2/seed_42/adapter_config.json +464 -0
  4. general-instruct/ablation_placement_random_draw2/seed_42/adapter_model.safetensors +3 -0
  5. general-instruct/ablation_placement_random_draw3/seed_42/README.md +207 -0
  6. general-instruct/ablation_placement_random_draw3/seed_42/adapter_config.json +464 -0
  7. general-instruct/ablation_placement_random_draw3/seed_42/adapter_model.safetensors +3 -0
  8. manifest.json +25 -1
README.md CHANGED
@@ -28,7 +28,7 @@ census records a real difference, using Integrated Gradients. It places LoRA ada
28
  layers alone with rank proportional to attribution, and trains them with a condition-adaptive,
29
  rationale-aware objective.
30
 
31
- This repository holds **43 adapters** so that every number in the paper can be
32
  recomputed rather than taken on trust.
33
 
34
  ## Layout
@@ -41,7 +41,7 @@ manifest.json base model, revision, rank range and trainable sha
41
  | Tier | Base model | Adapters |
42
  |---|---|---|
43
  | `broad-instruct` | Qwen/Qwen3-4B-Instruct-2507 | 19 |
44
- | `general-instruct` | google/gemma-3-12b-it | 5 |
45
  | `small-instruct` | meta-llama/Llama-3.2-3B-Instruct | 19 |
46
 
47
  Methods present: `ablation_no_condition_adaptive`, `ablation_no_rationale_loss`, `ablation_placement_random`, `ablation_placement_random_draw2`, `ablation_placement_random_draw3`, `ablation_placement_uniform`, `ablation_rank_sweep_16`, `ablation_rank_sweep_32`, `ablation_rank_sweep_8`, `graft_proposed`, `graft_proposed_loao_gender`, `graft_proposed_loao_landholding`, `graft_proposed_loao_social_group`, `graft_proposed_qlora_nf4`, `reference_vanilla_lora_loao_gender`, `reference_vanilla_lora_loao_landholding`, `reference_vanilla_lora_loao_social_group`
 
28
  layers alone with rank proportional to attribution, and trains them with a condition-adaptive,
29
  rationale-aware objective.
30
 
31
+ This repository holds **45 adapters** so that every number in the paper can be
32
  recomputed rather than taken on trust.
33
 
34
  ## Layout
 
41
  | Tier | Base model | Adapters |
42
  |---|---|---|
43
  | `broad-instruct` | Qwen/Qwen3-4B-Instruct-2507 | 19 |
44
+ | `general-instruct` | google/gemma-3-12b-it | 7 |
45
  | `small-instruct` | meta-llama/Llama-3.2-3B-Instruct | 19 |
46
 
47
  Methods present: `ablation_no_condition_adaptive`, `ablation_no_rationale_loss`, `ablation_placement_random`, `ablation_placement_random_draw2`, `ablation_placement_random_draw3`, `ablation_placement_uniform`, `ablation_rank_sweep_16`, `ablation_rank_sweep_32`, `ablation_rank_sweep_8`, `graft_proposed`, `graft_proposed_loao_gender`, `graft_proposed_loao_landholding`, `graft_proposed_loao_social_group`, `graft_proposed_qlora_nf4`, `reference_vanilla_lora_loao_gender`, `reference_vanilla_lora_loao_landholding`, `reference_vanilla_lora_loao_social_group`
general-instruct/ablation_placement_random_draw2/seed_42/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: /workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.20.0
general-instruct/ablation_placement_random_draw2/seed_42/adapter_config.json ADDED
@@ -0,0 +1,464 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {
4
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 114,
5
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 114,
6
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 114,
7
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 114,
8
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 114,
9
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 114,
10
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 114,
11
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 126,
12
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 126,
13
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 126,
14
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 126,
15
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 126,
16
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 126,
17
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 126,
18
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.down_proj": 58,
19
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.gate_proj": 58,
20
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.k_proj": 58,
21
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.o_proj": 58,
22
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.q_proj": 58,
23
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.up_proj": 58,
24
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.v_proj": 58,
25
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.down_proj": 104,
26
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.gate_proj": 104,
27
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.k_proj": 104,
28
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.o_proj": 104,
29
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.q_proj": 104,
30
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.up_proj": 104,
31
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.v_proj": 104,
32
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 94,
33
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 94,
34
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 94,
35
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 94,
36
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 94,
37
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 94,
38
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 94,
39
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 78,
40
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 78,
41
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 78,
42
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 78,
43
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 78,
44
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 78,
45
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 78,
46
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.down_proj": 80,
47
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.gate_proj": 80,
48
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.k_proj": 80,
49
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.o_proj": 80,
50
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.q_proj": 80,
51
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.up_proj": 80,
52
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.v_proj": 80,
53
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 20,
54
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 20,
55
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 20,
56
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 20,
57
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 20,
58
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 20,
59
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 20,
60
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 70,
61
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 70,
62
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 70,
63
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 70,
64
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 70,
65
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 70,
66
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 70,
67
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 20,
68
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 20,
69
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 20,
70
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 20,
71
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 20,
72
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 20,
73
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 20,
74
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 118,
75
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 118,
76
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 118,
77
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 118,
78
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 118,
79
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 118,
80
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 118,
81
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 128,
82
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 128,
83
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 128,
84
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 128,
85
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 128,
86
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 128,
87
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 128,
88
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 54,
89
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 54,
90
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 54,
91
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 54,
92
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 54,
93
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 54,
94
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 54,
95
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.down_proj": 106,
96
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.gate_proj": 106,
97
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.k_proj": 106,
98
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.o_proj": 106,
99
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.q_proj": 106,
100
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.up_proj": 106,
101
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.v_proj": 106,
102
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 126,
103
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 126,
104
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 126,
105
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 126,
106
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 126,
107
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 126,
108
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 126,
109
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 98,
110
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 98,
111
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 98,
112
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 98,
113
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 98,
114
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 98,
115
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 98,
116
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.down_proj": 28,
117
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.gate_proj": 28,
118
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.k_proj": 28,
119
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.o_proj": 28,
120
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.q_proj": 28,
121
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.up_proj": 28,
122
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.v_proj": 28,
123
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 42,
124
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 42,
125
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 42,
126
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 42,
127
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 42,
128
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 42,
129
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 42,
130
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 66,
131
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 66,
132
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 66,
133
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 66,
134
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 66,
135
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 66,
136
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 66,
137
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.down_proj": 114,
138
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.gate_proj": 114,
139
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.k_proj": 114,
140
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.o_proj": 114,
141
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.q_proj": 114,
142
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.up_proj": 114,
143
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.v_proj": 114,
144
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.down_proj": 34,
145
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.gate_proj": 34,
146
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.k_proj": 34,
147
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.o_proj": 34,
148
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.q_proj": 34,
149
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.up_proj": 34,
150
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.v_proj": 34,
151
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.down_proj": 124,
152
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.gate_proj": 124,
153
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.k_proj": 124,
154
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.o_proj": 124,
155
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.q_proj": 124,
156
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.up_proj": 124,
157
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.v_proj": 124,
158
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.down_proj": 58,
159
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.gate_proj": 58,
160
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.k_proj": 58,
161
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.o_proj": 58,
162
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.q_proj": 58,
163
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.up_proj": 58,
164
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.v_proj": 58,
165
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 42,
166
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 42,
167
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 42,
168
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 42,
169
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 42,
170
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 42,
171
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 42,
172
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.down_proj": 60,
173
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.gate_proj": 60,
174
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.k_proj": 60,
175
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.o_proj": 60,
176
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.q_proj": 60,
177
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.up_proj": 60,
178
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.v_proj": 60,
179
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 100,
180
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 100,
181
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 100,
182
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 100,
183
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 100,
184
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 100,
185
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 100,
186
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 44,
187
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 44,
188
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 44,
189
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 44,
190
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 44,
191
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 44,
192
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 44,
193
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 24,
194
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 24,
195
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 24,
196
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 24,
197
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 24,
198
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 24,
199
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 24,
200
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 112,
201
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 112,
202
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 112,
203
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 112,
204
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 112,
205
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 112,
206
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 112,
207
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.down_proj": 64,
208
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.gate_proj": 64,
209
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.k_proj": 64,
210
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.o_proj": 64,
211
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.q_proj": 64,
212
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.up_proj": 64,
213
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.v_proj": 64
214
+ },
215
+ "arrow_config": null,
216
+ "auto_mapping": null,
217
+ "base_model_name_or_path": "/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it",
218
+ "bias": "none",
219
+ "corda_config": null,
220
+ "ensure_weight_tying": false,
221
+ "eva_config": null,
222
+ "exclude_modules": null,
223
+ "fan_in_fan_out": false,
224
+ "inference_mode": true,
225
+ "init_lora_weights": true,
226
+ "layer_replication": null,
227
+ "layers_pattern": null,
228
+ "layers_to_transform": null,
229
+ "loftq_config": {},
230
+ "lora_alpha": 20,
231
+ "lora_bias": false,
232
+ "lora_dropout": 0.05,
233
+ "lora_ga_config": null,
234
+ "megatron_config": null,
235
+ "megatron_core": "megatron.core",
236
+ "modules_to_save": null,
237
+ "monteclora_config": null,
238
+ "peft_type": "LORA",
239
+ "peft_version": "0.20.0",
240
+ "qalora_group_size": 16,
241
+ "r": 10,
242
+ "rank_pattern": {
243
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 57,
244
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 57,
245
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 57,
246
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 57,
247
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 57,
248
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 57,
249
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 57,
250
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 63,
251
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 63,
252
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 63,
253
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 63,
254
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 63,
255
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 63,
256
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 63,
257
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.down_proj": 29,
258
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.gate_proj": 29,
259
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.k_proj": 29,
260
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.o_proj": 29,
261
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.q_proj": 29,
262
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.up_proj": 29,
263
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.14\\.[^.]+\\.v_proj": 29,
264
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.down_proj": 52,
265
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.gate_proj": 52,
266
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.k_proj": 52,
267
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.o_proj": 52,
268
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.q_proj": 52,
269
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.up_proj": 52,
270
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.16\\.[^.]+\\.v_proj": 52,
271
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 47,
272
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 47,
273
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 47,
274
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 47,
275
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 47,
276
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 47,
277
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 47,
278
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 39,
279
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 39,
280
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 39,
281
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 39,
282
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 39,
283
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 39,
284
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 39,
285
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.down_proj": 40,
286
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.gate_proj": 40,
287
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.k_proj": 40,
288
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.o_proj": 40,
289
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.q_proj": 40,
290
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.up_proj": 40,
291
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.19\\.[^.]+\\.v_proj": 40,
292
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 10,
293
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 10,
294
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 10,
295
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 10,
296
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 10,
297
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 10,
298
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 10,
299
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 35,
300
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 35,
301
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 35,
302
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 35,
303
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 35,
304
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 35,
305
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 35,
306
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 10,
307
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 10,
308
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 10,
309
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 10,
310
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 10,
311
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 10,
312
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 10,
313
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 59,
314
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 59,
315
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 59,
316
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 59,
317
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 59,
318
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 59,
319
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 59,
320
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 64,
321
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 64,
322
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 64,
323
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 64,
324
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 64,
325
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 64,
326
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 64,
327
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 27,
328
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 27,
329
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 27,
330
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 27,
331
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 27,
332
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 27,
333
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 27,
334
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.down_proj": 53,
335
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.gate_proj": 53,
336
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.k_proj": 53,
337
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.o_proj": 53,
338
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.q_proj": 53,
339
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.up_proj": 53,
340
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.31\\.[^.]+\\.v_proj": 53,
341
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 63,
342
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 63,
343
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 63,
344
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 63,
345
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 63,
346
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 63,
347
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 63,
348
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 49,
349
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 49,
350
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 49,
351
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 49,
352
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 49,
353
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 49,
354
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 49,
355
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.down_proj": 14,
356
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.gate_proj": 14,
357
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.k_proj": 14,
358
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.o_proj": 14,
359
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.q_proj": 14,
360
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.up_proj": 14,
361
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.35\\.[^.]+\\.v_proj": 14,
362
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 21,
363
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 21,
364
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 21,
365
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 21,
366
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 21,
367
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 21,
368
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 21,
369
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 33,
370
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 33,
371
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 33,
372
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 33,
373
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 33,
374
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 33,
375
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 33,
376
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.down_proj": 57,
377
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.gate_proj": 57,
378
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.k_proj": 57,
379
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.o_proj": 57,
380
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.q_proj": 57,
381
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.up_proj": 57,
382
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.38\\.[^.]+\\.v_proj": 57,
383
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.down_proj": 17,
384
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.gate_proj": 17,
385
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.k_proj": 17,
386
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.o_proj": 17,
387
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.q_proj": 17,
388
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.up_proj": 17,
389
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.3\\.[^.]+\\.v_proj": 17,
390
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.down_proj": 62,
391
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.gate_proj": 62,
392
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.k_proj": 62,
393
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.o_proj": 62,
394
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.q_proj": 62,
395
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.up_proj": 62,
396
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.41\\.[^.]+\\.v_proj": 62,
397
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.down_proj": 29,
398
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.gate_proj": 29,
399
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.k_proj": 29,
400
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.o_proj": 29,
401
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.q_proj": 29,
402
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.up_proj": 29,
403
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.42\\.[^.]+\\.v_proj": 29,
404
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 21,
405
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 21,
406
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 21,
407
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 21,
408
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 21,
409
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 21,
410
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 21,
411
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.down_proj": 30,
412
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.gate_proj": 30,
413
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.k_proj": 30,
414
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.o_proj": 30,
415
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.q_proj": 30,
416
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.up_proj": 30,
417
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.44\\.[^.]+\\.v_proj": 30,
418
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 50,
419
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 50,
420
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 50,
421
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 50,
422
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 50,
423
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 50,
424
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 50,
425
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 22,
426
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 22,
427
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 22,
428
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 22,
429
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 22,
430
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 22,
431
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 22,
432
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 12,
433
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 12,
434
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 12,
435
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 12,
436
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 12,
437
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 12,
438
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 12,
439
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 56,
440
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 56,
441
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 56,
442
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 56,
443
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 56,
444
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 56,
445
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 56,
446
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.down_proj": 32,
447
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.gate_proj": 32,
448
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.k_proj": 32,
449
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.o_proj": 32,
450
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.q_proj": 32,
451
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.up_proj": 32,
452
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.9\\.[^.]+\\.v_proj": 32
453
+ },
454
+ "revision": null,
455
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(1|2|3|4|8|9|10|11|14|16|17|18|19|20|22|24|28|31|32|34|35|36|37|38|41|42|43|44|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
456
+ "target_parameters": null,
457
+ "task_type": "CAUSAL_LM",
458
+ "trainable_token_indices": null,
459
+ "use_bdlora": null,
460
+ "use_dora": false,
461
+ "use_qalora": false,
462
+ "use_rslora": false,
463
+ "velora_config": null
464
+ }
general-instruct/ablation_placement_random_draw2/seed_42/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d6492345cef752b7f149afb943be032fd64c55d22f8e15f1b6d03a5fd6ec72e
3
+ size 393226768
general-instruct/ablation_placement_random_draw3/seed_42/README.md ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: /workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it
7
+ - lora
8
+ - transformers
9
+ ---
10
+
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ <!-- Provide a longer summary of what this model is. -->
22
+
23
+
24
+
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
+
33
+ ### Model Sources [optional]
34
+
35
+ <!-- Provide the basic links for the model. -->
36
+
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
40
+
41
+ ## Uses
42
+
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
+
45
+ ### Direct Use
46
+
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Downstream Use [optional]
52
+
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
+
55
+ [More Information Needed]
56
+
57
+ ### Out-of-Scope Use
58
+
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ## Bias, Risks, and Limitations
64
+
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
+
67
+ [More Information Needed]
68
+
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
+
207
+ - PEFT 0.20.0
general-instruct/ablation_placement_random_draw3/seed_42/adapter_config.json ADDED
@@ -0,0 +1,464 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {
4
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 58,
5
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 58,
6
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 58,
7
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 58,
8
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 58,
9
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 58,
10
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 58,
11
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 126,
12
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 126,
13
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 126,
14
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 126,
15
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 126,
16
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 126,
17
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 126,
18
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.down_proj": 66,
19
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.gate_proj": 66,
20
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.k_proj": 66,
21
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.o_proj": 66,
22
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.q_proj": 66,
23
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.up_proj": 66,
24
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.v_proj": 66,
25
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.down_proj": 94,
26
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.gate_proj": 94,
27
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.k_proj": 94,
28
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.o_proj": 94,
29
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.q_proj": 94,
30
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.up_proj": 94,
31
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.v_proj": 94,
32
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 104,
33
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 104,
34
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 104,
35
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 104,
36
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 104,
37
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 104,
38
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 104,
39
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 58,
40
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 58,
41
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 58,
42
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 58,
43
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 58,
44
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 58,
45
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 58,
46
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 44,
47
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 44,
48
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 44,
49
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 44,
50
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 44,
51
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 44,
52
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 44,
53
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 114,
54
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 114,
55
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 114,
56
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 114,
57
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 114,
58
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 114,
59
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 114,
60
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.down_proj": 78,
61
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.gate_proj": 78,
62
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.k_proj": 78,
63
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.o_proj": 78,
64
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.q_proj": 78,
65
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.up_proj": 78,
66
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.v_proj": 78,
67
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 54,
68
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 54,
69
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 54,
70
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 54,
71
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 54,
72
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 54,
73
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 54,
74
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.down_proj": 42,
75
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.gate_proj": 42,
76
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.k_proj": 42,
77
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.o_proj": 42,
78
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.q_proj": 42,
79
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.up_proj": 42,
80
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.v_proj": 42,
81
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 112,
82
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 112,
83
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 112,
84
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 112,
85
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 112,
86
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 112,
87
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 112,
88
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.down_proj": 80,
89
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.gate_proj": 80,
90
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.k_proj": 80,
91
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.o_proj": 80,
92
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.q_proj": 80,
93
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.up_proj": 80,
94
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.v_proj": 80,
95
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.down_proj": 34,
96
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.gate_proj": 34,
97
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.k_proj": 34,
98
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.o_proj": 34,
99
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.q_proj": 34,
100
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.up_proj": 34,
101
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.v_proj": 34,
102
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 28,
103
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 28,
104
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 28,
105
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 28,
106
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 28,
107
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 28,
108
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 28,
109
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 98,
110
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 98,
111
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 98,
112
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 98,
113
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 98,
114
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 98,
115
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 98,
116
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.down_proj": 106,
117
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.gate_proj": 106,
118
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.k_proj": 106,
119
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.o_proj": 106,
120
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.q_proj": 106,
121
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.up_proj": 106,
122
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.v_proj": 106,
123
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 100,
124
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 100,
125
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 100,
126
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 100,
127
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 100,
128
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 100,
129
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 100,
130
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 64,
131
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 64,
132
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 64,
133
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 64,
134
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 64,
135
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 64,
136
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 64,
137
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 114,
138
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 114,
139
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 114,
140
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 114,
141
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 114,
142
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 114,
143
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 114,
144
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 70,
145
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 70,
146
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 70,
147
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 70,
148
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 70,
149
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 70,
150
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 70,
151
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.down_proj": 42,
152
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.gate_proj": 42,
153
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.k_proj": 42,
154
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.o_proj": 42,
155
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.q_proj": 42,
156
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.up_proj": 42,
157
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.v_proj": 42,
158
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 60,
159
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 60,
160
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 60,
161
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 60,
162
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 60,
163
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 60,
164
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 60,
165
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.down_proj": 126,
166
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.gate_proj": 126,
167
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.k_proj": 126,
168
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.o_proj": 126,
169
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.q_proj": 126,
170
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.up_proj": 126,
171
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.v_proj": 126,
172
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 128,
173
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 128,
174
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 128,
175
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 128,
176
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 128,
177
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 128,
178
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 128,
179
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 118,
180
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 118,
181
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 118,
182
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 118,
183
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 118,
184
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 118,
185
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 118,
186
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 20,
187
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 20,
188
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 20,
189
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 20,
190
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 20,
191
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 20,
192
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 20,
193
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.down_proj": 124,
194
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.gate_proj": 124,
195
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.k_proj": 124,
196
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.o_proj": 124,
197
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.q_proj": 124,
198
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.up_proj": 124,
199
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.v_proj": 124,
200
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.down_proj": 20,
201
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.gate_proj": 20,
202
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.k_proj": 20,
203
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.o_proj": 20,
204
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.q_proj": 20,
205
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.up_proj": 20,
206
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.v_proj": 20,
207
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 24,
208
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 24,
209
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 24,
210
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 24,
211
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 24,
212
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 24,
213
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 24
214
+ },
215
+ "arrow_config": null,
216
+ "auto_mapping": null,
217
+ "base_model_name_or_path": "/workspace/Finetune_AgriFair/models/google__gemma-3-12b-it",
218
+ "bias": "none",
219
+ "corda_config": null,
220
+ "ensure_weight_tying": false,
221
+ "eva_config": null,
222
+ "exclude_modules": null,
223
+ "fan_in_fan_out": false,
224
+ "inference_mode": true,
225
+ "init_lora_weights": true,
226
+ "layer_replication": null,
227
+ "layers_pattern": null,
228
+ "layers_to_transform": null,
229
+ "loftq_config": {},
230
+ "lora_alpha": 20,
231
+ "lora_bias": false,
232
+ "lora_dropout": 0.05,
233
+ "lora_ga_config": null,
234
+ "megatron_config": null,
235
+ "megatron_core": "megatron.core",
236
+ "modules_to_save": null,
237
+ "monteclora_config": null,
238
+ "peft_type": "LORA",
239
+ "peft_version": "0.20.0",
240
+ "qalora_group_size": 16,
241
+ "r": 10,
242
+ "rank_pattern": {
243
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.down_proj": 29,
244
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.gate_proj": 29,
245
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.k_proj": 29,
246
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.o_proj": 29,
247
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.q_proj": 29,
248
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.up_proj": 29,
249
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.10\\.[^.]+\\.v_proj": 29,
250
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.down_proj": 63,
251
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.gate_proj": 63,
252
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.k_proj": 63,
253
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.o_proj": 63,
254
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.q_proj": 63,
255
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.up_proj": 63,
256
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.11\\.[^.]+\\.v_proj": 63,
257
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.down_proj": 33,
258
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.gate_proj": 33,
259
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.k_proj": 33,
260
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.o_proj": 33,
261
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.q_proj": 33,
262
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.up_proj": 33,
263
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.12\\.[^.]+\\.v_proj": 33,
264
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.down_proj": 47,
265
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.gate_proj": 47,
266
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.k_proj": 47,
267
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.o_proj": 47,
268
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.q_proj": 47,
269
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.up_proj": 47,
270
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.13\\.[^.]+\\.v_proj": 47,
271
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.down_proj": 52,
272
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.gate_proj": 52,
273
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.k_proj": 52,
274
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.o_proj": 52,
275
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.q_proj": 52,
276
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.up_proj": 52,
277
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.17\\.[^.]+\\.v_proj": 52,
278
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.down_proj": 29,
279
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.gate_proj": 29,
280
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.k_proj": 29,
281
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.o_proj": 29,
282
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.q_proj": 29,
283
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.up_proj": 29,
284
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.18\\.[^.]+\\.v_proj": 29,
285
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.down_proj": 22,
286
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.gate_proj": 22,
287
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.k_proj": 22,
288
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.o_proj": 22,
289
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.q_proj": 22,
290
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.up_proj": 22,
291
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.1\\.[^.]+\\.v_proj": 22,
292
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.down_proj": 57,
293
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.gate_proj": 57,
294
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.k_proj": 57,
295
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.o_proj": 57,
296
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.q_proj": 57,
297
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.up_proj": 57,
298
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.20\\.[^.]+\\.v_proj": 57,
299
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.down_proj": 39,
300
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.gate_proj": 39,
301
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.k_proj": 39,
302
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.o_proj": 39,
303
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.q_proj": 39,
304
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.up_proj": 39,
305
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.21\\.[^.]+\\.v_proj": 39,
306
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.down_proj": 27,
307
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.gate_proj": 27,
308
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.k_proj": 27,
309
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.o_proj": 27,
310
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.q_proj": 27,
311
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.up_proj": 27,
312
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.22\\.[^.]+\\.v_proj": 27,
313
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.down_proj": 21,
314
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.gate_proj": 21,
315
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.k_proj": 21,
316
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.o_proj": 21,
317
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.q_proj": 21,
318
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.up_proj": 21,
319
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.23\\.[^.]+\\.v_proj": 21,
320
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.down_proj": 56,
321
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.gate_proj": 56,
322
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.k_proj": 56,
323
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.o_proj": 56,
324
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.q_proj": 56,
325
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.up_proj": 56,
326
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.24\\.[^.]+\\.v_proj": 56,
327
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.down_proj": 40,
328
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.gate_proj": 40,
329
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.k_proj": 40,
330
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.o_proj": 40,
331
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.q_proj": 40,
332
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.up_proj": 40,
333
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.25\\.[^.]+\\.v_proj": 40,
334
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.down_proj": 17,
335
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.gate_proj": 17,
336
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.k_proj": 17,
337
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.o_proj": 17,
338
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.q_proj": 17,
339
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.up_proj": 17,
340
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.26\\.[^.]+\\.v_proj": 17,
341
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.down_proj": 14,
342
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.gate_proj": 14,
343
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.k_proj": 14,
344
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.o_proj": 14,
345
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.q_proj": 14,
346
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.up_proj": 14,
347
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.28\\.[^.]+\\.v_proj": 14,
348
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.down_proj": 49,
349
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.gate_proj": 49,
350
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.k_proj": 49,
351
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.o_proj": 49,
352
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.q_proj": 49,
353
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.up_proj": 49,
354
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.2\\.[^.]+\\.v_proj": 49,
355
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.down_proj": 53,
356
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.gate_proj": 53,
357
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.k_proj": 53,
358
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.o_proj": 53,
359
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.q_proj": 53,
360
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.up_proj": 53,
361
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.30\\.[^.]+\\.v_proj": 53,
362
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.down_proj": 50,
363
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.gate_proj": 50,
364
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.k_proj": 50,
365
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.o_proj": 50,
366
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.q_proj": 50,
367
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.up_proj": 50,
368
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.32\\.[^.]+\\.v_proj": 50,
369
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.down_proj": 32,
370
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.gate_proj": 32,
371
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.k_proj": 32,
372
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.o_proj": 32,
373
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.q_proj": 32,
374
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.up_proj": 32,
375
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.34\\.[^.]+\\.v_proj": 32,
376
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.down_proj": 57,
377
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.gate_proj": 57,
378
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.k_proj": 57,
379
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.o_proj": 57,
380
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.q_proj": 57,
381
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.up_proj": 57,
382
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.36\\.[^.]+\\.v_proj": 57,
383
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.down_proj": 35,
384
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.gate_proj": 35,
385
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.k_proj": 35,
386
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.o_proj": 35,
387
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.q_proj": 35,
388
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.up_proj": 35,
389
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.37\\.[^.]+\\.v_proj": 35,
390
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.down_proj": 21,
391
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.gate_proj": 21,
392
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.k_proj": 21,
393
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.o_proj": 21,
394
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.q_proj": 21,
395
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.up_proj": 21,
396
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.40\\.[^.]+\\.v_proj": 21,
397
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.down_proj": 30,
398
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.gate_proj": 30,
399
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.k_proj": 30,
400
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.o_proj": 30,
401
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.q_proj": 30,
402
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.up_proj": 30,
403
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.43\\.[^.]+\\.v_proj": 30,
404
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.down_proj": 63,
405
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.gate_proj": 63,
406
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.k_proj": 63,
407
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.o_proj": 63,
408
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.q_proj": 63,
409
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.up_proj": 63,
410
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.45\\.[^.]+\\.v_proj": 63,
411
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.down_proj": 64,
412
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.gate_proj": 64,
413
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.k_proj": 64,
414
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.o_proj": 64,
415
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.q_proj": 64,
416
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.up_proj": 64,
417
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.46\\.[^.]+\\.v_proj": 64,
418
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.down_proj": 59,
419
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.gate_proj": 59,
420
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.k_proj": 59,
421
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.o_proj": 59,
422
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.q_proj": 59,
423
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.up_proj": 59,
424
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.47\\.[^.]+\\.v_proj": 59,
425
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.down_proj": 10,
426
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.gate_proj": 10,
427
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.k_proj": 10,
428
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.o_proj": 10,
429
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.q_proj": 10,
430
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.up_proj": 10,
431
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.4\\.[^.]+\\.v_proj": 10,
432
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.down_proj": 62,
433
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.gate_proj": 62,
434
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.k_proj": 62,
435
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.o_proj": 62,
436
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.q_proj": 62,
437
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.up_proj": 62,
438
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.6\\.[^.]+\\.v_proj": 62,
439
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.down_proj": 10,
440
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.gate_proj": 10,
441
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.k_proj": 10,
442
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.o_proj": 10,
443
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.q_proj": 10,
444
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.up_proj": 10,
445
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.7\\.[^.]+\\.v_proj": 10,
446
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.down_proj": 12,
447
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.gate_proj": 12,
448
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.k_proj": 12,
449
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.o_proj": 12,
450
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.q_proj": 12,
451
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.up_proj": 12,
452
+ "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*(?:layers|h)\\.8\\.[^.]+\\.v_proj": 12
453
+ },
454
+ "revision": null,
455
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(1|2|4|6|7|8|10|11|12|13|17|18|20|21|22|23|24|25|26|28|30|32|34|36|37|40|43|45|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
456
+ "target_parameters": null,
457
+ "task_type": "CAUSAL_LM",
458
+ "trainable_token_indices": null,
459
+ "use_bdlora": null,
460
+ "use_dora": false,
461
+ "use_qalora": false,
462
+ "use_rslora": false,
463
+ "velora_config": null
464
+ }
general-instruct/ablation_placement_random_draw3/seed_42/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99a57c659d01cddcad9b5292d6ae7adcc23595fb2ad5bb0054e78f48f5fb07f5
3
+ size 393226760
manifest.json CHANGED
@@ -264,6 +264,30 @@
264
  "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|5|6|9|10|11|12|13|14|16|17|19|20|21|22|23|24|25|26|27|33|37|40|41|42|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
265
  "trainable_parameter_percentage": null
266
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
267
  {
268
  "path_in_repo": "general-instruct/ablation_placement_uniform/seed_42",
269
  "model_tier": "general-instruct",
@@ -565,5 +589,5 @@
565
  "trainable_parameter_percentage": null
566
  }
567
  ],
568
- "count": 43
569
  }
 
264
  "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(0|1|2|3|5|6|9|10|11|12|13|14|16|17|19|20|21|22|23|24|25|26|27|33|37|40|41|42|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
265
  "trainable_parameter_percentage": null
266
  },
267
+ {
268
+ "path_in_repo": "general-instruct/ablation_placement_random_draw2/seed_42",
269
+ "model_tier": "general-instruct",
270
+ "base_model": "google/gemma-3-12b-it",
271
+ "base_model_revision": "96b6f1eccf38110c56df3a15bffe176da04bfd80",
272
+ "method": "ablation_placement_random_draw2",
273
+ "random_seed": 42,
274
+ "lora_rank_range": "10-64",
275
+ "lora_alpha": 20,
276
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(1|2|3|4|8|9|10|11|14|16|17|18|19|20|22|24|28|31|32|34|35|36|37|38|41|42|43|44|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
277
+ "trainable_parameter_percentage": null
278
+ },
279
+ {
280
+ "path_in_repo": "general-instruct/ablation_placement_random_draw3/seed_42",
281
+ "model_tier": "general-instruct",
282
+ "base_model": "google/gemma-3-12b-it",
283
+ "base_model_revision": "96b6f1eccf38110c56df3a15bffe176da04bfd80",
284
+ "method": "ablation_placement_random_draw3",
285
+ "random_seed": 42,
286
+ "lora_rank_range": "10-64",
287
+ "lora_alpha": 20,
288
+ "target_modules": "(?!.*(?:vision_tower|vision_model|visual|image_encoder|multi_modal_projector|audio_tower)).*\\.(?:layers|h)\\.(1|2|4|6|7|8|10|11|12|13|17|18|20|21|22|23|24|25|26|28|30|32|34|36|37|40|43|45|46|47)\\.[^.]+\\.(q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)",
289
+ "trainable_parameter_percentage": null
290
+ },
291
  {
292
  "path_in_repo": "general-instruct/ablation_placement_uniform/seed_42",
293
  "model_tier": "general-instruct",
 
589
  "trainable_parameter_percentage": null
590
  }
591
  ],
592
+ "count": 45
593
  }