Editing Models with Task Arithmetic
Paper • 2212.04089 • Published • 7
This is a merge of pre-trained language models created using mergekit.
This model was merged using the task arithmetic merge method using sam-paech/Darkest-muse-v1 + TouchNight/gemma-2-9b-it-abliterated-LoRA-untied as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
base_model: sam-paech/Darkest-muse-v1+TouchNight/gemma-2-9b-it-abliterated-LoRA-untied
dtype: bfloat16
merge_method: task_arithmetic
parameters:
normalize: false
slices:
- sources:
- layer_range: [0, 42]
model: sam-paech/Darkest-muse-v1+TouchNight/gemma-2-9b-it-abliterated-LoRA-untied
parameters:
weight: 1.0