Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification
Paper • 2607.12987 • Published
How to use hcarrion/cutaneous_T-cell_lymphoma with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2-1-base", dtype=torch.bfloat16, device_map="cuda")
pipe.load_textual_inversion("hcarrion/cutaneous_T-cell_lymphoma")This repository contains the textual inversion and fine-tuning weights for cutaneous T-cell lymphoma, trained on top of stabilityai/stable-diffusion-2-1-base as part of the cgDDI (Controllable Generation of Diverse Dermatological Imagery) framework.
This model uses textual inversion to learn the disease-specific concept <cutaneous_T-cell_lymphoma-class>. It can be used to generate diverse, controllable, and skin-tone-balanced synthetic imagery of cutaneous T-cell lymphoma to support fair machine learning classification in dermatology.
You can load and run this model using the diffusers library:
import torch
from diffusers import StableDiffusionPipeline
model_id = "hcarrion/cutaneous_T-cell_lymphoma"
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")
prompt = "a photo of a skin lesion of <cutaneous_T-cell_lymphoma-class> on dark skin"
image = pipe(prompt).images[0]
image.save("synthetic_lesion.png")
If you use this model or the cgDDI framework in your research, please cite:
@inproceedings{carrion2026cgddi,
title = {Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification},
author = {Carri{\'o}n, H{\'e}ctor and Norouzi, Narges},
booktitle = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
year = {2026},
publisher = {Springer},
series = {Lecture Notes in Computer Science}
}
Base model
stabilityai/stable-diffusion-2-1-base