DAPO
Dialogue-Adaptive Pre-training Objective
**Dialogue-Adaptive Pre-training Objective (DAPO)** is a pre-training objective for dialogue adaptation, which is designed to measure qualities of dialogues from multiple important aspects, like Readability, Consistency and Fluency which have already been focused on by general LM pre-training objectives, and those also significant for assessing dialogues but ignored by general LM pre-training objectives, like Diversity and Specificity.
Dialogue-adaptive Language Model Pre-training From Quality Estimation
https://paperswithcode.com/paper/task-specific-objectives-of-pre-trained
Dialogue-adaptive Language Model Pre-training From Quality Estimation