GPT
GPT
**GPT** is a [Transformer](https://paperswithcode.com/method/transformer)-based architecture and training procedure for natural language processing tasks. Training follows a two-stage procedure. First, a language modeling objective is used on
the unlabeled data to learn the initial parameters of a neural network model. Subsequently, these parameters are adapted to a target task using the corresponding supervised objective.
Improving Language Understanding by Generative Pre-Training
https://paperswithcode.com/paper/improving-language-understanding-by
Improving Language Understanding by Generative Pre-Training