GPT-Neo
GPT-Neo
An implementation of model & data parallel [GPT3-like](https://paperswithcode.com/method/gpt-3) models using the [mesh-tensorflow](https://github.com/tensorflow/mesh) library.

Source: [EleutherAI/GPT-Neo](https://github.com/EleutherAI/gpt-neo)