EleutherAI

• GPT-NeoX-20B Gen 2 Text

  Released 4y ago

  20B parameter open-source model; improved architecture over previous models.

• VQGAN-CLIP Gen 1 Image

  Released 5y ago

  Open-source combination for enhanced text-to-image synthesis.

• GPT-J Gen 1 Text

  Released 5y ago

  6B parameter open-source model; improved performance over GPT-Neo.

• GPT-Neo Gen 1 Text

  Released 5y ago

  GPT Open-source implementation inspired by GPT-3 architecture; multiple sizes released.

Datasets

• asdiv Dataset · License cc-by-nc-4.0 · 53,671 downloads · by EleutherAI
• drop Dataset · License cc-by-4.0 · 22,058 downloads · by EleutherAI
• headqa Dataset · License other · 102,966 downloads · by EleutherAI
• hendrycks_math Dataset · License mit · 198,545 downloads · by EleutherAI
• lambada_openai Dataset · License mit · language modeling · 108,106 downloads · by EleutherAI
• proof-pile-2 Dataset · 31,624 downloads · by EleutherAI
• wikitext_document_level Dataset · License cc-by-sa-3.0 · 78,239 downloads · by EleutherAI

Repositories

• cookbook Deep learning for dummies. All the practical details and useful utilities that go into working with real mode…
• knowledge-neurons A library for finding knowledge neurons in pretrained transformer models.
• sparsify Sparsify transformers with SAEs and transcoders