lucidrains

Working with Attention. It's all we need
San Francisco

Github Data

Followers 47135
Following 0

AI Project

Public repos: 323Public gists: 30

nGPT-pytorch

Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
star: 271fork: 20
language: Python
created at: 2024-10-08
updated at: 2025-01-21

mmdit

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch
star: 300fork: 8
language: Python
created at: 2024-05-04
updated at: 2025-02-09

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
star: 1.4Kfork: 73
language: Python
created at: 2024-01-19
updated at: 2025-02-05

llama-qrlhf

Implementation of the Llama architecture with RLHF + Q-learning
star: 160fork: 7
language: Python
created at: 2023-11-23
updated at: 2025-02-01

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
star: 7.7Kfork: 677
language: Python
created at: 2022-12-09
updated at: 2025-02-10

PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
star: 184fork: 10
language: Python
created at: 2022-04-08
updated at: 2024-12-12

PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
star: 821fork: 82
language: Python
created at: 2022-04-04
updated at: 2025-02-06

coco-lm-pytorch

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
star: 45fork: 7
language: Python
created at: 2021-03-02
updated at: 2024-11-05

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
star: 4.4Kfork: 321
language: Python
created at: 2021-01-17
updated at: 2025-02-09