LOGO

lucidrains

Working with Attention. It's all we need
San Francisco

Github Data

Followers 43010
Following 0

Links

https://lucidrains.github.io

AI Project

Public repos: 314Public gists: 29

nGPT-pytorch

Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
star: 259fork: 18
language: Python
created at: 2024-10-08
updated at: 2024-11-22

mmdit

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch
star: 256fork: 5
language: Python
created at: 2024-05-04
updated at: 2024-11-22

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
star: 1.3Kfork: 73
language: Python
created at: 2024-01-19
updated at: 2024-11-21

llama-qrlhf

Implementation of the Llama architecture with RLHF + Q-learning
star: 157fork: 6
language: Python
created at: 2023-11-23
updated at: 2024-11-14

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
star: 7.7Kfork: 669
language: Python
created at: 2022-12-09
updated at: 2024-11-24

PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
star: 185fork: 12
language: Python
created at: 2022-04-08
updated at: 2024-10-24

PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
star: 821fork: 82
language: Python
created at: 2022-04-04
updated at: 2024-11-18

coco-lm-pytorch

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
star: 45fork: 7
language: Python
created at: 2021-03-02
updated at: 2024-11-05

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
star: 4.4Kfork: 326
language: Python
created at: 2021-01-17
updated at: 2024-11-23