LOGO

lucidrains

Working with Attention. It's all we need
San Francisco[email protected]

Github Data

Followers 32127
Following 0

Links

https://lucidrains.github.io

AI Project

Public repos: 288Public gists: 27

mmdit

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch
star: 216fork: 3
language: Python
created at: 2024-05-04
updated at: 2024-08-15

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
star: 1.3Kfork: 71
language: Python
created at: 2024-01-19
updated at: 2024-08-11

llama-qrlhf

Implementation of the Llama architecture with RLHF + Q-learning
star: 154fork: 4
language: Python
created at: 2023-11-23
updated at: 2024-08-01

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
star: 7.6Kfork: 666
language: Python
created at: 2022-12-09
updated at: 2024-08-11

PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
star: 185fork: 12
language: Python
created at: 2022-04-08
updated at: 2024-07-08

PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
star: 815fork: 82
language: Python
created at: 2022-04-04
updated at: 2024-08-07

coco-lm-pytorch

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
star: 46fork: 7
language: Python
created at: 2021-03-02
updated at: 2024-01-04

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
star: 4.4Kfork: 327
language: Python
created at: 2021-01-17
updated at: 2024-07-23