LOGO

karpathy

I like to train Deep Neural Nets on large datasets.
Stanford

Github Data

Followers 92467
Following 8

Links

https://twitter.com/karpathy

AI Project

Public repos: 55Public gists: 10

nano-llama31

nanoGPT style version of Llama 3.1
star: 1.2Kfork: 62
language: Python
created at: 2024-08-01
updated at: 2024-11-20

LLM101n

LLM101n: Let's build a Storyteller
star: 30.2Kfork: 1.6K
language:
created at: 2024-05-27
updated at: 2024-11-21

llm.c

LLM training in simple, raw C/CUDA
star: 24.5Kfork: 2.8K
language: Cuda
created at: 2024-04-08
updated at: 2024-11-21

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
star: 9.2Kfork: 867
language: Python
created at: 2024-02-16
updated at: 2024-11-20

llama2.c

Inference Llama 2 in one file of pure C
star: 17.5Kfork: 2.1K
language: C
created at: 2023-07-23
updated at: 2024-11-20

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.
star: 37.4Kfork: 6.0K
language: Python
created at: 2022-12-28
updated at: 2024-11-21

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
star: 20.2Kfork: 2.5K
language: Python
created at: 2020-08-17
updated at: 2024-11-21