The Deja Vu Memorization framework allows for evaluating the memorization in CLIP models.

Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".

MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

Python Library to evaluate VLM models' robustness across diverse benchmarks

Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Official implementation of the paper "The Stable Signature Rooting Watermarks in Latent Diffusion Models"

We evaluate many models used for biomedical and clinical nlp tasks, and train new models that perform much better.