meta-llama

llama-stack-client-swift brings the inference and agents APIs of Llama Stack to iOS.

Python SDK for Llama Stack

Utilities intended for use with Llama models.

Composable building blocks to build Llama Apps

Agentic components of the Llama Stack APIs

The official Meta Llama 3 GitHub site

Set of tools to assess and improve LLM security.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

Inference code for Llama models