Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

Interact with your documents using the power of GPT, 100% privately, no data leaks

Platform to experiment with the AI Software Engineer. Terminal based. NOTE: Very different from https://gptengineer.app

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application.

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

The Memory layer for your AI apps

aider is AI pair programming in your terminal

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Universal LLM Deployment Engine with ML Compilation

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

🔥🔥🔥AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

StableLM: Stability AI Language Models

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

High-performance In-browser LLM Inference Engine

Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.

React UI + elegant infrastructure for AI Copilots, in-app AI agents, AI chatbots, and AI-powered Textareas 🪁

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.

Build AI-powered applications with React, Svelte, Vue, and Solid

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Tips and tricks for working with Large Language Models like OpenAI's GPT-4.

TypeChat is a library that makes it easy to build natural language interfaces using types.

structured outputs for llms

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

Supercharge Your LLM Application Evaluations 🚀

ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

LangGPT: Empowering everyone to become a prompt expert!🚀 Structured Prompt，Language of GPT, 结构化提示词，结构化Prompt

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

🥷 Run AI-agents with an API

LLMs custom-chatbots console ⚡

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Multi-Platform Package Manager for Stable Diffusion

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

StableSwarmUI, A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Numbers every LLM developer should know

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

LLM training code for Databricks foundation models

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Plugins for Auto-GPT

Open-source, accurate and easy-to-use video speech recognition & clipping tool, LLM based AI clipping intergrated.

Interact with your SQL database, Natural Language to SQL using LLMs

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.一键免费部署你的私人AutoGPT 网页应用

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

An app to interact privately with your documents using the power of GPT, 100% privately, no data leaks

HuggingLLM, Hugging Future.

The open-source visual AI programming environment and TypeScript library

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Zep | The Memory Foundation For Your AI Stack

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

10分钟搭建可免费商用的AI对话环境，搭建简单，包含用户，订单，任务，付费等功能

Harness LLMs with Multi-Agent Programming

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Turn expensive prompts into cheap fine-tuned models

UI for your AI. Open Source Tailwind components tailored for your GPT, generative AI, and LLM projects.

SuperSonic is the next-generation AI+BI platform that unifies Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

TigerBot: A multi-language multi-task LLM

Open-source end-to-end LLM Development Platform

Data framework for your LLM applications. Focus on server side solution

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

Must-read Papers on LLM Agents.

AutoChain: Build lightweight, extensible, and testable LLM Agents

Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.

《面向开发者的 ChatGPT 提示词工程》非官方版中英双语字幕 Unofficial subtitles of "ChatGPT Prompt Engineering for Developers"

Query your Apple Health data with natural language 💬 🩺

Documentation for Google's Gen AI site - including the Gemini API and Gemma

Sample code for a simple web chat experience through Azure OpenAI, including Azure OpenAI On Your Data.

GPTeam: An open-source multi-agent simulation

800,000 step-level correctness labels on LLM solutions to MATH problems

Create Custom GPT and add/embed on your site using Assistants api

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)

The official Python library for the Google Gemini API

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

Agent techniques to augment your LLM and push it beyong its limits

Instant, controllable, local pre-trained AI models in Rust

[NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified motion-language generation model using LLMs

[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)