Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Qwen / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS/Plugins/Artifacts). One-click FREE deployment of your private ChatGPT/ Claude application.

Interact with your documents using the power of GPT, 100% privately, no data leaks

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

aider is AI pair programming in your terminal

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

The Memory layer for AI Agents

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Universal LLM Deployment Engine with ML Compilation

🔥🔥🔥AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

React UI + elegant infrastructure for AI Copilots, in-app AI agents, AI chatbots, and AI-powered Textareas 🪁

StableLM: Stability AI Language Models

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers

High-performance In-browser LLM Inference Engine

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

Build AI-powered applications with React, Svelte, Vue, and Solid

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

structured outputs for llms

Tips and tricks for working with Large Language Models like OpenAI's GPT-4.

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

TypeChat is a library that makes it easy to build natural language interfaces using types.

Supercharge Your LLM Application Evaluations 🚀

LangGPT: Empowering everyone to become a prompt expert!🚀 Structured Prompt，Language of GPT, 结构化提示词，结构化Prompt

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

🌻 一键拥有你自己的 ChatGPT+众多AI 网页服务 | One click access to your own ChatGPT+Many AI web services

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

🥷 Run AI-agents with an API

Java version of LangChain

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Multi-Platform Package Manager for Stable Diffusion

LLMs custom-chatbots console ⚡

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

StableSwarmUI, A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

Numbers every LLM developer should know

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

Open-source, accurate and easy-to-use video speech recognition & clipping tool, LLM based AI clipping intergrated.

LLM training code for Databricks foundation models

Plugins for Auto-GPT

the LLM vulnerability scanner

Interact with your SQL database, Natural Language to SQL using LLMs

The open-source visual AI programming environment and TypeScript library

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Harness LLMs with Multi-Agent Programming

Zep | The Memory Foundation For Your AI Stack

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

HuggingLLM, Hugging Future.

SuperSonic is the next-generation AI+BI platform that unifies Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.

An app to interact privately with your documents using the power of GPT, 100% privately, no data leaks

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

UI for your AI. Open Source Tailwind components tailored for your GPT, generative AI, and LLM projects.

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

10分钟搭建可免费商用的AI对话环境，搭建简单，包含用户，订单，任务，付费等功能

Turn expensive prompts into cheap fine-tuned models

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

Data framework for your LLM applications. Focus on server side solution

TigerBot: A multi-language multi-task LLM

Must-read Papers on LLM Agents.

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

The official Python library for the Google Gemini API

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

OpenAGI: When LLM Meets Domain Experts

Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.

800,000 step-level correctness labels on LLM solutions to MATH problems

Documentation for Google's Gen AI site - including the Gemini API and Gemma

AutoChain: Build lightweight, extensible, and testable LLM Agents

A library for advanced large language model reasoning

《面向开发者的 ChatGPT 提示词工程》非官方版中英双语字幕 Unofficial subtitles of "ChatGPT Prompt Engineering for Developers"

Query your Apple Health data with natural language 💬 🩺

Sample code for a simple web chat experience through Azure OpenAI, including Azure OpenAI On Your Data.

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)

Instant, controllable, local pre-trained AI models in Rust