Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Plugins/Artifacts) and Thinking. One-click FREE deployment of your private ChatGPT/ Claude / DeepSeek application.

Interact with your documents using the power of GPT, 100% privately, no data leaks

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

aider is AI pair programming in your terminal

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

The Memory layer for AI Agents

⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Universal LLM Deployment Engine with ML Compilation

🔥🔥🔥AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

React UI + elegant infrastructure for AI Copilots, AI chatbots, and in-app AI agents. The Agentic last-mile 🪁

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

StableLM: Stability AI Language Models

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers

A list of AI autonomous agents

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

High-performance In-browser LLM Inference Engine

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library that gives you the tools you need to build AI-powered products.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

structured outputs for llms

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Tips and tricks for working with Large Language Models like OpenAI's GPT-4.

TypeChat is a library that makes it easy to build natural language interfaces using types.

Supercharge Your LLM Application Evaluations 🚀

LangGPT: Empowering everyone to become a prompt expert!🚀 Structured Prompt，Language of GPT, 结构化提示词，结构化Prompt

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

🌻 一键拥有你自己的 ChatGPT+众多AI 网页服务 | One click access to your own ChatGPT+Many AI web services

Java version of LangChain

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

🥷 Run AI-agents with an API

Multi-Platform Package Manager for Stable Diffusion

LLMs custom-chatbots console ⚡

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

StableSwarmUI, A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Numbers every LLM developer should know

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

Open-source, accurate and easy-to-use video speech recognition & clipping tool, LLM based AI clipping intergrated.

LLM training code for Databricks foundation models

Plugins for Auto-GPT

the LLM vulnerability scanner

Seamlessly integrate LLMs into scikit-learn.

Interact with your SQL database, Natural Language to SQL using LLMs

The open-source visual AI programming environment and TypeScript library

基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Harness LLMs with Multi-Agent Programming

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Zep | The Memory Foundation For Your AI Stack

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

HuggingLLM, Hugging Future.

SuperSonic is the next-generation AI+BI platform that unifies Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

An app to interact privately with your documents using the power of GPT, 100% privately, no data leaks

UI for your AI. Open Source Tailwind components tailored for your GPT, generative AI, and LLM projects.

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

10分钟搭建可免费商用的AI对话环境，搭建简单，包含用户，订单，任务，付费等功能

Turn expensive prompts into cheap fine-tuned models

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

Data framework for your LLM applications. Focus on server side solution

TigerBot: A multi-language multi-task LLM

The official Python library for the Google Gemini API

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

Must-read Papers on LLM Agents.

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

OpenAGI: When LLM Meets Domain Experts

Supercharged experience for multiple models such as ChatGPT, DALL-E and Stable Diffusion.

Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.

Documentation for Google's Gen AI site - including the Gemini API and Gemma

800,000 step-level correctness labels on LLM solutions to MATH problems

AutoChain: Build lightweight, extensible, and testable LLM Agents

A library for advanced large language model reasoning

《面向开发者的 ChatGPT 提示词工程》非官方版中英双语字幕 Unofficial subtitles of "ChatGPT Prompt Engineering for Developers"

Sample code for a simple web chat experience through Azure OpenAI, including Azure OpenAI On Your Data.

Query your Apple Health data with natural language 💬 🩺