User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Crawl a site to generate knowledge files to create your own custom GPT from a URL

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory

Brand new TTS solution

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

Letta (formerly MemGPT) is a framework for creating LLM services with memory.

《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合中国宝宝的部署教程

An Autonomous LLM Agent for Complex Task Solving

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Private & local AI personal knowledge management app for high entropy people.

Build ChatGPT over your data, all with natural language

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

PyTorch native finetuning library

A blazing fast inference solution for text embeddings models

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

Set of tools to assess and improve LLM security.

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

[ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct

Meditron is a suite of open-source medical Large Language Models (LLMs).

SecGPT网络安全大模型

PyTorch native quantization and sparsity for training and inference

LLM&VLM Tutorial

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

A Third-party GPTs store

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Easy token price estimates for 400+ LLMs. TokenOps.

DeepSeek LLM: Let there be answers

Developer APIs to Accelerate LLM Projects

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks

BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promptfiddle.com playground

AgentTuning: Enabling Generalized Agent Abilities for LLMs

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

A generalized information-seeking agent system with Large Language Models (LLMs).

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

Awesome AI GPTs, OpenAI GPTs, GPT-4, ChatGPT, GPTs, Prompts, plugins, Prompts leaking

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

Strong and Open Vision Language Assistant for Mobile Devices

A curated list of awesome LLM for Autonomous Driving resources (continually updated)

Top ranked OpenAI GPTs

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

Logging Made Easy (LME) is a no cost, open source platform that centralizes log collection, enhances threat detection, and enables real-time alerting, helping small to medium-sized organizations secure their infrastructure.

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

制作懂人情世故的大语言模型 | 提示词工程、RAG、Agent、微调全流程教程

AIlice is a fully autonomous, general-purpose AI agent.

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

BlueLM(蓝心大模型): Open large language models developed by vivo AI Lab

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

An LLM-based Agent for the New Automation Paradigm - Agentic Process Automation

OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) natively support KAG...

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

The official Node.js / Typescript library for the Google Gemini API

LLM abstractions that aren't obstructions

PhoGPT: Generative Pre-training for Vietnamese (2023)

🤖 Components Library for Quickly Building LLM Chat Interfaces.

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

Official implementation of Half-Quadratic Quantization (HQQ)

Create characters in Unity with LLMs!

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

Arena-Hard-Auto: An automatic LLM benchmark.

LLMPerf is a library for validating and benchmarking LLMs

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

An Obsidian plugin to interact with your privacy focused AI-Assistant making your second brain even smarter!

A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal vector embeddings.

DISC-FinLLM，中文金融大语言模型（LLM），旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.

Speech, Language, Audio, Music Processing with Large Language Model

The official Dart library for the Google Gemini API

Agent that empowers software testing with LLMs; industrial-first in China

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

AI Inference Operator for Kubernetes

Agent Cloud is like having your own GPT builder with a bunch extra goodies. The GUI features 1) RAG pipeline which can natively embed 260+ datasources 2) Create Conversational apps (like GPTs) 3) Create Multi Agent process automation apps (crewai) 4) Tools 5) Teams+user permissions. Get started fast with Docker and our install.sh

Open-Source Reproduction/Demo of the LLM Riddles Game

A conversational Q&A agent configuration system, self-hosted deployment solutions, and a convenient all-in-one application SDK, allowing you to create intelligent Q&A bots for your GitHub repositories

👀 What LLM to use?

Run serverless GPU workloads with fast cold starts on bare-metal servers, anywhere in the world

GPT4 based personalized ArXiv paper assistant bot

This sample has the full End2End process of creating RAG application with Prompty and AI Studio. It includes GPT 3.5 Turbo LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models

This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral

Rapid prototyping of web apps using plain english 👶🤖

appbuilder-sdk, 千帆AppBuilder-SDK帮助开发者灵活、快速的搭建AI原生应用

[CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

Data-Driven Evaluation for LLM-Powered Applications

AgentSearch is a framework for powering search agents and enabling customizable local search.

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.