User-friendly WebUI for LLMs (Formerly Ollama WebUI)

Crawl a site to generate knowledge files to create your own custom GPT from a URL

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

An Autonomous LLM Agent for Complex Task Solving

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Private & local AI personal knowledge management app.

Build ChatGPT over your data, all with natural language

《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合中国宝宝的部署教程

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型

A Native-PyTorch Library for LLM Fine-tuning

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

Brand new TTS solution

A blazing fast inference solution for text embeddings models

Set of tools to assess and improve LLM security.

Magicoder: Source Code Is All You Need

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Meditron is a suite of open-source medical Large Language Models (LLMs).

SecGPT网络安全大模型

LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.

A Third-party GPTs store

DeepSeek LLM: Let there be answers

Easy token price estimates for 400+ LLMs. TokenOps.

AgentTuning: Enabling Generalized Agent Abilities for LLMs

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

Developer APIs to Accelerate LLM Projects

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

A generalized information-seeking agent system with Large Language Models (LLMs).

Awesome AI GPTs, OpenAI GPTs, GPT-4, ChatGPT, GPTs, Prompts, plugins, Prompts leaking

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥

Top ranked OpenAI GPTs

Strong and Open Vision Language Assistant for Mobile Devices

LLM Tutorial

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

BlueLM(蓝心大模型): Open large language models developed by vivo AI Lab

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

Logging Made Easy (LME) is a no-cost and open logging and protective monitoring solution serving all organizations.

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks

PhoGPT: Generative Pre-training for Vietnamese (2023)

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

A curated list of awesome LLM for Autonomous Driving resources (continually updated)

An LLM-based Agent for the New Automation Paradigm - Agentic Process Automation

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

Official Implementation for LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models

The official Node.js / Typescript library for the Google Gemini API

AIlice is a fully autonomous, general-purpose AI agent.

OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) kNext SDK(python): LLM-enhanced knowledge construction, reasoning and generation

🤖 Components Library for Quickly Building LLM Chat Interfaces.

Official implementation of Half-Quadratic Quantization (HQQ)

An intuitive approach to building with LLMs

The official Dart library for the Google Gemini API

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

Agent that empowers software testing with LLMs; industrial-first in China

Open-Source Reproduction/Demo of the LLM Riddles Game

DISC-FinLLM，中文金融大语言模型（LLM），旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Agent Cloud is like having your own GPT builder with a bunch extra goodies. The GUI features 1) RAG pipeline which can natively embed 260+ datasources 2) Create Conversational apps (like GPTs) 3) Create Multi Agent process automation apps (crewai) 4) Tools 5) Teams+user permissions. Get started fast with Docker and our install.sh

LLMPerf is a library for validating and benchmarking LLMs

A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal vector embeddings.

GPT4 based personalized ArXiv paper assistant bot

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Create characters in Unity with LLMs!

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models

appbuilder-sdk, 千帆AppBuilder-SDK帮助开发者灵活、快速的搭建AI原生应用

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

AgentSearch is a framework for powering search agents and enabling customizable local search.

An Obsidian plugin to interact with your privacy focused AI-Assistant making your second brain even smarter!

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Speech, Language, Audio, Music Processing with Large Language Model

[CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

👀 What LLM to use?

Production-Grade Evaluation for LLM-Powered Applications

llama.cpp with BakLLaVA model describes what does it see

Rapid prototyping of web apps using plain english 👶🤖

Edge full-stack LLM platform. Written in Rust

This sample has the full End2End process of creating RAG application with Prompt Flow and AI Studio. It includes GPT 3.5 Turbo LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.

A curated list of awesome knowledge-driven autonomous driving (continually updated)

End-to-end platform for building voice first multimodal agents

[ICML 2024] CLLMs: Consistency Large Language Models

Best practices for distilling large language models.

RAG LLM Ops App for easy deployment and testing