Top Open Source AI Organization Influencers in

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥

Crawl a site to generate knowledge files to create your own custom GPT from a URL

SOTA Open Source TTS

Letta (formerly MemGPT) is a framework for creating LLM services with memory.

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

Open source AI coding agent. Designed for large tasks and real world project.

An Autonomous LLM Agent for Complex Task Solving

High-speed Large Language Model Serving for Local Deployment

Private & local AI personal knowledge management app for high entropy people.

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Build ChatGPT over your data, all with natural language

DeepSeek LLM: Let there be answers

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

PyTorch native post-training library

A blazing fast inference solution for text embeddings models

Set of tools to assess and improve LLM security.

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

SecGPT网络安全大模型

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

[ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

TensorRT Extension for Stable Diffusion Web UI

Meditron is a suite of open-source medical Large Language Models (LLMs).

LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.

PyTorch native quantization and sparsity for training and inference

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

LLM&VLM Tutorial

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

A Third-party GPTs store

Developer APIs to Accelerate LLM Projects

Easy token price estimates for 400+ LLMs. TokenOps.

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

AgentTuning: Enabling Generalized Agent Abilities for LLMs

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / LLaMA Factory / Swift / Ultralytics / veRL / MMEngine / Keras etc.

OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) natively support KAG...

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。

Deploy your private Gemini application for free with one click, supporting Gemini 1.5, Gemini 2.0 models.

A conversational Q&A agent configuration system, self-hosted deployment solutions, and a convenient all-in-one application SDK, allowing you to create intelligent Q&A bots for your GitHub repositories

Strong and Open Vision Language Assistant for Mobile Devices

A curated list of awesome LLM for Autonomous Driving resources (continually updated)

A generalized information-seeking agent system with Large Language Models (LLMs).

制作懂人情世故的大语言模型 | 涵盖提示词工程、RAG、Agent、LLM微调教程

Awesome AI GPTs, OpenAI GPTs, GPT-4, ChatGPT, GPTs, Prompts, plugins, Prompts leaking

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

The official Node.js / Typescript library for the Google Gemini API

Top ranked OpenAI GPTs

AIlice is a fully autonomous, general-purpose AI agent.

Logging Made Easy (LME) is a no cost, open source platform that centralizes log collection, enhances threat detection, and enables real-time alerting, helping small to medium-sized organizations secure their infrastructure.

LLM abstractions that aren't obstructions

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

Superlinked is a Python framework for AI Engineers building high-performance search & recommendation applications that combine structured and unstructured data.

BlueLM(蓝心大模型): Open large language models developed by vivo AI Lab

Create characters in Unity with LLMs!

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

An LLM-based Agent for the New Automation Paradigm - Agentic Process Automation

The official Android library for the Google Gemini API

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

An open-sourced end-to-end VLM-based GUI Agent

🤖 Components Library for Quickly Building LLM Chat Interfaces.

An Obsidian plugin to interact with your privacy focused AI-Assistant making your second brain even smarter!

PhoGPT: Generative Pre-training for Vietnamese (2023)

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

Official implementation of Half-Quadratic Quantization (HQQ)

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

Arena-Hard-Auto: An automatic LLM benchmark.

LLMPerf is a library for validating and benchmarking LLMs

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

Learn Cloud Applied Generative AI Engineering (GenEng) using OpenAI, Gemini, Streamlit, Containers, Serverless, Postgres, LangChain, Pinecone, and Next.js

Speech, Language, Audio, Music Processing with Large Language Model

Run serverless GPU workloads with fast cold starts on bare-metal servers, anywhere in the world

DISC-FinLLM，中文金融大语言模型（LLM），旨在为用户提供金融场景下专业、智能、全面的金融咨询服务。DISC-FinLLM, a Chinese financial large language model (LLM) designed to provide users with professional, intelligent, and comprehensive financial consulting services in financial scenarios.

智能聊天助手，内置 WEB 管理界面，可接入GPT、Gemini 、星火、文心、混元 、通义千问等大语言模型

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

This sample has the full End2End process of creating RAG application with Prompty and Azure AI Foundry. It includes GPT 3.5 Turbo LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.

The official Dart library for the Google Gemini API

👀 What LLM to use?

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Agent Cloud is like having your own GPT builder with a bunch extra goodies. The GUI features 1) RAG pipeline which can natively embed 260+ datasources 2) Create Conversational apps (like GPTs) 3) Create Multi Agent process automation apps (crewai) 4) Tools 5) Teams+user permissions. Get started fast with Docker and our install.sh

Agent that empowers software testing with LLMs; industrial-first in China