🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

A generative speech model for daily dialogue.

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers.

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording

Easily fine-tune, evaluate and deploy Qwen3, DeepSeek-R1, Llama 4 or any open source LLM / VLM!

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Composable building blocks to build Llama Apps

Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.

Utilities intended for use with Llama models.

[NeurIPS 2024 Best Paper][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Task oriented AI agent framework for digital workers and vertical AI agents

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through R&D-Agent, which lets AI drive data-driven AI. 🔗https://aka.ms/RD-Agent-Tech-Report

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

TEN Agent is a conversational voice AI agent powered by TEN, integrating Deepseek, Gemini, OpenAI, RTC, and hardware like ESP32. It enables realtime AI capabilities like seeing, hearing, and speaking, and is fully compatible with platforms like Dify and Coze.

Serverless AI Workflows for Data & ML Teams

Agentic components of the Llama Stack APIs

The easiest way to use Agentic RAG in any enterprise

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

A fast multimodal LLM for real-time voice

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

LM Studio CLI

Simple, scalable AI model deployment on GPU clusters

⚙️🦀 Build portable, modular & lightweight Fullstack Agents

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

AdalFlow: The library to build & auto-optimize LLM applications.

🚀 DeepSeek-V3 & R1大模型逆向API【特长：良心厂商】（官方贼便宜，建议直接走官方），支持高速流式输出、多轮对话，联网搜索，R1深度思考，零配置部署，多路token支持，仅供测试，如需商用请前往官方开放平台。

GPT4V-level open-source multi-modal model based on Llama3-8B

《大模型白盒子构建指南》：一个全手搓的Tiny-Universe

ETL, Analytics, Versioning for Unstructured Data

Supercharge Your LLM with the Fastest KV Cache Layer

free

Deploy your agentic worfklows to production

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

The code used to train and run inference with the ColPali architecture.

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Llama-3 agents that can browse the web by following instructions and talking to you

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

Open-source framework to review and patch code using your preferred LLM.

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.

🦾 Take control of your AI agents

Easiest and laziest way for building multi-agent LLMs applications.

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

Your 24/7 On-Call AI Agent - Solve Alerts Faster with Automatic Correlations, Investigations, and More

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini

A SOTA lightweight multilingual LLM

TypeScript AI platform with AI chat, Autonomous agents, Software developer agents, chatbots and more

Evaluate your LLM's response with Prometheus and GPT4 💯

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

An LLM-based Web Navigating Agent (KDD'24)

Create LLM agents without writing code.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

An Innovative Agent Framework Driven by KG Engine

The Open-Source Data Annotation Platform

LLM Analytics

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)

"ChatBot" AI application, supporting GPT, Gemini Pro, Cohere & Ollama models

Audio Large Language Models

A Versatile and Robust SDXL-ControlNet Model for Adaptable Line Art Conditioning

Fast voice assistant powered by Groq, Cartesia, and Vercel.

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

An open-source AI content search engine designed specifically for content creators. Supports extraction of text, images, and short videos. Allows full local deployment (web app, RAG server, LLM server). Supports multi-modal RAG content Q&A.

Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）

LiveBench: A Challenging, Contamination-Free LLM Benchmark

A recipe for online RLHF and online iterative DPO.

Open source project for data preparation of LLM application builders

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code.

Efficient and easy multi-instance LLM serving

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Most intuitive unified AI chat interface.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

A list of top AI agents

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

Fast, streaming indexing, query, and agentic LLM applications in Rust

RAI is a vendor-agnostic agentic framework for robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

Continual Learning of Large Language Models: A Comprehensive Survey

MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 Demo）

Open-source AI copilot that lets you chat with your observability data and code 🧙‍♂️

Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

Model Compression Toolbox for Large Language Models and Diffusion Models

Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

Replace OpenAI with Llama.cpp Automagically.

EVE Series: Encoder-Free Vision-Language Models from BAAI