Top Open Source AI Organization Influencers in 2024Q2

A generative speech model for daily dialogue.

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers. Support deepseek-r1

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Composable building blocks to build Llama Apps

[NeurIPS 2024 Best Paper][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.

Task oriented AI agent framework for digital workers and vertical AI agents

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Utilities intended for use with Llama models.

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

TEN Agent is a conversational voice AI agent powered by TEN, integrating Deepseek, Gemini, OpenAI, RTC, and hardware like ESP32. It enables realtime AI capabilities like seeing, hearing, and speaking, and is fully compatible with platforms like Dify and Coze.

Serverless AI Workflows for Data & ML Teams

Agentic components of the Llama Stack APIs

The easiest way to use Agentic RAG in any enterprise

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

A fast multimodal LLM for real-time voice

LM Studio CLI

⚙️🦀 Build portable, modular & lightweight Fullstack Agents

AdalFlow: The library to build & auto-optimize LLM applications.

《大模型白盒子构建指南》：一个全手搓的Tiny-Universe

ETL, Analytics, Versioning for Unstructured Data

🚀 DeepSeek-V3 R1大模型逆向API【特长：良心厂商】（官方贼便宜，建议直接走官方），支持高速流式输出、多轮对话，联网搜索，R1深度思考，零配置部署，多路token支持，仅供测试，如需商用请前往官方开放平台。

GPT4V-level open-source multi-modal model based on Llama3-8B

free

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Deploy your agentic worfklows to production

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through our open source R&D automation tool RD-Agent, which lets AI drive data-driven AI.

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

The code used to train and run inference with the ColPali architecture.

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Llama-3 agents that can browse the web by following instructions and talking to you

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

Manage GPU clusters for running AI models

Open-source framework to review and patch code using your preferred LLM.

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.

🦾 Take control of your AI agents

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

Easiest and laziest way for building multi-agent LLMs applications.

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini

A SOTA lightweight multilingual LLM

TypeScript AI platform with AI chat, Autonomous agents, Software developer agents, chatbots and more

Evaluate your LLM's response with Prometheus and GPT4 💯

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

An LLM-based Web Navigating Agent (KDD'24)

Create LLM agents without writing code.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

An Innovative Agent Framework Driven by KG Engine

Redis for LLMs

The Open-Source Data Annotation Platform

LLM Analytics

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs

"ChatBot" AI application, supporting GPT, Gemini Pro, Cohere & Ollama models

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

An open-source AI content search engine designed specifically for content creators. Supports extraction of text, images, and short videos. Allows full local deployment (web app, RAG server, LLM server). Supports multi-modal RAG content Q&A.

Fast voice assistant powered by Groq, Cartesia, and Vercel.

A Versatile and Robust SDXL-ControlNet Model for Adaptable Line Art Conditioning

Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）

LiveBench: A Challenging, Contamination-Free LLM Benchmark

A recipe for online RLHF and online iterative DPO.

Open source project for data preparation of LLM application builders

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Most intuitive unified AI chat interface.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code.

A list of top AI agents

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

Fast, streaming indexing, query, and agentic LLM applications in Rust

Continual Learning of Large Language Models: A Comprehensive Survey

MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 Demo）

Open-source AI copilot that lets you chat with your observability data and code 🧙‍♂️

Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

Model Compression Toolbox for Large Language Models and Diffusion Models

Efficient and easy multi-instance LLM serving

Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

Replace OpenAI with Llama.cpp Automagically.

EVE Series: Encoder-Free Vision-Language Models from BAAI

Paving the way for open agents and AGI for all.

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

Arcade AI Python SDK and CLI

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

A continuously updated collection of CodeLLM papers

A fuzzy key value store based on semantic similarity rather lexical equality.