Top Open Source AI Organization Influencers in 2024Q2

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers. Support deepseek-r1

library & platform to build, distribute, monetize ai apps that have the full context (like rewind, granola, etc.), open source, 100% local, developer friendly. 24/7 screen, mic, keyboard recording and control

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Composable building blocks to build Llama Apps

Task oriented AI agent framework for digital workers and vertical AI agents

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Utilities intended for use with Llama models.

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

A new DSL and server for AI agents and multi-step tasks

TEN Agent is a conversational AI powered by the TEN, integrating Gemini 2.0 Live, OpenAI Realtime, RTC, and more. It delivers real-time capabilities to see, hear, and speak, while being fully compatible with popular workflow platforms like Dify and Coze.

Agentic components of the Llama Stack APIs

The easiest way to use Agentic RAG in any enterprise

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

A fast multimodal LLM for real-time voice

⚙️🦀 Build portable, modular & lightweight Fullstack Agents

AdalFlow: The library to build & auto-optimize LLM applications.

👾 LM Studio CLI

ETL, Analytics, Versioning for Unstructured Data

free

GPT4V-level open-source multi-modal model based on Llama3-8B

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Deploy your agentic worfklows to production

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through our open source R&D automation tool RD-Agent, which lets AI drive data-driven AI.

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

The code used to train and run inference with the ColPali architecture.

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Llama-3 agents that can browse the web by following instructions and talking to you

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

Manage GPU clusters for running AI models

Open-source framework to review and patch code using your preferred LLM.

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

🦾 Take control of your AI agents

Easiest and laziest way for building multi-agent LLMs applications.

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

A SOTA lightweight multilingual LLM

TypeScript AI platform with AI chat, Autonomous agents, Software developer agents, chatbots and more

Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini

Evaluate your LLM's response with Prometheus and GPT4 💯

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

An LLM-based Web Navigating Agent (KDD'24)

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

An Innovative Agent Framework Driven by KG Engine

The Open-Source Data Annotation Platform

LLM Analytics

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs

"ChatBot" AI application, supporting GPT, Gemini Pro, Cohere & Ollama models

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

An open-source AI content search engine designed specifically for content creators. Supports extraction of text, images, and short videos. Allows full local deployment (web app, RAG server, LLM server). Supports multi-modal RAG content Q&A.

Fast voice assistant powered by Groq, Cartesia, and Vercel.

A Versatile and Robust SDXL-ControlNet Model for Adaptable Line Art Conditioning

Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）

LiveBench: A Challenging, Contamination-Free LLM Benchmark

A recipe for online RLHF and online iterative DPO.

Open source project for data preparation of LLM application builders

Making Long-Context LLM Inference 10x Faster and 10x Cheaper

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Most intuitive unified AI chat interface.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

A list of top AI agents

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

Fast, streaming indexing, query, and agentic LLM applications in Rust

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code.

Continual Learning of Large Language Models: A Comprehensive Survey

MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 Demo）

Open-source AI copilot that lets you chat with your observability data and code 🧙‍♂️

Model Compression Toolbox for Large Language Models and Diffusion Models

Replace OpenAI with Llama.cpp Automagically.

Paving the way for open agents and AGI for all.

Efficient and easy multi-instance LLM serving

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

Arcade AI Python SDK and CLI

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

EVE Series: Encoder-Free Vision-Language Models from BAAI

Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

A fuzzy key value store based on semantic similarity rather lexical equality.

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]

Self-hosted environment for programming tutorial by LLM

Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

Medical Multimodal LLMs

LLM prompts, llama3 prompts, llama2 prompts

AI Studio is an independent app for utilizing LLM.