Top Open Source AI Organization Influencers in 2024Q2

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

rewind.ai x cursor.com = your AI assistant that has all the context. 24/7 screen & voice recording for the age of super intelligence. get your data ready or be left behind

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Intelligence development framework in python for your product like Apple Intelligence

Utilities intended for use with Llama models.

Composable building blocks to build Llama Apps

Agentic components of the Llama Stack APIs

The easiest way to use Agentic RAG in any enterprise

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

A new DSL and server for AI agents and multi-step tasks

free

GPT4V-level open-source multi-modal model based on Llama3-8B

AdalFlow: The library to build & auto-optimize LLM applications.

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

AI-data warehouse to enrich, transform and analyze unstructured data

Deploy your agentic worfklows to production

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

👾 LM Studio CLI

TEN Agent is the world’s first real-time multimodal agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG capabilities.

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

A fast multimodal LLM for real-time voice

Llama-3 agents that can browse the web by following instructions and talking to you

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through our open source R&D automation tool RD-Agent, which lets AI drive data-driven AI.

The code used to train and run inference with the ColPali architecture.

Automate code reviews, patching and documentation with self-hosted LLM workflows.

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

Easiest and laziest way for building multi-agent LLMs applications.

A SOTA lightweight multilingual LLM

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

Evaluate your LLM's response with Prometheus and GPT4 💯

Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.

🦾 Take control of your AI agents

An LLM-based Web Navigating Agent (KDD'24)

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

Manage GPU clusters for running LLMs

LLM Analytics

The Open-Source Data Annotation Platform

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

"ChatBot" AI application, supporting GPT, Gemini Pro, Cohere & Ollama models

An open-source AI content search engine designed specifically for content creators. Supports extraction of text, images, and short videos. Allows full local deployment (web app, RAG server, LLM server). Supports multi-modal RAG content Q&A.

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）

A Versatile and Robust SDXL-ControlNet Model for Adaptable Line Art Conditioning

Fast voice assistant powered by Groq, Cartesia, and Vercel.

Official implementation of ⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

An Innovative Agent Framework Driven by KG Engine

A recipe for online RLHF and online iterative DPO.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

A list of top AI agents

Open source project for data preparation of LLM application builders

Most intuitive unified AI chat interface.

LiveBench: A Challenging, Contamination-Free LLM Benchmark

MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 Demo）

Replace OpenAI with Llama.cpp Automagically.

Open-source AI copilot that lets you chat with your observability data and code 🧙‍♂️

Paving the way for open agents and AGI for all.

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust

A fuzzy key value store based on semantic similarity rather lexical equality.

Continual Learning of Large Language Models: A Comprehensive Survey

Medical Multimodal LLMs

Ultra-Fast and Cheaper Long-Context LLM Inference

Self-hosted environment for programming tutorial by LLM

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

Model Compression Toolbox for Large Language Models and Diffusion Models

BigCodeBench: Benchmarking Code Generation Towards AGI

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code.

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]

Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

Efficient and easy multi-instance LLM serving

⚙️🦀 Build portable, modular & lightweight Fullstack Agents

Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

Action library for AI Agent

On-device LLM Inference Powered by X-Bit Quantization

Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)

GPT-SoVITS2

LLM prompts, llama3 prompts, llama2 prompts