🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

rewind.ai x cursor.com = your AI assistant that has all the context

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Intelligence development framework in python for your product like Apple Intelligence

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Utilities intended for use with Llama models.

Composable building blocks to build Llama Apps

Agentic components of the Llama Stack APIs

The easiest way to use Agentic RAG in any enterprise

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

A new DSL and server for AI agents and multi-step tasks

free

GPT4V-level open-source multi-modal model based on Llama3-8B

AdalFlow: The library to build & auto-optimize LLM applications.

Deploy your agentic worfklows to production

AI-data warehouse to enrich, transform and analyze unstructured data

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

👾 LM Studio CLI

TEN Agent is the world’s first real-time multimodal agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG capabilities.

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Llama-3 agents that can browse the web by following instructions and talking to you

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

Automate code reviews, patching and documentation with self-hosted LLM workflows.

The code used to train and run inference with the ColPali architecture.

Easiest and laziest way for building multi-agent LLMs applications.

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through our open source R&D automation tool RD-Agent, which lets AI drive data-driven AI.

A fast multimodal LLM for real-time voice

A SOTA lightweight multilingual LLM

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

Evaluate your LLM's response with Prometheus and GPT4 💯

Build your own generative UI chatbot using the Vercel AI SDK and Google Gemini

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.

An LLM-based Web Navigating Agent (KDD'24)

🦾 Take control of your AI agents

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

LLM Analytics

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

Stateful load balancer custom-tailored for llama.cpp

The Open-Source Data Annotation Platform

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

Manage GPU clusters for running LLMs

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

"ChatBot" AI application, supporting GPT, Gemini Pro, Cohere & Ollama models

An open-source AI content search engine designed specifically for content creators. Supports extraction of text, images, and short videos. Allows full local deployment (web app, RAG server, LLM server). Supports multi-modal RAG content Q&A.

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）

Fast voice assistant powered by Groq, Cartesia, and Vercel.

A Versatile and Robust SDXL-ControlNet Model for Adaptable Line Art Conditioning

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

Official implementation of ⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation

A recipe for online RLHF and online iterative DPO.

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

An Innovative Agent Framework Driven by KG Engine

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

A list of top AI agents

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Replace OpenAI with Llama.cpp Automagically.

LiveBench: A Challenging, Contamination-Free LLM Benchmark

Open-source AI copilot that lets you chat with your observability data and code 🧙‍♂️

MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 Demo）

Paving the way for open agents and AGI for all.

Most intuitive unified AI chat interface.

Open source project for data preparation of LLM application builders

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

A fuzzy key value store based on semantic similarity rather lexical equality.

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust

Medical Multimodal LLMs

Continual Learning of Large Language Models: A Comprehensive Survey

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

BigCodeBench: Benchmarking Code Generation Towards AGI

Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code.

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]

Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

Ultra-Fast and Cheaper Long-Context LLM Inference

Efficient and easy multi-instance LLM serving

Action library for AI Agent

On-device LLM Inference Powered by X-Bit Quantization

Official code for Paper "Mantis: Multi-Image Instruction Tuning"

GPT-SoVITS2

LLM prompts, llama3 prompts, llama2 prompts

Seamlessly integrate state-of-the-art transformer models into robotics stacks

Tutorial for building LLM router

RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.