SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

The easiest way to use Agentic RAG in any enterprise

Utilities intended for use with Llama models.

free

Agentic components of the Llama Stack APIs

GPT4V-level open-source multi-modal model based on Llama3-8B

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Llama-3 agents that can browse the web by following instructions and talking to you

LM Studio CLI. Written in TypeScript/Node

An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Open-source alternative to Assistant's API with a managed backend for memory, RAG, tools and tasks. ~Supabase for building AI agents.

Automate development gruntwork like code reviews, patching and documentation with LLM workflows.

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Evaluate your LLM's response with Prometheus and GPT4 💯

A lightweight multilingual SOTA LLM

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to integrate, test, and deploy sophisticated AI features to Firebase or Google Cloud.

LLM Analytics

DataChain 🔗 AI-dataframe to enrich, transform and analyze data from cloud storages for ML training and LLM apps

An LLM-based Web Navigating Agent (KDD'24)

🍦 ChatTTS-Forge is a project developed around the TTS generation model ChatTTS, implementing an API Server and a Gradio-based WebUI.

Grounded Multimodal Large Language Model with Localized Visual Tokenization

A Versatile and Robust SDXL-ControlNet Model for Adaptable Line Art Conditioning

An open-source AI content search engine designed specifically for content creators. Supports extraction of text, images, and short videos. Allows full local deployment (web app, RAG server, LLM server). Supports multi-modal RAG content Q&A.

A trivial programmatic Llama 3 jailbreak. Sorry Zuck!

"ChatBot" AI application, supporting GPT, Gemini Pro, Cohere & Ollama models

clean & curate your data with LLMs.

Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）

Official implementation of ⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation

Stateful load balancer custom-tailored for llama.cpp

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

The Lightning Library for LLM Applications.

Bring AI models closer to your PostgreSQL data

Fast voice assistant powered by Groq, Cartesia, and Vercel.

A recipe for online RLHF.

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

A lightning-fast workflow builder, it supports multimodal interaction, highly customizable extensions, and is intuitive to use even without any coding knowledge.

A list of top AI agents

Replace OpenAI with Llama.cpp Automagically.

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

Manage GPU clusters for running LLMs

The code used to train and run inference with the ColPali architecture.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.

A fuzzy key value store based on semantic similarity rather lexical equality.

MarkLLM: An Open-Source Toolkit for LLM Watermarking.

EVE: Encoder-Free Vision-Language Models from BAAI

Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

Continual Learning of Large Language Models: A Comprehensive Survey

Medical Multimodal LLMs

Seamlessly integrate state-of-the-art transformer models into robotics stacks

Tutorial for building LLM router

Easyest and lazyest way for building multi-agent LLMs applications.

On-device LLM Inference Powered by X-Bit Quantization

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

Model components of the Llama Stack APIs

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]

Official code for Paper "Mantis: Multi-Image Instruction Tuning"

Cell type annotation with local Large Language Models (LLMs) - Ensuring privacy and speed with extensive customized reports

GPT-SoVITS2

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

WorldGPT: Empowering LLM as Multimodal World Model

A toolkit to create optimal Production-ready RAG setup for your data

LLM prompts, llama3 prompts, llama2 prompts

Local LLM App

Run and develop self-hosted AI apps

Attribute (or cite) statements generated by LLMs back to in-context information.

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All and Jan) and Cloud based LLMs to help review, test, explain your project code.

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

Community Plugins for Genkit (OpenAI, Groq, Anthropic, Cohere, etc)

😜 表情包视觉数据集，使用glm-4v、step-1v的图像解析能力标注。

RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

PsyDI: Towards a Personalized and Progressively In-depth Chatbot for Psychological Measurements. (e.g. MBTI Measurement Agent)

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

This is the official implementation of the paper "Needle In A Multimodal Haystack"

RAG(Retrieval-Augmented Generation) for Evolving Data

A JavaScript implementation of Llama 3 using node-mlx.

Benchmarking library for RAG

Firebase for AI Agents: Open-source backend platform that puts powerful generative models at the core of your database. With managed memory and RAG capabilities, developers can easily build AI agents, enhance their apps with generative tables, and create magical UI experiences.

A toolbox for benchmarking trustworthiness of multimodal large language models (MultiTrust)

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

A Comprehensive Benchmark for Code Information Retrieval.

Documentation of AnythingLLM by Mintplex Labs Inc.

This repo aims to help developers to get into the genAI topic quicker by automating AI Core and HANA Vector Engine provisioning and configuration with Terraform Provider for SAP BTP.

🦜🪺 Parakeet is a GoLang library, made to simplify the development of small generative AI applications with Ollama 🦙.

一个基于react + semi ui + tauri开发的LLM对话工具，通过此工具可以快速构建你的专属人工智能助手。