A modular graph-based Retrieval-Augmented Generation (RAG) system

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

rewind.ai x cursor.com = your AI assistant that has all the context. 24/7 screen & voice recording for the age of super intelligence. get your data ready or be left behind

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, and Gemini.

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

Multilingual Voice Understanding Model

Open-source Next.js template for building apps that are fully generated by AI. By E2B.

Efficient Triton Kernels for LLM Training

TEN Agent is a conversational AI powered by TEN, integrating Gemini 2.0 Multimodal Live API, OpenAI Realtime API, RTC, and more. It offers real-time capabilities to see, hear, and speak, along with advanced tools like weather checks, web search, and RAG.

Implementation for MatMul-free LM.

🔍 AI search engine - self-host with local or cloud LLMs

A new DSL and server for AI agents and multi-step tasks

Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁，一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️、Vue 生态搭建前端🍍、FastAPI 搭建后端🗝️、Docker-compose 打包部署🐋

In-browser Postgres sandbox with AI assistance

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

Turn any webpage into structured data using LLMs

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

AdalFlow: The library to build & auto-optimize LLM applications.

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

AI-data warehouse to enrich, transform and analyze unstructured data

利用AI大模型，一键解说并剪辑视频； Using AI models to automatically provide commentary and edit videos with a single click.

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

👾 LM Studio CLI

A simple, easy-to-hack GraphRAG implementation

Optimizing inference proxy for LLMs

A fast multimodal LLM for real-time voice

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

A system for agentic LLM-powered data processing and ETL

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage graphRAG / RAG

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

The TypeScript AI framework.

Chat with any codebase in under two minutes | Fully local or via third-party APIs

Easiest and laziest way for building multi-agent LLMs applications.

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

A SOTA lightweight multilingual LLM

Lightweight library for scraping web-sites with LLMs

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more

This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

Unified KV Cache Compression Methods for Auto-Regressive Models

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

Evaluate your LLM's response with Prometheus and GPT4 💯

A 4-hour coding workshop to understand how LLMs are implemented and used

🦾 Take control of your AI agents

Agentless🐱: an agentless approach to automatically solve software development problems

The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

Generate music based on natural language prompts using LLMs running locally

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

A list of free LLM inference resources accessible via API.

Unifying 3D Mesh Generation with Language Models

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

Practical Llama 3 inference in Java

BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works with the free Gemini API, local LLMs, and other cloud providers.

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

Effortlessly run LLM backends, APIs, frontends, and services with one command.

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

Instrument any LLM to do actual stuff.

Kodu is an autonomous coding agent that lives in your IDE. It is a VSCode extension that can help you build your dream project step by step by leveraging the latest technologies in automated coding agents

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

Go manage your Ollama models

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

Fast voice assistant powered by Groq, Cartesia, and Vercel.

Dynamiq is an orchestration framework for agentic AI and LLM applications

Fullstack "Chat with your PDFs" RAG (Retrieval Augmented Generation) app built fully on Cloudflare

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

An Innovative Agent Framework Driven by KG Engine

Bring Claude's Artifacts feature to ChatGPT

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Raycast extension to use GPT-4, Llama-3, and more... all for FREE. No API Key required!

A recipe for online RLHF and online iterative DPO.

AI-powered assistant to help you with your daily tasks, powered by Llama 3.2. It can recognize your voice, process natural language, and perform various actions based on your commands: summarizing text, rephasing sentences, answering questions, writing emails, and more.

A command-line interface for LLMs written in Bash.

An open source voice-enabled, compact, empathic AI hardware + software 🤖 framework for companionship, entertainment, education, pediatric care, IoT robotics applications, AI-enhanced robotics application services, research, and DIY robotics kit development using Python, NextJs, Arduino, ESP32, LLMs (GPT), STT, TTS, Emotion Analysis, AI agent

The React library for LLMs

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

An open-source implementation for training LLaVA-NeXT.

A highly optimized inference acceleration engine for Llama and its variants.

Claude Memory: Long-term memory for Claude

The simplest and most cost-effective AI integration solution, enabling any device to achieve intelligent conversation functionality (based on ESP development boards). If you like this project, please give it a Star! | 最简单、最低成本的AI接入方案，让任何物品都能实现智能对话功能(基于ESP开发板)。喜欢本项目的话点个 Star 吧，您的一个 Star 对目前的仓库发展非常重要

PearAI acts as an inventory that curates the leading, cutting-edge AI tools in one place. We build a centralized user interface for these solutions, allowing you to effortlessly use the best AI tools without having to waste effort looking for alternatives. This repository lists all the other repos that make up the entire PearAI project.

Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention