🙌 OpenHands: Code Less, Make More

A modular graph-based Retrieval-Augmented Generation (RAG) system

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

Automate browser-based workflows with LLMs and Computer Vision

rewind.ai x cursor.com = your AI assistant that has all the context. 24/7 screen & voice recording for the age of super intelligence. get your data ready or be left behind

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

Large Action Model framework to develop AI Web Agents

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

Blazingly fast LLM inference.

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, and Gemini.

Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

🚀 KIMI AI 长文本大模型逆向API白嫖测试【特长：长文本解读整理】，支持高速流式输出、智能体对话、联网搜索、长文档解读、图像OCR、多轮对话，零配置部署，多路token支持，自动清理会话痕迹。

Containerized, state of the art Retrieval-Augmented Generation (RAG) system with a RESTful API

Multilingual Voice Understanding Model

Open-source Next.js template for building apps that are fully generated by AI. By E2B.

Efficient Triton Kernels for LLM Training

Run PyTorch LLMs locally on servers, desktop and mobile

Implementation for MatMul-free LM.

🔍 AI search engine - self-host with local or cloud LLMs

A new DSL and server for AI agents and multi-step tasks

Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁，一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️、Vue 生态搭建前端🍍、FastAPI 搭建后端🗝️、Docker-compose 打包部署🐋

基于大模型的智能对话客服工具，支持微信、拼多多、千牛、哔哩哔哩、抖音企业号、抖音、抖店、微博聊天、小红书专业号运营、小红书、知乎等平台接入，可选择 GPT3.5/GPT4.0/ 懒人百宝箱 （后续会支持更多平台），能处理文本、语音和图片，通过插件访问操作系统和互联网等外部资源，支持基于自有知识库定制企业 AI 应用。

In-browser Postgres sandbox with AI assistance

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

The open source Tines / Splunk SOAR alternative for security engineers.

Turn any webpage into structured data using LLMs

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

AdalFlow: The library to build & auto-optimize LLM applications.

✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

🚀 An open-source SQL AI (Text-to-SQL) Agent that empowers data, product teams to chat with their data. 🤘

AI-data warehouse to enrich, transform and analyze unstructured data

利用AI大模型，一键解说并剪辑视频； Using AI models to automatically provide commentary and edit videos with a single click.

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

TEN Agent is a world-class multimodal AI agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG.

👾 LM Studio CLI

A simple, easy-to-hack GraphRAG implementation

Text-To-Speech, RAG, and LLMs. All local!

Optimizing inference proxy for LLMs

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

A fast multimodal LLM for real-time voice

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.

A system for agentic LLM-powered data processing and ETL

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

Chat with any codebase in under two minutes | Fully local or via third-party APIs

LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ollama, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage neo4j KG, graphRAG / RAG / html 2 img

Easiest and laziest way for building multi-agent LLMs applications.

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

A SOTA lightweight multilingual LLM

Lightweight library for scraping web-sites with LLMs

A @ClickHouse fork that supports high-performance vector search and full-text search.

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more

This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

Unified KV Cache Compression Methods for Auto-Regressive Models

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

Evaluate your LLM's response with Prometheus and GPT4 💯

A 4-hour coding workshop to understand how LLMs are implemented and used

🦾 Take control of your AI agents

Agentless🐱: an agentless approach to automatically solve software development problems

The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

Generate music based on natural language prompts using LLMs running locally

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

The TypeScript AI framework.

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

A Framework of Small-scale Large Multimodal Models

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

A list of free LLM inference resources accessible via API.

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

Unifying 3D Mesh Generation with Language Models

Scalable data pre processing and curation toolkit for LLMs

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

🤖 Free Search with AI, 💡 Open-Source Perplexity, 📍 Support Ollama/SearXNG, Support Docker deployment. 让AI大模型和搜索引擎回答你的问题，支持本地大模型(Ollama)、聚合搜索引擎SearXNG，支持Docker一键部署。

MobiLlama : Small Language Model tailored for edge devices

A unified interface for working with LLMs in Laravel

Practical Llama 3 inference in Java

BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Large Language Models (LLMs) by generating a comprehensive Markdown file containing the content of your codebase. ⭐ If you find Code2Prompt useful, consider giving us a star on GitHub! It helps us reach more developers and improve the tool. ⭐

The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works with the free Gemini API, local LLMs, and other cloud providers.

Generative Representational Instruction Tuning

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites