🙌 OpenHands: Code Less, Make More

A modular graph-based Retrieval-Augmented Generation (RAG) system

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

Automate browser-based workflows with LLMs and Computer Vision

rewind.ai x cursor.com = your AI assistant that has all the context

Building a quick conversation-based search demo with Lepton AI.

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

Large Action Model framework to develop AI Web Agents

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

Blazingly fast LLM inference.

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

🚀 KIMI AI 长文本大模型逆向API白嫖测试【特长：长文本解读整理】，支持高速流式输出、智能体对话、联网搜索、长文档解读、图像OCR、多轮对话，零配置部署，多路token支持，自动清理会话痕迹。

The all-in-one solution for RAG. Build, scale, and deploy state of the art Retrieval-Augmented Generation applications

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, and Gemini.

Efficient Triton Kernels for LLM Training

Open-source Next.js template for building apps that are fully generated by AI. By E2B.

Run PyTorch LLMs locally on servers, desktop and mobile

Multilingual Voice Understanding Model

Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Implementation for MatMul-free LM.

🔍 AI search engine - self-host with local or cloud LLMs

A new DSL and server for AI agents and multi-step tasks

Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁，一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️、Vue 生态搭建前端🍍、FastAPI 搭建后端🗝️、Docker-compose 打包部署🐋

基于大模型的智能对话客服工具，支持微信、拼多多、千牛、哔哩哔哩、抖音企业号、抖音、抖店、微博聊天、小红书专业号运营、小红书、知乎等平台接入，可选择 GPT3.5/GPT4.0/ 懒人百宝箱 （后续会支持更多平台），能处理文本、语音和图片，通过插件访问操作系统和互联网等外部资源，支持基于自有知识库定制企业 AI 应用。

The open source Tines / Splunk SOAR alternative for security engineers.

In-browser Postgres sandbox with AI assistance

Turn any webpage into structured data using LLMs

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

🚀 Open-source SQL AI Agent. A Text-to-SQL solution for your data! 🤘

AdalFlow: The library to build & auto-optimize LLM applications.

利用AI大模型，一键解说并剪辑视频； Using AI models to automatically provide commentary and edit videos with a single click.

AI-data warehouse to enrich, transform and analyze unstructured data

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

👾 LM Studio CLI

Text-To-Speech, RAG, and LLMs. All local!

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

TEN Agent is the world’s first real-time multimodal agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG capabilities.

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

Optimizing inference proxy for LLMs

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

A simple, easy-to-hack GraphRAG implementation

ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

A system for agentic LLM-powered data processing and ETL

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Ollama, etc supported. :fireworks: Code RAG

Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Chat with any codebase in under two minutes | Fully local or via third-party APIs

Easiest and laziest way for building multi-agent LLMs applications.

Dify in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ollama, grok, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage neo4j KG, graphRAG / RAG / html 2 img

A fast multimodal LLM for real-time voice

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

LLM powered fuzzing via OSS-Fuzz.

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

A SOTA lightweight multilingual LLM

A @ClickHouse fork that supports high-performance vector search and full-text search.

Lightweight library for scraping web-sites with LLMs

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

TypeScript AI agent platform with Autonomous agents, Software developer agents, AI code review agents and more

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

Evaluate your LLM's response with Prometheus and GPT4 💯

Fully-featured, beautiful web interface for Ollama LLMs - built with NextJS. Deploy with a single click.

A 4-hour coding workshop to understand how LLMs are implemented and used

🦾 Take control of your AI agents

Agentless🐱: an agentless approach to automatically solve software development problems

The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

Control Any Computer Using LLMs

Generate music based on natural language prompts using LLMs running locally

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

A Framework of Small-scale Large Multimodal Models

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

MobiLlama : Small Language Model tailored for edge devices

🤖 Free Search with AI, 💡 Open-Source Perplexity, 📍 Support Ollama/SearXNG, Support Docker deployment. 让AI大模型和搜索引擎回答你的问题，支持本地大模型(Ollama)、聚合搜索引擎SearXNG，支持Docker一键部署。

Scalable data pre processing and curation toolkit for LLMs

Generative Representational Instruction Tuning

Practical Llama 3 inference in Java

Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Large Language Models (LLMs) by generating a comprehensive Markdown file containing the content of your codebase. ⭐ If you find Code2Prompt useful, consider giving us a star on GitHub! It helps us reach more developers and improve the tool. ⭐

Stateful load balancer custom-tailored for llama.cpp

A unified interface for working with LLMs in Laravel

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

The Official Implementation of PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling