RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild. Our new online demo is also released at suppixel.ai.

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Set of tools to assess and improve LLM security.

深入探索精选的套壳站和必备API资源。本文为初学者和经验丰富的运营者提供一站式指南，涵盖常见问题解答和基础攻略，助您迈向套壳站副业成功之路。Dive into a curated selection of shell sites and essential APIs. This article offers a comprehensive guide for both beginners and seasoned operators, covering FAQs and basic strategies to propel you towards success in your shell site side hustle.

这是一个全自动（音频）视频翻译项目。利用Whisper识别声音，AI大模型翻译字幕，最后合并字幕视频，生成翻译后的视频。

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

LLM&VLM Tutorial

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

Easy token price estimates for 400+ LLMs. TokenOps.

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

A curated list of Large Language Model (LLM) Interpretability resources.

Help your LLMs online

Strong and Open Vision Language Assistant for Mobile Devices

[CVPR2024] StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On

✨ AI-powered coding, seamlessly in Neovim. Supports Anthropic, Copilot, Gemini, Ollama, OpenAI and xAI LLMs

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

A benchmark to evaluate language models on questions I've previously asked them to solve.

the resources about the application based on LLM with RAG pattern

制作懂人情世故的大语言模型 | 提示词工程、RAG、Agent、微调全流程教程

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

LLM abstractions that aren't obstructions

The official Node.js / Typescript library for the Google Gemini API

Awesome papers about generative Information Extraction (IE) using Large Language Models (LLMs)

Deploy your private Gemini application for free with one click, supporting Gemini 1.5 Pro, Gemini 1.5 Flash, Gemini Pro and Gemini Pro Vision models. 一键免费部署您的私人 Gemini 应用, 支持 Gemini 1.5 Pro、Gemini 1.5 Flash、Gemini Pro 和 Gemini Pro Vision 模型。

A GPT-4/Gemini Voice/Video Exploration Tool

Create characters in Unity with LLMs!

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

A Home Assistant integration & Model to control your smart home using a Local LLM

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

Stable Video Diffusion Training Code and Extensions.

A proxy for converting the OpenAI API protocol to the Google Gemini Pro protocol.

Structured outputs for LLMs in Elixir

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Quick Start for Large Language Models (Theoretical Learning and Practical Fine-tuning) 大语言模型快速入门（理论学习与微调实战）

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.

[ICML 2024] TrustLLM: Trustworthiness in Large Language Models

Rapid prototyping of web apps using plain english 👶🤖

appbuilder-sdk, 千帆AppBuilder-SDK帮助开发者灵活、快速的搭建AI原生应用

This autoblogger uses the GPT assistant's API to autoblog on ecommerce websites

Data-Driven Evaluation for LLM-Powered Applications

AgentSearch is a framework for powering search agents and enabling customizable local search.

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Mac compatible Ollama Voice

Galah: An LLM-powered web honeypot.

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

End-to-end platform for building voice first multimodal agents

Best practices for distilling large language models.

Large language Models (LLM)

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction

LLM Inference benchmark

Create an AI clone of yourself from your WhatsApp chats (using Llama 3)

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design

Generative AI phone call toolkit using Twilio Media Streams.

A collection of benchmarks and datasets for evaluating LLM.

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

LLM for Long Text Summary (Comprehensive Bulleted Notes)

Embeddable vector database for Go with Chroma-like interface and zero third-party dependencies. In-memory with optional persistence.

Collection of training data management explorations for large language models

function calling-based LLM agents

GPT in 500 lines of SQL

Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few lines of modular code.

a small code base for training large models

AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser.

将chatgpt前端进行逆向，实现绕过cloudflare 对官方api进行代理 实现前端接口转标准api(通过access_token实现标准api传入访问)

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

Evaluating text-to-image/video/3D models with VQAScore

将你的 copilot 转成 ChatGPT API（支持GPT4）

A playground for creative exploration that uses SDXL Turbo.

Making the food-delivery experience easy for busy folks :)

Kotlin Multiplatform sample that uses Gemini Generative AI APIs. Runs on Android, iOS, Desktop and Wasm based Compose for Web.

Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and representation of player Elo.

A library for prototyping generative AI applications.

Comparison of Language Model Inference Engines

GPT-Analyst: A GPT for GPT analysis and reverse engineering

Work with LLMs on a local environment using containers

This tool named "W0rm-GPT" is mainly use to research all activities which ChatGPT cant't give , All working apis are present in the script , If you do any illegal activites through this script we are not responsible

A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

Create state-machine-powered LLM agents using XState

Moonshot - A simple and modular tool to evaluate and red-team any LLM application.

A fast batching API to serve LLM models

Official code for article "LLMLight: Large Language Models as Traffic Signal Control Agents".

LLM plugin providing access to Mistral models using the Mistral API

A python package for developing AI applications with local LLMs.