RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild. Our new online demo is also released at suppixel.ai.

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Set of tools to assess and improve LLM security.

深入探索精选的套壳站和必备API资源。本文为初学者和经验丰富的运营者提供一站式指南，涵盖常见问题解答和基础攻略，助您迈向套壳站副业成功之路。Dive into a curated selection of shell sites and essential APIs. This article offers a comprehensive guide for both beginners and seasoned operators, covering FAQs and basic strategies to propel you towards success in your shell site side hustle.

Easy token price estimates for 400+ LLMs. TokenOps.

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

这是一个全自动（音频）视频翻译项目。利用Whisper识别声音，AI大模型翻译字幕，最后合并字幕视频，生成翻译后的视频。

Tensor parallelism is all you need. Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

A curated list of Large Language Model (LLM) Interpretability resources.

Strong and Open Vision Language Assistant for Mobile Devices

Help your LLMs online

LLM Tutorial

[CVPR2024] StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

A benchmark to evaluate language models on questions I've previously asked them to solve.

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

A GPT-4/Gemini Voice/Video Exploration Tool

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

The official Node.js / Typescript library for the Google Gemini API

Awesome papers about generative Information Extraction (IE) using Large Language Models (LLMs)

the resources about the application based on LLM with RAG pattern

An intuitive approach to building with LLMs

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

Stable Video Diffusion Training Code and Extensions.

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

A Home Assistant integration & Model to control your smart home using a Local LLM

This autoblogger uses the GPT assistant's API to autoblog on ecommerce websites

Create characters in Unity with LLMs!

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Structured outputs for LLMs in Elixir

appbuilder-sdk, 千帆AppBuilder-SDK帮助开发者灵活、快速的搭建AI原生应用

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

AgentSearch is a framework for powering search agents and enabling customizable local search.

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Production-Grade Evaluation for LLM-Powered Applications

Rapid prototyping of web apps using plain english 👶🤖

Mac compatible Ollama Voice

Quick Start for Large Language Models (Theoretical Learning and Practical Fine-tuning) 大语言模型快速入门（理论学习与微调实战）

Galah: An LLM-powered web honeypot.

Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

[ICML 2024] TrustLLM: Trustworthiness in Large Language Models

The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction

End-to-end platform for building voice first multimodal agents

Create an AI clone of yourself from your WhatsApp chats (using Llama 3)

Best practices for distilling large language models.

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

LLM Inference benchmark

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

Large language Models (LLM)

GPT in 500 lines of SQL

function calling-based LLM agents

将chatgpt前端进行逆向，实现绕过cloudflare 对官方api进行代理 实现前端接口转标准api(通过access_token实现标准api传入访问)

a small code base for training large models

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser.

Collection of training data management explorations for large language models

A playground for creative exploration that uses SDXL Turbo.

将你的 copilot 转成 ChatGPT API（支持GPT4）

✨ A Copilot Chat experience in Neovim. Supports Anthropic, Ollama and OpenAI LLMs

Making the food-delivery experience easy for busy folks :)

A collection of benchmarks and datasets for evaluating LLM.

Kotlin Multiplatform sample that uses Gemini Generative AI APIs. Runs on Android, iOS, Desktop and Wasm based Compose for Web.

LLM for Long Text Summary (Comprehensive Bulleted Notes) : Walkthrough and Model Rankings

FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design

Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and representation of player Elo.

Generative AI phone call toolkit using Twilio Media Streams.

GPT-Analyst: A GPT for GPT analysis and reverse engineering

A fast batching API to serve LLM models

Work with LLMs on a local environment using containers

Embeddable vector database for Go with Chroma-like interface and zero third-party dependencies. In-memory with optional persistence.

Comparison of Language Model Inference Engines

This tool named "W0rm-GPT" is mainly use to research all activities which ChatGPT cant't give , All working apis are present in the script , If you do any illegal activites through this script we are not responsible

A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

Official code for article "LLMLight: Large Language Models as Traffic Signal Control Agents".

LLM plugin providing access to Mistral models using the Mistral API

Evaluating text-to-image/video/3D models with VQAScore

A python package for developing AI applications with local LLMs.

A starter for working with tldraw and large language models.

Compressing SDXL via knowledge-distillation

A holistic way of understanding how LLaMA and its components run in practice, with code and detailed documentation.

微信AI助理 (Wechat AI Assistant): 在微信中与 AI 助理进行多模态交互, 处理问答、扮演角色、响应语音消息、分析图片和视频、总结文章和网页链接、搜索互联网等等。现支持 OpenAI Assistant API 和 GPT-4o模型。

A reproduction of the Gemini demo using GPT-vision.

Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B

Leetcode Intensive tutorial and study guide generated by llama-index, networkx, scikit-learn and pydantic

Experimental adventure game with AI-generated content

Data extraction with LLM on CPU

LLM Engineering CrashCourse