rewind.ai x cursor.com = your AI assistant that has all the context. 24/7 screen & voice recording for the age of super intelligence. get your data ready or be left behind

Utilities intended for use with Llama models.

一本 GPT4 生成的单词书📚，超过 8000 个单词分析，涵盖了词义、例句、词根词缀、变形、文化背景、记忆技巧和小故事

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Using GPT to parse PDF

AI-data warehouse to enrich, transform and analyze unstructured data

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

TEN Agent is a world-class multimodal AI agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG.

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Things you can do with the token embeddings of an LLM

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

The code used to train and run inference with the ColPali architecture.

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

Easiest and laziest way for building multi-agent LLMs applications.

A SOTA lightweight multilingual LLM

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

Unified KV Cache Compression Methods for Auto-Regressive Models

Inference Microsoft Florence2 VLM

A 4-hour coding workshop to understand how LLMs are implemented and used

Agentless🐱: an agentless approach to automatically solve software development problems

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Yacine's LLM nvim scripts

🚀 一键部署个人的 ChatGPT 镜像站

Local SRT/LLM/TTS Voicechat

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

[NeurIPS 2024 Spotlight] Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models

Instrument any LLM to do actual stuff.

An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

Official implementation of ⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation

Bring Claude's Artifacts feature to ChatGPT

[SIGGRAPH Asia 2024 (Journal Track)] StableNormal: Reducing Diffusion Variance for Stable and Sharp Normal

Index your memes by their content and text, making them easily retrievable for your meme warfare pleasures. Find funny fast.

A curated list of awesome open-source libraries for production LLM

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

gpt-2 from scratch in mlx

The simplest and most cost-effective AI integration solution, enabling any device to achieve intelligent conversation functionality (based on ESP development boards). If you like this project, please give it a Star! | 最简单、最低成本的AI接入方案，让任何物品都能实现智能对话功能(基于ESP开发板)。喜欢本项目的话点个 Star 吧，您的一个 Star 对目前的仓库发展非常重要

LiveBench: A Challenging, Contamination-Free LLM Benchmark

llama3.cuda is a pure C/CUDA implementation for Llama 3 model.

Replace OpenAI with Llama.cpp Automagically.

A font for writing tiny stories

Vercel AI provider for Chrome built-in model (Gemini Nano)

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust

Medical Multimodal LLMs

LLM-powered lossless compression tool

[NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models

基于Node.js、Vue3、uniapp的ChatGPT+Midjourney绘画+Suno音乐+Pika/Runway/Sora视频 网页服务 | 个人、团队、企业私有化AIGC平台

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.

Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

大语言模型微调，Qwen2VL、Qwen2、GLM4指令微调

Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

GPT-SoVITS2

Tutorial for building LLM router

RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

LLaRA: Large Language and Robotics Assistant

使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力

Cell type annotation with local Large Language Models (LLMs) - Ensuring privacy and speed with extensive customized reports

Build your own Face App with Stable Diffusion 2.1

Integrate LLM's into your OS. For any issues or ideas, message us in the discord server below!

Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

Belullama is a comprehensive AI application that bundles Ollama, Open WebUI, and Automatic1111 (Stable Diffusion WebUI) into a single, easy-to-use package.

Platform of Open Intelligence eXperiences for Everyone. 面向所有人的开放智能体验平台，一站式AI对话工具聚合

🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Paper.

AI Coding assistant for large and complex codebases.

A toolbox for benchmarking trustworthiness of multimodal large language models (MultiTrust, NeurIPS 2024 Track Datasets and Benchmarks)

[NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of existing MLLMs to comprehend long multimodal documents.

🎙️ Speak with AI - Run locally using Ollama, OpenAI or xAI - Speech uses XTTS, OpenAI or ElevenLabs

Semantic Kernel for Java. Integrate cutting-edge LLM technology quickly and easily into your Java based apps. See https://aka.ms/semantic-kernel.

llama.cpp fork with additional SOTA quants and improved performance

[CoRL2024] Official repo of `A3VLM: Actionable Articulation-Aware Vision Language Model`

A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 Studio, LLaMA.CPP, and Ollama, and hundreds of models.

Automatic translate your language files into many languages using AI like Claude, GPT and etc.

A curated list of open source repositories for AI Engineers

Generate long weighted prompt embeddings for Stable Diffusion

Sample GLM4V + ChatTTS AI assistant

《动手学SpringAI》包含SSE流/Agent智能体/知识图谱RAG/FunctionCall/历史消息/图片生成/图片理解/Embedding/VectorDatabase/RAG

📖 A step-by-step guide for beginners to running Claude-generated React code locally.

VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".

Fixed Attention Couple, NegPip(negative weights in prompts) for SDXL and FLUX, more CFG++ and SMEA DY samplers, etc.

Visualizing the attention of vision-language models

GenAI & LLM usecases and applications

Tiny client for LLMs with vision and tool calling. As simple as it gets.

LLaMA Factory Document

Swift library that utilize GPT-4o for scanning receipt and its items

A node.js project that generates short videos using popular AI LLM.

🌋👵🏻 Yo'LLaVA: Your Personalized Language and Vision Assistant

RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for engaging with different chat providers while offering robust features for managing and customizing your conversations. The code in this repo is 100% AI generated. Nothing has been written by a human.

The Library for LLM-based multi-agent applications

OmniAI standardizes the APIs for multiple AI providers like OpenAI's Chat GPT, Mistral's LeChat, Claude's Anthropic and Google's Gemini.

A Comprehensive Benchmark for Code Information Retrieval.

This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingface.

OpenShield is a new generation security layer for AI models