GLM-4-Voice | 端到端中英语音对话模型

Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Unifying 3D Mesh Generation with Language Models

Python API client for AI providers that intends to replace LangChain and LangGraph for most common use cases.

Generate large synthetic data using a local LLM

Write and execute jq programs with the help of LLM

For LLMs to better code with Jina API

A command-line personal assistant that integrates with Google Calendar, Gmail, and Tasks to help manage your digital life.

Vim plugin for LLM-assisted code/text completion

A GitHub Action that automatically reviews pull requests using Google's Gemini AI.

A Survey of Spoken Dialogue Models (60 pages)

StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurization

Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"

An introduction to LLM Sampling

NotebookLlama powered by Groq - Create podcasts on any topic lightning fast

Unifying 3D Mesh Generation with Language Models

A Survey of Spoken Dialogue Models (60 pages)

SDXL Training Improvements

End-to-End Navigation with VLMs

🤖 AI-powered food analysis tool that instantly calculates calories and nutrients from images. Built with Next.js 15, Vercel AI SDK, and GPT-4o.

Youtube:

Can GPT solve Brazilian university entrance exams?

Ask Me Anything for any website, powered by Firecrawl and OpenAI GPT-4o-mini

A powerful, unofficial OpenAI-compatible API service offering free access to GPT-4o, GPT-4-turbo, and audio preview models like gpt-4o-audio-preview & Realtime Models like gpt-4o-realtime. Features streaming responses, voice synthesis, TTS with no authentication requirements. Hosted on Hugging Face & Railway (Free tier)

PyCon mini 東海 2024 のトーク「Google Colaboratoryで試すVLM」で紹介したサンプル集

This repository contains a series of samples on how to analyse a video using multimodal Large Language Models, like GPT-4o or GPT-4o-mini.

The prompts which could enable GPT-4o to think and act like GPT-o1-mini

An AI chatbot plugin for Obsidian using the Gemini API for note summarization, content generation, and more. Enhance your workflow with AI assistance like the Notion AI bot.

Revolutionizing learning through AI-powered flashcards and adaptive study methods.

(WIP) 🦀 An Insanely Fast 🚀 Full Stack Content Generation SaaS Platform Powered by Dioxus, Dioxus Server Functions, Axum, Unsplash, Gemini AI & MongoDB.

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

📃 A better UX for chat, writing content, and coding with LLMs.

GLM-4-Voice | 端到端中英语音对话模型

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。

Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Use ChatGpt 4o forFree - No API Key Need. also ChatGpt 3 and ChatGpt 3.5 Experience the power of ChatGPT with a user-friendly interface, enhanced jailbreaks, and completely free.

Azure OpenAI code resources for using gpt-4o-realtime capabilities.

Large Reasoning Models

The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works with the free Gemini API, local LLMs, and other cloud providers.

实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

Chat with your documents using Vision Language Models. This repo implements an End to End RAG pipeline with both local and proprietary VLMs

Parsing-free RAG supported by VLMs

Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents

PDF 生成中文播客

Python API client for AI providers that intends to replace LangChain and LangGraph for most common use cases.

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

Dynamiq is an orchestration framework for agentic AI and LLM applications

AI-powered assistant to help you with your daily tasks, powered by Llama 3.2. It can recognize your voice, process natural language, and perform various actions based on your commands: summarizing text, rephasing sentences, answering questions, writing emails, and more.

「大模型」3小时从0训练27M参数的视觉多模态VLM，个人显卡即可推理训练！

Go library for embedded vector search and semantic embeddings using llama.cpp

Kodu is an autonomous coding agent that lives in your IDE. It is a VSCode extension that can help you build your dream project step by step by leveraging the latest technologies in automated coding agents

A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp

High-quality and streaming Speech-to-Speech interactive agent in a single file. 只用一个文件实现的流式全双工语音交互原型智能体！

Auto_Jobs_Applier_AI_Agent by AIHawk is an AI Agent that automates the jobs application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in an automated and personalized way.

Official inference framework for 1-bit LLMs

Efficient Triton Kernels for LLM Training

利用AI大模型，一键解说并剪辑视频； Using AI models to automatically provide commentary and edit videos with a single click.

Optimizing inference proxy for LLMs

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

nanoGPT style version of Llama 3.1

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Chat with any codebase in under two minutes | Fully local or via third-party APIs

Lightweight library for scraping web-sites with LLMs

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

A minimalistic AI-powered search engine that helps you find information on the internet. Powered by Vercel AI SDK Search with models like GPT-4o mini, GPT-4o and Claude 3.5 Sonnet(New)!

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

An open source voice-enabled, compact, empathic AI hardware + software 🤖 framework for companionship, entertainment, education, pediatric care, IoT robotics applications, AI-enhanced robotics application services, research, and DIY robotics kit development using Python, NextJs, Arduino, ESP32, LLMs (GPT), STT, TTS, Emotion Analysis, AI agent

PDF to Markdown with vision models

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, and Gemini.

Open-source Next.js template for building apps that are fully generated by AI. By E2B.

「大模型」3小时完全从0训练26M的小参数GPT，个人显卡即可推理训练！

Distributed LLM and StableDiffusion inference for mobile, desktop and server.

In-browser Postgres sandbox with AI assistance

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

Local realtime voice AI

GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.

A simple, easy-to-hack GraphRAG implementation

A Node.js CLI that uses Ollama and LM Studio models (Llava, Gemma, Llama etc.) to intelligently rename files by their contents

An AI personal tutor built with Llama 3.1

A Multimodal Native Agent Framework for Smart Hardware and More

A system for agentic LLM-powered data processing and ETL

rewind.ai x cursor.com = your AI assistant that has all the context. 24/7 screen & voice recording for the age of super intelligence. get your data ready or be left behind

Utilities intended for use with Llama models.

一本 GPT4 生成的单词书📚，超过 8000 个单词分析，涵盖了词义、例句、词根词缀、变形、文化背景、记忆技巧和小故事

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Using GPT to parse PDF

AI-data warehouse to enrich, transform and analyze unstructured data

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

TEN Agent is the world’s first real-time multimodal agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG capabilities.

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Things you can do with the token embeddings of an LLM

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

The code used to train and run inference with the ColPali architecture.

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

LLM101n: Let's build a Storyteller

🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper

llama3 implementation one matrix multiplication at a time

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

Intelligence development framework in python for your product like Apple Intelligence

A self-organizing file system with llama 3

AI一键批量生成各类短视频,自动批量混剪短视频,自动把视频发布到抖音,快手,小红书,视频号上,赚钱从来没有这么容易过! 支持本地语音模型chatTTS,fasterwhisper,GPTSoVITS,支持云语音：Azure,阿里云,腾讯云。支持Stable diffusion,comfyUI直接AI生图。Generate short videos with one click using AI LLM,print money together! support:chatTTS,faster-whisper,GPTSoVITS,Azure,tencent Cloud,Ali Cloud.

A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL

Deploy your agentic worfklows to production

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers

A fast multimodal LLM for real-time voice

llama3.np is a pure NumPy implementation for Llama 3 model.

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

Generate music based on natural language prompts using LLMs running locally

LLM training in simple, raw C/CUDA

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Collection of awesome LLM apps with RAG using OpenAI, Anthropic, Gemini and opensource models.

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

The easiest way to use Agentic RAG in any enterprise

《动手学大模型Dive into LLMs》系列编程实践教程

Utilize the unlimited free GPT-3.5-Turbo API service provided by the login-free ChatGPT Web.

Implementation for MatMul-free LM.

🔍 AI search engine - self-host with local or cloud LLMs

A new DSL and server for AI agents and multi-step tasks

Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁，一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️、Vue 生态搭建前端🍍、FastAPI 搭建后端🗝️、Docker-compose 打包部署🐋

Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

Turn any webpage into structured data using LLMs

🙌 OpenHands: Code Less, Make More

The official Meta Llama 3 GitHub site

A modular graph-based Retrieval-Augmented Generation (RAG) system

利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.

An open-source RAG-based tool for chatting with your documents.

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

Examples and guides for using the Gemini API

Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper

🚀 KIMI AI 长文本大模型逆向API白嫖测试【特长：长文本解读整理】，支持高速流式输出、智能体对话、联网搜索、长文档解读、图像OCR、多轮对话，零配置部署，多路token支持，自动清理会话痕迹。

Run PyTorch LLMs locally on servers, desktop and mobile

Devon: An open-source pair programmer

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

LLM Zoomcamp - a free online course about building a Q&A system

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

Improved file parsing for LLM’s

Open-Sora: Democratizing Efficient Video Production for All

Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Automate browser-based workflows with LLMs and Computer Vision

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Large Action Model framework to develop AI Web Agents

Blazingly fast LLM inference.

Containerized, state of the art Retrieval-Augmented Generation (RAG) system with a RESTful API

Reverse Engineering: Decompiling Binary Code with Large Language Models

ChatOllama is an open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.

No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents

Open weights LLM from Google DeepMind.

The open source Tines / Splunk SOAR alternative for security engineers.

SoraWebui is an open-source Sora web client, enabling users to easily create videos from text with OpenAI's Sora model.

FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs 🚀 🚀 🚀

One-step image-to-image with Stable Diffusion turbo: sketch2image, day2night, and more

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Python scraper based on AI

🏠 将小爱音箱接入 ChatGPT 和豆包，改造成你的专属语音助手。

Building a quick conversation-based search demo with Lepton AI.

MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.

The open source platform for AI-native application development.

SGLang is a fast serving framework for large language models and vision language models.

Curated list of chatgpt prompts from the top-rated GPTs in the GPTs Store. Prompt Engineering, prompt attack & prompt protect. Advanced Prompt Engineering papers.

Start building LLM-empowered multi-agent applications in an easier way.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

AIOS: LLM Agent Operating System

Parse files for optimal RAG

Build AI assistants that interact with your systems

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Neo4j graph construction from unstructured data using LLMs

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild. Our new online demo is also released at suppixel.ai.

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Set of tools to assess and improve LLM security.

深入探索精选的套壳站和必备API资源。本文为初学者和经验丰富的运营者提供一站式指南，涵盖常见问题解答和基础攻略，助您迈向套壳站副业成功之路。Dive into a curated selection of shell sites and essential APIs. This article offers a comprehensive guide for both beginners and seasoned operators, covering FAQs and basic strategies to propel you towards success in your shell site side hustle.

这是一个全自动（音频）视频翻译项目。利用Whisper识别声音，AI大模型翻译字幕，最后合并字幕视频，生成翻译后的视频。

LLM&VLM Tutorial

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

Easy token price estimates for 400+ LLMs. TokenOps.

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

✨ AI-powered coding, seamlessly in Neovim. Supports Anthropic, Copilot, Gemini, Ollama, OpenAI and xAI LLMs

A curated list of Large Language Model (LLM) Interpretability resources.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

A cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

LLM inference in C/C++

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

The official gpt4free repository | various collection of powerful language models

Interact with your documents using the power of GPT, 100% privately, no data leaks

Platform to experiment with the AI Software Engineer. Terminal based. NOTE: Very different from https://gptengineer.app

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application.

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)