Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant

[Support 0.48.x]（Reset Cursor AI MachineID & Auto Sign Up / In & Bypass Higher Token Limit）自动注册 Cursor Ai ，自动重置机器ID ， 免费升级使用Pro功能: You've reached your trial request limit. / Too many free trial accounts used on this machine. Please upgrade to pro. We have this limit in place to prevent abuse. Please let us know if you believe this is a mistake.

eShopLite is a set of reference .NET applications implementing an eCommerce site with features like Semantic Search, MCP, Reasoning models and more.

First-of-its-kind benchmark for evaluating the protection capabilities of large language model (LLM) guard systems

A powerful Android app that connects to LM Studio running on your computer, allowing you to chat with your favorite AI models from your mobile device.

An external provider for Llama Stack allowing for the use of RamaLama for inference.

Enable tool-use ability for any LLM model (DeepSeek V3/R1, etc.)

LLamaHTML is a simple html file to communicate with a running llamacpp llama-server

A simple, user-friendly CLI tool for managing, and running, llama.cpp's llama-server with multiple configuration profiles and providing OpenAI-compatible API access.

Run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1, and other state-of-the-art language models locally with scorching-fast performance. Inferno provides an intuitive CLI and an OpenAI/Ollama-compatible API, putting the inferno of AI innovation directly in your hands.

This repository hosts the instructions and workshop materials for Lab 331 (Deep Research with Langchain and DeepSeek R1) for Microsoft Build

基于DeepSeek-R1黑盒蒸馏的网络安全渗透领域推理模型。可高效的应对断网情况下的网络安全大赛。简介写完整了，图片加载不出来看看是否梯子挂好了

Cook your files into AI-ready servings

A privacy-first, self-hosted AI chat UI powered by Ollama and open-source models like Mistral, LLaMA 3, and Phi. Designed to be fast, lightweight, and simple to deploy (Docker-ready)—no GPU or complex setup required. Spin up your own ChatGPT alternative in minutes with a beautiful TailwindCSS UI and Go Fiber backend. Supports real-time streaming

Inference Llama 2 in several files of pure C but on a C64

Run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1, and other state-of-the-art language models locally with scorching-fast performance. Inferno provides an intuitive CLI and an OpenAI/Ollama-compatible API, putting the inferno of AI innovation directly in your hands.

ChatGPT 中文版：国内直连教程（支持GPT-4、4o、o1、o3 和 DeepSeek R1，无需翻墙）【5月持续更新】

Geologic models from Llama 4 language model + GemPy!

Discord chat bot using AI models from Nano-GPT.com. Supports popular AI models such as ChatGPT, Llama, Claude, Gemini, Grok, and many more!

a GitHub repository dedicated to building and hosting wheels for llama-cpp-python. The goal is to automate the build process for various platforms, architectures, and backend configurations using GitHub Actions and host the resulting wheels, likely via GitHub Releases or GitHub Pages.

This project is a backend system for an online learning platform built with Java Spring Boot and MySQL. It provides RESTful APIs for user registration, course management, quiz features, and role-based access. The system supports JWT authentication, Swagger API documentation, and includes unit , integration testing for services and controllers.

This repository is CUDA implementation for LLAMA 3.1 open models

MindSight is an AI-powered tool for visualizing and analyzing brain wave activity using advanced machine learning. Built with React and integrating with Hugging Face's DeepSeek-R1 model, it demonstrates the potential of AI in neuroscience applications.

A Revolutionary Robot Powered by BCE, ChromaDB, and Deepseek-R1

A modern AI-powered text summarization tool that effortlessly condenses articles, blogs, research papers, and documents into clear, easy-to-read summaries.

LlamaCon Hackathon 2025 Project using Llama API and Groq Inferencing to extract Basketball Highlights and compose sports clips in real-time.

An iterative multi-LLM consensus framework for accurate cell type annotation in single-cell RNA-seq data

Implementing DeepSeek R1's GRPO algorithm from scratch

Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant

Voice AI agent starter kit with Groq, Llama 4, and (optionally) Twilio

Official PyTorch implementation of the paper "Chapter-Llama: Efficient Chaptering in Hour-Long Videos with LLMs"

Summarize PDFs into beautiful sections with Llama 3.3

A cutting-edge voice assistant combining real-time speech recognition, AI reasoning, and neural text-to-speech capabilities.

[Support 0.48.x]（Reset Cursor AI MachineID & Auto Sign Up / In & Bypass Higher Token Limit）自动注册 Cursor Ai ，自动重置机器ID ， 免费升级使用Pro功能: You've reached your trial request limit. / Too many free trial accounts used on this machine. Please upgrade to pro. We have this limit in place to prevent abuse. Please let us know if you believe this is a mistake.

eShopLite is a set of reference .NET applications implementing an eCommerce site with features like Semantic Search, MCP, Reasoning models and more.

First-of-its-kind benchmark for evaluating the protection capabilities of large language model (LLM) guard systems

Used for thinking process intervention of reasoning models such as DeepSeek-R1, effectively controlling the reasoning thinking process. 用于DeepSeek-R1等推理模型的思维过程干预，有效控制推理思考过程

A powerful Android app that connects to LM Studio running on your computer, allowing you to chat with your favorite AI models from your mobile device.

An external provider for Llama Stack allowing for the use of RamaLama for inference.

OmniMind: An open-source Python library for effortless MCP (Model Context Protocol) integration, AI Agents, AI workflows, and AI Automations. Plug & Play AI Tools for MCP Servers and Clients, powered by Google Gemini.

Enable tool-use ability for any LLM model (DeepSeek V3/R1, etc.)

A community-driven AI automation framework that builds upon the incredible work of the open source community. Our goal is to combine language models with specialized tools for tasks like web search, crawling, and Python code execution, while giving back to the community that made this possible.

SpatialLM: Large Language Model for Spatial Understanding

Skywork-R1V2:Multimodal Hybrid Reinforcement Learning for Reasoning (Best open-source multimodal reasoning model)

📎 Clippy, now with some AI

Run LLMs with MLX

🌐 WebThinker: Empowering Large Reasoning Models with Deep Research Capability

Awesome RL Reasoning Recipes ("Triple R")

An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案，包含从训练到推理的完整代码和脚本，以及实践中积累一些经验和结论。)

An open-source tool for seamless migration from other LLMs to Llama, and for general prompt optimization.

Reproduction of DeepSeek-R1

Latest Advances on Long Chain-of-Thought Reasoning

Stay ahead of AI trends with automated Reddit insights! 🚀 This tool scans AI-related Reddit communities in English & Chinese, using DeepSeek R1 by Groq to analyze posts, summarize key discussions, and track trends. Daily rankings highlight hot topics—catch emerging trends before they go mainstream! (Updated every 6 AM CDT)

Ollama负载均衡服务器 | 一款高性能、易配置的开源负载均衡服务器，优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度，同时确保系统资源的有效利用。

LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM

DeepSeek-V3/R1 inference performance simulator

Whisper STT + Orpheus TTS + Gemma 3 using LM Studio to create a virtual assistant.

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Solve Visual Understanding with Reinforced VLMs

Witness the aha moment of VLM with less than $3.

Local Deep Research is an AI-powered assistant that transforms complex questions into comprehensive, cited reports by conducting iterative analysis using any LLM across diverse knowledge sources including academic databases, scientific repositories, web content, and private document collections.

Unleash Next-Level AI! 🚀 💻 Code Generation: DeepSeek r1 + Claude 3.7 Sonnet - Unparalleled Performance! 📝 Content Creation: DeepSeek r1 + Gemini 2.5 Pro - Superior Quality! 🔌 OpenAI-Compatible. 🌊 Streaming & Non-Streaming Support. ✨ Experience the Future of AI – Today! Click to Try Now! ✨

Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity.

(Supports DeepSeek R1) An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models.

An AI chat bot for small and medium-sized teams, supporting models such as Deepseek, Open AI, Claude, and Gemini. 专为中小团队设计的 AI 聊天应用，支持 Deepseek、Open AI、Claude、Gemini 等模型。

An open-source alternative to OpenAI and Gemini's deep research.

Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.

deepseek java sdk

TypeScript AI Framework specialized AI Function Calling enhanced by compiler skills.

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models

Explore the Multimodal “Aha Moment” on 2B Model

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

Fully open reproduction of DeepSeek-R1

Minimal reproduction of DeepSeek R1-Zero

A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

YuE: Open Full-song Music Generation Foundation Model, something similar to Suno.ai but open

Keep searching, reading webpages, reasoning until it finds the answer (or exceeding the token budget)

This is a replicate of DeepSeek-R1-Zero and DeepSeek-R1 training on small models with limited data

A GUI Agent application based on UI-TARS(Vision-Lanuage Model) that allows you to control your computer using natural language.

Perplexity style AI Search engine clone built with Gemini 2.0 Flash and Grounding

A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

VS Code extension for LLM-assisted code/text completion

A simple open-source chat app that uses Exa's API for web search and Deepseek R1 for reasoning

Bringing together outstanding artificial intelligence (AI) open source projects from around the world.

Deploy a Gemini multimodal chat website in 10 seconds, Severless! 只需准备一个Gemini API Key，10秒即可部署一个Gemini多模态对话的网站。

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

Taming Stable Diffusion for Lip Sync!

All Cursor AI's official download links for both the latest and older versions, making it easy for you to update, downgrade, and choose any version. 🚀

Open source alternative to Gemini Deep Research. Generate reports with AI based on search results.

🐵 Preswald is a full-stack platform for building, deploying, and managing interactive data applications. It brings ingestion, storage, transformation, and visualization into a simple SDK, minimizing complexity while maintaining flexibility for both prototyping and production-grade use cases.

This series will take you on a journey from the fundamentals of NLP and Computer Vision to the cutting edge of Vision-Language Models.

English pronunciation correction teacher built with gemini

A free and open source, self hosted Ai based live meeting note taker and minutes summary generator that can completely run in your Local device (Mac OS support is added. Will add windows and linux support soon)

A highly optimized LLM inference acceleration engine for Llama and its variants.

Google AI Studio Starter Apps

Project showcasing Llama 3.3 70B HTML codegen abilities

Minimalist LLM Framework in 100 Lines. Enable LLMs to Program Themselves.

OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking

✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)

WorkflowAI is an open-source platform where product and engineering teams 
collaborate to build and iterate on AI features.

A framework to enable autonomous android and computer use using any LLM (local or remote)

Document to Markdown OCR library with Llama 3.2 vision

Zotero chat PDF with AI, DeepSeek, GPT 4.1, ChatGPT, Claude, Gemini, Qwen3

Interface for OuteTTS models.

[CVPR2025] We present StableAnimator, the first end-to-end ID-preserving video diffusion framework, which synthesizes high-quality videos without any post-processing, conditioned on a reference image and a sequence of poses.

Unifying 3D Mesh Generation with Language Models

A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.

[768 Resolution] [Any "SDXL" Model] [Various Conditions] [Arbitrary Views] Official impl. of "MV-Adapter: Multi-view Consistent Image Generation Made Easy"

一个轻量级、支持全链路且易于二次开发的大模型应用项目(Large Model Data Assistant) 支持DeepSeek/Qwen2.5等大模型 基于 Dify 、Ollama&Vllm、Sanic 和 Text2SQL 📊 等技术构建的一站式大模型应用开发项目，采用 Vue3、TypeScript 和 Vite 5 打造现代UI。它支持通过 ECharts 📈 实现基于大模型的数据图形化问答，具备处理 CSV 文件 📂 表格问答的能力。同时，能方便对接第三方开源 RAG 系统 检索系统 🌐等，以支持广泛的通用知识问答。

A hub for various industry-specific schemas to be used with VLMs.

GPT-4o and Claude-3.7-Sonnet APIs for coding.

CodeGate: CodeGen Privacy and Security

User-friendly Enterprise Ready AI Interface (Supports Ollama, OpenAI API, DeepSeek...)

A Survey of Spoken Dialogue Models (60 pages)

📚FFPA(Split-D): Yet another Faster Flash Attention with O(1) GPU SRAM complexity large headdim, 1.8x~3x↑🎉 faster than SDPA EA.

A Cross-platform AI chat application built with React Native and powered by Amazon Bedrock

Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding

Make websites accessible for AI agents

Janus-Series: Unified Multimodal Understanding and Generation Models

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

📃 A better UX for chat, writing content, and coding with LLMs.

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

veRL: Volcano Engine Reinforcement Learning for LLM

GLM-4-Voice | 端到端中英语音对话模型

Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。

The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more.

An Open Source implementation of Notebook LM with more flexibility and features

Vim plugin for LLM-assisted code/text completion

Use ChatGpt 4o forFree - No API Key Need. also ChatGpt 3 and ChatGpt 3.5 Experience the power of ChatGPT with a user-friendly interface, enhanced jailbreaks, and completely free.

Large Reasoning Models

Azure OpenAI code resources for using gpt-4o-realtime capabilities.

实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive AI systems.

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.

g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

AI Agent Builder in Python

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

🚀 「大模型」1小时从0训练26M参数的视觉多模态VLM！🌏 Train a 26M-parameter VLM from scratch in just 1 hours!

Kodu is an autonomous coding agent that lives in your IDE. It is a VSCode extension that can help you build your dream project step by step by leveraging the latest technologies in automated coding agents

BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

这是一份入门AI/LLM大模型的逐步指南，包含教程和演示代码，带你从API走进本地大模型部署和微调，代码文件会提供Kaggle或Colab在线版本，即便没有显卡也可以进行学习。项目中还开设了一个小型的代码游乐场🎡，你可以尝试在里面实验一些有意思的AI脚本。同时，包含李宏毅 (HUNG-YI LEE）2024生成式人工智能导论课程的完整中文镜像作业。

Use LLMs in Excel formulas

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

Dynamiq is an orchestration framework for agentic AI and LLM applications

Jobs_Applier_AI_Agent_AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Official inference framework for 1-bit LLMs

The TypeScript AI agent framework. ⚡ Assistants, RAG, observability. Supports any LLM: GPT-4, Claude, Gemini, Llama.

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

Efficient Triton Kernels for LLM Training

Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet. Powered by Vercel AI SDK! Search with models like Grok 2.0.

利用AI大模型，一键解说并剪辑视频； Using AI models to automatically provide commentary and edit videos with a single click.

✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

Optimizing inference proxy for LLMs

Laminar - open-source all-in-one platform for engineering AI products. Create data flywheel for your AI app. Traces, Evals, Datasets, Labels. YC S24.

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

nanoGPT style version of Llama 3.1

百聆 是一个类似GPT-4o的语音对话机器人，通过ASR+LLM+TTS实现，集成DeepSeek R1等优秀大模型，时延低至800ms，Mac等低配置也可运行，支持打断

Chat with any codebase in under two minutes | Fully local or via third-party APIs

Lightweight library for scraping web-sites with LLMs

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

PDF to Markdown with vision models

Let AI be your browser operator.

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

Open-source Next.js template for building apps that are fully generated by AI. By E2B.

A list of free LLM inference resources accessible via API.

Distributed LLM and StableDiffusion inference for mobile, desktop and server.

In-browser Postgres sandbox with AI assistance (formerly postgres.new)

A simple, easy-to-hack GraphRAG implementation

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

Build multimodal language agents for fast prototype and production

AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording

Utilities intended for use with Llama models.

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

TEN Agent is a conversational voice AI agent powered by TEN, integrating Deepseek, Gemini, OpenAI, RTC, and hardware like ESP32. It enables realtime AI capabilities like seeing, hearing, and speaking, and is fully compatible with platforms like Dify and Coze.

一本 GPT4 生成的单词书📚，超过 8000 个单词分析，涵盖了词义、例句、词根词缀、变形、文化背景、记忆技巧和小故事

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

Using GPT to parse PDF

ETL, Analytics, Versioning for Unstructured Data

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI

The code used to train and run inference with the ColPali architecture.

Things you can do with the token embeddings of an LLM

Agentless🐱: an agentless approach to automatically solve software development problems

🙌 OpenHands: Code Less, Make More

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Make websites accessible for AI agents

A generative speech model for daily dialogue.

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper

The official Meta Llama 3 GitHub site

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

Jobs_Applier_AI_Agent_AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

LLM training in simple, raw C/CUDA

利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers. Support deepseek-r1

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

An open-source RAG-based tool for chatting with your documents.

Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.