Top Open Source AI Dev Influencers in March 2024

🙌 OpenHands: Code Less, Make More

The official Meta Llama 3 GitHub site

A modular graph-based Retrieval-Augmented Generation (RAG) system

利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.

An open-source RAG-based tool for chatting with your documents.

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

Examples and guides for using the Gemini API

Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper

🚀 KIMI AI 长文本大模型逆向API白嫖测试【特长：长文本解读整理】，支持高速流式输出、智能体对话、联网搜索、长文档解读、图像OCR、多轮对话，零配置部署，多路token支持，自动清理会话痕迹。

Run PyTorch LLMs locally on servers, desktop and mobile

Devon: An open-source pair programmer

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

LLM Zoomcamp - a free online course about building a Q&A system

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

Improved file parsing for LLM’s

基于大模型的智能对话客服工具，支持微信、拼多多、千牛、哔哩哔哩、抖音企业号、抖音、抖店、微博聊天、小红书专业号运营、小红书、知乎等平台接入，可选择 GPT3.5/GPT4.0/ 懒人百宝箱 （后续会支持更多平台），能处理文本、语音和图片，通过插件访问操作系统和互联网等外部资源，支持基于自有知识库定制企业 AI 应用。

✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

DarkGPT is an OSINT assistant based on GPT-4-200K (recommended use) designed to perform queries on leaked databases, thus providing an artificial intelligence assistant that can be useful in your traditional OSINT processes.

DeepSeek-VL: Towards Real-World Vision-Language Understanding

Accelerating the development of large multimodal models (LMMs) with lmms-eval

🚀 An open-source SQL AI (Text-to-SQL) Agent that empowers data, product teams to chat with their data. 🤘

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

Text-To-Speech, RAG, and LLMs. All local!

Mora: More like Sora for Generalist Video Generation

Use API to call the music generation AI of suno.ai, and easily integrate it into agents like GPTs.

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

chatGPT、prompt、LLM

Extract clean data from anywhere, powered by vision-language models ⚡

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

The easiest way to get started with LlamaIndex

RAG Search API

Fine-tune LLM agents with online reinforcement learning

A @ClickHouse fork that supports high-performance vector search and full-text search.

Low code tool to rapidly build and coordinate multi-agent teams

The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"

Automate the analysis of GitHub repositories for LLMs with RepoToTextForLLMs. Fetch READMEs, structure, and non-binary files efficiently. Outputs include analysis prompts to aid in comprehensive repo evaluation

esp32 based device, mainly used for voice chat with large language models

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

Scalable data pre processing and curation toolkit for LLMs

Twitter data scraping, embedding based image search and more.

🤖 Free Search with AI, 💡 Open-Source Perplexity, 📍 Support Ollama/SearXNG, Support Docker deployment. 让AI大模型和搜索引擎回答你的问题，支持本地大模型(Ollama)、聚合搜索引擎SearXNG，支持Docker一键部署。

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Large Language Models (LLMs) by generating a comprehensive Markdown file containing the content of your codebase. ⭐ If you find Code2Prompt useful, consider giving us a star on GitHub! It helps us reach more developers and improve the tool. ⭐

Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

AI Powered Search and Chat for Orgs - Think ChatGPT meets Google Search but powered by your data.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

The React library for LLMs

Chat with multiple PDFs locally

VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

Turn PDFs and EPUBs into audiobooks, subtitles or videos into dubbed videos (including translation), and more. For free. Pandrator uses local models, notably XTTS, including voice-cloning (instant, RVC-enhanced, XTTS fine-tuning) and LLM processing. It aspires to be a user-friendly app with a GUI, an installer and all-in-one packages.

Train a 1B LLM with 1T tokens from scratch by personal

Tech Stack for Building, Evaluating, and Deploying your LLM Application

Java client library for OpenAI API.Full support for all OpenAI API models including Completions, Chat, Edits, Embeddings, Audio, Files, Assistants-v2, Images, Moderations, Batch, and Fine-tuning.

[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

HPT - Open Multimodal LLMs from HyperGAI

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

🤖 Admyral enables continuous control monitoring for any custom control

ID-based RAG FastAPI: Integration with Langchain and PostgreSQL/pgvector

A curated list of awesome prompt/adapter learning methods for vision-language models like CLIP.

A talking LLM that runs on your own computer without needing the internet.

This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.

从零实现一个小参数量中文大语言模型。

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.

Automate the tedious development tasks with AI

Build, evaluate and observe LLM apps

LLM plugin for interacting with the Claude 3 family of models

(2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

비트코인 GPT 인공지능 AI 자동매매 시스템

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Financial datasets for LLMs 🧪

Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.

MindSQL: A Python Text-to-SQL RAG Library simplifying database interactions. Seamlessly integrates with PostgreSQL, MySQL, SQLite, Snowflake, and BigQuery. Powered by GPT-4 and Llama 2, it enables natural language queries. Supports ChromaDB and Faiss for context-aware responses.

A linter with superpowers! 🔥 Use LLMs to enforce best practices across your codebase.

An extension for Visual Studio Code that integrates the power of OpenAI's GPT models into VSCode.

A resource repository for machine unlearning in large language models

An implementation of bucketMul LLM inference

A collection of 150+ surveys on LLMs

An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).

AI chat client

适用于 GPT-SoVITS 的api调用接口

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

Instructions on how to run LLMs on Raspberry PI

本项目开源基于NextJS的前端， 希望能够提供一个用于生成式AI的文字转视频， 尤其是电影从编剧到视频生成的Web前端平台参考。Everyone can become a director. The Nextjs front-end of an AI driven platform for automatic movie/video generation (form GPT script generation to text2video movie generation).这是一个免费试用AI视频创作平台，集成了基于GPT的视频剧本生成和视频生成功能。 我们的理想是让每个人都能成为导演，以最快的方式将日常中的任何创意转化为高质量的视频， 无论是电影、营销视频、还是自媒体视频。

LLMs Run Riot in Production. Get Back in The Driving Seat. Build Your Own Evals, Iterate Quickly, and Go from Prototype to Production in No Time ⚡

Efficient fine-tuning for ko-llm models

Code files for advanced LLM Course

LLM-Merging: Building LLMs Efficiently through Merging

A bunch of experiments using Large Language Models