Top Open Source AI Organization Influencers in 2024Q4

Make websites accessible for AI agents

Janus-Series: Unified Multimodal Understanding and Generation Models

📃 A better UX for chat, writing content, and coding with LLMs.

Taming Stable Diffusion for Lip Sync!

veRL: Volcano Engine Reinforcement Learning for LLM

GLM-4-Voice | 端到端中英语音对话模型

Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

A react-based starter app for using the Multimodal Live API over websockets with Gemini

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。

Vim plugin for LLM-assisted code/text completion

🐵 Preswald is a full-stack platform for building, deploying, and managing interactive data applications. It brings ingestion, storage, transformation, and visualization into a simple SDK, minimizing complexity while maintaining flexibility for both prototyping and production-grade use cases.

A free and open source, self hosted Ai based live meeting note taker and minutes summary generator that can completely run in your Local device (Mac OS support is added. Will add windows and linux support soon)

Unifying 3D Mesh Generation with Language Models

A highly optimized LLM inference acceleration engine for Llama and its variants.

Large Reasoning Models

Google AI Studio Starter Apps

Parsing-free RAG supported by VLMs

Project showcasing Llama 3.3 70B HTML codegen abilities

Minimalist LLM Framework in 100 Lines. Enable LLMs to Program Themselves.

Apple MLX engine for LM Studio

A hub for various industry-specific schemas to be used with VLMs.

VSCode for the new age of AI.

OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking

Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents

A framework to enable autonomous android and computer use using any LLM (local or remote)

Generate large synthetic data using an LLM

CodeGate: CodeGen Privacy and Security

🤠 Agent-as-a-Judge and DevAI dataset

Friends of OLMo and their links.

Turn any app into agent knowledge

AI toolkit for making Shorts/Tiktoks

The agentic internet

Chat UI components for LLM apps

[ICLR2025] MagicPIG: LSH Sampling for Efficient LLM Generation

A lightweight, functional, and composable framework for building AI agents. No PhD required.

🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.

A Cross-platform AI chat application built with React Native and powered by Amazon Bedrock

Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑🎉vs SDPA EA.

This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]

The official implementation of the paper "AgentSquare: Automatic LLM Agent Search in Modular Design Space""

Official repo of VLABench, a large scale benchmark designed for fairly evaluating VLA, Embodied Agent, and VLMs.

LLM4AD: A Platform for Algorithm Design with Large Language Model

For LLMs to better code with Jina API

GLM Series Edge Models

Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research

Benchmarking Agentic LLM and VLM Reasoning On Games

Code for FreeScale, a tuning-free method for higher-resolution visual generation

Open source AI analyst powered by E2B. Analyze your CSV files with Llama 3.1 and create interactive charts.

A Ruby gem for seamlessly and uniformly interacting with large language and vision model (LLM) API's served by numerous services, including those of OpenAI, Anthropic, Google and others.

Lightweight Multi Agent AI Orchestrator Framework with AGI Capabilities.

💬 AI Chat Bot demo app showcasing the integration of Gemini SDK with Firebase Realtime Database for real-time chat functionality.

[CoRL 2024] VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding

TrustEval: A modular and extensible toolkit for comprehensive trust evaluation of generative foundation models (GenFMs)

An introduction to LLM Sampling

[ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"

Enhance and modify high-quality compositions using real-time rendering and generative AI output without affecting a hero product asset.

[NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective

Dingo: A Comprehensive Data Quality Evaluation Tool

✨✨Latest Advances on Neuro-Symbolic Learning in the era of Large Language Models

[ICLR 2025] Simple is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation

OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024

End-to-End Navigation with VLMs

This is a tool that can automatically translate the chat log into a note using LLM API

Official implementation of "Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policy."

Build AI powered websites with Astro, Shadcn and Vercel AI SDK

Official implementation of "GPT or BERT: why not both?"

A MCP server connecting to a managed index on LlamaCloud

Human Demo Videos to Robot Action Plans

Official repository for Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning [ICLR 2025]

Exploration into leveraging vision capabilities of an LLM

智谱AI 2024年金融行业大模型挑战赛仓库

Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning

Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."

LLM for Scientific Research Survey

ApolloMoE: Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts

Chat with your pdf using your local LLM, OLLAMA client.(incomplete)

[CVPR 2025] FLAIR: VLM with Fine-grained Language-informed Image Representations

DuckDB Community Extension to prompt LLMs from SQL

A growing list of fake podcasts generated by Notebook LM

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

An interactive integration of yFiles for HTML with LlamaIndex to visualize the knowledge graph used for query resolution.

Hacker News Companion - Browser extension

[EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs

Open Source multi-modal LLM environment. Host your own web and mobile chat interface, powered by real-time bots and voice AI functionality.

Splicing: Gen-AI Copilot for Data Engineering

The code, data, and models for "Teach Multimodal LLMs to Comprehend Electrocardiographic Images".

基于 Yunzai 的 AIGC 插件，可免费使用 FLUX、SD、MJ 等绘图、LLM 推理、谷歌实时搜索 LLM、Vits 语音合成等功能。支持多模型接入、多 Key 负载均衡、图生图、直链获取、Markdown 图片输出等特性

Translations Manager extension to use ChatGPT openAI to auto translate your __(), trans() fn

Document parser for RAG

This repository contains a series of samples on how to analyse a video using multimodal Large Language Models, like GPT-4o or GPT-4o-mini.

This is an opensource project allowing you to compare two LLM's head to head with a given prompt, this section will be regarding the backend of this project, allowing for llm api's to be incorporated and used in the front-end

Arduino library for M5Stack LLM Module

The official landing page for Sora Labs.

BehAV: Behavioral Rule Guided Autonomy Using VLM for Robot Navigation in Outdoor Scenes

Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral