Top Open Source AI Organization Influencers in 2024Q4

Make websites accessible for AI agents

📃 A better UX for chat, writing content, and coding with LLMs.

veRL: Volcano Engine Reinforcement Learning for LLM

GLM-4-Voice | 端到端中英语音对话模型

Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。

🐵 Preswald is a full-stack platform for building, deploying, and managing interactive data applications. It brings ingestion, storage, transformation, and visualization into a simple SDK, minimizing complexity while maintaining flexibility for both prototyping and production-grade use cases.

Vim plugin for LLM-assisted code/text completion

Unifying 3D Mesh Generation with Language Models

Large Reasoning Models

Parsing-free RAG supported by VLMs

VSCode for the new age of AI.

Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents

Generate large synthetic data using an LLM

A highly optimized inference acceleration engine for Llama and its variants.

A framework to enable autonomous android and computer use using any LLM (local or remote)

CodeGate: CodeGen Privacy and Security

🤠 Agent-as-a-Judge and DevAI dataset

Turn any app into agent knowledge

AI toolkit for making Shorts/Tiktoks

The agentic internet

Chat UI components for LLM apps

[ICLR2025] MagicPIG: LSH Sampling for Efficient LLM Generation

A lightweight, functional, and composable framework for building AI agents. No PhD required.

🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

The official implementation of the paper "AgentSquare: Automatic LLM Agent Search in Modular Design Space""

LLM4AD: A Platform for Algorithm Design with Large Language Model

For LLMs to better code with Jina API

GLM Series Edge Models

This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]

Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research

Benchmarking Agentic LLM and VLM Reasoning On Games

Code for FreeScale, a tuning-free method for higher-resolution visual generation

Open source AI analyst powered by E2B. Analyze your CSV files with Llama 3.1 and create interactive charts.

A Ruby gem for seamlessly and uniformly interacting with large language and vision model (LLM) API's served by numerous services, including those of OpenAI, Anthropic, Google and others.

Lightweight Multi Agent AI Orchestrator Framework with AGI Capabilities.

💬 AI Chat Bot demo app showcasing the integration of Gemini SDK with Firebase Realtime Database for real-time chat functionality.

[CoRL 2024] VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding

An introduction to LLM Sampling

[ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"

[NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective

Enhance and modify high-quality compositions using real-time rendering and generative AI output without affecting a hero product asset.

TrustEval: A modular and extensible toolkit for comprehensive trust evaluation of generative foundation models (GenFMs)

End-to-End Navigation with VLMs

OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024

This is a tool that can automatically translate the chat log into a note using LLM API

Official implementation of "Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policy."

Official implementation of "GPT or BERT: why not both?"

[ICLR 2025] Simple is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation

Human Demo Videos to Robot Action Plans

Official repository for Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning [ICLR 2025]

Exploration into leveraging vision capabilities of an LLM

智谱AI 2024年金融行业大模型挑战赛仓库

Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning

Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."

LLM for Scientific Research Survey

ApolloMoE: Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts

Chat with your pdf using your local LLM, OLLAMA client.(incomplete)

Dingo: A Comprehensive Data Quality Evaluation Tool

DuckDB Community Extension to prompt LLMs from SQL

A growing list of fake podcasts generated by Notebook LM

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

[EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs

Open Source multi-modal LLM environment. Host your own web and mobile chat interface, powered by real-time bots and voice AI functionality.

Splicing: Gen-AI Copilot for Data Engineering

The code, data, and models for "Teach Multimodal LLMs to Comprehend Electrocardiographic Images".

基于 Yunzai 的 AIGC 插件，可免费使用 FLUX、SD、MJ 等绘图、LLM 推理、谷歌实时搜索 LLM、Vits 语音合成等功能。支持多模型接入、多 Key 负载均衡、图生图、直链获取、Markdown 图片输出等特性

Translations Manager extension to use ChatGPT openAI to auto translate your __(), trans() fn

A hub for various industry-specific schemas to be used with VLMs.

Document parser for RAG

This repository contains a series of samples on how to analyse a video using multimodal Large Language Models, like GPT-4o or GPT-4o-mini.

This is an opensource project allowing you to compare two LLM's head to head with a given prompt, this section will be regarding the backend of this project, allowing for llm api's to be incorporated and used in the front-end

Arduino library for M5Stack LLM Module

The official landing page for Sora Labs.

BehAV: Behavioral Rule Guided Autonomy Using VLM for Robot Navigation in Outdoor Scenes

Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral

Code for the paper: Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping

NeurIPS'24 - LLM Safety Landscape

TrafficJamAnalyzer is an advanced tool designed to help monitor and analyze traffic conditions by processing images from CCTV cameras around the roads of Tenerife. By utilizing artificial intelligence (AI) with Semantic Kernel and OpenAI, the application accurately assesses traffic density and identifies locations with potential traffic jams.

Computer Agent Arena Hub: Compare & Test AI Agents on Crowdsourced Real-World Computer Use Tasks

Lecca.io | AI Agents & Automations

A Python-based AWS solution for automated Jira ticket classification using Amazon Bedrock. This project helps Jira users automate ticket categorization featuring S3 integration, AWS Glue deduplication, LLMs, and Terraform deployment.

Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions

This is the public code repository for the paper 'Reconstruct Your Previous Conversations! Comprehensively Investigating Privacy Leakage Risks in Conversations with GPT Models'

FloTorch is an open-source tool for optimizing Generative AI workloads on AWS. It automates RAG proof-of-concept development with features like hyperparameter tuning, vector database optimization, and LLM integration. FloTorch streamlines experimentation, ensures security, and accelerates production with cost-efficient, validated workflows.

An LLM-based app to easily track calories and exercise by taking a photo of your meal or describing your physical activity

(WIP) 🦀 An Insanely Fast 🚀 Full Stack Content Generation SaaS Platform Powered by Dioxus, Dioxus Server Functions, Axum, Unsplash, Gemini AI & MongoDB.

Can VLMs understand students' hand-drawn math work?

REST API for computing cross-modal similarity between images and text using the ColPaLI vision-language model

This project provides tools to load and prune large language models using a structured pruning method.