Top Open Source AI Organization Influencers in 2024Q3

Auto_Jobs_Applier_AI_Agent by AIHawk is an AI Agent that automates the jobs application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in an automated and personalized way.

Official inference framework for 1-bit LLMs

PDF to Markdown with vision models

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Open-source Next.js template for building apps that are fully generated by AI. By E2B.

Efficient Triton Kernels for LLM Training

Multilingual Voice Understanding Model

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

In-browser Postgres sandbox with AI assistance

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

Local realtime voice AI

A Multimodal Native Agent Framework for Smart Hardware and More

A system for agentic LLM-powered data processing and ETL

MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Chat with any codebase in under two minutes | Fully local or via third-party APIs

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with your APIs - outside business logic. Built by the core contributors of Envoy proxy, on Envoy.

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

An AI-powered automation SDK can control the page, perform assertions, and extract data in JSON format using natural language.

LOTUS: A semantic query engine - process data with LLMs as easily as writing pandas code

Dynamiq is an orchestration framework for agentic AI and LLM applications

AI-powered assistant to help you with your daily tasks, powered by Llama 3.2. It can recognize your voice, process natural language, and perform various actions based on your commands: summarizing text, rephasing sentences, answering questions, writing emails, and more.

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

An open source voice-enabled, compact, empathic AI hardware + software 🤖 framework for companionship, entertainment, education, pediatric care, IoT robotics applications, AI-enhanced robotics application services, research, and DIY robotics kit development using Python, NextJs, Arduino, ESP32, LLMs (GPT), STT, TTS, Emotion Analysis, AI agent

Prompt chains maximize intelligence and results when using LLMs

Claude Memory: Long-term memory for Claude

Kodu is an autonomous coding agent that lives in your IDE. It is a VSCode extension that can help you build your dream project step by step by leveraging the latest technologies in automated coding agents

An example of multi-agent orchestration with llama-index

E2M converts various file types (doc, docx, epub, html, htm, url, pdf, ppt, pptx, mp3, m4a) into Markdown. It’s easy to install, with dedicated parsers and converters, supporting custom configs. E2M offers an all-in-one, flexible, and open-source solution.

The fastest way to bring multi-agent workflows to production.

Get up and running with the Gemini API in under 5 minutes (with Python)

HumanLayer enables AI agents to communicate with humans in tool-based and async workflows. Guarantee human oversight of high-stakes function calls with approval workflows across slack, email and more. Bring your LLM and Framework of choice and start giving your AI agents safe access to the world. Agentic Workflows, human in the loop, tool calling

The TypeScript AI framework.

An awesome repository & A comprehensive survey on interpretability of LLM attention heads.

A simple example implementation of the VoiceRAG pattern to power interactive voice generative AI experiences using RAG with Azure AI Search and Azure OpenAI's gpt-4o-realtime-preview model.

Chat with your data, modify it, visualize it, create and test machine learning models all in plain English. DataHorse makes data analysis and data science conversational using LLMs.

LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.

High-quality and streaming Speech-to-Speech interactive agent in a single file. 只用一个文件实现的流式全双工语音交互原型智能体！

LlamaVoice is a llama-based large voice generation model, providing inference and training ability.

Call LLM APIs from R

参考GraphRag使用 Semantic Kernel 来实现的dotnet版本，可以使用NuGet开箱即用集成到项目中

Connect Data Silos with Explainable AI⚡🚀

End-to-End Local-First Text-to-SQL Pipelines

MooER: Moore-threads Open Omni model for speech-to-speech intERaction. MooER-omni includes a series of end-to-end speech interaction models along with training and inference code, covering but not limited to end-to-end speech interaction, end-to-end speech translation and speech recognition.

开箱即用的基于企业私有知识库的LLM大语言模型的智能客服机器人问答系统，支持私有化部署，代码免费开源且可商用，由芝麻小客服官方推出。

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.

TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle

The Dawn of Video Generation: Preliminary Explorations with SORA-like Models

DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception

Context-aware structured outputs. Search your documents or the web for specific data and get it back in JSON or Markdown.

Knowledge Base Builder，是一款基于LLM大语言模型的开源知识库生成管理优化构建系统，是「滨电智言」的一款开源工具，旨在成为企业的知识库构建中枢。

The repository of TrafficLLM, a universal LLM adaptation framework to learn robust traffic representation for all open-sourced LLM in real-world scenarios and enhance the generalization across diverse traffic analysis tasks.

SwarmZero's SDK for building AI agents, swarms of agents and much more.

Finetune Llama-3-8b on the MathInstruct dataset

【grps接入trtllm】通过GPRS+TensorRT-LLM+Tokenizers.cpp实现纯C++版高性能OpenAI LLM服务，支持chat和function call模式，支持ai agent，支持分布式多卡推理，支持多模态，支持gradio聊天界面。

Efficiently find the best-suited language model (LM) for your NLP task

Effective LLM Alignment Toolkit

A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.

LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1

A survey on harmful fine-tuning attack for large language model

Build multimodal data processing pipelines with Azure AI Services + LLMs

LLM Instance gateway implementation.

Full stack tools for building voice agents

Python SDK for Llama Stack

LLM-powered AI guide that leads and drives intelligent conversations

FlockMTL: DuckDB extension to seamlessly combine analytics and semantic analysis using language models (LMs)

Easily generate multilingual translations for your project with a single command, powered by Azure AI Services.

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

A proxy sidecar to access Gemini models via OpenAI and Ollama APIs

Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafted for accuracy, speed, and customization.

An agent framework offering a Python code interface for LLM-driven agents and meta-agents to do everything by code generation.

A modern learning management system to place learning in the hands of the students

[ECCV 2024] - Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation

Dabarqus is a stand alone application that implements a complete RAG solution.

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

ROS2 nodes for LLM, VLM, VLA

A demonstration of chatting with uploaded images using OpenAI vision models like gpt-4o.

The Library for LLM-based web-agent applications

A recipe that will walk you through using either Meta Llama 3.1 405B or GPT-4o deployed on Azure AI to generate a synthetic dataset using UC Berkeley's Gorilla project RAFT method.

multi-agents banking assistant with Java and Semantic Kernel

🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.

Terraform configuration for deploying Dify on Google Cloud with scalability, high availability, and production-level readiness.

GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI.

Finite State Machine based approach to create Agentic LLM Apps!

[ACMMM'2024] Generative Expressive Conversational Speech Synthesis