Audio (general)

A feature-rich command-line audio/video downloader

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

AI turns documents or topics into real, native PowerPoint decks—with native shapes, transitions and animations, data-backed charts and tables on demand, audio narration from speaker notes, and support for your own .pptx templates. · by Hugo He

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Video.js v10 - open source media player framework for HTML and React.

🔊 Text-Prompted Generative Audio Model

Instant voice cloning by MIT and MyShell. Audio foundation model.

🎥 Command line media player

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

SRS is a simple, high-performance, AI-driven real-time media server supporting RTMP, WebRTC, HLS, HTTP-FLV, HTTP-TS, SRT, MPEG-DASH, and GB28181, with codec support for H.264, H.265, AV1, VP9, AAC, Opus, and G.711.

The most advanced free and open-source browser fingerprinting library

GUI for a Vocal Remover that uses Deep Neural Networks.

🎧 Your Personal Streaming Service

Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

Ready-to-use Media-over-QUIC / SRT / WebRTC / RTSP / RTMP / LL-HLS / MPEG-TS / RTP live media server and media proxy that allows to read, publish, proxy, record and playback real-time video and audio streams.

The free and privacy-friendly screen recorder with no limits 🎥

Audio Editor

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.

A PyTorch-based Speech Toolkit

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

A React component for playing a variety of URLs, including file paths, YouTube, Facebook, Twitch, SoundCloud, Streamable, Vimeo, Wistia and DailyMotion

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

🎤⌨️ Acoustic keyboard eavesdropping

Text-audio foundation model from Boson AI

Mumble is an open-source, low-latency, high quality voice chat software.

HTML5 <audio> or <video> player with support for MP4, WebM, and MP3 as well as HLS, Dash, YouTube, Facebook, SoundCloud and others with a common HTML5 MediaElement API, enabling a consistent UI in all browsers.

Synchronous multiroom audio player

An extensible, plugin-oriented, HTML5-first media player for the web

Download web video and audio

Mixxx is Free DJ software that gives you everything you need to perform live mixes.

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

GNU Radio – the Free and Open Software Radio Ecosystem

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

250+ Fine-tuning & RL Notebooks for text, vision, audio, embedding, TTS models.

Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI

Effort free video editing!

Noise supression using deep filtering

Kimi-Audio, an open-source audio foundation model excelling in audio understanding, generation, and conversation

Think DSP: Digital Signal Processing in Python, by Allen B. Downey.

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

Random digital audio effects

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

A curated list of awesome data labeling tools

Soundcloud Music Downloader

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.

Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, images, and video, as well as generating speech in real time.

:strawberry: Strawberry Music Player

Low-level cross-platform audio I/O library in Rust

Deprecated in favour of Video.js 10; security fixes only until January 2028. UI components and hooks for building video and audio players on the web.

A library for audio and music analysis, feature extraction.

A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, MusicGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, and Bark!

Use API to call the music generation AI of suno.ai, and easily integrate it into agents like GPTs.

Self-hosted AI audio transcription

Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!

Data manipulation and transformation for audio signal processing, powered by PyTorch

An open-source audio wake word (or phrase) detection framework with a focus on performance and simplicity.

Extracts Exif, IPTC, XMP, ICC and other metadata from image, video and audio files

A list of open source audio software projects (Apps, Plugins and Libraries). Please contribute more links or open source your own plugins.

🎚️ Open Source Audio Matching and Mastering

ElevenLabs UI is a component library and custom registry built on top of shadcn/ui to help you build multimodal agents faster.

Voice Activity Detector (VAD) : low-latency, high-performance and lightweight

🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).

Cutting edge AI technology for automated audio transcription. A nice GUI for OpenAIs Whisper and pyannote (speaker identification)

The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.

Voice activity detector (VAD) for the browser with a simple API

[EMNLP2026] "VideoAgent: All-in-One Agentic Framework for Video Understanding and Editing, and Remaking"

MLT Multimedia Framework

[mirror] A list of software and resources for professional audio/video/live events production on Linux.

Cross-Platform, GPU Accelerated Whisper 🏎️

Server for Squeezebox and compatible players. This server is also called Lyrion Music Server.

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

A comprehensive ComfyUI integration for Microsoft's VibeVoice text-to-speech model, enabling high-quality single and multi-speaker voice synthesis directly within your ComfyUI workflows.

SALMONN family: A suite of advanced multi-modal LLMs

A curated list of software, services, and resources to create and distribute music

Step-Audio 2 is an end-to-end multi-modal large language model designed for industry-strength audio understanding and speech conversation.

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

Easy to use stem (e.g. instrumental/vocals) separation from CLI or as a python package, using a variety of amazing pre-trained models (primarily from UVR)

A full-featured image/video management app with AI-powered organization and semantic search. Supports metadata from SD-webui, ComfyUI, Fooocus, NovelAI, StableSwarmUI, and more. Available as standalone app, SD-webui extension, or library.

Scrobble plays from multiple sources to multiple clients

[NeurIPS2026] We present StableAvatar, the first end-to-end video diffusion transformer, which synthesizes infinite-length high-quality audio-driven avatar videos without any post-processing, conditioned on a reference image and audio.

Teensy Audio Library

A ComfyUI custom node integration for local multi-engine multi-language Text-to-Speech and Voice Conversion. Supports: RVC, Echo-TTS, Qwen3-TTS, Cozy Voice 3, Step Audio EditX, IndexTTS-2, Chatterbox (classic and multilingual), F5-TTS, Higgs Audio 2, 3, and VibeVoice with unlimited text length, SRT timing, Character support, and many audio tools

Unofficial PyTorch implementation of Google AI's VoiceFilter system

A free & open tool for transcribing audio interviews

PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models

Open source audio annotation tool for humans

MiMo-Audio: Audio Language Models are Few-Shot Learners

A powerful 3B-parameter, LLM-based Reinforcement Learning audio edit model excels at editing emotion, speaking style, and paralinguistics, and features robust zero-shot text-to-speech

AI Audio Datasets (AI-ADS) 🎵, including Speech, Music, and Sound Effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications.

ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more, with features like streaming, interactive chat, prompt files, image/audio I/O, MCP tool calls, and an experimental agent mode for safe, multi-step automation.

The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.

Near-Realtime audio transcription using self-hosted Whisper and WebSocket in Python/JS

Transform PDFs into AI podcasts for engaging on-the-go audio content.

A 100% private AI voice transcription app that converts speech to text in 100+ languages. Built with Compose Multiplatform for Android & iOS using Whisper AI - no cloud uploads, all processing happens on-device for complete privacy.

Generate transcripts for audio and video content with a user friendly UI, powered by Open AI's Whisper with automatic translations and download videos automatically with yt-dlp integration

🔈 Sonos Media Player Interface/Client

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

The (official) Music Assistant Mobile app is a cross-platform client application designed for Android and iOS. Developed using Kotlin Multiplatform (KMP) and Compose Multiplatform frameworks, this project aims to provide a unified codebase for seamless music management across multiple platforms.

Turn PDFs and EPUBs into audiobooks; subtitles or videos into dubbed videos (including translation), and more. For free. Pandrator uses local models, including voice-cloning (instant, RVC-enhanced, XTTS fine-tuning) and LLM processing. It aspires to be a user-friendly app with a GUI, an installer and all-in-one packages.

A React component to make correcting automated transcriptions of audio and video easier and faster. By BBC News Labs. - Work in progress

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

Open Audio Watermarking Tool

Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

ScribeWizard: Generate organized notes from audio using Groq, Whisper, and Llama3

Open Source Multiroom Audio Streamer based on Raspberry Pi, Snapcast & camillaDSP

This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

Tero Subtitler is an open source, cross-platform, and free subtitle editing software.

Natural language → ComfyUI workflow JSON. 34 built-in templates, 360+ node definitions, auto model download. Supports txt2img, img2img, txt2vid, img2vid, audio, 3D generation across SD1.5/SDXL/SD3/FLUX/Wan2.2/HunyuanVideo/LTXV/Mochi/Cosmos + LLM integration. Works as a skill for Claude Code, Cursor, and other AI coding agents.

Free on-device web app for audio transcribing and rendering subtitles

AudioBench: A Universal Benchmark for Audio Large Language Models

Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测，知己知彼。A unified benchmark framework for ASR/TTS/Audio Codec/audio LLM evaluation

Collection of LADSPA/LV2/VST/JACK audio plugins for high-quality processing

OpenShot Audio Library (libopenshot-audio) is a free, open-source project that enables high-quality editing and playback of audio, and is based on the amazing JUCE library.

Transcribe audio and add subtitles to videos using Whisper in ComfyUI

An audio recording helper for React. Provides a component and a hook to help with audio recording.

Snapcast client for Android

The AI Podcast Studio: generate podcasts scripts and their audio version with a team of AI workers in a Podcast Studio 🎙️📜

Production-ready ComfyUI custom nodes for 1,400+ fal.ai models, auto-updated image, video, audio, LLM and VLM APIs with native media, caching and cost controls.

A modern, real-time speech recognition application built with OpenAI's Whisper and PySide6. This application provides a beautiful, native-looking interface for transcribing audio in real-time with support for multiple languages.

PySimpleGUI based DESKTOP APP to AUTO GENERATE SUBTITLE FILE (using free Google Speech Recognition API) and TRANSLATED SUBTITLE FILE (using unofficial online Google Translate API) for any video or audio file

Generate karaoke videos, by downloading audio and lyrics, separating instrumentals, synchronising lyrics using transcription models, rendering CDG and uploading videos to YouTube / Dropbox / Google Drive

Modern GUI application that transcribes and translate audio files using OpenAI Whisper.

💬 Fast, cross-platform CLI and GUI for batch transcription, translation, speaker annotation and subtitle generation using OpenAI’s Whisper on CPU, Nvidia GPU and Apple MLX.

The BEST music separation model with help of A.I. ... to my ears ! 👂👂

A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.

Cross-platform audio recorder designed for real-time speech audio processing

Elucidated Text-To-Audio (ETTA) is a SOTA text-to-audio model with a holistic understanding of the design space and trained with synthetic captions.

Wayland Speech-to-Text Tool - A minimal signal-driven speech-to-text tool for Wayland environments with PipeWire audio

Fine-tuning toolkit for Chatterbox TTS & Chatterbox TURBO models. Supports 23 languages with smart vocabulary extension. Features offline preprocessing, automatic VAD trimming, and voice cloning capabilities. Train custom TTS models with your own dataset in LJSpeech and file-based format.

AI-powered music production and post-production in REAPER via MCP — 181 tools for composition, mixing, mastering, batch editing, audio QC, and ReaScript automation.

End-to-end workflow to automatically generate show notes from audio/video transcripts

Vapi Blocks is a library of components & api snips to copy and paste into React applications built with TailwindCSS for integrating Voice AI into your application using Vapi.ai. Vapi let's you develop voice AI fast, Vapi Blocks helps you implement faster.

AI-powered tool for automatic podcast script and audio generation.

A comprehensive framework to test audio comprehension of Large Audio Language Models.

A user-friendly Raspberry Pi baby monitor with cry detection and audio/video streaming.

Transcribe audio and video files with speaker diarization and logically grouped timestamps using Gemini Flash

Free in-browser audio & video censorship tool. AI-powered transcription with Whisper, 100% private client-side processing. Bleep profanity, custom words, or any phrase.

a comfyui cuatom node for audio subtitling based on whisperX and translators

SVAR - Simple Voice Activated Recorder

Free real-time AI Noise Gate VST3/AU plugin. Removes coughs, sneezes, and other artifacts from your live streams, podcasts, and videos.

MCP server for Fal.ai - Generate images, videos, music and audio with Claude

An MCP Server for audio transcription using OpenAI

AI-Powered Podcast Generator: A Python-based tool that converts text scripts into realistic audio podcasts using Google's Generative AI API. This project leverages advanced text-to-speech technology to create dynamic, multi-speaker conversations with customizable voices.

Automatically generate subtitles from an input audio or video file using OpenAI Whisper

Installation script for an AI applications using ROCm on Linux.

Snapcast Multiroom audio docker image

This project is a video processing application that extracts audio from videos, performs automatic speech recognition (ASR), and generates subtitles. It allows users to enhance audio quality, correct transcription errors, and convert subtitles into various dialects, all through a user-friendly command-line and web interface.

A set of bash scripts to convert audio files into M4B audiobooks with chapter markers, customizable bitrate, book metadata and embedded cover art.

Android application for data transfer, using sound waves

Learn how multimodal AI merges text, image, and audio for smarter models

Dockerized Whisper C++ speech-to-text API for easy deployment and rapid integration. Offering the latest stable and nightly builds for efficient audio transcription.

Removes silence segments from wav audio files

Text-to-speech plugin for Claude Code — multi-provider support (ElevenLabs, OpenAI, Google, Amazon Polly, Azure, Kitten, local system TTS) on macOS, Linux, and Windows

Generate audio datasets for training Text-To-Speech models, through smart audio splitting with silence detection, and transcription using Whisper.

A cross-platform desktop application that records audio and transcribes it to text using OpenAI's Whisper API or compatible services. Perfect for dictation, note-taking, and accessibility.

Audio Cleaner using DeepFilterNet, hosted through Streamlit

A curated list of tools for building AI with rich context from screen recordings, audio, and personal data

The Multi-Language Automatic Translation, Subtitling, and Voice Rendering System uses third party software to automatically convert audio to text, translate text, render text to video, and render text to audio.

An audio processing tool for detecting and removing silence in audio recordings. Create text files for video silence removal using custom-defined thresholds.

Official Python SDK for WaveSpeed — image, video, audio and 3D generation via the wavespeed.ai API

International Public Radio Directory, bringing diversity into audio. Public listing of internet radios from all around the world.

Prompt Management System for Interaction with the ChatGPT API

A Python tool that uses Google Gemini API to transcribe video or audio files into SRT subtitle files.

Transcribe audio/video to text, locally on macOS, Linux and Windows. A simple whisper.cpp wrapper/UI built with Go/Fyne.

Transcribe Offline by openresearchtools.com is an open source desktop application that allows you to transcribe audio and video fully offline, with optional speaker diarisation and word-level alignment. It can also generate subtitles and integrate with local large language models (LLMs) for summarisation and editing

A high-performance speech recognition MCP server based on Faster Whisper, providing efficient audio transcription capabilities.

OmniEvalKit is an evaluation framework designed for omni-modal large language models, with a focus on audio and audio-visual understanding. Based on OmniEvalKit, you can quickly reproduce benchmarks, implement your own models or datasets, and conduct fair comparisons with other open-source models. MiniCPM-o is evaluated using this framework.

A MCP server that provides audio transcription capabilities using OpenAI's Whisper API

An audio/video transcriber with diarization and transcription editing.

Convert audio files (flac, mp3, mp4, mpeg, mpga, m4a, ogg, wav, and webm) to SRT subtitles with OpenAI Whisper. Easy script for fast, accurate transcription.

One-key voice-to-transcription tool: record speech, transcribe locally with Whisper, then paste. Never lose your audio files anymore!

[ACL 2025] Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Models

Fine-tuned whisper that transcribe Hebrew audio into IPA

A voice transcription tool using faster-whisper that records audio and converts speech to text on Linux systems.

Rudimentary program for speech transcription, manipulation, and redaction.

AudioWrite: Effortless voice dictation powered by Google's Gemini API. Record, transcribe, and transform rambling audio into polished, multi-language notes. PWA ready.

WhisperVoice: Covert voice notes. Encrypts text and hides it via LLM-generated acrostic sentences. Murf.ai creates natural audio. Browser extension decrypts with passcode, revealing hidden message or playing decoy for unauthorized listeners. Uses LLM, Murf.ai, STT APIs

Linux utility to record audio via shortcut, transcribe using a local Whisper FastAPI server, and copy text to clipboard.

🎙️ Lightning-fast voice dictation Desktop Web App powered by Groq's Whisper Turbo - Open-source, privacy-first, with real-time audio visualization and intuitive click controls

Modern NVR with object/motion/audio detection, push notifications, multi-location, and encrypted local and cloud-based storage support built in.

Real-time desktop audio transcription using OpenAI Whisper for Arch Linux with CUDA acceleration

A powerful audio transcription server that seamlessly transcribes meeting recordings, generates notes, and intelligently splits audio files for efficient management. Open-source and built with FastMCP and Groq/OpenAI Whisper

MCP server for real-time audio transcription using OpenAI Whisper

Synchronous multiroom audio player

A powerful MCP (Model Context Protocol) server that transcribes audio and video files into text using Groq's Whisper model.

A deep learning application that classifies the reason for a baby's cry (hunger, pain, etc.) from live or uploaded audio. Built with a TensorFlow/Keras CNN, Librosa for audio processing, and a responsive Flask web UI with real-time recording and visualization. Helps caregivers understand an infant's needs instantly.

Python API for controlling Snapcast, a multi-room synchronous audio solution.

XTTS fine-tuning via CLI

Blazingly fast audio transcription MCP server using Whisper with Flash Attention 2

App for transcribing audio/video to editable SRT subtitles using Whisper. Supports mp3/mp4/wav inputs, audio extraction, and local download.