Models
SALMONN
bytedance/SALMONN
ByteDance's family of multimodal large language models for speech, audio and audio-visual understanding, released with model checkpoints and inference and training code.
Topics
Related projects
CrisperWhisper1.5kA multilingual speech recognition model for verbatim and intended transcription with precise word-level timestamps, distributed as model weights plus a Python inference package.
speechbrain11.9kA PyTorch speech toolkit with recipes and pretrained models for recognition, enhancement, separation, and spoken language tasks.
audio3kTorchAudio, PyTorch's official library for loading audio datasets and applying transforms such as spectrograms, MFCC, and resampling in machine learning pipelines.
voxcpm41.3kAn open-source 2B tokenizer-free multilingual TTS model for voice design, controllable cloning, and studio-quality synthesis.
MOSS-Transcribe-Diarize2.3kAn open 0.9B end-to-end audio model for long-form transcription in 50+ languages, with speaker diarization, timestamps, and acoustic event awareness. The repo ships inference code, serving recipes, a subtitle web app, and fine-tuning guidance.
agentscope35.9kA production-ready multi-agent platform shipping an SDK plus a deployable agent service with team orchestration and web UI.