explaingit

decibel-hq/reso

Analysis updated 2026-05-18

17PythonAudience · researcherComplexity · 4/5LicenseSetup · hard

TLDR

The training pipeline Decibel Labs used to build Reso, a streaming text-to-speech voice model that responds to emotion tags like laugh or whisper.

Mindmap

mindmap
  root((repo))
    What it does
      TTS training pipeline
      Tag controllable speech
      Streaming audio output
    Tech stack
      Python
      Orpheus 3B base model
      LoRA fine-tuning
    Use cases
      Train a custom voice model
      Run a local speech demo
      Study a TTS pipeline design
    Audience
      ML researchers
      Voice AI builders
    Setup
      Needs Mac checkpoint file
      Weights not included

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Study how a team distilled a large TTS model into a smaller fine-tuned one.

USE CASE 2

Run the local demo script to hear a sample of the Reso voice on a Mac.

USE CASE 3

Reuse the pipeline scripts to build a similar tag-controllable voice model.

USE CASE 4

Inspect the quality-control steps used to filter synthetic training audio.

What is it built with?

PythonLoRAOrpheus 3BSNAC

How does it compare?

decibel-hq/reso0petru/sentimoalingalingling/akasha-wechat
Stars171717
LanguagePythonPythonPython
Setup difficultyhardmoderatehard
Complexity4/53/54/5
Audienceresearcherdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires a separately obtained model checkpoint file not included in the repository.

Use freely, including commercially, as long as you keep attribution notices and don't use the project name to endorse your own product.

In plain English

This repository holds the training pipeline that Decibel Labs used to build Reso, a text-to-speech voice model. Text-to-speech means turning written text into spoken audio. Reso is described as expressive, streaming, and tag-controllable, meaning it can produce speech with emotional cues, generate audio as it goes rather than waiting for the whole sentence, and respond to inline tags placed in the text, such as laugh, chuckle, sigh, gasp, whisper, and pause, to change how a line is delivered. The README explains the pipeline in stages: a larger existing model, ElevenLabs, was used to generate many example audio clips from a written text corpus of over 16,000 phrases. Those clips were then checked automatically for quality, using a speech recognition tool to catch mistakes, and the clips that passed were used to fine-tune a smaller base model called Orpheus 3B through a technique called LoRA, which adjusts a small part of an existing model rather than retraining it from scratch. A status table in the README shows each of these stages has already been completed at least once, with rough numbers for how many clips were produced and passed quality checks. The repository is organized into folders for the text prompts, the numbered pipeline scripts, a database tracking pipeline state, data splits for training and testing, and saved checkpoints, though the actual audio files and trained model weights are deliberately left out of the repository. There is a quickstart for running a demo locally on an Apple M-series Mac, but it requires a separately obtained model checkpoint file that is not included in the repository. The project is released under the Apache 2.0 license, the same license as the base models it builds on.

Copy-paste prompts

Prompt 1
Explain the training pipeline stages in this repository from teacher synthesis to LoRA fine-tuning.
Prompt 2
Help me set up the local demo script on my Mac using the checkpoint file this repository expects.
Prompt 3
Explain what the laugh, sigh, and whisper tags do in this repository's text-to-speech prompts.
Prompt 4
Summarize the folder layout of this repository and what belongs in each directory.

Frequently asked questions

What is reso?

The training pipeline Decibel Labs used to build Reso, a streaming text-to-speech voice model that responds to emotion tags like laugh or whisper.

What language is reso written in?

Mainly Python. The stack also includes Python, LoRA, Orpheus 3B.

What license does reso use?

Use freely, including commercially, as long as you keep attribution notices and don't use the project name to endorse your own product.

How hard is reso to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is reso for?

Mainly researcher.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.