explaingit

qualialabsai/smoothconv-duplexconv

Analysis updated 2026-05-18

61HTMLAudience · researcherComplexity · 2/5LicenseSetup · easy

TLDR

Two Chinese speech datasets of natural multi-party dialogue, built to train and benchmark AI that can hold realistic spoken conversations.

Mindmap

mindmap
  root((repo))
    What it does
      Chinese speech datasets
      Multi party dialogue
      Natural conversation audio
    Tech stack
      HuggingFace hosted
    Use cases
      Train conversational AI
      Benchmark transcription
      Evaluate turn prediction
    Audience
      Speech researchers
      AI labs
    Dataset parts
      SmoothConv human labeled
      DuplexConv AI labeled
      FastTurn Test Set

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Train speech AI models on real overlapping, interrupted, multi-party Chinese conversation.

USE CASE 2

Benchmark a model's transcription and speaker-overlap accuracy against human-labeled data.

USE CASE 3

Pre-train large speech models on 2,000 hours of AI-labeled conversational audio.

USE CASE 4

Evaluate turn-prediction ability using the FastTurn Test Set.

What is it built with?

HuggingFace Datasets

How does it compare?

qualialabsai/smoothconv-duplexconvhamzafarooq/claude-certified-architecttashisleepy/knowledge-engine
Stars616161
LanguageHTMLHTMLHTML
Setup difficultyeasyeasymoderate
Complexity2/51/53/5
Audienceresearcherdevelopervibe coder

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 30min

Datasets only, no commercial use permitted under the license.

Creative Commons Attribution NonCommercial 4.0: free to use for academic research with credit, but not for commercial products.

In plain English

SmoothConv and DuplexConv are two Chinese speech datasets designed to help researchers build and test AI systems for real spoken conversations. Most existing Chinese speech datasets contain single speakers reading scripted text, these two cover genuine multi-party dialogue where people talk over each other, interrupt, laugh, and hand off the floor in natural ways. That kind of data is scarce, and it is necessary for training AI that can hold realistic two-way conversations. The two datasets come from the same original recordings and cover two scenarios: tutoring sessions and casual social chat. SmoothConv is the smaller, higher-quality part: 100 hours of audio with labels created by trained human annotators. Those labels include timestamped transcripts accurate to the millisecond, notes on who overlapped whom and when, markers for pauses, laughter, coughs, and breathing, and per-speaker tags for gender, age, and emotion. DuplexConv is the larger part: 2,000 hours of audio from the same domains, with labels generated by an AI-assisted pipeline instead of humans. The AI-assisted labels include transcripts, speaker-aware conversation structure, and scene-level context information. The two datasets together are meant to complement each other: SmoothConv for benchmarking and supervised training where label quality matters most, DuplexConv for large-scale pre-training where volume matters. A related resource called the FastTurn Test Set is also provided. It is a benchmark for evaluating whether a model can predict what kind of turn a speaker is in the middle of: a complete utterance, an incomplete one, a short backchannel response, or a wait signal. It contains about 22,000 real clips from SmoothConv plus 1,000 synthesized wait examples added to balance the classes. All three resources are available on HuggingFace. The datasets are released under Creative Commons Attribution NonCommercial 4.0, which means they can be used for academic research but not for commercial products. The project is a collaboration between the ASLP lab at Northwestern Polytechnical University and QualiaLabs.

Copy-paste prompts

Prompt 1
Help me download and load the SmoothConv dataset from HuggingFace for training.
Prompt 2
Explain the difference between SmoothConv's human labels and DuplexConv's AI-assisted labels.
Prompt 3
Show me how to evaluate a speech model against the FastTurn Test Set.
Prompt 4
What does the Creative Commons Attribution NonCommercial license allow me to do with this data?

Frequently asked questions

What is smoothconv-duplexconv?

Two Chinese speech datasets of natural multi-party dialogue, built to train and benchmark AI that can hold realistic spoken conversations.

What language is smoothconv-duplexconv written in?

Mainly HTML. The stack also includes HuggingFace Datasets.

What license does smoothconv-duplexconv use?

Creative Commons Attribution NonCommercial 4.0: free to use for academic research with credit, but not for commercial products.

How hard is smoothconv-duplexconv to set up?

Setup difficulty is rated easy, with roughly 30min to a first successful run.

Who is smoothconv-duplexconv for?

Mainly researcher.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.