paddlepaddle/paddlespeech

★ 12,597PythonAudience · developerComplexity · 3/5LicenseSetup · moderate

Mindmap

mindmap
  root((PaddleSpeech))
    What It Does
      Speech to text
      Text to speech
      Speaker detection
      Keyword spotting
    Language Support
      English
      Mandarin
      Cantonese
      Other dialects
    Access Methods
      Command line tool
      HTTP server mode
      Python API
    Tech Stack
      Python
      PaddlePaddle
      Pre-trained models

mindmap root((PaddleSpeech)) What It Does Speech to text Text to speech Speaker detection Keyword spotting Language Support English Mandarin Cantonese Other dialects Access Methods Command line tool HTTP server mode Python API Tech Stack Python PaddlePaddle Pre-trained models

Click or tap to explore — scroll the page freely

Things people build with this

USE CASE 1

Transcribe audio files or live microphone input into text in English or Mandarin Chinese.

USE CASE 2

Convert written Chinese text, including numbers and dates, into natural-sounding speech audio.

USE CASE 3

Identify which person is speaking in a recorded audio file using speaker verification.

USE CASE 4

Build a real-time voice assistant that wakes on a specific keyword using the keyword detection feature.

Tech stack

PythonPaddlePaddle

Getting it running

Difficulty · moderate Time to first run · 30min

Install via pip on Linux, Windows, or macOS with Python 3.8+, GPU accelerates training but is not required for running pre-trained models.

Use freely for any purpose including commercial use, as long as you include the Apache 2.0 license notice.

In plain English

PaddleSpeech is an open-source toolkit from Baidu's PaddlePaddle team that bundles a wide range of audio and speech tasks into one Python library. It covers converting spoken audio into text (speech recognition), converting text into spoken audio (text-to-speech), identifying who is speaking (speaker verification), detecting specific keywords in audio streams, and translating spoken language from one language to another. The library supports both English and Chinese, including Mandarin, Cantonese, and several other Chinese dialects. For non-developers, PaddleSpeech is most easily accessed through a command-line interface or a server mode, where you can send audio files or text and receive results without writing code. There is also a streaming mode suitable for real-time applications like live transcription or interactive voice systems. The project won a Best Demo Award at a major academic conference in 2022. For developers, the library provides pre-trained models that can be used directly, as well as the underlying training code for those who want to build or fine-tune their own models. A Chinese text processing pipeline handles converting written Chinese numbers, dates, and abbreviations into a form suitable for speech synthesis, which is a detail that matters a lot for natural-sounding Chinese audio output. Installation is through pip, the standard Python package manager, and the toolkit runs on Linux, Windows, and macOS with Python 3.8 or newer. The project is open-source under the Apache 2.0 license. The full README is longer than what was shown.

Copy-paste prompts

Prompt 1

Using PaddleSpeech from the command line, transcribe a Mandarin Chinese audio file into text.

Prompt 2

Write Python code using PaddleSpeech to convert an English paragraph into a spoken audio file.

Prompt 3

How do I run PaddleSpeech in server mode and send it audio for real-time transcription via HTTP requests?

Prompt 4

Use PaddleSpeech speaker verification to check whether two audio clips were recorded by the same person.

Open on GitHub → Explain another repo

← paddlepaddle on gitmyhub — every repo by this author, as a profile.

Verify against the repo before relying on details.