GitLocker: The Coding Marketplace

Description:

sherpa onnx

Supported functions #

Speech recognition
Speech synthesis
Speaker verification
Speaker identification

✔️
✔️
✔️
✔️

Spoken Language identification
Audio tagging
Voice activity detection

✔️
✔️
✔️

Keyword spotting
Add punctuation

✔️
✔️

Supported platforms #

Architecture
Android
iOS
Windows
macOS
linux

x64
✔️

✔️
✔️
✔️

x86
✔️

✔️

arm64
✔️
✔️
✔️
✔️
✔️

arm32
✔️

✔️

riscv64

✔️

Supported programming languages #

1. C++
2. C
3. Python
4. JavaScript

✔️
✔️
✔️
✔️

5. Java
6. C#
7. Kotlin
8. Swift

✔️
✔️
✔️
✔️

9. Go
10. Dart
11. Rust
12. Pascal

✔️
✔️
✔️
✔️

For Rust support, please see sherpa-rs
It also supports WebAssembly.
Introduction #
This repository supports running the following functions locally

Speech-to-text (i.e., ASR); both streaming and non-streaming are supported
Text-to-speech (i.e., TTS)
Speaker identification
Speaker verification
Spoken language identification
Audio tagging
VAD (e.g., silero-vad)
Keyword spotting

on the following platforms and operating systems:

x86, x86_64, 32-bit ARM, 64-bit ARM (arm64, aarch64), RISC-V (riscv64)
Linux, macOS, Windows, openKylin
Android, WearOS
iOS
NodeJS
WebAssembly
Raspberry Pi
RV1126
LicheePi4A
VisionFive 2
旭日X3派
爱芯派
etc

with the following APIs

C++, C, Python, Go, C#
Java, Kotlin, JavaScript
Swift, Rust
Dart, Object Pascal

Links for Huggingface Spaces #
You can visit the following Huggingface spaces to try sherpa-onnx without
installing anything. All you need is a browser.

Description
URL

Speech recognition
Click me

Speech recognition with Whisper
Click me

Speech synthesis
Click me

Generate subtitles
Click me

Audio tagging
Click me

Spoken language identification with Whisper
Click me

We also have spaces built using WebAssembly. The are listed below:

Description
Huggingface space
ModelScope space

Voice activity detection with silero-vad
Click me
地址

Real-time speech recognition (Chinese + English) with Zipformer
Click me
地址

Real-time speech recognition (Chinese + English) with Paraformer
Click me
地址

Real-time speech recognition (Chinese + English + Cantonese) with Paraformer-large
Click me
地址

Real-time speech recognition (English)
Click me
地址

VAD + speech recognition (Chinese + English + Korean + Japanese + Cantonese) with SenseVoice
Click me
地址

VAD + speech recognition (English) with Whisper tiny.en
Click me
地址

VAD + speech recognition (English) with Zipformer trained with GigaSpeech
Click me
地址

VAD + speech recognition (Chinese) with Zipformer trained with WenetSpeech
Click me
地址

VAD + speech recognition (Japanese) with Zipformer trained with ReazonSpeech
Click me
地址

VAD + speech recognition (Thai) with Zipformer trained with GigaSpeech2
Click me
地址

VAD + speech recognition (Chinese 多种方言) with a TeleSpeech-ASR CTC model
Click me
地址

VAD + speech recognition (English + Chinese, 及多种中文方言) with Paraformer-large
Click me
地址

VAD + speech recognition (English + Chinese, 及多种中文方言) with Paraformer-small
Click me
地址

Speech synthesis (English)
Click me
地址

Speech synthesis (German)
Click me
地址

Links for pre-built Android APKs #

Description
URL
中国用户

Streaming speech recognition
Address
点此

Text-to-speech
Address
点此

Voice activity detection (VAD)
Address
点此

VAD + non-streaming speech recognition
Address
点此

Two-pass speech recognition
Address
点此

Audio tagging
Address
点此

Audio tagging (WearOS)
Address
点此

Speaker identification
Address
点此

Spoken language identification
Address
点此

Keyword spotting
Address
点此

Links for pre-built Flutter APPs #
Real-time speech recognition

Description
URL
中国用户

Streaming speech recognition
Address
点此

Text-to-speech

Description
URL
中国用户

Android (arm64-v8a, armeabi-v7a, x86_64)
Address
点此

Linux (x64)
Address
点此

macOS (x64)
Address
点此

macOS (arm64)
Address
点此

Windows (x64)
Address
点此

Note: You need to build from source for iOS.

Links for pre-built Lazarus APPs #
Generating subtitles

Description
URL
中国用户

Generate subtitles (生成字幕)
Address
点此

Links for pre-trained models #

Description
URL

Speech recognition (speech to text, ASR)
Address

Text-to-speech (TTS)
Address

VAD
Address

Keyword spotting
Address

Audio tagging
Address

Speaker identification (Speaker ID)
Address

Spoken language identification (Language ID)
See multi-lingual Whisper ASR models from Speech recognition

Punctuation
Address

Useful links #

Documentation: https://k2-fsa.github.io/sherpa/onnx/
Bilibili 演示视频: https://search.bilibili.com/all?keyword=%E6%96%B0%E4%B8%80%E4%BB%A3Kaldi

How to reach us #
Please see
https://k2-fsa.github.io/sherpa/social-groups.html
for 新一代 Kaldi 微信交流群 and QQ 交流群.