Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/private/voice-agent-api.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ Adapts to each speaker's pace over the course of a conversation. It adjusts the

**Best for:** General conversational voice agents.

**Languages:** All supported languages. Disfluency detection is English-only — other languages fall back to speech-rate adaptation.
**Languages:** All supported languages. Disfluency detection is available for the [supported languages](https://docs.speechmatics.com/speech-to-text/formatting#supported-languages-for-disfluencies) — other languages fall back to speech-rate adaptation.

**Trade-off:** Latency varies by speaker.

Expand Down
35 changes: 31 additions & 4 deletions docs/speech-to-text/formatting.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ For other languages, consider using [word replacement](#word-replacement) to ide

## Disfluencies

Disfluencies are hesitation sounds like "um", "uh", and "hmm". In English, these are automatically tagged with `disfluency`:
Disfluencies are hesitation sounds like "um", "uh", and "hmm". Speechmatics automatically tags them with `disfluency` in the transcript output:

```json
"results": [
Expand All @@ -101,7 +101,7 @@ Disfluencies are hesitation sounds like "um", "uh", and "hmm". In English, these
```

<details data-accent-color="gray">
<summary>Full list of tagged disfluencies</summary>
<summary>Full list of tagged English disfluencies</summary>
<CodeBlock>
{`huh
aha
Expand Down Expand Up @@ -147,6 +147,33 @@ uum`}
</CodeBlock>
</details>

### Supported languages for disfluencies

Disfluency tagging and removal are available for the following languages. Each language has its own set of hesitation sounds; the expandable list at the start of this section covers English.

- Arabic (`ar`)
- Chinese Mandarin (`cmn`)
Comment thread
petemomo marked this conversation as resolved.
- Danish (`da`)
- Dutch (`nl`)
- English (`en`)
- Finnish (`fi`)
- French (`fr`)
- German (`de`)
- Greek (`el`)
- Hebrew (`he`)
- Hindi (`hi`)
- Hungarian (`hu`)
- Italian (`it`)
- Japanese (`ja`)
- Norwegian (`no`)
- Polish (`pl`)
- Portuguese (`pt`)
- Russian (`ru`)
- Spanish (`es`)
- Swedish (`sv`)

Coverage of hesitation sounds varies by language. If you rely on disfluency removal for a specific language, test it with representative audio rather than assuming full coverage.

### Removing disfluencies

You can automatically remove disfluencies from your transcript:
Expand All @@ -169,7 +196,7 @@ Without disfluency removal:
With disfluency removal:
> What would you like?

This feature is available for English only. The default setting is `"remove_disfluencies": false`.
This feature is available for the [supported languages](#supported-languages-for-disfluencies). The default setting is `"remove_disfluencies": false`.

## Word replacement

Expand Down Expand Up @@ -341,7 +368,7 @@ The system applies different formatting rules based on the type of entity detect
The system chooses entity classes based on context, so occasionally a value might be classified differently than expected. For example, "2001" could be a "cardinal" number or a "date".
:::

### Languages
### Languages for smart formatting

Each language follows its own conventions for:

Expand Down
2 changes: 1 addition & 1 deletion spec/realtime.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1127,7 +1127,7 @@ components:
tags:
type: array
description: |
This is a set list of profanities and disfluencies respectively that cannot be altered by the end user. `[disfluency]` is only present in English, and `[profanity]` is present in English, Spanish, and Italian
This is a set list of profanities and disfluencies respectively that cannot be altered by the end user. `[disfluency]` is present in the [supported languages](https://docs.speechmatics.com/speech-to-text/formatting#supported-languages-for-disfluencies), and `[profanity]` is present in English, Spanish, and Italian
items:
$ref: "#/components/schemas/RecognitionAlternativeTagsEnum"
required:
Expand Down