Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 19 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,20 @@
# SALT (Sunbird African Language Technology) dataset
SALT is a multi-way parallel text corpus of Engish and five key Ugandan languages: Luganda, Lugbara, Acholi, Runyankole and Ateso. The dataset contains 25,000 sentences covering a range of topics of local relevance, such as agriculture, health and society. Each sentence is translated into all six languages.

SALT is a multi-way parallel text corpus of English and five key Ugandan languages: Luganda, Lugbara, Acholi, Runyankole and Ateso. This dataset is designed to facilitate research and development in Machine Translation (both text and speech), Automatic Speech Recognition (ASR) and Text-to-Speech synthesis (TTS). It contains sentences in both text and audio format, with audio available in both crowdsourced and studio-quality speech (work in progress).

Each row in the dataset represents a sentence. This sentence is provided in six different languages (including English), with each language variant being presented in both text and audio format. Here's a breakdown of the row structure:

* **text**: This section contains the written form of the sentence in six languages. Each language is represented by a key-value pair, with the key being the language code and the value being the sentence in that language.

* **asr-speech**: This section contains links to the crowdsourced audio files for the sentence in six languages. Like in the text section, each language is represented by a key-value pair, where the key is the language code and the value is the filename of the audio file in that language.

* **tts-speech**: This section contains links to the high-quality studio-recorded audio files for the sentence. In the current version of the dataset, only Luganda and English are available in this format.

The dataset covers a wide range of locally relevant topics such as agriculture, health, and society, making it a versatile resource for developing and testing language technology applications for these languages.

Each sentence in the dataset is available as an audio file that can be accessed by appending `https://salt-tts-data.s3.eu-west-1.amazonaws.com/` to the relative paths provided in the "asr-speech" column of the dataset. This allows for the practical usage of the dataset in various speech recognition tasks. Alternatively the zip files containing each language "asr-speech" column data can be obtained from

This dataset is suited for those with a lower intermediate level of technical expertise, and can be used for a multitude of tasks including Machine Translation (text and speech), ASR, and TTS.

More details are in the following publication:

Expand All @@ -9,13 +24,14 @@ This repository contains a notebook for training and evaluation which can be use

## Changelog

#### [v1.3] 2023-07-31
Added Multispeaker STT data for Acholi, Ateso, Luganda, Lugbara and Runyankole

#### [v1.2] 2023-04-21
Added TTS data for Luganda and English.

#### [v1.1] 2023-04-19

Data format changed, some duplicate sentences removed, and sentences partitioned into splits (train: 23,497; dev: 500, test: 500).

#### [v1.0] 2021-12-01

Initial commit of 25,000 sentences, with each sentence translated from English to Acholi, Ateso, Luganda, Lugbara and Runyankole.
493 changes: 493 additions & 0 deletions v1.3/salt-dev-v1.3.jsonl

Large diffs are not rendered by default.

492 changes: 492 additions & 0 deletions v1.3/salt-test-v1.3.jsonl

Large diffs are not rendered by default.

23,723 changes: 23,723 additions & 0 deletions v1.3/salt-train-v1.3.jsonl

Large diffs are not rendered by default.

493 changes: 493 additions & 0 deletions v1.3/salt-url-dev-v1.3.jsonl

Large diffs are not rendered by default.

492 changes: 492 additions & 0 deletions v1.3/salt-url-test-v1.3.jsonl

Large diffs are not rendered by default.

23,723 changes: 23,723 additions & 0 deletions v1.3/salt-url-train-v1.3.jsonl

Large diffs are not rendered by default.

496 changes: 496 additions & 0 deletions v1.4/salt-dev-v1.4.jsonl

Large diffs are not rendered by default.

500 changes: 500 additions & 0 deletions v1.4/salt-test-v1.4.jsonl

Large diffs are not rendered by default.

23,947 changes: 23,947 additions & 0 deletions v1.4/salt-train-v1.4.jsonl

Large diffs are not rendered by default.