Datasets

Dataset

samanantar

by ai4bharat

Dataset Card for Samanantar Dataset Summary Samanantar is the largest publicly available parallel corpora collection for Indic language: Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, Telugu. The corpus has 49.

CC-BY-NC-4.0text-generation 2587 4810M < n < 100M rows

published 2 Mar 2022

Preview

The Hugging Face dataset viewer has no preview for this one.

Cite this

CC-BY-NC-4.0textCite

Tags

task_categories:text-generationtask_categories:translationannotations_creators:no-annotationlanguage_creators:foundmultilinguality:translationsource_datasets:originallanguage:enlanguage:aslanguage:bnlanguage:gulanguage:hilanguage:knlanguage:mllanguage:mrlanguage:orlanguage:palanguage:talanguage:telicense:cc-by-nc-4.0size_categories:10M<n<100Mformat:parquetmodality:textlibrary:datasetslibrary:dasklibrary:mlcroissantlibrary:polarsarxiv:2104.05596region:usconditional-text-generation