Datasets

Dataset

wikiann

by aarontseng

Dataset Card for WikiANN Dataset Summary WikiANN (sometimes called PAN-X) is a multilingual named entity recognition dataset consisting of Wikipedia articles annotated with LOC (location), PER (person), and ORG (organisation) tags in the IOB2 format. This v…

No licensetoken-classification 47 01M < n < 10M rows

published 28 Aug 2026

Preview

First 5 rows of or / train, from the Hugging Face dataset viewer.

tokensner_tagslangsspans
["ଦକ୍ଷିଣରେ","ସୁବର୍ଣ୍ଣପୁର","ଜିଲ୍ଲା","ଓ","ଅନୁଗୋଳ","ଜିଲ୍ଲା","ଅବସ୍ଥିତ","।"][0,5,6,0,5,6,0,0]["or","or","or","or","or","or","or","or"]["LOC: ସୁବର୍ଣ୍ଣପୁର ଜିଲ୍ଲା","LOC: ଅନୁଗୋଳ ଜିଲ୍ଲା"]
["ଏହା","କଟକଠାରୁ","ପ୍ରାୟ","୨୫","କି.ମି","."][0,5,0,0,0,0]["or","or","or","or","or","or"]["LOC: କଟକଠାରୁ"]
["ଲେଉଟାଣି","ଅଭୟ","ଚରଣାରବିନ୍ଦ","ଭକ୍ତିବେଦାନ୍ତ","ସ୍ଵାମୀ","ପ୍ରଭୁପାଦ"][0,1,2,2,2,2]["or","or","or","or","or","or"]["PER: ଅଭୟ ଚରଣାରବିନ୍ଦ ଭକ୍ତିବେଦାନ୍ତ ସ୍ଵାମୀ ପ୍ରଭୁପାଦ"]
["କେନ୍ଦ୍ରୀୟ","ଧାନ","ଗବେଷଣା","କେନ୍ଦ୍ର",",","ବିଦ୍ୟାଧରପୁର"][3,4,4,4,0,0]["or","or","or","or","or","or"]["ORG: କେନ୍ଦ୍ରୀୟ ଧାନ ଗବେଷଣା କେନ୍ଦ୍ର"]
["ଲେଉଟାଣି","ଆକାଶବାଣୀ","(","ରେଡ଼ିଓ","ପ୍ରସାରଣ","ସେବା",")"][0,3,4,4,4,4,4]["or","or","or","or","or","or","or"]["ORG: ଆକାଶବାଣୀ ( ରେଡ଼ିଓ ପ୍ରସାରଣ ସେବା )"]

Cite this

No licensetextCite

Tags

task_categories:token-classificationtask_ids:named-entity-recognitionannotations_creators:machine-generatedlanguage_creators:crowdsourcedmultilinguality:multilingualsource_datasets:originallanguage:acelanguage:aflanguage:alslanguage:amlanguage:anlanguage:anglanguage:arlanguage:arclanguage:arzlanguage:aslanguage:astlanguage:aylanguage:azlanguage:balanguage:barlanguage:belanguage:bglanguage:bhlanguage:bnlanguage:bolanguage:brlanguage:bslanguage:calanguage:cbklanguage:cdolanguage:celanguage:ceblanguage:ckblanguage:colanguage:crhlanguage:cslanguage:csblanguage:cvlanguage:cy