Datasets
Dataset
reranker_continuous_filt_max7_train
by lightblue
Reranker training data This data was generated using 4 steps: We gathered queries and corresponding text data from 35 high quality datasets covering more than 95 languages. For datasets which did not already have negative texts for queries, we mined hard ne…
Apache-2.0other 150 81M < n < 10M rows
published 19 Dec 2024
Preview
First 5 rows of default / train, from the Hugging Face dataset viewer.
| question | answer | dataset_name | language | added_neg | doc_id | added_doc_id | row_id | context | label | 32B_score_probs | 32B_score_probs_rev | prob_exp_val | rev_prob_exp_val | mean_exp_val | mean_exp_val_max7 | mean_exp_val_max7_round | conversations |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qué término coloquial se utiliza para los residentes de plymouth? | Janners | mlqa | es | true | ["Plymouth"] | false | 413517 | People from Plymouth are known as Plymothians or less formally as Janners. Its meaning is described as a person from Devon, deriving from Cousin Jan (the Devon form of John), but more particularly in naval circles anyone from the Plymouth area. | true | [1.88146303754838e-11,6.803957986331397e-9,2.8041020417478875e-7,0.008847354297271612,0.9911523501306718] | [1.5137377642006806e-10,2.8399508530519606e-8,0.000024254849111926457,0.0018675207678398543,0.9981081581656464] | 4.991152064321404 | 4.998083883657743 | 4.994617973989573 | 6.99192696098436 | 7 | [{"from":"system","value":"Given a query and a piece of text, output a score of 1-7 based on how related the query is to the text. 1 means least related and 7 is most related."},{"from":"human","value":"<<<Query>>>\nQué término coloquial se utiliza para los residentes de plymouth?\n\n<<<Context>>>\… |
| What year was the former host of The Look for Less Born? | 1977 | hotpot_qa | en | false | 237581 | The Look for Less The Look for Less is a television show airing on the Style Network. Previously hosted by "" contestant Elisabeth Hasselbeck, the current host is "America's Next Top Model" winner Yoanna House. House was one of thirteen contestants on "America's Next Top Model", Cycle Two. In mo… | true | [5.127361973115911e-9,0.000001913071487359886,0.00009510295665270524,0.04084174744716185,0.9590611844912549] | [5.741069787937045e-9,0.0000019201250001952975,0.0011628629318623455,0.12238049578347669,0.8764547426089696] | 4.9589622849907045 | 4.875287998404486 | 4.917125141697595 | 6.875687712546393 | 7 | [{"from":"system","value":"Given a query and a piece of text, output a score of 1-7 based on how related the query is to the text. 1 means least related and 7 is most related."},{"from":"human","value":"<<<Query>>>\nWhat year was the former host of The Look for Less Born?\n\n<<<Context>>>\nThe Look… | ||
| Τι μας υπενθυμίζει η Θεοτόκος σχετικά με τον προορισμό μας; | Η Θεοτόκος μας υπενθυμίζει ότι πραγματοποιώντας τον προορισμό μας, μπορούμε να φανερώσουμε μέσα από την ύπαρξη μας την παρουσία της “εικόνας του Θεού” που είναι ο Χριστός. | lb_rag_monolingual | el | false | 792181 | αγίας Νεαπόλεως. Στο κήρυγμά του ο Σεβασμιώτατος Ποιμενάρχης ανεφέρθη στη σοφή διδαχή του μεγάλου Οσίου Ιωάννου της «Κλίμακος» ο οποίος μας διδάσκει με πρακτικό τρόπο πώς να επιζητούμε την βοήθεια και το έλεος του Χριστού τόσο για τον εαυτό μας, όσο και για τους δικούς μας ανθρώπους. Επεσήμανε μετα… | false | [0.02499696541315155,0.9091447837263666,0.06585823214891558,8.801214766212826e-9,8.939813731559982e-9] | [0.000006910482580777146,0.06754436702545936,0.9324211490360267,0.00002733148879937981,2.2213709856237597e-7] | 2.0408613111972924 | 2.9324695864332444 | 2.4866654488152684 | 3.229998173222903 | 3 | [{"from":"system","value":"Given a query and a piece of text, output a score of 1-7 based on how related the query is to the text. 1 means least related and 7 is most related."},{"from":"human","value":"<<<Query>>>\nΤι μας υπενθυμίζει η Θεοτόκος σχετικά με τον προορισμό μας;\n\n<<<Context>>>\nαγίας… | ||
| Kapan PT Semen Indonesia Tbk (SMGR) mengakuisisi PT Holcim Indonesia Tbk (SMCB)? | Awal tahun 2019. | lb_rag_monolingual | id | false | 843101 | anan Surat Izin Pendakian adalah tanggal 8 Juli 2009. Calon pendaki datang langsung ke Pos Pendakian yang telah ditunjuk resmi oleh Balai TNGC dengan menyerahkan persyaratan secara lengkap, membayar karcis masuk dan asuransi, menetapkan tanggal pendakian pintu masuk dan pintu keluar. Surat Izin Pen… | false | [1,2.5109991557439816e-8,0,0,3.7910417027920744e-9] | [0.9999997615814777,2.657725417977281e-7,1.5404905889384314e-10,4.799544972039692e-12,7.701968379871599e-10] | 1.0000000402741573 | 1.0000002691758185 | 1.000000154724988 | 1.000000232087482 | 1 | [{"from":"system","value":"Given a query and a piece of text, output a score of 1-7 based on how related the query is to the text. 1 means least related and 7 is most related."},{"from":"human","value":"<<<Query>>>\nKapan PT Semen Indonesia Tbk (SMGR) mengakuisisi PT Holcim Indonesia Tbk (SMCB)?\n\… | ||
| Obwohl Südkalifornien als stark entwickeltes städtisches Umfeld gilt, ist wie viel davon bislang unentwickelt geblieben? | riesigen Gebieten | xquad | de | true | ["Southern California consists of a heavily developed urban environment, home to some of the largest urban areas in the state, along with vast areas that have been left undeveloped. It is the third most populated megalopolis in the United States, after the Great Lakes Megalopolis and the Northeaste… | false | 149262 | تتكون كاليفورنيا الجنوبية من مجال إحصائي مشترك، وثمانية مناطق إحصائية حضرية ضخمة ، ومنطقة حضرية دولية ضخمة، والعديد من التقاسيم الحضرية الضخمة. كما أنها تحوي منطقتان حضريتان متوسعتان ، يتجاوز عدد السكان فيهما خمسة ملايين نسمة ، وهما لوس أنجلس الكبرى بمساحة قدرها 17,786,419، وسان دييغو تيجوانا بـحوا… | false | [0.00008480448523577903,0.9998379016459485,0.00007721536249867693,1.3099365649163572e-9,1.4613398382320497e-9] | [0.000006267266583687391,0.011331489209283778,0.9886450772755081,0.000013688968753687627,0.000003570980857395123] | 1.9999924178805812 | 2.9886768082490116 | 2.4943346130647965 | 3.241501919597195 | 3 | [{"from":"system","value":"Given a query and a piece of text, output a score of 1-7 based on how related the query is to the text. 1 means least related and 7 is most related."},{"from":"human","value":"<<<Query>>>\nObwohl Südkalifornien als stark entwickeltes städtisches Umfeld gilt, ist wie viel … |
Cite this
Apache-2.0tabulartextCite
Tags
language:enlanguage:zhlanguage:eslanguage:delanguage:arlanguage:rulanguage:jalanguage:kolanguage:hilanguage:sklanguage:vilanguage:trlanguage:filanguage:idlanguage:falanguage:nolanguage:thlanguage:svlanguage:ptlanguage:dalanguage:bnlanguage:telanguage:rolanguage:itlanguage:frlanguage:nllanguage:swlanguage:pllanguage:hulanguage:cslanguage:ellanguage:uklanguage:mrlanguage:talanguage:tllanguage:bglanguage:ltlanguage:urlanguage:helanguage:gu