This folder contains examples to show how to make your own task.

## [RACE](http://www.qizhexie.com/data/RACE_leaderboard.html)
The RACE dataset is a large-scale ReAding Comprehension dataset collected from English Examinations that are created for middle school and high school students.

To get start you need to download data from http://www.cs.cmu.edu/~glai1/data/race/, then run `run_race.sh`.


## [AlphaNLI](https://leaderboard.allenai.org/anli/submissions/public)
Abductive Natural Language Inference (aNLI) is a new commonsense benchmark dataset designed to test an AI system’s capability to apply abductive reasoning and common sense to form possible explanations for a given set of observations. Formulated as a binary-classification task, the goal is to pick the most plausible explanatory hypothesis given two observations from narrative contexts.

To get start you need to download data from https://leaderboard.allenai.org/anli/submissions/public, then run `run_anli.sh`.