HANS (Invalid NLI Heuristics Benchmark)

Source Huggingface Hub: link

About this dataset The HANS dataset is an NLI evaluation set that tests specific hypotheses about invalid heuristics that NLI models are likely to learn.

Columns File: validation.csv

Column name Description premise The premise of the example. (string) hypothesis The hypothesis of the example. (string) label The label of the example. (string) parse_premise The parse of the premise. (string) parse_hypothesis The parse of the hypothesis. (string) binary_parse_premise The binary parse of the premise. (string) binary_parse_hypothesis The binary parse of the hypothesis. (string) heuristic The heuristic that the example is based on. (string) subcase The subcase of the heuristic that the example is based on. (string) template The template that the example is based on. (string) File: train.csv

Column name Description premise The premise of the example. (string) hypothesis The hypothesis of the example. (string) label The label of the example. (string) parse_premise The parse of the premise. (string) parse_hypothesis The parse of the hypothesis. (string) binary_parse_premise The binary parse of the premise. (string) binary_parse_hypothesis The binary parse of the hypothesis. (string) heuristic The heuristic that the example is based on. (string) subcase The subcase of the heuristic that the example is based on. (string) template The template that the example is based on. (string)