Non-parallel splits feature over 50% culturally-specific examples.
Yonatan Belinkov#547
We are releasing an expanded version of Global PIQA! It now covers 141 language varieties and includes parallel and non-parallel splits. We are also releasing an updated preprint.
It is often understated how hard ot is to compare multilingual models, especially small ones. With hundreds of people working on it, you can now enjoy:
We are releasing an expanded version of Global PIQA! It now covers 141 language varieties and includes parallel and non-parallel splits. We are also releasing an updated preprint.
Non-parallel splits feature over 50% culturally-specific examples.
Yonatan Belinkov#547We are releasing an expanded version of Global PIQA! It now covers 141 language varieties and includes parallel and non-parallel splits. We are also releasing an updated preprint.
Users thanked the authors for expanding the PIQA dataset to 141 language varieties because it advances commonsense reasoning benchmarks across more languages.