Towards Evaluation for Speciesist Bias in AI with Question Answering Datasets
-
- MASASHI Takeshita
- Hokkaido University
Bibliographic Information
- Other Title
-
- 質問応答データセットによる種差別バイアスの測定に向かって
Abstract
<p>The social biases inherent in language models trained on large corpora have become a problem, leading to the development of datasets for evaluating various social biases, such as gender and racial biases. However, although many datasets were created for measuring social bi- ases, they are limited to social attributes regarding human beings. This study develops a dataset for evaluating discriminatory bias towards nonhuman animals, namely speciesist bias. By refer- encing existing English question answering (QA) datasets, we construct a Japanese QA dataset to assess speciesist biases in Japanese large language models. The experimental results reveal a tendency for some of these models to exhibit speciesist bias.</p>
Journal
-
- JSAI Technical Report, Type 2 SIG
-
JSAI Technical Report, Type 2 SIG 2023 (AGI-026), 41-49, 2024-03-08
The Japanese Society for Artificial Intelligence
- Tweet
Details 詳細情報について
-
- CRID
- 1390017920607668992
-
- ISSN
- 24365556
-
- Text Lang
- ja
-
- Data Source
-
- JaLC
-
- Abstract License Flag
- Allowed