Sequential dependencies of responses in a questionnaire survey and their effects on the reliability and validity of measurement
書誌事項
- 公開日
- 2022-09-09
- 資源種別
- journal article
- 権利情報
-
- https://www.springernature.com/gp/researchers/text-and-data-mining
- https://www.springernature.com/gp/researchers/text-and-data-mining
- DOI
-
- 10.3758/s13428-022-01943-z
- 10.31234/osf.io/s8dea
- 公開者
- Springer Science and Business Media LLC
説明
<p>The reliability and validity of measurements in questionnaire surveys are affected by the survey design. Previous studies have discussed whether the items in a multidimensional scale should be grouped by subscale or randomized to increase the reliability and validity of the measurement. However, it is not clear what effect item order has on the true reliability and validity and whether it causes bias in these estimates. Furthermore, it is not clear whether there are sequential dependencies of responses, which is the effect of past responses on current responses, and if so, what effect it has on reliability, coefficient α, and validity. Study 1 empirically revealed that each respondent's previous response had a positive effect on his or her current response. In Study 2, we conducted a theoretical investigation and found that the first-order positive sequential dependencies of responses reduced the reliability, coefficient α, and validity of the subscales. In addition, sequential dependencies were found to make these indicators higher when the items were grouped than when they were randomized and cause an overestimation of reliability by the coefficient α. Study 3 confirmed the effects of sequential dependencies and item order on the coefficient α in real data. Thus, this study showed the potential impact of sequential dependencies of responses on psychological measurement.</p>
収録刊行物
-
- Behavior Research Methods
-
Behavior Research Methods 55 (6), 3241-3259, 2022-09-09
Springer Science and Business Media LLC
