Model Dependent variable
I Reading problems R comprehension problems R mapping roblems I probing problems




1 2 3 4 5 6 7
Question-answer sequence level variables
 Interviewer reading problem −0.03
(0.03)
−0.001
(0.03)
 Respondent comprehension problem 0.40**
(0.05)
 Respondent mapping problem 2.74**
(0.04)
Question characteristics
 Number of sentences 0.79**
(0.07)
0.02
(0.08)
0.02
(0.08)
−0.02
(0.07)
−0.02
(0.07)
−0.05
(0.07)
−0.06
(0.07)
 Flesch-Kincaid grade level 0.11**
(0.01)
0.04**
(0.01)
0.04**
(0.01)
0.02*
(0.01)
0.03*
(0.01)
−0.02*
(0.01)
−0.05**
(0.01)
 Judgment typea
  Subjective −0.39
(0.47)
−0.21
(0.54)
−0.21
(0.54)
0.58
(0.47)
0.58
(0.47)
0.36
(0.52)
0.24
(0.51)
  Self −0.20
(0.52)
−0.73
(0.59)
−0.73
(0.59)
0.35
(0.51)
0.35
(0.51)
−0.20
(0.57)
−0.31
(0.56)
Response formatb
  Agree-disagree −0.63*
(0.27)
−0.07
(0.31)
−0.07
(0.31)
0.93**
(0.25)
0.93**
(0.26)
1.19**
(0.28)
0.78**
(0.27)
  Yes-no −0.21
(0.15)
−0.82**
(0.17)
−0.82**
(0.17)
−0.88**
(0.15)
−0.88**
(0.15)
−1.56**
(0.17)
1.23**
(0.17)
  Categorical −0.26+
(0.15)
−0.34+
(0.18)
−0.34+
(0.18)
−0.20
(0.15)
−0.20
(0.15)
−0.72**
(0.18)
−0.62**
(0.17)
  Unipolar 0.29+
(0.16)
−0.84**
(0.19)
−0.84**
(0.19)
−0.57**
(0.16)
−0.57**
(0.16)
−0.56**
(0.18)
−0.36*
(0.18)
  Bipolar with midpoint 0.15
(0.19)
−0.59**
(0.22)
−0.59**
(0.22)
−0.43*
(0.19)
−0.43*
(0.19)
−0.48*
(0.20)
−0.34+
(0.20)
  Bipolar without midpoint 0.49
(0.31)
−0.94*
(0.37)
−0.94*
(0.37)
0.25
(0.31)
0.25
(0.31)
−0.31
(0.33)
−0.52
(0.33)
  Semantic eifferential with endpoints labeled −0.01
(0.22)
0.01
(0.26)
0.01
(0.26)
−1.34**
(0.23)
−1.34**
(0.23)
−0.74**
(0.25)
−0.22
(0.25)
  Semantic differential with endpoints and midpoint labeled −0.16
(0.72)
−2.15**
(0.84)
−2.16**
(0.84)
−2.19**
(0.72)
−2.19**
(0.72)
1.52+
(0.81)
−0.72
(0.80)
  Faces scale −0.84
(0.57)
−0.10
(0.64)
−0.10
(0.64)
−2.04**
(0.56)
−2.04**
(0.56)
−1.57**
(0.61)
−0.82
(0.60)
Abstraction −0.05
(0.10)
−0.17
(0.11)
−0.17
(0.11)
−0.23*
(0.10)
−0.23*
(0.10)
−0.54**
(0.11)
−0.50**
(0.11)
Deliberately difficult 0.16
(0.37)
2.38**
(0.41)
2.38**
(0.41)
0.02
(0.36)
0.03
(0.36)
2.42**
(0.36)
2.68**
(0.35)
Time qualified judgement 0.09
(0.09)
0.23*
(0.11)
0.23*
(0.11)
−0.25**
(0.09)
−0.25**
(0.09)
−0.20+
(0.11)
−0.11
(0.11)
Explicit DK option provided −0.32
(0.41)
−0.23
(0.47)
−0.23
(0.47)
−0.17
(0.41)
−0.17
(0.41)
−0.55
(0.46)
−0.51
(0.45)
Preceded by a DK filter question 0.53
(0.58)
−0.75
(0.67)
−0.75
(0.67)
−0.53
(0.58)
−0.53
(0.58)
−0.07
(0.61)
0.06
(0.61)
DK filter question −0.02
(0.60)
1.87**
(0.66)
1.87**
(0.67)
1.12+
(0.58)
1.12+
(0.58)
0.90
(0.64)
0.10
(0.63)
Proxy report 0.65**
(0.12)
−0.94**
(0.15)
−0.94**
(0.15)
−0.08
(0.12)
−0.08
(0.12)
0.57**
(0.14)
0.72**
(0.14)
  Sensitivity −0.19
(0.14)
0.12
(0.16)
0.12
(0.16)
0.38**
(0.14)
0.38**
(0.14)
0.26+
(0.15)
0.13
(0.15)
  Showcard 0.27
(0.42)
1.04*
(0.48)
1.04*
(0.48)
1.11*
(0.45)
1.11*
(0.42)
0.67
(0.47)
0.17
(0.44)
Number of previous questions 0.001**
(0.0002)
−0.001**
(0.0003)
−0.001**
(0.0003)
−0.0002**
(0.0002)
−0.0002**
(0.0002)
−0.001
(0.001)
0.0004
(0.001)
Intercept −4.93**
(0.60)
−2.78**
(0.64)
−2.79**
(0.64)
−2.70**
(0.55)
−2.70**
(0.55)
−3.38**
(0.64)
4.10**
(0.64)
Question-answer sequence level df 107,355 107,355 107,355 107,355 107,355 107,355 107,355
Respondent df 544 544 544 544 544 544 544
Question df 294 294 294 294 294 294 294