title: Reliability of the discrete choice experiment at the input and output level in patients with rheumatoid arthritis.
abstract: OBJECTIVE
  To investigate the issue of conjoint reliability over time.
  
  
  METHODS
  A discrete choice experiment was applied using scenarios that describe the effect of treating rheumatoid arthritis patients with TNF-alpha inhibitors, a novel class of highly effective, but expensive antirheumatic agents. Respondents participated in three face-to-face interviews over a period of 4 months. Reliability was measured both at the input level, where the consistency of matches made by respondents to the Discrete Choice Experiment (DCE) question between replications was determined, and at the output level, where the parameters of the conjoint model were estimated and tested for joint significance and willingness to pay (WTP) confidence intervals were calculated.
  
  
  RESULTS
  Input level: Of the 1661 choices made in survey 1, 1316 were repeated in survey 2. Based on the observed number of consistently repeated choices and the expected number by chance, a fair agreement between the choices in the two surveys (chi2 = 324) was found. Of the 998 consistently repeated choices from survey 1 to survey 2, 818 were repeated in survey 3. There was again a high level of consistency between the choices in surveys 1 and 2 and the final choice in survey 3. Output level: The confidence intervals for WTP figures in surveys 1 and 2 and 1 and 3 were overlapping, implying that the DCE was reliable at the output level over time.
  
  
  CONCLUSIONS
  The proportion of consistent responses was higher than would be expected by chance. Conjoint reliability over time was found both at the input and output level.
authors.affiliation: Institute of Public Health, University of Southern Denmark, Odense, Denmark. ulla@skjoldborg.biz
authors.forename: Ulla Slothuus
authors.initials: US
authors.lastname: Skjoldborg
authors.forename: Jørgen
authors.initials: J
authors.lastname: Lauridsen
authors.forename: Peter
authors.initials: P
authors.lastname: Junker
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D018501:Antirheumatic Agents / Q000191:economics*; D001172:Arthritis, Rheumatoid / Q000188:drug therapy* / Q000191:economics; D002755:Choice Behavior; D003718:Denmark; D005260:Female; D005102:Health Expenditures; D006801:Humans; D007407:Interviews as Topic; D008297:Male; D008875:Middle Aged; D015233:Models, Statistical; D010342:Patient Acceptance of Health Care / Q000523:psychology; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D014409:Tumor Necrosis Factor-alpha / Q000037:antagonists & inhibitors* / Q000191:economics; D055815:Young Adult
chemical_list: D018501:Antirheumatic Agents; D014409:Tumor Necrosis Factor-alpha