title: Complex Valuation: Applying Ideas from the Complex Intervention Framework to Valuation of a New Measure for End-of-Life Care.
abstract: BACKGROUND
  The UK Medical Research Council approach to evaluating complex interventions moves through development, feasibility, piloting, evaluation and implementation in an iterative manner. This approach might be useful as a conceptual process underlying complex valuation tasks.
  
  
  OBJECTIVE
  The objective of the study was to explore the applicability of such a framework using a single case study (valuing the ICECAP-Supportive Care Measure) and considering three key uncertainties: the number of response categories for the measure; experimental design; and the potential for using slightly different variants of the measure with the same value set.
  
  
  METHODS
  Three on-line pilot studies (n = 204, n = 100, n = 102) were undertaken during 2012 and 2013 with adults from the UK general population. Each used variants of discrete choice and best-worst scaling tasks; respondents were randomly allocated to different groups to allow exploration of the number of levels for the instrument (four or five), optimal experimental design and the values for alternative wording around prognosis. Conditional logit regression models were used in the analysis and variance scale factors were explored.
  
  
  RESULTS
  The five-level version of the measure seemed to result in simplifying heuristics. Plotting the variance scale factors suggested that best-worst scaling answers were approximately four times more consistent than the discrete choice answers. The likelihood ratio test indicated there was virtually no difference in values between the differently worded versions.
  
  
  CONCLUSIONS
  Rigorous piloting can improve the design of valuation studies. Thinking in terms of a 'complex valuation framework' may emphasise the importance of conducting and funding such rigorous pilots.
authors.affiliation: School of Social and Community Medicine , University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK. jo.coast@bristol.ac.uk.
authors.forename: Joanna
authors.initials: J
authors.lastname: Coast
authors.affiliation: Institute for Choice, University of South Australia, Adelaide, Australia.
authors.forename: Elisabeth
authors.initials: E
authors.lastname: Huynh
authors.affiliation: School of Social and Community Medicine , University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK.
authors.forename: Philip
authors.initials: P
authors.lastname: Kinghorn
authors.affiliation: TF Choices Ltd, Nottingham, UK.
authors.forename: Terry
authors.initials: T
authors.lastname: Flynn
mesh_terms: D006801:Humans; D016015:Logistic Models; D010865:Pilot Projects; D012107:Research Design; D013727:Terminal Care