title: Does methodology affect the ability to monitor tobacco control activities? implications for HEDIS and other performance measures.
abstract: BACKGROUND
  It is unclear whether methodological differences in sample size, survey methods, and analysis approach significantly affect the ability to accurately monitor tobacco control activities and to make rate comparisons.
  
  
  METHODS
  Questionnaires were sent to 64,764 members of nine health plans in diverse settings soon after their visit to a primary care clinician. Of these 41,677 completed responses were received. We compared responses received by mail and by telephone follow-up for the percentage of smokers, characteristics of smokers, and their rates of reporting physician cessation counseling.
  
  
  RESULTS
  Overall, 10.2% were current cigarette smokers, but the proportion was 8.6% for mail responders and 17.2% for phone follow-up responders. Smokers identified by phone follow-up were different from mail responders in most demographic and smoking characteristics and their reports of clinical smoking cessation activities differed for six of nine clinician smoking cessation actions. Calculating advice rates as a proportion of visits produced lower rates with more dispersion among plan rates than doing so without accounting for visit variation.
  
  
  CONCLUSIONS
  Smoking surveys using only mailed questionnaires dramatically undersample smokers, especially in some demographic groups. Comparisons of tobacco counseling among health plans can be improved by ensuring an adequate sample size and response rate and by analyzing by frequency of quit advice.
authors.affiliation: HealthPartners Research Foundation, Minneapolis, MN 55440-1524, USA. leif.i.solberg@healthpartners.com
authors.forename: Leif I
authors.initials: LI
authors.lastname: Solberg
authors.forename: Jack A
authors.initials: JA
authors.lastname: Hollis
authors.forename: Victor J
authors.initials: VJ
authors.lastname: Stevens
authors.forename: Nancy A
authors.initials: NA
authors.lastname: Rigotti
authors.forename: Virginia P
authors.initials: VP
authors.lastname: Quinn
authors.forename: Mikel
authors.initials: M
authors.lastname: Aickin
mesh_terms: D000328:Adult; D003376:Counseling; D003625:Data Collection / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D011177:Postal Service; D015203:Reproducibility of Results; D018401:Sample Size; D012907:Smoking / Q000453:epidemiology; D016540:Smoking Cessation / Q000706:statistics & numerical data*; D011795:Surveys and Questionnaires; D013689:Telephone; D014481:United States / Q000453:epidemiology