Analysis, power and design of antimicrobial resistance surveillance studies, taking account of inter-centre variation and turnover.
OBJECTIVE
Logistic regression is commonly used to analyse resistance surveillance studies, but variation between collecting centres undermines its assumption that isolates are independent. We studied the impact of this problem and the ability of alternative methods to overcome it. We also investigated different study designs and estimated the statistical power of the BSAC Resistance Surveillance Programmes.


METHODS
We simulated datasets with various combinations of study design, inter-centre variation, annual centre turnover, initial resistance level and odds ratio, and analysed 1000 repetitions of each for trends in resistance by five variants of logistic regression.


RESULTS
Traditional analysis by unadjusted logistic regression was invalid because it gave very high type 1 (false-positive) error rates, up to 49%, in the presence of high levels of inter-centre variation and turnover. Of the other methods investigated, logistic regression with random effects for centre performed best: it had appropriate error rates for all study designs assessed and generally had higher power than fixed-effects or cluster-robust approaches. A 'Diffuse' study with more centres contributing fewer isolates was less susceptible to the ill-effects of inter-centre variation than a study of equal overall size with fewer centres contributing more, and had slightly higher power.


CONCLUSIONS
Unadjusted logistic regression, ignoring inter-centre variation, is unsuitable for the analysis of trends in typical resistance surveillance studies, often leads to erroneous conclusions and should be avoided. Random effects logistic regression is an appropriate, widely applicable alternative, available in most standard statistical software. Collecting isolates from a larger number of centres has both statistical and scientific advantages.
Reynolds
Rosy
R
Department of Medical Microbiology, Southmead Hospital, Southmead Road, Bristol BS10 5NB, UK. rreynolds@bsac.org.uk
Lambert
Paul C
PC
Burton
Paul R
PR
D000900:Anti-Bacterial Agents / Q000494:pharmacology*; D001419:Bacteria / Q000145:classification / Q000187:drug effects* / Q000302:isolation & purification; D001424:Bacterial Infections / Q000382:microbiology*; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D024881:Drug Resistance, Bacterial; D006801:Humans; D007494:Ireland; D016015:Logistic Models; D008826:Microbial Sensitivity Tests / Q000379:methods / Q000592:standards; D015203:Reproducibility of Results; D012107:Research Design / Q000592:standards*; D018571:Sentinel Surveillance; D006113:United Kingdom
D000900:Anti-Bacterial Agents