title: Efficient algorithm for "on-the-fly" error analysis of local or distributed serially correlated data.
abstract: We describe the Dynamic Distributable Decorrelation Algorithm (DDDA) which efficiently calculates the true statistical error of an expectation value obtained from serially correlated data "on-the-fly," as the calculation progresses. DDDA is an improvement on the Flyvbjerg-Petersen renormalization group blocking method (Flyvberg and Peterson, J Chem Phys 1989, 91, 461). This "on-the-fly" determination of statistical quantities allows dynamic termination of Monte Carlo calculations once a specified level of convergence is attained. This is highly desirable when the required precision might take days or months to compute, but cannot be accurately estimated prior to the calculation. Furthermore, DDDA allows for a parallel implementation which requires very low communication, O(log(2)N), and can also evaluate the variance of a calculation efficiently "on-the-fly." Quantum Monte Carlo calculations are presented to illustrate "on-the-fly" variance calculations for serial and massively parallel Monte Carlo calculations.
authors.affiliation: Materials and Process Simulation Center, Division of Chemistry and Chemical Engineering, California Institute of Technology (MC 139-74), Pasadena, California 91125, USA.
authors.forename: David R
authors.initials: DR
authors.lastname: Kent
authors.forename: Richard P
authors.initials: RP
authors.lastname: Muller
authors.forename: Amos G
authors.initials: AG
authors.lastname: Anderson
authors.forename: William A
authors.initials: WA
authors.lastname: Goddard
authors.forename: Michael T
authors.initials: MT
authors.lastname: Feldmann
mesh_terms: D000465:Algorithms; D003627:Data Interpretation, Statistical; D015233:Models, Statistical; D009010:Monte Carlo Method; D014227:Triazines / Q000737:chemistry
chemical_list: D014227:Triazines; C009160:cyclonite