title: Reliable prediction intervals with regression neural networks.
abstract: This paper proposes an extension to conventional regression neural networks (NNs) for replacing the point predictions they produce with prediction intervals that satisfy a required level of confidence. Our approach follows a novel machine learning framework, called Conformal Prediction (CP), for assigning reliable confidence measures to predictions without assuming anything more than that the data are independent and identically distributed (i.i.d.). We evaluate the proposed method on four benchmark datasets and on the problem of predicting Total Electron Content (TEC), which is an important parameter in trans-ionospheric links; for the latter we use a dataset of more than 60000 TEC measurements collected over a period of 11 years. Our experimental results show that the prediction intervals produced by our method are both well calibrated and tight enough to be useful in practice.
authors: Computer Science and Engineering Department, Frederick University, 7 Y. Frederickou St., Palouriotisa, Nicosia 1036, Cyprus. h.papadopoulos@frederick.ac.cy
authors: Harris
authors: H
authors: Papadopoulos
authors: Haris
authors: H
authors: Haralambous
mesh_terms: D000465:Algorithms; D000818:Animals; D001185:Artificial Intelligence; D019985:Benchmarking; D001900:Boston; D002138:Calibration; D003201:Computers; D003299:Cooperative Behavior; D016208:Databases, Factual; D004583:Electrons; D005118:Extraterrestrial Environment; D005544:Forecasting / Q000379:methods*; D049851:Gastropoda / Q000502:physiology; D006798:Housing / Q000706:statistics & numerical data; D006801:Humans; D016571:Neural Networks, Computer; D025341:Principal Component Analysis; D012044:Regression Analysis; D015203:Reproducibility of Results; D019445:Solar Activity