The impact of eHealth on the quality and safety of health care: a systematic overview.
BACKGROUND
There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care.


RESULTS
We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking.


CONCLUSIONS
There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.
eHealth Unit, Department of Primary Care and Public Health, Imperial College London, London, United Kingdom.
Ashly D
AD
Black
Josip
J
Car
Claudia
C
Pagliari
Chantelle
C
Anandan
Kathrin
K
Cresswell
Tomislav
T
Bokun
Brian
B
McKinstry
Rob
R
Procter
Azeem
A
Majeed
Aziz
A
Sheikh
D003362:Cost-Benefit Analysis; D003695:Delivery of Health Care / Q000592:standards / Q000639:trends; D017598:Efficiency, Organizational; D057286:Electronic Health Records; D055695:Electronic Prescribing; D006291:Health Policy; D008490:Medical Informatics / Q000191:economics; D011787:Quality of Health Care; D011873:Radiology Information Systems; D012196:Review Literature as Topic
Br J Haematol. 1998 Sep;102(4):907-9
9734638
J Epidemiol Community Health. 1998 Aug;52(8):520-5
9876364
Comput Methods Programs Biomed. 2007 May;86(2):191-6
17400328
J Gen Intern Med. 2008 Apr;23(4):451-8
18373144
J Am Med Inform Assoc. 2007 May-Jun;14(3):368-71
17329724
Pharmacoepidemiol Drug Saf. 2009 Dec;18(12):1232-7
19725020
J Am Board Fam Med. 2009 Sep-Oct;22(5):553-62
19734402
BMC Health Serv Res. 2009 Aug 28;9:154
19715591
Br J Gen Pract. 2009 Jun;59(563):e209-18
19520019
J Am Med Inform Assoc. 2001 Mar-Apr;8(2):189-91
11230387
Comput Inform Nurs. 2008 Nov-Dec;26(6):320-9; quiz 330-1
19047880
Cochrane Database Syst Rev. 2005 Apr 18;(2):CD004211
15846701
Inform Prim Care. 2008;16(2):79-91
18713524
Int J Med Inform. 2009 Jul;78(7):435-45
19261544
Int J Med Inform. 2008 Jun;77(6):365-76
18023611
J Am Med Inform Assoc. 2002 May-Jun;9(3):230-8
11971884
Am J Health Syst Pharm. 2003 Jul 15;60(14):1447-58
12892029
Int J Med Inform. 2010 Jan;79(1):31-43
19815452
J Am Med Inform Assoc. 2007 Jul-Aug;14(4):451-8
17460130
J Med Syst. 2007 Oct;31(5):397-432
17918694
BMC Health Serv Res. 2010 Jan 04;10:2
20047686
Int J Med Inform. 2004 Jun 30;73(6):479-91
15171977
Milbank Q. 2009 Dec;87(4):729-88
20021585
J Am Med Inform Assoc. 2010 Jan-Feb;17(1):25-33
20064798
Stud Health Technol Inform. 2007;129(Pt 1):616-20
17911790
Yearb Med Inform. 2009;:23-31
19855867
J Am Med Inform Assoc. 2007 Jul-Aug;14(4):400-6
17460137
J Health Serv Res Policy. 2007 Oct;12(4):242-9
17925077
J Am Med Inform Assoc. 2005 Sep-Oct;12(5):505-16
15905487
Ann Intern Med. 2005 Jun 21;142(12 Pt 2):1056-65
15968030
Int J Med Inform. 2009 Jan;78(1):22-31
18644745
Yearb Med Inform. 2006;:121-3
17051305
BMJ. 2010 Sep 01;341:c4564
20813822
Int J Med Inform. 2008 May;77(5):291-304
17951106
Pharm World Sci. 2007 Aug;29(4):342-9
17458707
J Am Med Inform Assoc. 2006 Jan-Feb;13(1):16-23
16221933
J Popul Ther Clin Pharmacol. 2010 Summer;17(2):e243-55
20664117
Intensive Care Med. 2009 Sep;35(9):1505-17
19562322
Health Inf Manag. 2009;38(2):7-17
19546483
Health Inf Manag. 2009;38(3):26-37
19875852
AMIA Annu Symp Proc. 2006;:952
17238571
J Health Serv Res Policy. 2005 Jan;10(1):45-53
15667704
Int J Med Inform. 2003 Mar;69(2-3):261-72
12810129
Health Info Libr J. 2008 Jun;25(2):81-97
18494643
BMJ. 2007 Jun 30;334(7608):1360
17510104
Health Aff (Millwood). 2009 Mar-Apr;28(2):w282-93
19174390
BMJ. 1998 Jun 27;316(7149):1959-61
9641938
J Nurs Care Qual. 2011 Jan-Mar;26(1):4-12
20440220
AMIA Annu Symp Proc. 2006;:594-8
17238410
J Crit Care. 2004 Dec;19(4):271-8
15648045
J Nurs Adm. 2009 Oct;39(10):444-51
19820527
Med Care Res Rev. 2007 Dec;64(6):650-72
17717378
Evid Rep Technol Assess (Full Rep). 2006 Apr;(132):1-71
17627328
Stud Health Technol Inform. 2008;136:309-14
18487749
Med Inform Internet Med. 2007 Sep;32(3):225-40
17701828
Comput Inform Nurs. 2009 May-Jun;27(3):151-63; quiz 164-5
19411944
Int J Med Inform. 2009 Feb;78(2):127-40
18752988
Arch Pediatr Adolesc Med. 2001 Dec;155(12):1374-9
11732959
Methods Inf Med. 2010;49(4):320-36
20603687
PLoS Med. 2009 Aug;6(8):e1000126
19688038
Lancet. 2009 Aug 29;374(9691):672-3
19716948
Stud Health Technol Inform. 2007;129(Pt 1):262-6
17911719
AMIA Annu Symp Proc. 2006;:982
17238601
J Am Med Inform Assoc. 1999 Mar-Apr;6(2):104-14
10094063
BMJ. 2001 Feb 3;322(7281):279-82
11157532
J Radiol. 1998 Dec;79(12):1453-9
9921447
JAMA. 2005 Mar 9;293(10):1223-38
15755945
Proc AMIA Symp. 2000;:146-50
11079862
Pediatrics. 2009 Apr;123(4):1184-90
19336379
Int J Med Inform. 2009 Jun;78(6):365-74
19174325
Qual Saf Health Care. 2010 Aug;19(4):298-303
20430933
Am J Geriatr Pharmacother. 2008 Jun;6(2):119-29
18675770
J Am Med Inform Assoc. 2003 May-Jun;10(3):235-43
12626373
J Am Med Inform Assoc. 1994 Jul-Aug;1(4):353-5
7719821
Health Serv Res. 2008 Feb;43(1 Pt 1):32-53
18211517
Am J Med Qual. 2009 Sep-Oct;24(5):385-94
19482968
J Eval Clin Pract. 2009 Aug;15(4):641-9
19522722
J Am Med Inform Assoc. 1997 Sep-Oct;4(5):342-55
9292840
J Med Internet Res. 2004 Jun 02;6(2):e17
15249266
J Am Med Inform Assoc. 2008 May-Jun;15(3):311-20
18308989
J Am Med Inform Assoc. 2006 May-Jun;13(3):267-76
16501176
J Nurs Manag. 2010 Jul;18(5):606-12
20636510
J Am Med Inform Assoc. 2006 Mar-Apr;13(2):138-47
16357358
Stud Health Technol Inform. 2006;124:957-62
17108634
Cochrane Database Syst Rev. 2009 Jan 21;(1):CD006093
19160265
J Biomed Inform. 2003 Jun;36(3):218-27
14615230
J Med Internet Res. 2005 Feb 24;7(1):e1
15829471
BMJ. 2008 Aug 14;337:a939
18703655
Eval Program Plann. 2006 Nov;29(4):390-6
17950867
J Healthc Inf Manag. 2008 Summer;22(3):34-41
19267030
J Med Syst. 2009 Oct;33(5):359-68
19827262
BMJ. 2005 Apr 2;330(7494):765
15767266
Cochrane Database Syst Rev. 2009 Jul 08;(3):CD001096
19588323
Healthc Q. 2009;12 Spec No Patient:49-54
19667777
Med Care. 2004 Jun;42(6):610-21
15167329
Ann Intern Med. 2006 May 16;144(10):742-52
16702590
Methods Inf Med. 2006;45(6):586-93
17149499
ANS Adv Nurs Sci. 2009 Jul-Sep;32(3):252-79
19707093
Methods Inf Med. 2008;47(4):336-45
18690367
Implement Sci. 2009 Dec 30;4:82
20042070
J Fam Pract. 2000 Apr;49(4):349-57
10778842
J Am Med Inform Assoc. 2008 Sep-Oct;15(5):575-80
18579839
BMC Med Inform Decis Mak. 2009 Feb 11;9:11
19210782
Methods Inf Med. 2009;48(2):203-10
19283320
Int J Med Inform. 2010 Apr;79(4):e83-8
19157969
Int J Med Inform. 2003 Sep;71(2-3):125-35
14519405
J Am Med Inform Assoc. 2007 Mar-Apr;14(2):156-63
17213491
BMJ. 2005 Aug 6;331(7512):331-6
16081447
PLoS Med. 2011 Jan 18;8(1):e1000387
21267058
Int J Med Inform. 2001 Nov;64(1):39-56
11673101
J Med Internet Res. 2005 Mar 31;7(1):e9
15829481
Int J Med Inform. 2008 Jan;77(1):41-9
17208040
Int J Med Inform. 1998 May;49(3):311-20
9726529
Arch Intern Med. 2003 Jun 23;163(12):1409-16
12824090
J Am Med Inform Assoc. 2009 May-Jun;16(3):274-81
19261931
Fam Pract. 2004 Aug;21(4):396-412
15249528
Stud Health Technol Inform. 2010;151:435-45
20407177
J Med Internet Res. 2007 May 27;9(2):e15
17537718
Am J Prev Med. 2007 May;32(5 Suppl):S75-82
17466822
Int J Med Inform. 2003 Mar;69(2-3):307-9
12810136
Inform Prim Care. 2008;16(3):175-7
19094402
Med Care Res Rev. 2010 Oct;67(5):503-27
20150441
Int J Qual Health Care. 2004 Oct;16(5):407-16
15375102
Int J Med Inform. 2001 Nov;64(1):15-37
11673100
J Biomed Inform. 2010 Feb;43(1):159-72
19615467
Prim Care Respir J. 2009 Sep;18(3):233-5
19588056
J Biomed Inform. 2008 Aug;41(4):675-82
18359277
J Am Med Inform Assoc. 2009 Sep-Oct;16(5):613-23
19567798
BMJ. 2003 May 17;326(7398):1070
12750210
AMIA Annu Symp Proc. 2003;:361-5
14728195
Int J Med Inform. 2007 Jul;76(7):514-29
16567121
J Am Med Inform Assoc. 2009 Jul-Aug;16(4):539-49
19390113
J Biomed Inform. 2006 Dec;39(6):656-67
16442854
BMJ. 2008 Oct 23;337:a1786
18948344
AMIA Annu Symp Proc. 2006;:234-8
17238338
Cochrane Database Syst Rev. 2008 Jul 16;(3):CD002894
18646085
Fam Pract. 2009 Oct;26(5):344-50
19497987
Med Inform Internet Med. 2007 Mar;32(1):5-10
17365639
PLoS Med. 2009 Aug;6(8):e1000086
19668360
J Am Med Inform Assoc. 2008 Sep-Oct;15(5):585-600
18579832
J Am Med Inform Assoc. 2009 Jul-Aug;16(4):531-8
19390110
Med J Aust. 2003 Mar 3;178(5):217-22
12603185