title: On genies and bottles: scientists' moral responsibility and dangerous technology R&D.
abstract: The age-old maxim of scientists whose work has resulted in deadly or dangerous technologies is: scientists are not to blame, but rather technologists and politicians must be morally culpable for the uses of science. As new technologies threaten not just populations but species and biospheres, scientists should reassess their moral culpability when researching fields whose impact may be catastrophic. Looking at real-world examples such as smallpox research and the Australian "mousepox trick", and considering fictional or future technologies like Kurt Vonnegut's "ice-nine" from Cat's Cradle, and the "grey goo" scenario in nanotechnology, this paper suggests how ethical principles developed in biomedicine can be adjusted for science in general. An "extended moral horizon" may require looking not just to the effects of research on individual human subjects, but also to effects on humanity as a whole. Moreover, a crude utilitarian calculus can help scientists make moral decisions about which technologies to pursue and disseminate when catastrophes may result. Finally, institutions should be devised to teach these moral principles to scientists, and require moral education for future funding.
authors: Department of Philosophy, Faculty of Technology, Policy, and Management, Delft University of Technology, 2600 GA Delft, The Netherlands. d.r.koepsell@tudelft.nl
authors: David
authors: D
authors: Koepsell
mesh_terms: D001675:Bioethics; D035843:Biomedical Research / Q000941:ethics*; D023482:Bioterrorism / Q000941:ethics / Q000517:prevention & control; D032781:Codes of Ethics; D003657:Decision Making / Q000941:ethics; D034723:Double Effect Principle; D028663:Ethical Theory; D005544:Forecasting; D005818:Genetic Engineering / Q000941:ethics; D017408:Guidelines as Topic; D006801:Humans; D033181:Information Dissemination / Q000941:ethics; D028681:Moral Obligations; D028662:Principle-Based Ethics; D024382:Professional Role; D012109:Research Support as Topic / Q000941:ethics; D018570:Risk Assessment / Q000941:ethics; D012586:Science / Q000941:ethics*; D012901:Variola virus / Q000235:genetics