★★★★★ 3
A warning for the threat of non-human intelligence - and then what?
Format: Paperback
When you commit to reading a book with a title like ‘Our Final Invention’, already a sense of doom overwhelms you. In particular with the smaller print title being ‘Artificial Intelligence and the end of the human era’ you may want to start thinking about making your bucket list. But continue reading this review. I have no intention of overcriticising this book or veering off into polarising statements. Barrat is formulating a warning about the ‘perils of the heedless pursuit of advanced AI’. This is not a utopian narrative. The book opens in fact with a science-fictionous scenario where AI has overtaken human intelligence by speed, having developed into AGI (Artificial General Intelligence) and ASI (Artificial Super Intelligence). This potential danger of this happening is the thread through all the chapters. The book expresses a warning that given something that thinks and act faster (and more effective) than us will develop exponentially (beyond the singularity) and then given the wrong objective function it will do everything to reach that goal (what goal?) including destroying everything that does not fit in that frame, or is not sufficiently effective (including us). A warning that once we no longer understand it through its complexity (like nature?) it is out of control. The book contains many examples of the current state of the art in AI and selected perspectives from interviews with and references to thought leaders in the field, Goertzel, Kurzweil, Bostrom, Yudkowsky to name a few. It is asserted that neither funding of programming complexity will be show stoppers for the development of AGI. So AGI and AGI 2.0 (AGI augmented with feelings?) are coming and we better be ready (how?). Toward the end of the book, I believe the examples that are used to warn us about the dangers of AGI are slightly out of context. Disasters like Chernobyl and Three Mile Island warn us that engineers with deep subject matter knowledge still failed to intervene. Stuxnet cyberwar is brought to mind as a blunder of catastrophic proportions (may well be, but is this about AGI taking over the world with non-human objective functions?). These are examples of science manipulated by human agents into disaster. So the book ends with a doomsday warning that we, humanity, will only have one chance to ensure a positive coexistence with AI. This is where I would have expected more. While this may lead the reader to think, 99% of the readerbase are likely only at the receiving end of all of this and are now left a bit in a void. The open questions are what can science do to have a constructive journey into AGI? What are the actionable options? How can the general public be better educated (beyond doomsday scenarios)? What questions can they ask? What should they expect from politicians? There are initiatives under way in areas of ethics (Asilomar) and privacy (GDPR) to weigh in the equation. How can they be improved? How can the dialog be accelerated? But that said, I consider this a very valuable reading supported by primary and secondary research, with many examples and references. It also leaves the reader to think and consider. It is a good bundle of concerns and questions that as a minimum should be kept as a checklist on the scientific journey toward AGI and as such it should be used to improve the research, making it more ethical, not as a tool to curb it.
WAS THIS REVIEW HELPFUL?YesReportShare
Reviewed in the United States on April 12, 2018

