Panelists: David Brin, Phil Osborn, Vernor Vinge, Mitch Wagner. Filmed at Los Con 39 #loscon
On November 24, 2012 at LAX Marriott Hotel, Los Angeles, California.
aleph.se/Trans/Global/SingularityThe technological singularity is a hypothetical event related to the advent of artificial general intelligence (also known as “strong AI”). Such a computer, computer network, or robot would theoretically be capable of recursive self-improvement (redesigning itself), or of designing and building computers or robots better than itself. Repetitions of this cycle would likely result in a runaway effect – an intelligence explosion – where smart machines design successive generations of increasingly powerful machines, creating intelligence far exceeding human intellectual capacity and control. Because the capabilities of such a superintelligence may be impossible for a human to comprehend, the technological singularity is the point beyond which events may become unpredictable or even unfathomable to human intelligence.
The term technological singularity was popularized by mathematician, computer scientist and science fiction author Vernor Vinge, who argues that artificial intelligence, human biological enhancement, or brain–computer interfaces could be possible causes of the singularity.
Guest of Honor: Vernor Vinge
Artist Guest of Honor: Alan White
Fan Guests of Honor: Lloyd Penney & Yvonne Penney
Costume Guest of Art: Mela Hoyt-Heydon
Why should we prioritize improving the long-term future? Longtermism is an ethical stance motivates the reduction of existential risks such as nuclear war, engineered pandemics and emerging technologies like AI and nanotechnology. Sigal Samuel summarizes the key argument for longtermism as follows: “future people matter morally just as much as people alive today; (…) there…
Is controlling AI is enough? AI safety has a steering problem, not just a brakes problem. We have to make it care about the right things. As AI systems become more capable, the foundational question isn’t merely how do we contain them? It’s: what are they optimising for, and why should we trust that objective?…
AI doesn’t need a moustache-twirling villain to go wrong – it just needs the wrong metaethics in an unforgiving game. In this post I argue that: (1) many human moral norms are shaped by competitive, “Molochian” pressures; (2) if we give AI a purely constructivist / anti-realist metaethic, it will inherit and amplify those pressures;…
A talk for the ‘Stepping into the Future‘ conference (April 2022). Synopsis: Does the History, Dynamics, and Structure of our Universe give any evidence that it is inherently “Good”? Does it appear to be statistically protective of adapted complexity and intelligence? Which aspects of the big history of our universe appear to be random? Which…
The Golden Age of Philosophy: Navigating the Ethics of AI with Toby Walsh In an era where technology evolves faster than our social structures, artificial intelligence (AI) is pushing humanity toward a “Golden Age of Philosophy.” In a compelling interview, Toby Walsh, Professor of Artificial Intelligence at the University of New South Wales, explores why…
The concept of a non-arbitrary objective value space offers a compelling framework for understanding how to navigate to more valuable worlds. This framework presupposes the existence of stance-independent normative truths – metaphysical/ontological, epistemic, scientific & ethical principles that rational agents will converge upon given sufficient cognitive sophistication [1]. Here I will mostly talk in relation…