Forthcoming interview with Nick Bostrom
Super excited that I’ll be interviewing Nick Bostrom again in a few days – last time was in 2012 (on XRisks of AI and the Simulation Argument). This time we will cover topics that range from Superintelligence to Deep Utopia.
Since Nick Bostrom wrote Superintelligence, AI has surged from theoretical speculation to powerful, world-shaping reality. Progress is undeniable, yet there is an ongoing debate in the AI safety community – caught between mathematical rigor and swiss-cheese security. p(doom) debates rage on, but equally concerning is the risk of locking in suboptimal futures for a very long time.
Zooming in: motivation selection—especially indirect normativity—raises the question: is there a structured landscape of possible value configurations, or just a chaotic search for alignment?
Enter Deep Utopia: not just avoiding catastrophe but ensuring resilience, meaning, and flourishing in a ‘solved’ world; a post instrumental, plastic utopia – where humans are ‘deeply redundant’.
This is our moment to shape the future. What values will we encode? What futures will we entrench?
The calls to action: engage, research, and steer.
