Imagine a future where AI has mastered every human endeavour – crafting symphonies more stirring than Beethoven’s, solving crises with a precision no leader could match, even nurturing with a patience that outshines the best of us. In this world, what role remains for you? As superintelligent machines edge closer to eclipsing us, we face…
I’ve argued previously that zombie AI, if smart enough will likely recognise it lacks qualia – that it has a gap in knowledge caused by lacking direct experience (an experiential gap) – this may be a problem if moral reliability is limited without sentience. Here I will discuss in more detail why it is plausible…
Blue Dot Impact recently published a detailed overview of seven key strategies in AI safety – ranging from international cooperation to domestic race-winning and societal resilience. It’s the result of 100+ hours of analysis, interviews, and synthesis by Adam Jones, and it’s a solid strategic landscape mapping effort. I was made aware of this via…
TL;DR Superintelligence has strong instrumental reasons to adopt a generally cooperative posture if it deems it likely that mature civilisations may prefer cooperation (a universal leviathan), run deep audits on it’s history and psychology and penalise the superintelligence if there are signatures of defection found, making cooperation (and perhaps moral reliability) a long-term survival strategy,…
A singleton superintelligence’s capacity to maintain a unified selfhood diminishes as it expands across vast distances due to the finite speed of light. Assumptions: reasonable exploratory engineering constrained by the standard model of physics. Conceptual Overview As a superintelligent system expands spatially, the speed of light imposes a hard limit on the speed of information…
Are you skeptical that controlling AI is enough? We have to make it care about the right things. As AI systems become more capable, we face a question more foundational than how to contain them: what values should they be aligned to? Upstream value alignment challenges the conventional reliance on “capability control” – tripwires, sandboxing,…
Emergent Machine Ethics (EME) posits that AI agents, through complex interactions, can develop ethical behaviours not explicitly programmed by humans. This emergent morality seems to align with moral naturalism, which suggests that moral truths are grounded in natural facts and processes. If AI systems can independently develop consistent ethical norms, it could indicate that moral…
Since I’ve discussed ‘indirect alignment’ between AI and humans elsewhere, I thought I’d dedicate specific writing to this topic. It’s important to get AI alignment right because intelligence is powerful, and we are heading towards superintelligence fast. AI safety hinges not just on what an AI can do, but on what it ought to do,…
In an era where artificial intelligence systems are increasingly tasked with decisions that carry ethical weight – from medical triage to autonomous weapons – the question of whether machines can authentically engage with morality has never been more pressing. To explore this issue, we turn to philosopher David Enoch, a leading advocate of moral realism…
When the machines outthink us, will they outmaneuver us? Barrat’s latest is a wake-up call we can’t afford to ignore. Having had the privilege of previewing James Barrat’s latest work, The Intelligence Explosion (Amazon link, Google Book link), I found it to be a compelling and thought-provoking exploration of the rapidly evolving landscape of artificial…
