I haven’t seen a single watertight argument for default 100% p(doom) yet. They are all speculative as far as I can tell. Though I do think we should have some credence for doom. We Should be Concerned about p(Doom) A catastrophic scenario does not need to be watertight to warrant deep concern. Doomer scenarios rest…
Short:In evaluating strategies for AI Safety, capability control may buy us time – it may even calm our nerves, but it won’t hold once AI outsmarts the safeguards. The deeper challenge is value alignment: increasing the likelihood that superintelligent AI successfully navigates the landscape of value – optimising for coherent and grounded notions of the…
If morality is real, ignoring it in AI design is the most dangerous mistake we could make. In discussing with others about AI safety and the future of humanity, I decided to create a blogpost distilling my thoughts on the matter: Disagreement != No Truth Few would claim that persistent disagreement implies there is no…
Pain isn’t an illusion – pain is real. In practise, is pain objectively measurable? Yes, it’s signatures are already well researched. Yes, in that it’s presence can be detected not just by behavioural observation of the organism reactions to pain, but by peering in via modern instrumentation at the changes in the state of the…
As a posthumanist who thinks a lot about AI and the future of life, the Geth in Mass Effect are fascinating because they blur the line between individual and collective intelligence. There is quite a lot of philosophical depth to explore, especially if you are interested in either: a) role playing beyond maxing out your…
I was struck by how Richard Sutton’s The Bitter Lesson in AI resonates with motivation selection and indirect normativity within ongoing debates in AI alignment. Sutton argues that human-crafted domain knowledge (e.g., “how to play chess” or “how to recognise phonemes”) is brittle and doesn’t scale with compute, compared to search + learning. If we…
Stelarc’s art suggests that humanity’s future lies not in holding onto the “natural” body, but in embracing its redesign. The body is contingent – a temporary configuration ripe for reinvention. “The idea of redesigning the body is something that’s come out from the perceived inadequacies in interacting with technology. So for me it’s not an…
The Ethics of AI: Why We Need Moral Machines, Not Just Smart Ones In an era defined by rapid advancements in artificial intelligence, we often find ourselves wrestling with profound ethical questions. One of the most provocative of these is whether machines can, or should, be given a sense of morality. In this recent video…
Cunning + luck ≈> brute-force intelligence – (cascading caveats ensuing).. In a densely populated landscape of naively or sub-adequately regulated selection pressures, raw cunning combined with moderate intelligence and high risk-tolerance will often outperform high IQ (esp. in the short to medium term). This holds so long as peak cunning matches or exceeds the higher…
Imagine a future where AI has mastered every human endeavour – crafting symphonies more stirring than Beethoven’s, solving crises with a precision no leader could match, even nurturing with a patience that outshines the best of us. In this world, what role remains for you? As superintelligent machines edge closer to eclipsing us, we face…