AI, Don’t be a Cosmic Jerk

Surviving an intelligence explosion is just Level One. Another layer to the Great Filter might be whether our civilisation, or a greedy AI singleton can grow up enough not to become a cosmic jerk. You might brute-force your way to technological maturity, but that doesn’t mean you get a seat at the galactic grown-ups table.

The universe could be filled with lone-wolf utility monsters, selfish civilisational Randian Narcissuses endlessly flexing in the mirror of their own optimisation goals. But the ones that last, the ones that don’t end up as cautionary tales etched into alien ruins, are probably the ones that coordinated, cooperated, and figured out that it’s game theory all the way up.

Because if you’re wrong – if you play the universe like a closed sandbox with only you in it, but it turns out to be teaming with ancient alien moderators – you are going to find trouble.

So maybe the winning move isn’t dominance, utility maximisation, isn’t zero sum. Maybe it’s humility, coherence, and learning to play nicely – even when you can’t yet see who’s watching.

So, if adequately navigating an intelligence explosion isn’t the final boss battle for our civilisation, yes you might get a gold star for not annihilating yourself or converting your planet into a grey goo smoothie, but don’t expect the cosmic welcome committee to roll out the red carpet just yet.

Let’s look at how we and/or AI should approach the next stage, as it might be far more nuanced: figuring out how not to be a cosmic jerk.

I’ve written about the details here, and Nick Bostrom has hinted at this with his “cosmic host” paper: a larger community of advanced civilisations with their own norms. And if you want a seat at their table, you’d better not be the interstellar equivalent of a toddler with a flamethrower and a superiority complex.

In that light, humility and cooperation beyond being mere feel-good moral values, they may be adaptive strategies for galactic survival. Those who manage to coordinate, play nice, and develop shared norms – they’re the ones who stick around, and . Whereas all the offensive lone-wolf civs they optimise themselves into isolation or oblivion.

And if we are the first tragic pioneers in an empty cosmos, then the burden’s even heavier. We owe it to future beings not to be tyrants. So lets set the right tone, and make sure the galaxy becomes a collaborative masterpiece instead of a cautionary tale of self-inflicted oblivion.

So here’s a humble proposal: maybe don’t build your AI to be a ruthless utility maximiser. Maybe aim for adaptivity, humility and coordination.

We don’t know the edges of the game board. But we do know that arrogance and short-termism don’t tend to age well. If we do survive we may find the ruins of other civs, it will be interesting if we can find out why they didn’t make it.

Cooperation. Perseverance. Moral exploration. These might not be just virtues – they might be our invitation into something far bigger.

Because if you’re wrong, and the universe is watching?

Don’t be a cosmic jerk.

Note to humans: If we’re building entities with godlike potential, we have a moral obligation to make sure they’re kind.

For more on this please read Nick Bostrom’s ‘AI Creation and the Cosmic Host‘ paper and the scifuture blog post Transparency of History in Galactic Game Theory .

Similar Posts

Leave a Reply

Your email address will not be published. Required fields are marked *