Understanding the moral status of digital minds requires a mature understanding of sentience
Turning off all AI won’t happen in the real world. If we understand the signatures of sentience, we’ll be in a better position to know what to do to circumstantially prevent/mitigate it or encourage it. AI, esp LLMs ‘claiming sentience’ isn’t enough… We need to deep operational understandings of it.
See the article by 80k https://80000hours.org/problem-profiles/moral-status-digital-minds/
I’ll be interviewing Jeff Sebo on ‘Taking AI Welfare Seriously’ soon, and I’ll be expanding this post…