Objective Moral Ontology Should Inform AI Alignment
I lean moral naturalist: the view that morality is not a fictional or supernatural layer placed over the world, but is grounded in real features of reality. Morality and purpose, on this view, emerge from a rationally sound understanding of what the universe contains: conscious systems, valenced experience, welfare, agency, flourishing, suffering, and interests. The…