Understanding V-Risk: Navigating the Complex Landscape of Value in AI
|

Understanding V-Risk: Navigating the Complex Landscape of Value in AI

In this post I explore what I explore what I broadly define as V-Risk (Value Risk), which I think is a critical and underrepresented concept in general, but especially for the alignment of artificial intelligence. There are two main areas of AI alignment: capability control and motivation selection. Values are what motivates approaches to fulfilling…

VRisk – Value Risk
|

VRisk – Value Risk

Value Risk (VRisk) is the risk of suboptimal or harmful values becoming dominant, shaping the trajectory of civilizations, institutions, AI systems (especially transformative AI systems) in ways that may be difficult—or even impossible—to reverse. Unlike existential risks (XRisk), which threaten outright extinction, or suffering risks (SRisk), which entail large-scale suffering, VRisk concerns the entrenchment of…