Orthogonality Thesis

Orthogonality defeats automatic moral convergence – but it does not, by itself, establish alien-value likelihood. The serious work lies in the bridge premises. The orthogonality thesis shows that intelligence alone gives us no guarantee of moral or human-value convergence. Claims that advanced AI values are likely to be alien require further arguments about training, selection,…