Forethought

Forethought is "a research nonprofit focused on how to navigate the transition to a world with superintelligent AI systems".