Artificial intelligence is the topic on everyone’s lips. Safety risks are increasing as we approach truly transformative “strong” AI systems, models that could outperform humans in nearly every domain. These models could do tremendous good, like helping develop new cancer drugs or solving fusion, but they could also enable catastrophic harm if misdirected.