Why didn't more people in AI safety call for a pause or stop earlier?

An AI pause/stop advocate argues that calling for a pause or stop early required doubting that any of numerous safety approaches, including RLHF and mechanistic interpretability, would prove feasible, safe and have a low enough “safety tax” in time. They also say it was easier to build a career supporting one or more of those approaches than expressing general skepticism.