Test link in an X reply reportedly drew thousands of crawlers

A site owner says his pages slowed shortly after he shared links on X, so he posted a test URL deep in a thread. He reports that thousands of crawlers opened it, with X’s Twitterbot first and the first non-X bot arriving 8.40 seconds after posting. Another user asked whether the bots could be blocked automatically.