kottke.org— Here's a small and nerdy measure of the huge change in the executive branch of the US government today. Here's the robots.txt file from whitehouse.gov yesterday and today.
Jan 20, 2009View in Crawl 4
I don't think everyone on here understands that it's metaphorical. Many comments have already been made by people assuming this means he's more open.For example, the comment beneath Curvearth (at the same comment level) reads: "The Bush robots.txt pretty much sums up his presidency. Secretive and only release the information that is helpful to him."
I don't see any difference in my countries Robot.txt file.Oh wait, that's because I live in the other part of the world that exists outside of the United States.Do we count as real people?
Yeah, they'll likely be disallowing cgi-bin soon. You really don't want your cgi scripts to be exercised by spiders - they can get into some crazy not-quite loops in there.
No, I will not. These "sensationalist headlines" followed with articles that try to manipulate readers into believing someone's political agenda are bad for everyone, and should be called out and pointed out.People deserve better than living in some warped fantasy land formulating emotional political opinions on someone's twisted, lying agenda - left or right. These sort of twisted articles hurt the country. It is better for people to face reality and form logical opinions based on facts.
They were trying to keep their search engine results showing the most current content, without removing the old stuff. robots.txt doesn't provide any security. It would be idiotic (even for Bush) to put confidential info in there.This has little to do with any sort of philosophical difference between the two administrations and mostly to do with a Brand New Websitehis has little to do with any sort of philosophy..... <a class="user" href="http://www.deutsche-slots.de">http://www.deutsche-slots.de</a>
toarnJan 21, 2009
hm, not that surprising.. old robots.txt from whithouse.gov Feb 2, 2001:<a class="user" href="http://web.archive.org/web/20010419161754/whitehouse.gov/robots.txt">http://web.archive.org/web/20010419161754/whitehou ...</a>.. basically the same
beakerzJan 21, 2009
Well considering that he is a devious? bastard - what else can you expect? xD
black27696Jan 21, 2009
I don't think everyone on here understands that it's metaphorical. Many comments have already been made by people assuming this means he's more open.For example, the comment beneath Curvearth (at the same comment level) reads: "The Bush robots.txt pretty much sums up his presidency. Secretive and only release the information that is helpful to him."
crasymikeJan 21, 2009
I don't see any difference in my countries Robot.txt file.Oh wait, that's because I live in the other part of the world that exists outside of the United States.Do we count as real people?
whitehatlurkerJan 21, 2009
Yeah, they'll likely be disallowing cgi-bin soon. You really don't want your cgi scripts to be exercised by spiders - they can get into some crazy not-quite loops in there.
mrgolf34Jan 22, 2009
wooooo obama
webmastuhbJan 22, 2009
No, I will not. These "sensationalist headlines" followed with articles that try to manipulate readers into believing someone's political agenda are bad for everyone, and should be called out and pointed out.People deserve better than living in some warped fantasy land formulating emotional political opinions on someone's twisted, lying agenda - left or right. These sort of twisted articles hurt the country. It is better for people to face reality and form logical opinions based on facts.
temsiJan 22, 2009
<a class="user" href="http://www.letmegooglethatforyou.com/?q=how+does+a+robots.txt+file+work">http://www.letmegooglethatforyou.com/?q=how+does+a ...</a>
djanakinJan 23, 2009
Made sense to me. Maybe you should stick to picture books.
dini95Jun 29, 2009
They were trying to keep their search engine results showing the most current content, without removing the old stuff. robots.txt doesn't provide any security. It would be idiotic (even for Bush) to put confidential info in there.This has little to do with any sort of philosophical difference between the two administrations and mostly to do with a Brand New Websitehis has little to do with any sort of philosophy..... <a class="user" href="http://www.deutsche-slots.de">http://www.deutsche-slots.de</a>
fernandowwwJul 6, 2009
Now we can see what they think that we will never see, thanks for share. =)<a class="user" href="http://www.peear.com">http://www.peear.com</a>