searchengineland.com— The "Unavailable After" tag will allow webmasters to create expirations for pages with time-sensitive data... No more "breaking news" from 5 years ago...
Jul 13, 2007View in Crawl 4
if companies want to keep users off some page, they should close access to it. And it's pretty simple to block the bots from indexing some content, so no points here.
origclubsodaJul 14, 2007
If only Digg would delete BREAKING from story titles.
link5280Jul 14, 2007
lol, you are so right!
jefflerJul 15, 2007
The problem is that most people will ignore the date anyway if the content seems good - how many times have we seen this on digg?
dtizianiJul 15, 2007
if companies want to keep users off some page, they should close access to it. And it's pretty simple to block the bots from indexing some content, so no points here.
th3wiz4rdJul 15, 2007
Good idea, but what if you want to get 'expired' results for some reason? There should definitely be an option to include expired pages in a search.
julianrodJul 15, 2007
I was thinking the same thing. Instead of reinventing the wheel... why not use the tools that already exist?