adsensebits.com— Google no longer sees your website through eyes of an 11 year old text browser (No I'm not talking about IE), but what's to come is still unknown.
Feb 23, 2006View in Crawl 4
I suspect this has been done to workaround any filters that prohibit anything but Mozilla compatible clients. Back in the day, Internet Explorer added "Mozilla compatible" in the agent header to avoid all the greedy webmasters blocking it.
From the article: "Previously the only way to tell if information was important, was if we told Google it was by using various forms of markup" and "As the web evolves, so must Google"hmmm...firstly, using various forms of *correct* markup (if something's a heading, mark it as a heading, etc) isn't just done for google...it's the foundation upon which the entire www rests; standards, definitions of how content gets marked up.so the evolution of the web foreseen by the author is one where everything can just be marked up as whatever, as long as it's styled? a huge step back! that's devolution, not evolution.
Another wonderful feature they could add to their new, highly-extensible bot is validation. Lets say...Page 1 has to validate as valid markup. Thats taking your market power and leveraging it for Good?.
Why would googlebot use lynx or mozilla, both are browsers. Humans use browsers to read html. I don't see why the useragent string makes any difference unless you are serving different versions of your site for each browser.Where's the bury button
Closed AccountFeb 23, 2006
I suspect this has been done to workaround any filters that prohibit anything but Mozilla compatible clients. Back in the day, Internet Explorer added "Mozilla compatible" in the agent header to avoid all the greedy webmasters blocking it.
nanobeFeb 23, 2006
The new user agent string thing is old news. I blogged about it back in 2004: <a class="user" href="http://nanobox.chipx86.com/blog/2004/09/new-googlebot.php">http://nanobox.chipx86.com/blog/2004/09/new-googlebot.php</a>Although I hadn't heard about it requesting CSS and JS files. I'll have to look through my logs and check it out.
reduxFeb 24, 2006
From the article: "Previously the only way to tell if information was important, was if we told Google it was by using various forms of markup" and "As the web evolves, so must Google"hmmm...firstly, using various forms of *correct* markup (if something's a heading, mark it as a heading, etc) isn't just done for google...it's the foundation upon which the entire www rests; standards, definitions of how content gets marked up.so the evolution of the web foreseen by the author is one where everything can just be marked up as whatever, as long as it's styled? a huge step back! that's devolution, not evolution.
dvvarfFeb 24, 2006
if googlebot really is looking for color, it might mean that adsense that better synchronises with the layout..that would be fun
neffyFeb 25, 2006
Another wonderful feature they could add to their new, highly-extensible bot is validation. Lets say...Page 1 has to validate as valid markup. Thats taking your market power and leveraging it for Good?.
challahcFeb 27, 2006
Why would googlebot use lynx or mozilla, both are browsers. Humans use browsers to read html. I don't see why the useragent string makes any difference unless you are serving different versions of your site for each browser.Where's the bury button