Google, Yahoo, the X-Robots directive and your website rankings
Saturday, January 12th, 2008Last week, Yahoo announced that they now support the X-Robots-Tag in the HTTP header. This new tag allows you to influence how Google and Yahoo index your website pages. What is the X-Robots-Tag? Google introduced the new X-Robots-Tag directive in 2007 to allow webmasters to control access to non-web page documents, such ...