RewriteEngine on
RewriteCond %{HTTP:User-Agent} ^.*Googlebot.*$ [NC]
RewriteRule ^/?$ [NC,NE]
OR
RewriteEngine on
RewriteCond %{HTTP:User-Agent} ^.*Googlebot.*$ [OR]
RewriteCond %{HTTP:User-Agent} ^.*msnbot.*$ [NC]
RewriteRule ^/?$ [NC,NE]
百度的蜘蛛名叫Baiduspider
GOOGLE的蜘蛛名叫googlebot
YAHOO的蜘蛛名叫 Yahoo!+Slurp+China
bind 的蜘蛛名叫 msnbot
阅读(540) | 评论(0) | 转发(0) |