Форум Сайтостроение Веб-строительство

Robot.txt для WordPress

S2
На сайте с 15.11.2006
Offline
53
s1712
576

Добрый день.

Настраиваю robot.txt для сайта на WordPress. Пока вот как получается.

Что скажите? Посоветуете?

Заранее всем большое спасибо.

User-agent: *

Disallow: /cgi-bin

Disallow: /wp-admin/

Disallow: /wp-includes/

Disallow: /wp-content/plugins/

Disallow: /wp-content/cache/

Disallow: /wp-content/themes/

Disallow: /wp-trackback

Disallow: /wp-feed

Disallow: /wp-comments

Disallow: /category/

Disallow: /author/

Disallow: /page/

Disallow: /20*

Disallow: */trackback

Disallow: */comments

Disallow: /*.php

User-agent: Yandex

Disallow: /cgi-bin

Disallow: /wp-admin/

Disallow: /wp-includes/

Disallow: /wp-content/plugins/

Disallow: /wp-content/cache/

Disallow: /wp-content/themes/

Disallow: /wp-trackback

Disallow: /wp-feed

Disallow: /wp-comments

Disallow: /category/

Disallow: /author/

Disallow: /page/

Disallow: /20*

Disallow: */trackback

Disallow: */comments

Disallow: /*.php

Host: www.example.ru

Sitemap: http://www.example.ru/sitemap.xml

G
На сайте с 12.09.2011
Offline
33
Glocc
#1

User-agent: *

Disallow: /cgi-bin/

Disallow: /downloads/

Disallow: /wp-login.php

Disallow: /wp-admin

Disallow: /wp-includes/

Disallow: /xmlrpc.php

Disallow: /wp-content/plugins/

Disallow: /wp-content/cache

Disallow: /wp-content/themes

Disallow: /wp-register.php

Disallow: /archive/

Disallow: /author

Disallow: /trackback

Disallow: /feed

Disallow: /comments

Disallow: /?feed=

Disallow: */trackback

Disallow: */feed

Disallow: */comments

Disallow: /tag*/

Disallow: /?s=

Disallow: /*?*

Disallow: /*?

# Google Image

User-agent: Googlebot-Image

Disallow:

Allow: /*

User-agent: Yandex

Disallow: /cgi-bin/

Disallow: /wp-login.php

Disallow: /wp-register.php

Disallow: /wp-includes/

Disallow: /xmlrpc.php

Disallow: /wp-admin

Disallow: /wp-content/plugins

Disallow: /wp-content/themes

Disallow: /archive

Disallow: /tag/

Disallow: /trackback/

Disallow: /feed/

Disallow: /comments/

Disallow: */trackback/

Disallow: */feed/

Disallow: */comments/

Disallow: /?feed=

Disallow: /?s=

Disallow: /*?*

Disallow: /*?

Хоккейный блог (http://hockeys.ru/)

Авторизуйтесь или зарегистрируйтесь, чтобы оставить комментарий