Глубина просмотра сайта роботом

Из Хелпа Алтависты:
14. How deep do you go on a Web site?
AltaVista may not visit all pages included in your Web site.
Your Web design may block our crawlers from some pages.
In addition, due to the rapid growth of the Web, our crawlers
may not visit pages several levels down in your site hierarchy.
Put the most important information high in your site hierarchy
and be sure your top pages contain links to other important pages.
You can submit your most important pages on our Submit a Site page.