Monday, July 4, 2005

How can I prevent my public JSP page from appearing within the search engine

There are two ways of achieving it:
  • You can add a meta tag to the generated HTML content indicating that the page must not be indexed by the search engine's spider.
<meta name="robots" content="noindex">
  • put a file robots.txt at the root of your site, that is /robots.txt. In that file you can configure certain sections of your site to be skipped by crawling bots:
# All robots will spider the domain
User-agent: *
Disallow: /path/of/files/or/documents/to/deny

1 comment:

Anonymous said...

I didnt find thing that i need... :-(


Popular Posts (Last 30 days)

This is a personal blog and I do not speak for my employer.