Re: [SLUG] htdig or other searchers

[telford@xxxxxxxxxxxxxxxxxxxxx]

On Sun, Jul 03, 2005 at 04:58:10PM +1000, David wrote:

> Does htdig go to the server (thereby parsing includes?). The site 
> navigates perfectly from a browser.

Yes, in my experience it does, there are entries in the access_log.
Beware if you are running virtual servers because usually it connects
to 127.0.0.1 (but that's configurable). Also it has filters based on
file type, usually it avoids all CGI references.

	- Tel