SLUG Mailing List Archives - Re: [SLUG] Spider a website

To: Mary Gardiner <mary@xxxxxxxxxxxx>
Subject: Re: [SLUG] Spider a website
From: Ycros <waikurosu@xxxxxxxxx>
Date: Tue, 3 Jun 2008 15:26:03 +1000
Cc: slug@xxxxxxxxxxx
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to:in-reply-to:content-type:content-transfer-encoding:mime-version:subject:date:references:x-mailer; bh=CvBYCE5WiTy+7eHxtHxqHov63K8GozALmDYxpdHx9DA=; b=AFZv8mjHNvYyovg4AolZGhbd+XOnm4M+yJEbq49pkXJf1yWJMwXaJB/Lw3ohcgQFXgv/Tkr0Kxhg/85eAjtWhSV9/bMWfPD12vme1pS+iTSU4WepuQGX9mIvTN6bRrol3r/GEd8MnRZWQezkpEhRwaWUT+ADnpsL5BBPoDqkfjk=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type:content-transfer-encoding:mime-version:subject:date:references:x-mailer; b=lp5ptNir+uFaFvy5kBb796RtmTgiDAStftM/hA+QBJ9H1ndVnPRyt7iSUouajhg8GW9gnbBkufBl4YvcsZ4Gcua6c4SNt7rA8FOXMvSaiUGcNXNfHzqQI/a+FUlTb8lWhMzZMnzQ+VUKeagwUOQMCEgzs6RaoXHIgqOXvwb+2nw=

On 03/06/2008, at 3:19 PM, Mary Gardiner wrote:

On Tue, Jun 03, 2008, Ycros wrote:

It's not always perfect however, as it can sometimes mess the URLsup,
but it's worth a try anyway.


The -k option to convert any absolute paths to relative ones can be
helpful with this (depending on what you meant by "mess the URLs up").

I think it was URLs in stylesheets and in javascript (well, there'snot much you can do with the javascript really)

References:
- [SLUG] Spider a website
  - From: Peter Rundle
- Re: [SLUG] Spider a website
  - From: Ycros
- Re: [SLUG] Spider a website
  - From: Mary Gardiner