Hi All,

Does anyone know of any (free) software that can crawl a website I have created? I just need to produce a text file of all the pages on this site for seo purposes.

It's not a problem to type it all into notepad, but as there are many pages I thought I'd ask the question here to see if I could save time.

I've had a look on the net, but can't seem to find anything useful.

Any ideas would be very welcome.

Many thanks,

Dan.

---------------------------------------------
If I knew what I was doing, I'd be dangerous...

On windows I found a context-menu script that uses an old DOS trick to print a file listing to a TXT file! Was very handy, do a little Googling on that.

~ ~ ~ ~ ~ ~ ~
Chris Charlton <i>- DMXzone Manager</i>
<font size=1>[ Studio MX/MX2004 | PHP/ASP | SQL | XHTML/CSS | XML | Actionscript | Web Accessibility | MX Extensibility ]</font id=size1>

Hi Chris,

Many thanks. Googled it and there it was.

Seeing how useful this is, it amazes me that windows doesn't have something like this by default.

If anyone else is interested in this, I found the instructions here:

hacks.oreilly.com/pub/h/611

Thanks again Chris, you've saved me a mountain of typing!!!

Dan.

---------------------------------------------
If I knew what I was doing, I'd be dangerous...

Edited by - Danski on 11 May 2005 11:20:42