Quote:
Originally Posted by verheiratet1952
adding 8muses.com account does not make sense?
|
Yes it does:
Their forum attachments can only be accessed by registered and logged in users.
Quote:
Originally Posted by verheiratet1952
it is about those links like:
|
Works fine here.
For the first URL e.g. our crawler finds 10 results (pdf files) for me.
If it fails for you,r please provide a log.
Quote:
Originally Posted by verheiratet1952
I do have to add every link to be crawled by JD?
|
Yes.
Our current crawler is not designed to crawl multiple forum pages of this website.
Quote:
Originally Posted by verheiratet1952
why not be able to use any script or code to get all 'sub-pages' when adding main link
|
Sure you can code a script if you want.
-psp-