[heinrichb]

Hey JD team,

I'm experiencing a weird issue, where certain Reddit.com User profiles are not getting crawl. I had a quick look at the logs and it looks like the crawler does find some URLs, but somehow they do not get added.

An example URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**

[Jiaz]

@heinrichb: working fine here/can't reproduce any issue
have you setup a quick filter in linkgrabber right side? eg hide hide imgur?
have you setup any linkgrabber filter? eg blocking imgur or anything else that might cause this issue

Else please provide a debug log, see
https://support.jdownloader.org/Know...d-session-logs
Enable debug mode, restart JDownloader and try to add this link again and then create log and post logID here

[heinrichb]

Hey,

thanks for having a look.

No, I don't have much configured, it's basically a vanilla JD2 installation. With few Reddit plugins setting + packagizer rules.

Just testing a bit around here before sending logs. I noticed 2 things.

- I do have have set "crawl complete user profiles" set. Could you confirm that it's working for you with this setting as well?
- In the logs I noticed java.lang.NullPointerException at a very specific time in the crawl. This seems to be the post that generates the Exception **External links are only visible to Support Staff****External links are only visible to Support Staff** In fact just trying to add this link alone to JD doesn't work in throws the same Exception. Could you try if this link is working for you?

[Jiaz]

Originally Posted by heinrichb

- I do have have set "crawl complete user profiles" set. Could you confirm that it's working for you with this setting as well?

I have same default setting, yes

[Jiaz]

Originally Posted by heinrichb

- In the logs I noticed java.lang.NullPointerException at a very specific time in the crawl. This seems to be the post that generates the Exception

I can reproduce this one
Update: I can't stress enough that I hate unicode within a URL Will be fixed with next update

[Jiaz]

@heinrichb; most likely this causes the crawling to fail when other links have unicode in url as well. Please wait for plugin update