[Jiaz]

Originally Posted by dominika992

I think there may be an issue with posts that have >1 image or more hmmm

Will be fixed with next plugin update

[pspzockerscene]

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Jambalaya]

I wonder if the way bdsmlr is presenting links has changed since the code for the plug-in was written? For example, if I paste **External links are only visible to Support Staff****External links are only visible to Support Staff** into LinkGrabber it finds 10 files. If I look at the blog archive **External links are only visible to Support Staff****External links are only visible to Support Staff** (which eliminates reposts from other blogs), I count 21 files.

Another example: **External links are only visible to Support Staff****External links are only visible to Support Staff** finds 16 files in LinkGrabber, but looking at the archive I counted 50+ files before I stopped counting manually.

The page seems to fetch more links when one scrolls to the bottom - was that part of the site design when the plug-in was written, or is that new?

[pspzockerscene]

Originally Posted by Jambalaya

I wonder if the way bdsmlr is presenting links has changed since the code for the plug-in was written?

Maybe it has changed slightly.

Originally Posted by Jambalaya

The page seems to fetch more links when one scrolls to the bottom - was that part of the site design when the plug-in was written, or is that new?

Yap the dynamic pagination has always been there.
I'll need to look into it. Most likely the website was slightly changed or your URLs go to content which the plugin can't handle properly yet.

[Jambalaya]

Sounds good. One other thing I have noticed is that server response time can vary quite a bit, from a second or two, on up to like 20 seconds on rare occasions so I wonder if the link scanner is timing out before the server has a chance to respond. Just a thought.

[pspzockerscene]

I can look into your logs if you want me to check it but from my quick tests it stops so fast that it's most likely a stop condition that is triggered falsely.

[pspzockerscene]

I was able to fix it.
This website is hell to parse as virtually anything can happen so it's hard to determine good stop conditions.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Jambalaya]

That's awesome, thank-you! So quick too.

[pspzockerscene]

Originally Posted by Jambalaya

So quick too.

Wait until updates get released.
Depending on some factors, that can take more time

However you can be sure that once those updates get released, this issue will be fixed.

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-

[dominika992]

It doesn't seem like fully working cuz crawling this
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Crawls like 150 imges while this blog has so much more

[pspzockerscene]

Fixed by adding support for post type "typelink": Posts containing external URLs.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[dominika992]

is it out now? I have core #48254.
or is it still not available?

it the fix is ON, then something may be still missing because it crawled only 359 from **External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

Fixed.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Jambalaya]

Since Thursday or Friday I have been having a strange issue with JDownloader where it is very slow to traverse the download list, and often pauses for a very long time between files. Around that time, I had a linkgrabber task that would not stop no matter how many times I told it to quit, so finally I quit JDownloader which caused me to receive all the latest updates. So I can't tell if this is:
a) some kind of corruption/confusion caused by the runaway linkgrabber task that I force halted
b) related to a core or plugin update
c) a curious timing coincidence related to some new ratelimiter that may have been implemented at bdsmlr

I created a log and added it here: 14.11.23 10.40.56 <--> 14.11.23 11.01.43 jdlog://6409311370661/

I think this log covers about 10 minutes of time, during which around 30 files were downloaded (set to 2 max connections per host) with long pauses between many of the files. Some files were not found, which also causes long pauses, and unfortunately there were no 'file already exists' as these seem to pause for exceedingly long times, multiple minutes for each duplicate file.

Let me know if you need further detail or if you'd prefer I start a new thread. Thanks!

[pspzockerscene]

This is just JDownloader waiting to terminate connections in a good way. I'd call it and old design weakness but either way you can't just prohibit it from happening.
Please provide example URLs so I can check if I can do anything about it.
It is definitely not related to any of the recent updates.

Either force restart it or disable / enable your network connection adapter - that should make it stop immediately.

[Jambalaya]

I rebooted the computer but download behavior is still the same. I timed one of the 'file not found' pauses at about 58 seconds, and uploaded a debug log here: 14.11.23 12.48.33 <--> 14.11.23 13.01.56 jdlog://0509311370661/

This is just a linkgrabber list taken from this blog, but seems to happen with all blogs: **External links are only visible to Support Staff****External links are only visible to Support Staff**

If I do a URL lookup on one 'file not found' entry I see this: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Sometimes if there are multiple valid files in a row, JD will download multiple (8-15) files successfully in rapid succession like it used to do for the entire package. Other times it just does 2 and then sits there before attempting the next.

[pspzockerscene]

I've downloaded all ~5000 items (~15GiB) within less than 10 minutes without this problem.
In total, 65 of 5187 items were offline.

[Jambalaya]

Thanks for taking the time to do that. Today I noticed that there were more JD updates available, and after applying them everything seems to be back to normal. Not sure what the root cause of my issue was, but all's well that ends well! Thanks for your assistance.

[pspzockerscene]

The updates released today did not touch any of the code related to the possible issue you had.

Thanks for the feedback anyways - let's hope it continues to work fine.