JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 03.11.2023, 19:04
lakers24kobe lakers24kobe is offline
Baby Loader
 
Join Date: Jan 2022
Posts: 5
Default Webtoons plugin needs some fixes

Hello,

the plugin is not working correctly.
It only crawls partial links from the menu sometimes.
If there were 70 episodes, I must paste the menu link to JDownloader more than 10 times, trying to get the links for all episodes.

And the other issue is that the plugin only crawls the first 10 pages of the menu, it won't crawl the rest of the pages.

Thank you for your hard work!

Spoiler:

Example link for the first issue:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Example link for the second issue:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
(There are 170+ episodes, and the plugin only gets 100 episodes from the first 10 pages and couldn't crawl the rest of the pages.)
Reply With Quote
  #2  
Old 07.11.2023, 14:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Hi again lakers24kobe,
I can't reproduce any of your reported issues so my guess is that you ran into a rate-limit.

To look into this deeper, I'd need a debug-log.

For now I've limited the number of concurrent crawl processing instances of this plugin to 1 to try to avoid running into this problem.
When I'm adding your 2nd URL, I get 175 packages with a total of 7920 links.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 08.11.2023, 01:15
lakers24kobe lakers24kobe is offline
Baby Loader
 
Join Date: Jan 2022
Posts: 5
Default

Hi,

I tried for a few links, but it's still the same situation.
I've uploaded the log.
Log ID:08.11.23 05.03.30 <--> 08.11.23 07.11.45 jdlog://8888311370661/
Reply With Quote
  #4  
Old 08.11.2023, 10:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

Your log looks fine.
Please explain what you mean by "it's still the same situation".

Also please do the following:
1. Restart JD.
2. Add only the 2nd URL of your initial post.
3. Wait until processing is completed, then upload a log of only the current JDownloader session and post that fresh LogID here.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 08.11.2023, 15:45
lakers24kobe lakers24kobe is offline
Baby Loader
 
Join Date: Jan 2022
Posts: 5
Default

This is the LogID you ask:
08.11.23 21.20.50 <--> 08.11.23 21.24.08 jdlog://0098311370661/

Quote:
Please explain what you mean by "it's still the same situation".
It was still missing some episodes sometimes when I tested it last time, but it works fine mostly now.
I tested the link below three times, and it's missing different episodes each time.
Spoiler:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

And here's the log when I tested it:
08.11.23 21.35.57 <--> 08.11.23 21.38.57 jdlog://1098311370661/
Reply With Quote
  #6  
Old 08.11.2023, 16:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,499
Default

I've found the rate limit error in your log and added errorhandling so you will get feedback on such failures so you can try again later yourself.

I still wasn't able to reproduce the problem here so I guess your IP or GEO-location in general is limited a bit more by them serverside.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 23:17.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.