JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #21  
Old 30.06.2021, 18:56
RedViper RedViper is offline
Fibre Channel User
 
Join Date: Apr 2016
Location: Mexico
Posts: 126
Default

Quote:
Originally Posted by Jiaz View Post
@RedViper: flushing DNS -> most likely next time JDownloader tries to download the image another server/IP will be used. It will work until you've hit rate/request limit on that server again.


how many? rough estimated number? maybe you can send us example links so we can try to reproduce the issue.
we might try to set a request limit to avoid this issue
After my last reply I saw that you had already answered me again.

Apparently it is when I download too many pictures, it only happens with the pictures. After about 10 minutes or so the error disappears and all the images start to download again.

But it happens with any type of link image with twitter, after downloading several more than 20 at the same time [one by one].
__________________
- Ramón V M
Reply With Quote
  #22  
Old 30.06.2021, 18:58
RedViper RedViper is offline
Fibre Channel User
 
Join Date: Apr 2016
Location: Mexico
Posts: 126
Default

Quote:
Originally Posted by Jiaz View Post
With next plugin update, I've set a request limit of 4 requests/second
It must have something to do with it, but it still seems very strange to me because it is something that had not appeared before this week.



Thanks again!
__________________
- Ramón V M
Reply With Quote
  #23  
Old 30.06.2021, 19:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,116
Default

Wait for next update and check if it helps
__________________
JD-Dev & Server-Admin
Reply With Quote
  #24  
Old 30.06.2021, 19:13
RedViper RedViper is offline
Fibre Channel User
 
Join Date: Apr 2016
Location: Mexico
Posts: 126
Default

Quote:
Originally Posted by Jiaz View Post
Wait for next update and check if it helps
Excellent! Really, thank you very much!
__________________
- Ramón V M
Reply With Quote
  #25  
Old 30.06.2021, 19:25
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,116
Default

Update is live. Hit update button and restart JDownloader
__________________
JD-Dev & Server-Admin
Reply With Quote
  #26  
Old 30.06.2021, 20:20
RedViper RedViper is offline
Fibre Channel User
 
Join Date: Apr 2016
Location: Mexico
Posts: 126
Default

Quote:
Originally Posted by Jiaz View Post
Update is live. Hit update button and restart JDownloader
As soon as I tried with a bunch of pictures all were stop by the error

Then I tried again with only 3 and the same thing happened

I waited and deleted the links

I tried again with this picture

**External links are only visible to Support Staff****External links are only visible to Support Staff**

30.06.21 11.58.49 <--> 30.06.21 12.09.23 jdlog://5324825302851/

And after some minutes I was able to downloaded it

I tried with more images and nothing bad happened

What makes me think that on my first attempt the error came up and then it is no longer that it must be a problem with the Twitter servers

The first attempt with the new update list of links I could not download them, I came out with the error and better I deleted them. And then mysteriously no longer even if there were many images.

Try again with a list of images and failed. I deleted the links and immediately try again and suddenly I was able

**External links are only visible to Support Staff****External links are only visible to Support Staff**

30.06.21 11.58.49 <--> 30.06.21 12.18.20 jdlog://6324825302851/

:confused:

I don't think it has to do with JDownloader but with Twitter, because this doesn't make much sense
__________________
- Ramón V M
Reply With Quote
  #27  
Old 01.07.2021, 19:59
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,116
Default

@RedViper: Try again with next update. There was a misstake in my rate limiter.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #28  
Old 02.07.2021, 07:38
RedViper RedViper is offline
Fibre Channel User
 
Join Date: Apr 2016
Location: Mexico
Posts: 126
Default

Thank you so much, Jiaz!

At the beginning I tried all these links and everything was perfect:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**


But I really wanted to know if the error no longer appeared and I tried these:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

And then the error appeared

But this time, unlike the other times, the error did not last more than 5 minutes

01.07.21 23.20.40 <--> 01.07.21 23.37.55 jdlog://4134825302851/
__________________
- Ramón V M
Reply With Quote
  #29  
Old 02.07.2021, 10:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,683
Default

I'm sorry but we won't be able to prohibit their rate-limiting (error 503) 100% from kicking in.

For me e.g. it does not happen at all...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #30  
Old 02.07.2021, 11:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,116
Default

@RedViper: with next plugin update I tried to further reduce the requests being made
__________________
JD-Dev & Server-Admin
Reply With Quote
  #31  
Old 03.07.2021, 08:54
RedViper RedViper is offline
Fibre Channel User
 
Join Date: Apr 2016
Location: Mexico
Posts: 126
Cool

With the last update I have been downloading images for more than an hour and the error has not appeared once!

Thanks so much, Jiaz! Now JDownloader has returned to be the best software also to download content on Twitter
__________________
- Ramón V M
Reply With Quote
  #32  
Old 05.07.2021, 06:22
Terrowin Terrowin is offline
Modem User
 
Join Date: Jul 2021
Posts: 2
Default

Sorry for posting in a thread marked solved but I believe I'm experiencing the same issue; however for me it's still ongoing even with the latest updates. As of the latest update Twitter has stopped working entirely for me.

Add links using link grabber, use packagerizer to format the filename and save directory, hit start downloads, download errors out "An error occurred! (twitter.com) File not found"

04.07.21 23.04.06 <--> 04.07.21 23.04.05 jdlog://1444825302851/

If this is a separate issue or you need additional troubleshooting let me know what I can do to help.

Edit: I should also note my issue was similar to previous posts; when downloading too many it would error or if I waited a while it would work again. Right now I've tried with one link after ten hours and it still fails.

Edit 2: Tried again out of habit and found that it did work, sort of. When adding 9 links the 4th in the set had the same error "An error occurred! (twitter.com) File already exists", the other 8 added at the same time through linkgrabber downloaded without issue. I then reset my 200ish failed links and tried those again, but all of those failed instantly.

04.07.21 23.04.06 <--> 05.07.21 01.05.38 jdlog://5444825302851/

Edit 3: I tried removing the packages completely instead of resetting them which has mostly good results but still mixed. Out of 276 links 29 had the same error.

Last edited by Terrowin; 05.07.2021 at 08:20. Reason: Additional info
Reply With Quote
  #33  
Old 05.07.2021, 12:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,683
Default

@Terrowin
Please post some example URLs that you are unable to download and please post a debug log (enable debug mode first, see log help article).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #34  
Old 06.07.2021, 17:10
Terrowin Terrowin is offline
Modem User
 
Join Date: Jul 2021
Posts: 2
Default

Seems like I cant replicate the issue anymore, sorry for wasting your time.

Resetting the packages would get the same error, but completely removing the packages and recreating them through link grabber got those links working again for the bulk of those 276 twitter URLs. For the remainder there were a mix of some that I had downloaded manually, some that were unavailable (author deleted), and only a few that seemed to fail for no reason. Those last few I got to work by deleting their packages and retrying them from scratch again.
Reply With Quote
  #35  
Old 06.07.2021, 17:28
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,116
Default

@Terrowin: You've added the failed Links (LinkCrawlerRetry) to the download list. Those links are not working and you cannot make them work, I'm sorry but you will have to readd those. sorry for late response about that
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 00:10.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.