Hi

When trying to download multiple files (3000, with each file being around 1-3mb), I get: "An Error Occured! (aws hosting code). While every file was previously online during the linkgrabber, when I try and download it then shows the availability to be offline.

When I break it down to 500 file blocks, everything works fine. Any ideas on why this is happening? Is Amazon throttling my downloads?

thanks!

[raztoki]

probably 'some connection limit / some time period',

what sort of max sim dls and max chunks are you using?

if you could provide the list of links (paste into pastebin service http://jdownloader.org/pastebin/)
and your logs for that session it should help identify time parameters, and the error response.

http://jdownloader.org/knowledge/wik...d-log?s=lng_en (scroll down for JDownloader 2.0 guide)


raztoki

Hi

Thanks for looking into this:

Max Chunks per download = 1
Max sim downloads = 2

http://jdownloader.org/pastebin/134264

deleted log file

Couldn't upload to the pastebin; they asked to find a supporter?

[raztoki]

Upload to our pastebin, then copy the url (it will say .org/pastebin/number123). Only supporters can view this.

raztoki

ahh....got it.

here's the bin link:
http://jdownloader.org/pastebin/134264

thanks!

[raztoki]

directhttp plugin took the download, it failed I assume because the link expires after time or IP change

did you just add these links yourself or from deepanalyse?

raztoki

[Jiaz]

we should add a plugin to refresh token/session of the image

Hi

I just copied the links (webpage URL) and run them through 'deep analyse' to see if it can find the download file. When you do it for an individual link (or up to 500 links) it works fine; that is it finds the download for each URL. Then if you try and download 500 files, it also works fine.

Issue begins when I try and download 1000+ files; the first 500 or so start of fine (i.e download is found from URL by deep analyse + I successfully get the download). Then after 500 files or so all the remaining files begin to "Error" out and it shows the file going offline.

The URL doesn't expire (its the webpage) and the also filename doesn't change over time. Not sure what you mean by IP change outside of perhaps Amazon blocking my IP from downloading more than 500+ files at a time?

thanks!

[raztoki]

in the image url, has a expire token and session id both can be dynamic. Hence why I'm of the opinion that dedicated plugin is required to handle these link types. The volume of downloads probably relates to triggering time in which older links expire before download.

No as in your IP address changes between the time the session links are made for your IP. Changing IP could result in all the generated links not been valid and getting the 403 forbidden response code.

raztoki

[pspzockerscene]

Added support for tookapic.com.
---

[Please read]=>How/when do I get updates?
Read it carefully BEFORE complaining that something would still be not working!
Update cycles depend on your installed JD version!!

---
[Bitte lesen]=>Wie/wann bekomme ich Updates?
Bitte vollständig lesen bevor ihr euch beschwert, dass etwas immernoch nicht funktionieren würde!
Die Updatezyklen variieren je nach installierter JD Version!!

GreeZ pspzockerscene