[verheiratet1952]

I just want to make one folder from many folders but NOT moving/copying files...

foldername is the same, just want to have one folder in downloadlist...

but it takes very long until I see anything happening !?
(no other activity like adding new links at linkgrabber or downloading etc...)


very long means 12-18 hours...

example:
first 3 folders from screenshot that are at about 21k 58k 36k files...

is there any fine-tuning necessary with advanced settings to make it work within 30min not 12-18 hours?

[verheiratet1952]

Originally Posted by verheiratet1952

I just want to make one folder from many folders but NOT moving/copying files...

foldername is the same, just want to have one folder in downloadlist...

but it takes very long until I see anything happening !?
(no other activity like adding new links at linkgrabber or downloading etc...)


very long means 12-18 hours...

example:
first 3 folders from screenshot that are at about 21k 58k 36k files...

is there any fine-tuning necessary with advanced settings to make it work within 30min not 12-18 hours?

@jiaz

if you want to check "a real world" for better understanding... I can send downloadList zip files

[pspzockerscene]

Hi,
So you want to move all of those packages into one single package?
1. Please post a screenshot of the "About dialog".
2. Please also check this article (see especially the end of that article which will also link to this one).

-psp-
EDIT

@verheiratet1952
Please use the "edit post" functionality of this forum instead of double-posting.
Thanks!

[verheiratet1952]

Originally Posted by pspzockerscene

Hi,
So you want to move all of those packages into one single package?
1. Please post a screenshot of the "About dialog".
2. Please also check **External links are only visible to Support Staff**... (see especially the end of that article which will also link to **External links are only visible to Support Staff**...).

-psp-
EDIT

@verheiratet1952
Please use the "edit post" functionality of this forum instead of double-posting.
Thanks!

here it is


by the way: I do assign 30gb of RAM manually using shortcut

[pspzockerscene]

Hm that looks good.
You can send your downloadlist to us via support@jdownloader.org.

Please do not expect an answer soon as Jiaz is very busy at this moment.

-psp-
EDIT

Out of curiosity:
How many items are in your downloadlist in total?

[verheiratet1952]

Originally Posted by pspzockerscene

Out of curiosity:
How many items are in your downloadlist in total?[/B]

in that special case it is only at about 800k image files... with just a few folders...

I can handle 4.3mio images with 85k folders with optimized JD settings...

(I have different sources of content, but with same configuration and settings it has different behavior...

different behavior not when talking about downloading or linkcrawling, that depends on website/server where content is crawled, but because of high RAM usage etc...)

[pspzockerscene]

Hm okay you're definitely a poweruser.
Please let Jiaz investigate this - I can't help you atm.

-psp-

[verheiratet1952]

Originally Posted by pspzockerscene

Hm okay you're definitely a poweruser.
-psp-

yes maybe
but it is just image crawling from different websites...

no encrypted links or archive extraction...

I can run 7 JD installs in parallel with 128gb RAM desktop PC...
the funny thing is that 4.2mio images work fine, but 800k images bring issues...



will send those downloadlist ZIP for testing in a real world these days...

[pspzockerscene]

Originally Posted by verheiratet1952

I can run 7 JD installs in parallel with 128gb RAM desktop PC...
the funny thing is that 4.2mio images work fine, but 800k images bring issues...

I never claimed you had a weak system

Depending on how single plugins are coded and/or how many properties of additional metadata a plugin is storing, such issues may also only happyn for specific websites e.g. twitter.com.

As explained, Jiaz can check this using your zipped downloadlist.

-psp-

[verheiratet1952]

Originally Posted by pspzockerscene

Hm that looks good.
You can send your downloadlist to us via support@jdownloader.org.

downloadlist ZIP has been sent

[verheiratet1952]

Originally Posted by pspzockerscene

Depending on how single plugins are coded and/or how many properties of additional metadata a plugin is storing, such issues may also only happyn for specific websites e.g. twitter.com.

-psp-

as I said before...

"no other activity like adding new links at linkgrabber or downloading etc..."


"different behavior not when talking about downloading or linkcrawling, that depends on website/server where content is crawled, but because of high RAM usage etc..."


"the funny thing is that 4.2mio images work fine, but 800k images bring issues..."


this thread is about merging (NOT copying or moving files) folders at downloadlist...


example:
if I want to merge 2 new empty folders with at about 150k and 80k image files - nothing downloaded yet, it takes nearly one day... (by the way running only a single JD install at the same time...)

[pspzockerscene]

Again:
Please use the "edit post" functionality which our forum provides instead of doing double-posts.
This makes threads more readable.
You can find the "edit" button on the right side of your existing post to the left of the buttons "Quote" and "Quote+".

Originally Posted by verheiratet1952

as I said before...

"no other activity like adding new links at linkgrabber or downloading etc..."

I've never claimed anything else.

The mentioned properties that plugins can store on links remain there permanently thus the more there are, the more RAM will be needed.
This doesn't affect most of all users as they never add a few thousand links at the same time (this is just my assumption).

Originally Posted by verheiratet1952

this thread is about merging (NOT copying or moving files) folders at downloadlist...
[...]
example:
if I want to merge 2 new empty folders with at about 150k and 80k image files - nothing downloaded yet, it takes nearly one day... (by the way running only a single JD install at the same time...)

Yap I understood that...

As explained please wait until Jiaz finds time to work on your request.

-psp-