JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 27.01.2022, 16:36
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default make one folder from many folders but NOT moving/copying files

I just want to make one folder from many folders but NOT moving/copying files...

foldername is the same, just want to have one folder in downloadlist...

but it takes very long until I see anything happening !?
(no other activity like adding new links at linkgrabber or downloading etc...)


very long means 12-18 hours...

example:
first 3 folders from screenshot that are at about 21k 58k 36k files...

is there any fine-tuning necessary with advanced settings to make it work within 30min not 12-18 hours?
Attached Images
File Type: png files-folders-downloadlist.PNG (5.9 KB, 2 views)
Reply With Quote
  #2  
Old 27.01.2022, 17:06
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default

Quote:
Originally Posted by verheiratet1952 View Post
I just want to make one folder from many folders but NOT moving/copying files...

foldername is the same, just want to have one folder in downloadlist...

but it takes very long until I see anything happening !?
(no other activity like adding new links at linkgrabber or downloading etc...)


very long means 12-18 hours...

example:
first 3 folders from screenshot that are at about 21k 58k 36k files...

is there any fine-tuning necessary with advanced settings to make it work within 30min not 12-18 hours?


@jiaz

if you want to check "a real world" for better understanding... I can send downloadList zip files
Reply With Quote
  #3  
Old 27.01.2022, 17:06
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 62,017
Default

Hi,
So you want to move all of those packages into one single package?
1. Please post a screenshot of the "About dialog".
2. Please also check this article (see especially the end of that article which will also link to this one).

-psp-
EDIT

@verheiratet1952
Please use the "edit post" functionality of this forum instead of double-posting.
Thanks!
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #4  
Old 27.01.2022, 17:18
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default

Quote:
Originally Posted by pspzockerscene View Post
Hi,
So you want to move all of those packages into one single package?
1. Please post a screenshot of the "About dialog".
2. Please also check **External links are only visible to Support Staff**... (see especially the end of that article which will also link to **External links are only visible to Support Staff**...).

-psp-
EDIT

@verheiratet1952
Please use the "edit post" functionality of this forum instead of double-posting.
Thanks!
here it is


by the way: I do assign 30gb of RAM manually using shortcut
Attached Images
File Type: png jd-about-gwm.PNG (6.8 KB, 1 views)

Last edited by verheiratet1952; 27.01.2022 at 17:22.
Reply With Quote
  #5  
Old 27.01.2022, 17:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 62,017
Default

Hm that looks good.
You can send your downloadlist to us via support@jdownloader.org.

Please do not expect an answer soon as Jiaz is very busy at this moment.

-psp-
EDIT

Out of curiosity:
How many items are in your downloadlist in total?
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #6  
Old 27.01.2022, 23:56
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default

Quote:
Originally Posted by pspzockerscene View Post

Out of curiosity:
How many items are in your downloadlist in total?[/B]

in that special case it is only at about 800k image files... with just a few folders...

I can handle 4.3mio images with 85k folders with optimized JD settings...

(I have different sources of content, but with same configuration and settings it has different behavior...

different behavior not when talking about downloading or linkcrawling, that depends on website/server where content is crawled, but because of high RAM usage etc...)
Reply With Quote
  #7  
Old 28.01.2022, 12:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 62,017
Default

Hm okay you're definitely a poweruser.
Please let Jiaz investigate this - I can't help you atm.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #8  
Old 30.01.2022, 02:00
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default

Quote:
Originally Posted by pspzockerscene View Post
Hm okay you're definitely a poweruser.
-psp-

yes maybe
but it is just image crawling from different websites...

no encrypted links or archive extraction...

I can run 7 JD installs in parallel with 128gb RAM desktop PC...
the funny thing is that 4.2mio images work fine, but 800k images bring issues...



will send those downloadlist ZIP for testing in a real world these days...
Reply With Quote
  #9  
Old 31.01.2022, 15:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 62,017
Default

Quote:
Originally Posted by verheiratet1952 View Post
I can run 7 JD installs in parallel with 128gb RAM desktop PC...
the funny thing is that 4.2mio images work fine, but 800k images bring issues...
I never claimed you had a weak system

Depending on how single plugins are coded and/or how many properties of additional metadata a plugin is storing, such issues may also only happyn for specific websites e.g. twitter.com.

As explained, Jiaz can check this using your zipped downloadlist.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #10  
Old 01.02.2022, 02:06
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default

Quote:
Originally Posted by pspzockerscene View Post
Hm that looks good.
You can send your downloadlist to us via support@jdownloader.org.

downloadlist ZIP has been sent
Reply With Quote
  #11  
Old 01.02.2022, 02:12
verheiratet1952 verheiratet1952 is offline
Black Hole
 
Join Date: Jan 2016
Posts: 262
Default

Quote:
Originally Posted by pspzockerscene View Post
Depending on how single plugins are coded and/or how many properties of additional metadata a plugin is storing, such issues may also only happyn for specific websites e.g. twitter.com.

-psp-
as I said before...

"no other activity like adding new links at linkgrabber or downloading etc..."


"different behavior not when talking about downloading or linkcrawling, that depends on website/server where content is crawled, but because of high RAM usage etc..."


"the funny thing is that 4.2mio images work fine, but 800k images bring issues..."


this thread is about merging (NOT copying or moving files) folders at downloadlist...


example:
if I want to merge 2 new empty folders with at about 150k and 80k image files - nothing downloaded yet, it takes nearly one day... (by the way running only a single JD install at the same time...)
Reply With Quote
  #12  
Old 01.02.2022, 13:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 62,017
Default

Again:
Please use the "edit post" functionality which our forum provides instead of doing double-posts.
This makes threads more readable.
You can find the "edit" button on the right side of your existing post to the left of the buttons "Quote" and "Quote+".

Quote:
Originally Posted by verheiratet1952 View Post
as I said before...

"no other activity like adding new links at linkgrabber or downloading etc..."
I've never claimed anything else.

The mentioned properties that plugins can store on links remain there permanently thus the more there are, the more RAM will be needed.
This doesn't affect most of all users as they never add a few thousand links at the same time (this is just my assumption).

Quote:
Originally Posted by verheiratet1952 View Post
this thread is about merging (NOT copying or moving files) folders at downloadlist...
[...]
example:
if I want to merge 2 new empty folders with at about 150k and 80k image files - nothing downloaded yet, it takes nearly one day... (by the way running only a single JD install at the same time...)
Yap I understood that...

As explained please wait until Jiaz finds time to work on your request.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 04:14.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.