[pspzockerscene]

I have the owner- and audio-ID but I do not know the request to get fresh links...
Via API, permissions are needed and we don't have them!

[djmakinera]

pspzockerscene -

API permissions - auth API with "audio" permission

[pspzockerscene]

I know.
Please stop posting parts of the puzzle.
If your "friend" knows something, either ask him to post it here or post it for him but please post something that actually helps us...

[djmakinera]

Spoiler:

I'm sorry :\ I write your post to him and my friend to answer your questions. I hope you understand?
Write the message (it would be better if you will converse with him on the Social Network.
If possible, write to him to chat:
Send a question here:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

No - you can do this as you're the one who needs the feature.

[djmakinera]

Wrote only this:

"scope" param
vk.com/dev/auth_mobile

Nothing more to help you with this. I do not have more information on it. Sorry!

[djmakinera]

Forum problem write "Russian name"
I added the name here
http://jdownloader.org/pastebin/133300


**External links are only visible to Support Staff****External links are only visible to Support Staff**

JD2 save file:

Spoiler:

[pspzockerscene]

What is the problem here?

[djmakinera]

Account is missing or "try restarting, plugin defect?"
Some link - not work (audio)

05.03.15 14.08.20to05.03.15 14.10.51 jdlog://3095196763241/
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Edit: 6.3.2015

Hi. pspzockerscne -

decrypt + add links <4800 Mega RAM ----> add1 link **External links are only visible to Support Staff****External links are only visible to Support Staff**
"C:\Program Files\Java\jre1.8.0_31\bin\javaw.exe" -Xmx4800M -jar Y:\JDownloader3\JDownloader.jar


Idle - 700MB - 1700 MB

high memory usage is only for decrypt + add links to a larger package
Avoid freezing applications and javaw crash
Please understand well that this problem only occurs when parse/crawling walls of the large amount of posts (100k post)
GUI crashed but still works in the background to decrypt and probably go to perform fully

Decrypted offset 120600 / 120602
05.03.15 18.46.47to05.03.15 23.25.47 jdlog://5277196763241

(Number of of links does not matter * Screenshot number 2)
Maybe to reduce memory usage CHANGE CODE?

Reached 5000 links per run limit
}
this.logger.info("Decrypted offset " + currentOffset + " / " + total_numberof_entries);
this.logger.info("Found " + this.decryptedLinks.size() + " links so far");
if (this.decryptedLinks.size() >= 5000)
{
this.logger.info("Reached 5000 links per run limit -> Returning link to continue");
DownloadLink loopBack = createDownloadlink(this.CRYPTEDLINK_FUNCTIONAL + "-maxoffset=" + total_numberof_entries + "-currentoffset=" + currentOffset);
fp.add(loopBack);
this.decryptedLinks.add(loopBack);
break;
}
currentOffset += 100;

Hmm? Reduced to:

Adding 50000+ links to one package

Up to 10,000 pictures per package
10000 + 10000 + 10000 + 10000 + 10000 ^.^ SPLIT

[pspzockerscene]

Hm I only tested it up to 25 000 links.
Memory usage increased from 190 to 550 MB and CPU stayed under 15%.
I fixed the "defect" bug for audio links.

[djmakinera]

When add a package to a single 30K-50K - high memory usage - 4.8 G and Out Of Memory...
Java not responding

Example:


400K link but small multi-packets = no problems
50K - 80K One or more very large package = the problem (but only if crawler added links to the package)

[pspzockerscene]

Please provide logs and wait for a response of jiaz.

[djmakinera]

I do not have logs. I deleted the logs.
I would have to analyze the walls again ... and create a NEW log

[pspzockerscene]

Well then please do this.

@jiaz
Just in case you check this: Simply use my vk account - you ll find it somewhere in closed vk related tickets.

[djmakinera]

Real memory usage (percentage or number)

always on top

If the load GUI - it is not possible to operate and can not be selected
"About JDownloader" and check memory usage.

Example:
In this picture - another program shows different values at the bottom of the window

[djmakinera]

FROZEN GUI


Private logfile:
Link Download:
http://jdownloader.org/pastebin/133312

[pspzockerscene]

Please wait for jiaz.
He will either help you tomorrow or on monday.

[djmakinera]

Okay...

Please see on the video.

Link Download VIDEO
http://jdownloader.org/pastebin/133313

[Jiaz]

JDownloader should not happen to "not possible to operate, not be selected".
I would like to check via JVisualvm and find out why it has so much memory need in your case.

[djmakinera]

See a video
Analysis time of 13 minutes and stopping critical.

logfile:
http://jdownloader.org/pastebin/133312

video:
http://jdownloader.org/pastebin/133313

Example link:

vk account - you ll find it somewhere in closed vk related tickets.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Soryy, I do not have a computer Java JDK.
But you can now reproduce the problem.