JDownloader Community - Appwork GmbH
 

Reply
Page 3 of 5 12 3 45
 
Thread Tools Display Modes
  #41  
Old 02.11.2016, 15:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
Here is the answer
https://board.jdownloader.org/showpo...2&postcount=11
__________________
JD-Dev & Server-Admin
Reply With Quote
  #42  
Old 02.11.2016, 15:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
Please answer my question in the link
__________________
JD-Dev & Server-Admin
Reply With Quote
  #43  
Old 02.11.2016, 16:01
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
Quote:
Originally Posted by Jiaz View Post
Before the update:
Write 500 mbyte to memory and then begin to write to disk
->result: 0 byte file written, broken list

Now:
Directly write to disk with smaller buffer (1 Mbyte max)
-> result: file size depends how long JDownloader before it gets killed, broken list

1. Before the update:
You're wrong. Do not broken list. Please understand this.
a) Broken only
Code:
XXXX.zip.backup (ONLY broken)
Code:
XXXX.zip Do not broken list !!!. A list of links is still intact!) even cutt off Power or kill javaw.exe !!!, it does not matter.
2. Now:
List of Links
Code:
XXXX.zip (broken)
Code:
XXXX.zip.backup (broken)
may be damaged after the restart the application during startup.
Reply With Quote
  #44  
Old 02.11.2016, 16:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
And yet no answers to my questions!

JDownloader does not create a .backup file of an empty (zero byte/broken) file
Nothing has changed. You still suffer from the same issue as before.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #45  
Old 02.11.2016, 16:04
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
Please STOP trying to explain that this is something different before because I've explained if often enough that it is the SAME issue as before.

HOW do you close/restart JDownloader. I cannot reproduce this even with 1mio links and 20k packages. YOU ARE THE ONLY ONE HAVING THIS ISSUE
__________________
JD-Dev & Server-Admin
Reply With Quote
  #46  
Old 02.11.2016, 16:10
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
1. Before the update:
CollectorLink.zip (650 MB)
Code:
kill javaw.exe
archive NOT(!) damaged
Code:
cutt off Power Suply
archiveNOT(!) damaged
-------------------------------------------------
ClollectorLink.zip.backup 0Byte
I tested 10 times!


2. "Correct" Restart JD2
CollectorLink.zip
damaged archive 1-2MB

CollectorLink.zip.backup
damaged archive 1-2MB
Reply With Quote
  #47  
Old 02.11.2016, 16:13
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
Quote:
Originally Posted by Jiaz View Post

Do you close JD normally or shutdown Computer?
Ctrl+Shift+R (Re-Start/Re-Run JD2)
Reply With Quote
  #48  
Old 02.11.2016, 16:20
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
I do not know what to answer you. I'm not an expert in this field.


I will not update the core. I can have even 10.000.000 (10 M) Old Core links and list of still not damaged :D (I'm not talking about the zip.backup)

---------------------
Please write how many supports JD2 links (NEW Core)
I will not exceed this limit the capabilities of applications, so it should be ok.
Reply With Quote
  #49  
Old 02.11.2016, 16:24
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
Send log, but it does not contain the necessary info error, the need for better handling log why this happens.
Reply With Quote
  #50  
Old 02.11.2016, 16:28
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
but I'm not talking about backup (about storing the list!)
I know zero, and so what?
Reply With Quote
  #51  
Old 02.11.2016, 16:31
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
Quote:
even with 1mio links
How much time do you need to correct application has been restarted?
Reply With Quote
  #52  
Old 02.11.2016, 16:36
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
How to restart the application safely without losing all collect links

http://www.imagebam.com/image/c0b04d512906076
Reply With Quote
  #53  
Old 02.11.2016, 17:11
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default Broken LinkList: Caused by: java.io.EOFException: Unexpected end of ZLIB input stream
Bug!
Still do not believe me?
Still I'm lying?

02.11.16 15.47.06 <--> 02.11.16 16.10.02 jdlog://5102881887641/

Code:
------------------------Thread: 44:jd.controlling.linkcollector.LinkCollector.log-----------------------
--ID:44TS:1478098028596-16-11-02 15:47:08 -  [jd.controlling.linkcollector.LinkCollector(findAvailableCollectorLists)] -> Collect Lists
--ID:44TS:1478098028606-16-11-02 15:47:08 -  [jd.controlling.linkcollector.LinkCollector(findAvailableCollectorLists)] -> Lists: [C:\JDownloader2\cfg\linkcollector1534.zip, C:\JDownloader2\cfg\linkcollector1533.zip, C:\JDownloader2\cfg\linkcollector1531.zip, C:\JDownloader2\cfg\linkcollector1530.zip]
--ID:44TS:1478098036321-16-11-02 15:47:16 -  [] -> org.appwork.storage.JSonMapperException: java.io.EOFException: Unexpected end of ZLIB input stream
	at org.appwork.storage.jackson.JacksonMapper.inputStreamToObject(JacksonMapper.java:179)
	at jd.controlling.linkcollector.LinkCollector.loadFile(LinkCollector.java:2121)
	at jd.controlling.linkcollector.LinkCollector.load(LinkCollector.java:2012)
	at jd.controlling.linkcollector.LinkCollector.access$4000(LinkCollector.java:135)
	at jd.controlling.linkcollector.LinkCollector$16.run(LinkCollector.java:1766)
	at jd.controlling.linkcollector.LinkCollector$16.run(LinkCollector.java:1753)
	at org.appwork.utils.event.queue.QueueAction.start(QueueAction.java:202)
	at org.appwork.utils.event.queue.Queue.startItem(Queue.java:491)
	at org.appwork.utils.event.queue.Queue.runQueue(Queue.java:425)
	at org.appwork.utils.event.queue.QueueThread.run(QueueThread.java:64)
Caused by: java.io.EOFException: Unexpected end of ZLIB input stream
	at java.util.zip.InflaterInputStream.fill(Unknown Source)
	at java.util.zip.InflaterInputStream.read(Unknown Source)
	at java.util.zip.ZipInputStream.read(Unknown Source)
	at jd.controlling.linkcollector.LinkCollector$22.read(LinkCollector.java:2079)
	at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.ensureLoaded(ByteSourceJsonBootstrapper.java:489)
	at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.detectEncoding(ByteSourceJsonBootstrapper.java:126)
	at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.constructParser(ByteSourceJsonBootstrapper.java:215)
	at com.fasterxml.jackson.core.JsonFactory._createParser(JsonFactory.java:1238)
	at com.fasterxml.jackson.core.JsonFactory.createParser(JsonFactory.java:807)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2874)
	at org.appwork.storage.jackson.JacksonMapper.inputStreamToObject(JacksonMapper.java:170)
	... 9 more

--ID:44TS:1478098036321-16-11-02 15:47:16 -  [jd.controlling.linkcollector.LinkCollector(loadFile)] -> Entry:00963_0874|Size:-1|Compressed Size:-1
--ID:44TS:1478098036321-16-11-02 15:47:16 -  [jd.controlling.linkcollector.LinkCollector(load)] -> Could backup C:\JDownloader2\cfg\linkcollector1534.zip<to>C:\JDownloader2\cfg\linkcollector1534.zip.backup
--ID:44TS:1478098036322-16-11-02 15:47:16 -  [] -> java.io.IOException: org.appwork.storage.JSonMapperException: java.io.EOFException: Unexpected end of ZLIB input stream
	at jd.controlling.linkcollector.LinkCollector.loadFile(LinkCollector.java:2227)
	at jd.controlling.linkcollector.LinkCollector.load(LinkCollector.java:2012)
	at jd.controlling.linkcollector.LinkCollector.access$4000(LinkCollector.java:135)
	at jd.controlling.linkcollector.LinkCollector$16.run(LinkCollector.java:1766)
	at jd.controlling.linkcollector.LinkCollector$16.run(LinkCollector.java:1753)
	at org.appwork.utils.event.queue.QueueAction.start(QueueAction.java:202)
	at org.appwork.utils.event.queue.Queue.startItem(Queue.java:491)
	at org.appwork.utils.event.queue.Queue.runQueue(Queue.java:425)
	at org.appwork.utils.event.queue.QueueThread.run(QueueThread.java:64)
Caused by: org.appwork.storage.JSonMapperException: java.io.EOFException: Unexpected end of ZLIB input stream
	at org.appwork.storage.jackson.JacksonMapper.inputStreamToObject(JacksonMapper.java:179)
	at jd.controlling.linkcollector.LinkCollector.loadFile(LinkCollector.java:2121)
	... 8 more
Caused by: java.io.EOFException: Unexpected end of ZLIB input stream
	at java.util.zip.InflaterInputStream.fill(Unknown Source)
	at java.util.zip.InflaterInputStream.read(Unknown Source)
	at java.util.zip.ZipInputStream.read(Unknown Source)
	at jd.controlling.linkcollector.LinkCollector$22.read(LinkCollector.java:2079)
	at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.ensureLoaded(ByteSourceJsonBootstrapper.java:489)
	at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.detectEncoding(ByteSourceJsonBootstrapper.java:126)
	at com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.constructParser(ByteSourceJsonBootstrapper.java:215)
	at com.fasterxml.jackson.core.JsonFactory._createParser(JsonFactory.java:1238)
	at com.fasterxml.jackson.core.JsonFactory.createParser(JsonFactory.java:807)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2874)
	at org.appwork.storage.jackson.JacksonMapper.inputStreamToObject(JacksonMapper.java:170)
	... 9 more

--ID:44TS:1478098083344-16-11-02 15:48:03 -  [jd.controlling.linkcollector.LinkCollector$16(run)] -> CollectorList found: 10553/1157112
Reply With Quote
  #54  
Old 02.11.2016, 17:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
This stacktrace is about loading. Again and again, how often should I explain.

Before: the file was empty. Now: the file is incomplete. Both were broken!

I've told you to stop this and ANSWER my questions
__________________
JD-Dev & Server-Admin
Reply With Quote
  #55  
Old 02.11.2016, 17:38
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
Let us do a teamviewer session. I'm not able to reproduce this. It must have something to do with your setup/system.

Send me ID and PW to support@jdownloader.org
__________________
JD-Dev & Server-Admin
Reply With Quote
  #56  
Old 02.11.2016, 17:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
Quote:
Originally Posted by djmakinera View Post
1. Before the update:
CollectorLink.zip (650 MB)
Code:
kill javaw.exe
archive NOT(!) damaged
Code:
cutt off Power Suply
archiveNOT(!) damaged
-------------------------------------------------
ClollectorLink.zip.backup 0Byte
I tested 10 times!


2. "Correct" Restart JD2
CollectorLink.zip
damaged archive 1-2MB

CollectorLink.zip.backup
damaged archive 1-2MB
are you likeing kiddin me?
You kill/terminate JDownloader? Of course nothing will happen because no file is written. OMG

And you even don't understand what I'm trying to tell you...over and over again.

Send me ID and PW to support@jdownloader.org.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #57  
Old 02.11.2016, 17:54
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
Quote:
You kill/terminate JDownloader?
Ctrl+Q (Exit)
I checked also a safe option, also damaged archives.
After Run JD2 shows an incomplete list of links.
The only workaround
* It only use a few days previous Core. Copy the archive to CFG.
In the old Core it runs everything perfectly. NOTHING BROKEN! NOTHING!
All time shows a complete HUGE list.
Turning off the "new" updates, it does not make more sense.
Not always new updates will work as expected.
You need not agree with me.
I do not know what else I would add here.
Reply With Quote
  #58  
Old 02.11.2016, 18:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
You still haven't understood the underlying issue...very sad ... :(

Still no teamviewer to find the true issue on YOUR system....you just keep repeating yourself and don't understand the problem.

I try it one last time!

Before:
JDownloader was not able to save the list, resulting in an empty (0 byte) zip file.
JDownloader skips loading that, no broken backup, nothing. It just ignores it.
->Result: Zip file not loaded (because empty)

Now:
JDownloader is abel to save the list, but gets killed before it can finish. Half finished zip file. JDownloader tries to load the file and fails and creates a backup.
->Result: Zip file not loaded (because incomplete)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #59  
Old 02.11.2016, 18:14
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,451
Default
Quote:
This problem only happens for you and we need to find out why.
I've just tested with 500k links and 10k packages. all fine
You can not reproduce the problem, because it is still too little links.
Please Test:
1150 (1M + 150K) links (!)
5590 packages
657 MB unpacking this archive takes a very long time!
Size probably larger than 5-6 GB (!)
Reply With Quote
  #60  
Old 02.11.2016, 18:31
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,084
Default
Meanwhile I tested with 2 Mio and 100k packages.
Your issue can only come from JDownloader crashing/being killed/terminated on shutdown.
It is not about loading, its about saving.

Why don't you want me to help you with simple teamviewer session. We already would have solved the issue.
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply
Page 3 of 5 12 3 45

« Previous Thread | Next Thread »
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

All times are GMT +2. The time now is 09:47.
JDownloader Community Board - Archive - Top
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.