JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 24.06.2016, 15:09
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default java.io.IOException: org.appwork.exceptions.WTFException: Empty/Invalid
java.io.IOException: org.appwork.exceptions.WTFException: Empty/Invalid


I tested a minute ago !!!
Please do not talk again Jiaz that my installation iscorrupted, have the latest installation and in each is the same!


I know what causes the problem !!!

100% bug JD2
Reply With Quote
  #2  
Old 24.06.2016, 15:19
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default java.io.IOException: org.appwork.exceptions.WTFException: Empty/Invalid
java.io.IOException: org.appwork.exceptions.WTFException: Empty/Invalid

Reproduce:
1Very large archive with links

2.Setting (screen)



Reply With Quote
  #3  
Old 24.06.2016, 15:24
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
How about a complete stacktrace, thanks
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 24.06.2016, 15:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
This error is correct and has NOTHING to do with "remove finished downloads"!
This error means that the file downloadList7287.zip is invalid/empty and JDownloader will try the next one.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 24.06.2016, 15:27
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
stack trace
what is this ?
Reply With Quote
  #6  
Old 24.06.2016, 15:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
https://board.jdownloader.org/showthread.php?t=69800
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 24.06.2016, 15:32
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Jiaz - yes, I see, my downloadlist is empty, the other archive does not exist or is very small I have to again decrypt many links? :D
Reply With Quote
  #8  
Old 24.06.2016, 15:40
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
my cuurent setting GeneralSettings.keepxoldlists:0
Reply With Quote
  #9  
Old 24.06.2016, 15:43
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
well, in that case you lost your list
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 24.06.2016, 15:47
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
I still think that this is a serious error, the archives should not be every time destroy during the removal of only some links already downloaded/finished!
Reply With Quote
  #11  
Old 24.06.2016, 15:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
this is not what happens JDownloader uses copy on write method to save. Data is written to disk, and ONLY if that is okay, the previous version is deleted. No JDownloader issue. Looks like you kill JDownloader or your filesystem is messed up or you flush cache without it being written to disk (data loss!)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 24.06.2016, 15:54
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Quote:
Originally Posted by Jiaz View Post
well, in that case you lost your list
Is this to say it is impossible to act on the causes? Previous version is still alive


Reply With Quote
  #13  
Old 24.06.2016, 15:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
Shadow Copies are part of OS and has nothing to do with an Application.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 24.06.2016, 15:56
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Strange. I tested the old core JD2 and the new core JD2.

The problem occurs only in the newer cores JD2. I do not know which version of the core of this problem exists.
Reply With Quote
  #15  
Old 24.06.2016, 16:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
This is no problem of JDownloader. Over and out. I can only repeat myself.
Write data to disk.
-No error -> flush cache to disk -> delete previous version
-Error-> delete broken file -> do not delete previous version
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 24.06.2016, 16:15
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Quote:
This is no problem of JDownloader.
Quote:
flush

I simply very much I test and various test and various test, therefore, is different errors with the settings, filters, archives etc.


See screen :D


Reply With Quote
  #17  
Old 24.06.2016, 16:26
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Clean JD2 end task 2 second OR small archive, very small list, everything work


Symptoms
1. if have too large archives
2. javaw.exe process ends task not properly because it contains too large archives, too much data.
Reply With Quote
  #18  
Old 24.06.2016, 16:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
large archives -> provide enough memory to java.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #19  
Old 24.06.2016, 16:34
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Quote:
Originally Posted by Jiaz View Post
large archives -> provide enough memory to java.
javaw.exe consumes 1.2 GB (idle) 5.9 GB RAM (download)
Physical Memory 31%
Pagefile.sys 16 GB
Reply With Quote
  #20  
Old 24.06.2016, 17:09
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
I have found a new bug.
I removed the download list. It's empty.
But, the archive has a size of +/- 433 KB and opened archive and still shows some links.
Archive should have a size of 1KB (empty)
Reply With Quote
  #21  
Old 24.06.2016, 17:18
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
And sure you have not enabled any filters
When it still shows some links, then you have not cleared the list
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 24.06.2016, 17:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
And again -> Teamviewer!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #23  
Old 24.06.2016, 20:50
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Jiaz - I respect you, but please do a test only for the hostname Vk.com

Setting:
Remove finished downloads: at startup
zippyshare.com
No errors.

----------------------
Setting:
Remove finished downloads: at startup
promodj.com
No errors.
------------------------

Setting:
Remove finished downloads: at startup
mediafire.com
No errors.

------------------------

Setting:
Remove finished downloads: at startup
vk.com
Errors. WTFException: Empty/Invalid

so it only caused by: Vk.com

Please decrypt only one link and 100% identical settings and restart your JD2 and see the log. But see all sublogs.


**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #24  
Old 24.06.2016, 21:09
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
raztoki and tony2long - I checked with lots of different hosts and with just one URL decrypt (!)

My settings and tests pcaused by: Vk.com ALWAYS causes broken archive.
Of course I have a clean, fresh, current version.
Please test and see all sub-logs to view. Search everything in the name of "Invalid"

Please do the test and you will see that I am right.
Reply With Quote
  #25  
Old 25.06.2016, 07:13
tony2long's Avatar
tony2long tony2long is offline
English Supporter
  
Join Date: Jun 2009
Posts: 6,507
Default
Sorry, I don't understand.
You have soooooo many problems.
__________________
FAQ: How to upload a Log
Reply With Quote
  #26  
Old 25.06.2016, 09:10
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
tony2long - It is probably not the fault of the plug, but new versions of the core, but as I said very easy to reproduce

Log = not reproduce
Test = reproduce
You can do the same experiment with the settings

Download Vk.com
Remove finished downloads: at startup
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #27  
Old 25.06.2016, 09:57
raztoki's Avatar
raztoki raztoki is offline
English Supporter
  
Join Date: Apr 2010
Location: Australia
Posts: 17,614
Default
All posts merged to this thread. Please keep specific issues/reports to specific threads. Do not switch around so often its next to impossible to follow context!
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #28  
Old 25.06.2016, 18:40
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Jiaz -
Quote:
No JDownloader issue. Looks like you kill JDownloader or your filesystem is messed up or you flush cache without it being written to disk (data loss!)
You Tested ? ? ?


raztoki - find all errors?
Reply With Quote
  #29  
Old 26.06.2016, 01:52
raztoki's Avatar
raztoki raztoki is offline
English Supporter
  
Join Date: Apr 2010
Location: Australia
Posts: 17,614
Default
I have not tested, nor am I interested in doing so. My JD setup is vastly different than yours and it would require a lot of workspace and settings changes to perform such tests. So I'll let Jiaz or others test your findings.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #30  
Old 30.06.2016, 20:34
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
Error creating new archives or their "gradual decrease the size / modification" in real time during the download cause settings.

Empty/Invalid Zip:C:\JDownloader2\cfg\downloadList12167.zip|Size:0


I do not know why the hell JD2 creates empty NON-STOP (!!) the extension zip.backup

JD2 does not recognize the zip file just wrong zip.backup

Send me logs from the VK download, restart the application and send the last 2 logs, and I guarantee you'll find all the bugs!!!


How to Disable "XXXX.zip.backup"
create only XXXX.zip
Reply With Quote
  #31  
Old 04.07.2016, 12:22
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
I'm sorry but I cannot reproduce any of your issues.
JDownloader backups every list file that JDownloader is unable to parse/load. I will update JDownloader to NOT create backups of empty files. There is no way to disable backups as you will need them when things go wrong.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #32  
Old 04.07.2016, 12:28
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
JD2 only creates backups of 0 KB invalid (empty!)
I checked in real time.
I checked it on a clean installation.
Only one link and one package.
Reply With Quote
  #33  
Old 04.07.2016, 12:38
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
Did you read what I wrote. At the moment JDownloader does not special handle 0 byte files and it creates backup of ALL files it had issues with loading. With next update it will only backup files with size >0 bytes
Please provide the link you've tried
__________________
JD-Dev & Server-Admin
Reply With Quote
  #34  
Old 04.07.2016, 12:52
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
It works but only in the old cores, eg. 2014-2015 year
2016 years is not working properly, please see the date.

Reply With Quote
  #35  
Old 04.07.2016, 13:07
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
did you actually read my post?no..okay. then I will close this thread.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #36  
Old 04.07.2016, 14:15
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
I read, but give me different answers:
Quote:
Write data to disk.
-No error -> flush cache to disk -> delete previous version
-Error-> delete broken file -> do not delete previous version
What flushing?
Correctly close or restart JD2 and do not get the error "Bad Exit" so close properly.
Reply With Quote
  #37  
Old 04.07.2016, 17:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
  
Join Date: Mar 2009
Location: Germany
Posts: 79,532
Default
Flush -> tell OS to write all changes to disk
And of course you have to correctly close your JDownloader in order for all data to be saved on disk!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #38  
Old 05.08.2016, 20:03
djmakinera djmakinera is offline
Banned
  
Join Date: May 2010
Location: Poland
Posts: 8,387
Default
How to fix it?
ALWAYS(!) occurs when "Restart" Ctrl + Shift + R or Run again JD2
Also occurs on a fresh installation jdownloader
Delete (tmp + Core.jar)

This type of error caused only VK

------------------------Thread: 48:jd.controlling.linkcollector.LinkCollector.log-----------------------
--ID:48TS:1470419247435-8/5/16 7:47:27 PM - [jd.controlling.linkcollector.LinkCollector(findAvailableCollectorLists)] -> Collect Lists
--ID:48TS:1470419247442-8/5/16 7:47:27 PM - [jd.controlling.linkcollector.LinkCollector(findAvailableCollectorLists)] -> Lists: [C:\JDownloader2\cfg\linkcollector3406.zip, C:\JDownloader2\cfg\linkcollector3405.zip]
--ID:48TS:1470419247445-8/5/16 7:47:27 PM - [jd.controlling.linkcollector.LinkCollector(load)] -> Could not backup C:\JDownloader2\cfg\linkcollector3406.zip<to>C:\JDownloader2\cfg\linkcollector3406.zip.backup because size=0
--ID:48TS:1470419247445-8/5/16 7:47:27 PM - [] -> java.io.IOException: org.appwork.exceptions.WTFException: Empty/Invalid Zip:C:\JDownloader2\cfg\linkcollector3406.zip|Size:0
at jd.controlling.linkcollector.LinkCollector.loadFile(LinkCollector.java:2111)
at jd.controlling.linkcollector.LinkCollector.load(LinkCollector.java:1902)
at jd.controlling.linkcollector.LinkCollector.access$4000(LinkCollector.java:133)
at jd.controlling.linkcollector.LinkCollector$16.run(LinkCollector.java:1656)
at jd.controlling.linkcollector.LinkCollector$16.run(LinkCollector.java:1643)
at org.appwork.utils.event.queue.QueueAction.start(QueueAction.java:189)
at org.appwork.utils.event.queue.Queue.startItem(Queue.java:489)
at org.appwork.utils.event.queue.Queue.runQueue(Queue.java:423)
at org.appwork.utils.event.queue.QueueThread.run(QueueThread.java:64)
Caused by: org.appwork.exceptions.WTFException: Empty/Invalid Zip:C:\JDownloader2\cfg\linkcollector3406.zip|Size:0
at jd.controlling.linkcollector.LinkCollector.loadFile(LinkCollector.java:2048)
... 8 more

--ID:48TS:1470419265085-8/5/16 7:47:45 PM - [jd.controlling.linkcollector.LinkCollector$16(run)] -> CollectorList found: 3571/379021



**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
Reply

« Previous Thread | Next Thread »
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

All times are GMT +2. The time now is 04:08.
JDownloader Community Board - Archive - Top
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.