Hello,

First of all,thanks for the great product you offer for free. I know the title of this thread alone seems far-fetched enough, specially for a Java application, but please hear me out.

After using JDownloader2 for a long time with great results on Windows, I decided to use it on a Linux computer to manage the download and auto-extraction of a bunch of files from Archive.org. I noticed that, after using it for a while, the network would crash (requiring a computer restart or a series of commands to bring it back up). Sometimes, however, it would go beyond that and bring down my SATA devices and causing general lockup errors (the entire system would be stuttering until I restarted it).

There's a long support thread over at the **External links are only visible to Support Staff**Manjaro forums where I was looking for help because, well, it never ocurred to me that JDownloader2 would be to blame. As you can see on that thread I tried everything I could think of - custom kernel parameters, different kernel versions, distros, drives, cables, you name it. If you wish to see more details about the crashes, dmesg logs and the like, you can check that thread.

Eventually I tested with torrents and regular wget downloads and realized that the problem only ever occurred with JDownloader. I then tested different JRE versions (Oracle's 8 and 13, OpenJDK's 11) and a few other things when I finally tried to disable auto-extraction... and the problems stopped happening.

Basically, if you have auto-extraction enabled, the downloads happen normally, the first extraction happens normally... then, a while after the first extraction completed, I hear some light thrashing from my hard drives and the network drops, sometimes followed by the rest of the system crapping out.

If I just download the files using JDownloader and extract them manually using Ark, everything works fine, even if there's still stuff being downloaded by JDownloader while I do that.


I am very reluctant in placing any blame on JDownloader because, well, it's an userspace, non-root, Java application; how the hell could it possibly cause these issues? Well, my hunch is that the problems aren't caused by JDownloadet itself but that the blame would lie within the 7-Zip-JBinding library. Not only does the problem only happen when extractions are involved but the library has binary parts (.so files) which would be way more likely to cause issues than pure Java code.

So I'm posting this here to see if you guys have any ideas about this issue or suggestions of stuff I can try to avoid or isolate the issue any further... or if you think I should just take the issue up with the 7-Zip-JBinding developers. But I don't know if I would have a lot of luck with talking to them about a problem that happens with an application that uses their library unless I can write my own sample Java app that uses their library and reproduces the issue, which I don't know if I would be able to do.

Thanks for reading all this, and thanks again for developing and supporting JDownloader2.

[pspzockerscene]

Hi,
thanks for your detailed bugreport.

Do you have a log of this happening?
EDIT
We need a log and more detailed information about your OS and Hardware.
We also need a kernel log (dmesg).

-psp-

First of all, thanks for taking the time to look at this. Here's the information you requested.

System info:

Spoiler:

System:    Host: retro Kernel: 5.6.0-1-MANJARO x86_64 bits: 64 compiler: gcc v: 9.2.1 
           parameters: BOOT_IMAGE=/boot/vmlinuz-5.6-x86_64 root=UUID=4f2094e3-ed71-4c70-a907-26d4aba12a07 rw quiet apparmor=1 
           security=apparmor udev.log_priority=3 
           Desktop: KDE Plasma 5.18.1 tk: Qt 5.14.1 wm: kwin_x11 dm: SDDM Distro: Manjaro Linux 
Machine:   Type: Desktop Mobo: ASUSTeK model: PRIME B450M-GAMING/BR v: Rev X.0x serial: <filter> UEFI: American Megatrends 
           v: 2006 date: 11/13/2019 
CPU:       Topology: Quad Core model: AMD Ryzen 5 3400G with Radeon Vega Graphics bits: 64 type: MT MCP arch: Zen+ 
           family: 17 (23) model-id: 18 (24) stepping: 1 microcode: 8108109 L2 cache: 2048 KiB 
           flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm bogomips: 65628 
           Speed: 2962 MHz min/max: 1400/4100 MHz boost: enabled Core speeds (MHz): 1: 3069 2: 1362 3: 1257 4: 1402 5: 2794 
           6: 1378 7: 1342 8: 1262 
           Vulnerabilities: Type: itlb_multihit status: Not affected 
           Type: l1tf status: Not affected 
           Type: mds status: Not affected 
           Type: meltdown status: Not affected 
           Type: spec_store_bypass mitigation: Speculative Store Bypass disabled via prctl and seccomp 
           Type: spectre_v1 mitigation: usercopy/swapgs barriers and __user pointer sanitization 
           Type: spectre_v2 mitigation: Full AMD retpoline, IBPB: conditional, STIBP: disabled, RSB filling 
           Type: tsx_async_abort status: Not affected 
Graphics:  Device-1: Advanced Micro Devices [AMD/ATI] Picasso vendor: ASUSTeK driver: amdgpu v: kernel bus ID: 09:00.0 
           chip ID: 1002:15d8 
           Display: x11 server: X.Org 1.20.7 driver: amdgpu FAILED: ati unloaded: modesetting alternate: fbdev,vesa 
           compositor: kwin_x11 resolution: 1920x1080~60Hz, CRT4_2560x240_59.92~60Hz 
           OpenGL: renderer: AMD RAVEN (DRM 3.36.0 5.6.0-1-MANJARO LLVM 9.0.1) v: 4.5 Mesa 19.3.4 direct render: Yes 
Audio:     Device-1: Advanced Micro Devices [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio vendor: ASUSTeK 
           driver: snd_hda_intel v: kernel bus ID: 09:00.1 chip ID: 1002:15de 
           Device-2: Advanced Micro Devices [AMD] Family 17h HD Audio vendor: ASUSTeK driver: snd_hda_intel v: kernel 
           bus ID: 09:00.6 chip ID: 1022:15e3 
           Sound Server: ALSA v: k5.6.0-1-MANJARO 
Network:   Device-1: Realtek RTL8111/8168/8411 PCI Express Gigabit Ethernet vendor: ASUSTeK driver: r8169 v: kernel port: f000 
           bus ID: 07:00.0 chip ID: 10ec:8168 
           IF: enp7s0 state: up speed: 1000 Mbps duplex: full mac: <filter> 
Drives:    Local Storage: total: 14.78 TiB used: 2.04 TiB (13.8%) 
           ID-1: /dev/nvme0n1 vendor: Lexar model: 250GB SSD size: 232.89 GiB block size: physical: 512 B logical: 512 B 
           speed: 31.6 Gb/s lanes: 4 serial: <filter> rev: S0614B0 scheme: GPT 
           ID-2: /dev/sda vendor: Western Digital model: WD82PURZ-85TEUY0 size: 7.28 TiB block size: physical: 4096 B 
           logical: 512 B speed: 6.0 Gb/s rotation: 7200 rpm serial: <filter> rev: 0A82 
           ID-3: /dev/sdb vendor: Western Digital model: WD82PURZ-85TEUY0 size: 7.28 TiB block size: physical: 4096 B 
           logical: 512 B speed: 6.0 Gb/s rotation: 7200 rpm serial: <filter> rev: 0A82 
Partition: ID-1: / raw size: 146.48 GiB size: 143.19 GiB (97.75%) used: 27.80 GiB (19.4%) fs: ext4 dev: /dev/nvme0n1p2 
Sensors:   System Temperatures: cpu: 39.9 C mobo: N/A gpu: amdgpu temp: 39 C 
           Fan Speeds (RPM): N/A 
Info:      Processes: 324 Uptime: 21h 00m Memory: 13.60 GiB used: 2.38 GiB (17.5%) Init: systemd v: 244 Compilers: gcc: 9.2.1 
           Shell: bash v: 5.0.16 running in: konsole inxi: 3.0.37

Here I have some dmesg logs. These errors only show up in dmesg a while after the network already stopped working.

The timeline usually happens like this:

• Extraction completes
• 10-30 seconds pass
• I hear some light thrashing from the hard drives
• Network stops working
• If I don't close JDownloader and leave it running, then those dmesg messages start showing up and the whole system comes crashing down
• If I close JDownloader immediately then I can manage to restart the network without restarting the entire computer

dmesg1:

Spoiler:

[ 3930.215468] pcieport 0000:02:06.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3930.215504] pcieport 0000:02:05.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3930.215519] pcieport 0000:02:04.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3930.215534] pcieport 0000:02:00.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3930.508779] enp7s0: cmd = 0xff, should be 0x07 
               .
[ 3930.508785] enp7s0: io_base_l = 0xffff, should be 0xf001 
               .
[ 3930.508789] enp7s0: mem_base_l = 0xffff, should be 0x4004 
               .
[ 3930.508793] enp7s0: mem_base_h = 0xffff, should be 0xfcc0 
               .
[ 3930.508797] enp7s0: resv_0x1c_l = 0xffff, should be 0x0000 
               .
[ 3930.508800] enp7s0: resv_0x1c_h = 0xffff, should be 0x0000 
               .
[ 3930.508804] enp7s0: resv_0x20_l = 0xffff, should be 0x0004 
               .
[ 3930.508807] enp7s0: resv_0x20_h = 0xffff, should be 0xfcc0 
               .
[ 3930.508811] enp7s0: resv_0x24_l = 0xffff, should be 0x0000 
               .
[ 3930.508815] enp7s0: resv_0x24_h = 0xffff, should be 0x0000

dmesg2:

Spoiler:

[ 3962.788040] r8168: enp7s0: link up
[ 3962.806956] ata5.00: exception Emask 0x52 SAct 0x80fff841 SErr 0xffffffff action 0x6 frozen
[ 3962.806962] ata5: SError: { RecovData RecovComm UnrecovData Persist Proto HostInt PHYRdyChg PHYInt CommWake 10B8B Dispar BadCRC Handshk LinkSeq TrStaTrns UnrecFIS DevExch }
[ 3962.806967] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.806976] ata5.00: cmd 61/00:00:80:9d:43/0a:00:38:00:00/40 tag 0 ncq dma 1310720 ou
                        res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.806979] ata5.00: status: { DRDY }
[ 3962.806983] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.806993] ata5.00: cmd 61/00:30:80:07:43/0a:00:38:00:00/40 tag 6 ncq dma 1310720 ou
                        res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.806995] ata5.00: status: { DRDY }
[ 3962.806998] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807005] ata5.00: cmd 61/00:58:80:11:43/0a:00:38:00:00/40 tag 11 ncq dma 1310720 ou
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807006] ata5.00: status: { DRDY }
[ 3962.807008] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807014] ata5.00: cmd 61/00:60:80:1b:43/0a:00:38:00:00/40 tag 12 ncq dma 1310720 ou
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807016] ata5.00: status: { DRDY }
[ 3962.807018] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807024] ata5.00: cmd 61/00:68:80:25:43/0a:00:38:00:00/40 tag 13 ncq dma 1310720 ou
                        res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807026] ata5.00: status: { DRDY }
[ 3962.807028] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807034] ata5.00: cmd 61/00:70:80:2f:43/0a:00:38:00:00/40 tag 14 ncq dma 1310720 ou
                        res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807035] ata5.00: status: { DRDY }
[ 3962.807037] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807043] ata5.00: cmd 61/00:78:80:39:43/0a:00:38:00:00/40 tag 15 ncq dma 1310720 ou
                        res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807044] ata5.00: status: { DRDY }
[ 3962.807046] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807052] ata5.00: cmd 61/00:80:80:43:43/0a:00:38:00:00/40 tag 16 ncq dma 1310720 ou
                        res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807054] ata5.00: status: { DRDY }
[ 3962.807055] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807061] ata5.00: cmd 61/00:88:80:4d:43/0a:00:38:00:00/40 tag 17 ncq dma 1310720 ou
                        res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807063] ata5.00: status: { DRDY }
[ 3962.807064] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807070] ata5.00: cmd 61/00:90:80:57:43/0a:00:38:00:00/40 tag 18 ncq dma 1310720 ou
                        res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807071] ata5.00: status: { DRDY }
[ 3962.807073] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807079] ata5.00: cmd 61/00:98:80:61:43/0a:00:38:00:00/40 tag 19 ncq dma 1310720 ou
                        res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807080] ata5.00: status: { DRDY }
[ 3962.807082] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807087] ata5.00: cmd 61/00:a0:80:6b:43/0a:00:38:00:00/40 tag 20 ncq dma 1310720 ou
                        res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807089] ata5.00: status: { DRDY }
[ 3962.807091] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807096] ata5.00: cmd 61/00:a8:80:75:43/0a:00:38:00:00/40 tag 21 ncq dma 1310720 ou
                        res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807098] ata5.00: status: { DRDY }
[ 3962.807100] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807105] ata5.00: cmd 61/00:b0:80:7f:43/0a:00:38:00:00/40 tag 22 ncq dma 1310720 ou
                        res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807107] ata5.00: status: { DRDY }
[ 3962.807108] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807114] ata5.00: cmd 61/00:b8:80:89:43/0a:00:38:00:00/40 tag 23 ncq dma 1310720 ou
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807115] ata5.00: status: { DRDY }
[ 3962.807117] ata5.00: failed command: WRITE FPDMA QUEUED
[ 3962.807123] ata5.00: cmd 61/00:f8:80:93:43/0a:00:38:00:00/40 tag 31 ncq dma 1310720 ou
                        res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3962.807124] ata5.00: status: { DRDY }
[ 3962.807128] ata5: hard resetting link
[ 3962.807133] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3963.839057] ata5: failed to resume link (SControl FFFFFFFF)
[ 3963.839072] ata5: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3964.855824] enp7s0: cmd = 0xff, should be 0x07 
               .
[ 3964.855829] enp7s0: io_base_l = 0xffff, should be 0xf001 
               .
[ 3964.855834] enp7s0: mem_base_l = 0xffff, should be 0x4004

dmesg3:

Spoiler:

[ 3317.502623] pcieport 0000:02:06.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3317.502651] pcieport 0000:02:05.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3317.502659] pcieport 0000:02:04.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3317.502667] pcieport 0000:02:00.0: can't change power state from D3cold to D0 (config space inaccessible)
[ 3329.476097] ------------[ cut here ]------------
[ 3329.476101] NETDEV WATCHDOG: enp7s0 (r8169): transmit queue 0 timed out
[ 3329.476124] WARNING: CPU: 7 PID: 0 at net/sched/sch_generic.c:442 dev_watchdog+0x26a/0x280
[ 3329.476125] Modules linked in: fuse squashfs loop nls_iso8859_1 nls_cp437 vfat joydev mousedev input_leds fat edac_mce_amd btrfs blake2b_generic xor ccp rng_core kvm irqbypass amdgpu snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio snd_hda_codec_hdmi snd_hda_intel gpu_sched eeepc_wmi asus_wmi i2c_algo_bit snd_intel_dspcfg crct10dif_pclmul battery ttm crc32_pclmul snd_hda_codec sparse_keymap rfkill wmi_bmof ghash_clmulni_intel snd_hda_core r8169 drm_kms_helper raid6_pq aesni_intel snd_hwdep libcrc32c realtek sp5100_tco drm crypto_simd pcspkr k10temp i2c_piix4 libphy snd_pcm cryptd glue_helper snd_timer agpgart snd syscopyarea sysfillrect sysimgblt fb_sys_fops soundcore wmi gpio_amdpt pinctrl_amd evdev mac_hid acpi_cpufreq uinput crypto_user ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 sd_mod hid_microsoft ff_memless hid_generic usbhid hid ahci libahci libata crc32c_intel xhci_pci xhci_hcd scsi_mod
[ 3329.476181] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G        W         5.5.2-1-MANJARO #1
[ 3329.476182] Hardware name: System manufacturer System Product Name/PRIME B450M-GAMING/BR, BIOS 2006 11/13/2019
[ 3329.476186] RIP: 0010:dev_watchdog+0x26a/0x280
[ 3329.476189] Code: 8a e2 7f ff eb 88 4c 89 f7 c6 05 8c 4d d1 00 01 e8 fb ad fa ff 44 89 e9 4c 89 f6 48 c7 c7 70 e1 fa 9d 48 89 c2 e8 c8 ae 88 ff <0f> 0b e9 66 ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00
[ 3329.476191] RSP: 0018:ffffb3c9c0354e60 EFLAGS: 00010286
[ 3329.476194] RAX: 0000000000000000 RBX: ffff94e445d87400 RCX: 0000000000000000
[ 3329.476195] RDX: 0000000000000103 RSI: 0000000000000096 RDI: 00000000ffffffff
[ 3329.476196] RBP: ffff94e44e46045c R08: 00000000000004d9 R09: 0000000000000001
[ 3329.476198] R10: 0000000000000000 R11: 0000000000000001 R12: ffff94e44e460480
[ 3329.476199] R13: 0000000000000000 R14: ffff94e44e460000 R15: ffff94e445d87480
[ 3329.476201] FS:  0000000000000000(0000) GS:ffff94e4509c0000(0000) knlGS:0000000000000000
[ 3329.476203] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 3329.476204] CR2: 00007f5d2da487e0 CR3: 00000003f3a3e000 CR4: 00000000003406e0
[ 3329.476206] Call Trace:
[ 3329.476208]  <IRQ>
[ 3329.476215]  ? qdisc_put_unlocked+0x30/0x30
[ 3329.476219]  call_timer_fn+0x2d/0x160
[ 3329.476222]  run_timer_softirq+0x1ad/0x510
[ 3329.476225]  ? qdisc_put_unlocked+0x30/0x30
[ 3329.476231]  __do_softirq+0x111/0x34d
[ 3329.476237]  irq_exit+0xac/0xd0
[ 3329.476240]  smp_apic_timer_interrupt+0xa6/0x1b0
[ 3329.476243]  apic_timer_interrupt+0xf/0x20
[ 3329.476245]  </IRQ>
[ 3329.476250] RIP: 0010:cpuidle_enter_state+0xc9/0x410
[ 3329.476253] Code: e8 7c 09 98 ff 80 7c 24 0f 00 74 17 9c 58 0f 1f 44 00 00 f6 c4 02 0f 85 1c 03 00 00 31 ff e8 ee 74 9e ff fb 66 0f 1f 44 00 00 <45> 85 ed 0f 88 72 02 00 00 49 63 d5 4c 2b 64 24 10 48 8d 04 52 48
[ 3329.476255] RSP: 0018:ffffb3c9c00e7e68 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 3329.476257] RAX: ffff94e4509c0000 RBX: ffff94e44e0d1000 RCX: 000000000000001f
[ 3329.476258] RDX: 0000000000000000 RSI: 000000001f383273 RDI: 0000000000000000
[ 3329.476259] RBP: ffffffff9e2c3d20 R08: 00000307343d554b R09: 0000000000001a04
[ 3329.476260] R10: 0000000000000397 R11: ffff94e4509ebbe4 R12: 00000307343d554b
[ 3329.476261] R13: 0000000000000002 R14: 0000000000000002 R15: ffff94e44ef0bc80
[ 3329.476270]  ? cpuidle_enter_state+0xa4/0x410
[ 3329.476274]  cpuidle_enter+0x29/0x40
[ 3329.476278]  do_idle+0x1e6/0x270
[ 3329.476282]  cpu_startup_entry+0x19/0x20
[ 3329.476286]  start_secondary+0x186/0x1d0
[ 3329.476290]  secondary_startup_64+0xb6/0xc0
[ 3329.476295] ---[ end trace e59409d38d427eac ]---
[ 3329.526705] r8169 0000:07:00.0 enp7s0: rtl_chipcmd_cond == 1 (loop: 100, delay: 100).
[ 3329.527907] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).
[ 3329.529077] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).
[ 3329.530256] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).
[ 3329.531426] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).

dmesg4:

Spoiler:

[ 3339.669198] r8169 0000:07:00.0 enp7s0: rtl_eriar_cond == 1 (loop: 100, delay: 100).
[ 3339.679327] r8169 0000:07:00.0 enp7s0: rtl_eriar_cond == 1 (loop: 100, delay: 100).
[ 3345.647369] audit: type=1130 audit(1582515772.346:107): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=NetworkManager-dispatcher comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 3348.293392] ata5.00: exception Emask 0x52 SAct 0x0 SErr 0xffffffff action 0x6 frozen
[ 3348.293397] ata5: SError: { RecovData RecovComm UnrecovData Persist Proto HostInt PHYRdyChg PHYInt CommWake 10B8B Dispar BadCRC Handshk LinkSeq TrStaTrns UnrecFIS DevExch }
[ 3348.293400] ata5.00: failed command: WRITE DMA EXT
[ 3348.293407] ata5.00: cmd 35/00:70:00:52:68/00:00:65:00:00/e0 tag 5 dma 57344 out
                        res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3348.293409] ata5.00: status: { DRDY }
[ 3348.293413] ata5: hard resetting link
[ 3348.293419] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3348.293430] ata6.00: exception Emask 0x52 SAct 0x0 SErr 0xffffffff action 0x6 frozen
[ 3348.293434] ata6: SError: { RecovData RecovComm UnrecovData Persist Proto HostInt PHYRdyChg PHYInt CommWake 10B8B Dispar BadCRC Handshk LinkSeq TrStaTrns UnrecFIS DevExch }
[ 3348.293436] ata6.00: failed command: WRITE DMA EXT
[ 3348.293442] ata6.00: cmd 35/00:70:00:b2:67/00:00:65:00:00/e0 tag 12 dma 57344 out
                        res 40/00:00:00:4f:c2/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
[ 3348.293443] ata6.00: status: { DRDY }
[ 3348.293445] ata6: hard resetting link
[ 3348.293448] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3349.326411] ata5: failed to resume link (SControl FFFFFFFF)
[ 3349.326426] ata5: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3354.436493] ata5: hard resetting link
[ 3354.436499] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3354.436532] ata6: failed to resume link (SControl FFFFFFFF)
[ 3354.436547] ata6: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3355.988075] audit: type=1131 audit(1582515782.685:108): pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=NetworkManager-dispatcher comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 3359.556970] ata6: hard resetting link
[ 3359.556975] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3360.589915] ata6: failed to resume link (SControl FFFFFFFF)
[ 3360.589930] ata6: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3360.589939] ata6: limiting SATA link speed to <unknown>
[ 3365.743625] ata6: hard resetting link
[ 3365.743630] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3365.743651] ata5: failed to resume link (SControl FFFFFFFF)
[ 3365.743666] ata5: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3365.743674] ata5: limiting SATA link speed to <unknown>
[ 3370.863410] ata5: hard resetting link
[ 3370.863416] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3371.897063] ata6: failed to resume link (SControl FFFFFFFF)
[ 3371.897078] ata6: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3371.897085] ata6.00: disabled
[ 3371.897100] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3371.897105] ata5: failed to resume link (SControl FFFFFFFF)
[ 3371.897114] sd 5:0:0:0: [sda] tag#12 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=55s
[ 3371.897118] sd 5:0:0:0: [sda] tag#12 Sense Key : Not Ready [current] 
[ 3371.897119] ata5: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF)
[ 3371.897123] sd 5:0:0:0: [sda] tag#12 Add. Sense: Logical unit not ready, hard reset required
[ 3371.897126] ata5.00: disabled
[ 3371.897127] sd 5:0:0:0: [sda] tag#12 CDB: Write(16) 8a 00 00 00 00 00 65 67 b2 00 00 00 00 70 00 00
[ 3371.897132] blk_update_request: I/O error, dev sda, sector 1701294592 op 0x1:(WRITE) flags 0x100000 phys_seg 14 prio class 0
[ 3371.897138] BTRFS error (device sdb): bdev /dev/sda errs: wr 1, rd 0, flush 0, corrupt 0, gen 0
[ 3371.897139] ahci 0000:01:00.1: AHCI controller unavailable!
[ 3371.897148] sd 4:0:0:0: [sdb] tag#5 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=55s
[ 3371.897151] sd 4:0:0:0: [sdb] tag#5 Sense Key : Not Ready [current] 
[ 3371.897154] sd 4:0:0:0: [sdb] tag#5 Add. Sense: Logical unit not ready, hard reset required
[ 3371.897157] sd 4:0:0:0: [sdb] tag#5 CDB: Write(16) 8a 00 00 00 00 00 65 68 52 00 00 00 00 70 00 00
[ 3371.897160] blk_update_request: I/O error, dev sdb, sector 1701335552 op 0x1:(WRITE) flags 0x100000 phys_seg 14 prio class 0
[ 3371.897165] BTRFS error (device sdb): bdev /dev/sdb errs: wr 1, rd 0, flush 0, corrupt 0, gen 0
[ 3371.897167] ata6: EH complete
[ 3371.897176] sd 5:0:0:0: rejecting I/O to offline device
[ 3371.897180] blk_update_request: I/O error, dev sda, sector 1808064 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[ 3371.897183] BTRFS error (device sdb): bdev /dev/sda errs: wr 1, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897193] sd 5:0:0:0: rejecting I/O to offline device
[ 3371.897196] blk_update_request: I/O error, dev sda, sector 1701294704 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
[ 3371.897197] ata5: EH complete
[ 3371.897201] BTRFS error (device sdb): bdev /dev/sda errs: wr 2, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897203] sd 4:0:0:0: rejecting I/O to offline device
[ 3371.897206] blk_update_request: I/O error, dev sdb, sector 1701335664 op 0x1:(WRITE) flags 0x100000 phys_seg 2 prio class 0
[ 3371.897209] BTRFS error (device sdb): bdev /dev/sdb errs: wr 2, rd 0, flush 0, corrupt 0, gen 0
[ 3371.897210] ata6.00: detaching (SCSI 5:0:0:0)
[ 3371.897225] ata5.00: detaching (SCSI 4:0:0:0)
[ 3371.897326] blk_update_request: I/O error, dev sda, sector 1701294720 op 0x1:(WRITE) flags 0x100000 phys_seg 21 prio class 0
[ 3371.897331] BTRFS error (device sdb): bdev /dev/sda errs: wr 3, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897334] BTRFS error (device sdb): bdev /dev/sda errs: wr 4, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897344] blk_update_request: I/O error, dev sdb, sector 1849024 op 0x0:(READ) flags 0x1000 phys_seg 4 prio class 0
[ 3371.897346] BTRFS error (device sdb): bdev /dev/sdb errs: wr 2, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897354] blk_update_request: I/O error, dev sdb, sector 1701335680 op 0x1:(WRITE) flags 0x100000 phys_seg 21 prio class 0
[ 3371.897355] blk_update_request: I/O error, dev sda, sector 1701294512 op 0x1:(WRITE) flags 0x100000 phys_seg 10 prio class 0
[ 3371.897357] BTRFS error (device sdb): bdev /dev/sda errs: wr 5, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897359] BTRFS error (device sdb): bdev /dev/sdb errs: wr 3, rd 1, flush 0, corrupt 0, gen 0
[ 3371.897374] blk_update_request: I/O error, dev sdb, sector 1701335472 op 0x1:(WRITE) flags 0x100000 phys_seg 10 prio class 0
[ 3371.897795] BTRFS: error (device sdb) in btrfs_run_delayed_refs:2209: errno=-5 IO failure
[ 3371.897799] BTRFS info (device sdb): forced readonly
[ 3371.901468] sd 5:0:0:0: [sda] Synchronizing SCSI cache
[ 3371.901526] sd 5:0:0:0: [sda] Synchronize Cache(10) failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3371.901528] sd 5:0:0:0: [sda] Stopping disk
[ 3371.901540] sd 5:0:0:0: [sda] Start/Stop Unit failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3371.903051] sd 4:0:0:0: [sdb] Synchronizing SCSI cache
[ 3371.903106] sd 4:0:0:0: [sdb] Synchronize Cache(10) failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3371.903109] sd 4:0:0:0: [sdb] Stopping disk
[ 3371.903124] sd 4:0:0:0: [sdb] Start/Stop Unit failed: Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3384.554126] r8169 0000:07:00.0 enp7s0: rtl_chipcmd_cond == 1 (loop: 100, delay: 100).
[ 3384.555351] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).
[ 3384.556537] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).
[ 3384.557721] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).
[ 3384.558892] r8169 0000:07:00.0 enp7s0: rtl_ephyar_cond == 1 (loop: 100, delay: 10).

Recent Testing
So, all the reporting you see before this point was data I acquired during my troubleshooting at the Manjaro forums. Since you requested JDownloader 2 logs, I got a new installation running with fresh settings.

This time, although the network interface still craps out the same way as before a short while after an extraction happens, the SATA/AHCI links stay stable. As a result, absolutely NO messages show up in dmesg during this. Maybe it's because I switched to kernel 5.6rc2 for my tests and some driver issues got cleared up in the process?

Anyway here's the JDownloader2 logs:

26.02.20 13.56.52 <--> 26.02.20 14.18.54 jdlog://1780715302851/

And the timeline was something like this:

• 14:01 start testing
• 14:03 extraction completes
• 14:04 network goes down
• 14:04 network comes back on its own
• 14:05 light hdd thrashing, network goes down
• 14:07 network restarted manually
• 14:10 extraction completes
• 14:10 network goes down
• 14:14 network restarted manually
• 14:15 extraction completes
• 14:16 light hdd thrashing, network goes down
• 14:18 stop testing

The problem still does not occur if extraction is not used in JDownloader2. I can extract the files manually using Ark while JDownloader2 is busy downloading the next files with no problem

For reference, here's the script I'm using to restart the network, since just using the GUI or restarting the NetworkManager.service isn't enough:

Spoiler:

#!/bin/bash

/bin/sh -c 'nmcli networking off'
systemctl stop NetworkManager
ip link set enp7s0 down
modprobe -r r8169
sleep 1
modprobe r8169
sleep .5
ip link set enp7s0 up
sleep .5
systemctl start NetworkManager
/bin/sh -c 'nmcli networking on'

Thanks again for the assistance.

[pspzockerscene]

I'll forward this!

Did you already test your RAM e.g. using memtest86?

-psp-

Originally Posted by pspzockerscene

I'll forward this!

Did you already test your RAM e.g. using memtest86?

-psp-

Thanks for forwarding it. I realize it's a bizarre problem to point at JDownloader.

And yes, I've ran memtest86, changed SATA cables and ports, tested the HDDs by doing extra concurrent work and I tested my NIC stability by running torrents with about a 100 connected peers saturating my connection.

I'm still unable to locate or produce any problems on this system with anything other than JDownloader2's extraction.

[pspzockerscene]

Okay I'll trust you - most of our user do not deliver bugreports with so much testing done in the first place

Jiaz might be able to give me more information tomorrow or the next week.
If you do not get an answer at all, please push this thread in a week.

-psp-

Originally Posted by pspzockerscene

Okay I'll trust you - most of our user do not deliver bugreports with so much testing done in the first place

Jiaz might be able to give me more information tomorrow or the next week.
If you do not get an answer at all, please push this thread in a week.

-psp-

Understood. Thanks for the help.

Hello,

I have finally been able to reproduce the issue without running JDownloader2. I still have to investigate it further to pinpoint the root cause but it is clearly not an issue involving this software. I'm terribly sorry for wasting your time with this.

Please disregard this bug report and feel free to close the thread. Thanks again for the assistance.

[pspzockerscene]

No problem - you've not yet wasted any of our time.

Feel free to post your solution here anyways - you've made even me curious now

Good night!

-psp-

I'm still running a few tests to narrow down the scope of the problem, but it is caused by btrfs' compression.

My files are on a btrfs filesystem using compress-force=zstd. The issue - i.e., killing several devices, including network and SATA drives - can occur when files that are stored with forced zstd compression are extracted to a destination where forced zstd is also enabled (within the same filesystem).

If the files are not under btrfs compression and are extracted to a forced zstd destination, it works... if they are extracted from forced zstd to unforced zstd, it works... forced zstd to forced lzo also works...

The only case where the issue happens is forced zstd to forced zstd.

I'll go back to my thread on the Manjaro forums and report this back there, at this point I'm willing to call it a bug with the btrfs support for zstd and/or forced compression.

Ah, it also only happens when uncompressing large files - like a compressed >1gb .iso file. If I uncompress a 5gb file that contains a lot of small <50mb files, the problem does not occur.

Anyway... really difficult to diagnose, right? What a perfect storm of conditions to cause the problem.

[pspzockerscene]

Originally Posted by dig

Anyway... really difficult to diagnose, right? What a perfect storm of conditions to cause the problem.

Yap - you must have put a lot of time into finding that out but that's good - maybe others will benefit from a future bugfix!

-psp-

[raztoki]

software controlled file systems like btfs/zfs can be problematic trouble shooting, especially adding layers ontop (encryption and compression).

Thanks for your report even though I didn't respond, it was very detailed.

Java programs like ours use Java internal methods (APIs) <> OS, so software like ours can't actually cause these type of issues typically, but could trigger it either within Java itself or Operating System or Drivers or in your case software based filesystem.

Originally Posted by raztoki

software controlled file systems like btfs/zfs can be problematic trouble shooting, especially adding layers ontop (encryption and compression).

Thanks for your report even though I didn't respond, it was very detailed.

Yes, when you add layers upon layers it's not easy to pinpoint the cause of the issue. All the way from the software you're using down to the hardware, you have to isolate, test and eliminate everything.

After changing my fstab entry from compress-force=zstd to compress-force=lzo, I ran JDownloader for one hour with no issues. I'm currently in the process of converting the compression on the rest of my filesystem and this is actually recovering space on the disks (probably because of the defragmentation), so it's all good. In the end, lzo compression is still resulting in files smaller than before the extraction in my use case so I can't ask for more.

And the reason the report was detailed was because I really didn't want to bring the issue here before I had eliminated every other possibility, because...

Originally Posted by raztoki

Java programs like ours use Java internal methods (APIs) <> OS, so software like ours can't actually cause these type of issues typically, but could trigger it either within Java itself or Operating System or Drivers or in your case software based filesystem.

Exactly. I'm a Java programmer myself and I'm aware of the way Java interacts with the system. A Java application would sooner crash the JVM than interfere with the system in a way to cause this sort of issue. Because of this, I was trying to point fingers at the 7zip bindings due to their native binaries, because nothing short of a very badly written binary library could bring a system down like this.

This is also the reason I kept testing and trying to reproduce the issue without using JDownloader. I know this software is mature enough to not be this problematic.

Once again, thank you for coming along for the ride of this particular issue

[raztoki]

this type of thread/post did draw my attention! the stickler for detail was commendable.

I totally agree with external libs, it could be the cause.. but statistically I haven't seen any reports of your nature soo unlikely?, though you could just be the first to report to us.
I had a quick look at boris github issues and even sourceforge(yes still exists) bugs and nothing I could see in relation to this either.

Seems like you have found a work around, wonderful.

Happy programming!

[pspzockerscene]

Awesome results

-psp-