JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 05.05.2024, 17:15
omega59 omega59 is offline
Mega Loader
 
Join Date: Jul 2019
Location: Canada
Posts: 66
Default [Cloudflare] recu.me plugin broken

Hi, is the site no longer supported or working. It seems once links work they stop and go offline. sometimes it may grab a m3u sometimes a mp4. thank you.
Reply With Quote
  #2  
Old 05.05.2024, 21:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,514
Default

@omega59: please provide example links and a log, see https://support.jdownloader.org/de/k...d-session-logs

Cloudflare blocking is also not a JD/plugin bug.
__________________
JD-Dev & Server-Admin

Last edited by pspzockerscene; 06.05.2024 at 13:57. Reason: EDIT by psp, moved posts which were accidentally moved to internal forum to public forums
Reply With Quote
  #3  
Old 12.05.2024, 16:37
omega59 omega59 is offline
Mega Loader
 
Join Date: Jul 2019
Location: Canada
Posts: 66
Default

an example this. it may grab the file or not it is hit or miss often.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #4  
Old 12.05.2024, 20:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,514
Default

@omega59: recu is making use of cloudflare and thus will randomly fail/break, see https://board.jdownloader.org/showthread.php?t=83712
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 18.05.2024, 18:31
Wizz Wizz is offline
Junior Loader
 
Join Date: Feb 2024
Posts: 11
Default

Quote:
Originally Posted by omega59 View Post
Hi, is the site no longer supported or working. It seems once links work they stop and go offline. sometimes it may grab a m3u sometimes a mp4. thank you.
You will have to use a HLS Downloader, or use normal premium downloading for Recu, as the cloudfare issues pretty much make using JD hard as hell.
Reply With Quote
  #6  
Old 27.05.2024, 12:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Read the recurbate specific posts starting from here:
https://board.jdownloader.org/showth...584#post530584

-> Did you set the "user-agent" value accordingly as stated by me?
Either way: Yes, recurbate plugin is quite unstable due to Cloudflare.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 28.05.2024, 11:54
jeonje jeonje is offline
Wind Gust
 
Join Date: Nov 2023
Posts: 40
Default

if there is any team members interested in working on bypass cloudfare, that would be life change solution. tools or inbuilt feature on JD to bypass cloudfare and get the full speed downloads instead of slow as hell pain.

any dear team interested ?
Reply With Quote
  #8  
Old 28.05.2024, 11:59
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

We're all interested but:
  • We don't have time for this
  • Also it's not really our business

Possible free open source solutions already exist, see Cloudflare thread: https://board.jdownloader.org/showthread.php?t=83712
Keywords: FlareSolverr, cloudscraper

More input and more detailed answer of our staff to your question can be found in said Cloudflare thread.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 08.06.2024, 12:24
jeonje jeonje is offline
Wind Gust
 
Join Date: Nov 2023
Posts: 40
Default

dear team recu.me after jdownloader update only downloading 1 file at a time, which is also slower then before where upto 10 could be downloaded with max speed from 100-1 mb
Reply With Quote
  #10  
Old 10.06.2024, 13:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Please read our slow speed troubleshooting guide:
https://support.jdownloader.org/de/k...-downloadspeed

Regarding the max number of simultaneous downloads in account mode for recu.me:
See Settings -> Plugins -> recu.me
I hightly recommend not to change the value to > 1!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 12.06.2024, 10:58
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

Hey JD-Team, I have a problem with adding links to the LinkGrabber from recu.me. I added the Account with name/cookie + User-Agent from where the cookie came from. I also double checked, deleted the account and added again to make sure.

I get a "HTTP/1.1 403 Forbidden" when I try to add links and nothing is added as a result. In the LinkCrawlerDeep log I can see that the User-Agent supposedly used for link retrivial does not match the one I added to the Account. If indeed the wrong User-Agent is used it does missmatch from the one in the cookies and this would be probably a reason for CF to deny access.

The wrong UA, the link I used can be found in the LinkGrabber Log:
12.06.24 10.47.50 <--> 12.06.24 10.51.21 jdlog://0243411370661/

Thanks for you ongoing support!
Reply With Quote
  #12  
Old 12.06.2024, 11:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Hi,
you mis-interpreted the log. There is no bug in the User-Agent handling.

Here is what really happened:
recu.me has once again changed their url-structure for single videos.
When you were adding the video-URL, JDownloader did not find a plugin which can handle this link so it tried to use the deep-crawler which is not using any plugin specific settings/user-agents and even if, it would've failed to find any downloadable content.

I'll update the URL-pattern inside the recu.me plugin then this will work fine again.

Old/current pattern:
Code:
/(?:play\\.php\\?video=|video/)(\\d+)
Your link:
Code:
/username/video/12345678/play
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 12.06.2024 at 11:19.
Reply With Quote
  #13  
Old 12.06.2024, 11:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Addendum:
As a workaround-attempt, you can remove the username from the URL and add it as:
Code:
/video/12345678/play
In the browser that works too - no gurantees but if the URL structure is all they changed, that should work fine in JD too.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 12.06.2024, 11:41
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

I've updated the URL-structure which the plugin is supporting but:
  • Other parts of the website were also changed
  • I was unable to make the login work and I'am not wasting any time trying to get through Cloudflare

If it's the same for you, you might want to use this method to download from recu.me.

As for the code changes I did, the following applies:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #15  
Old 12.06.2024, 12:39
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

The logic around the deep scan makes sense, I was not aware of that. Thanks for the clarification and the update! LinkGrabber is definetly working again.

Regarding your concerns about general problems with login: My Account was premium but is currently Basic and I can say that at least in this mode one download is currently working.
Reply With Quote
  #16  
Old 12.06.2024, 12:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Nice so I guess it just failed here.

Well that's how Cloudflare works - it is a blackbox :(
So thanks for your feedback!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #17  
Old 30.06.2024, 13:23
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

Hey JD-Team,

there seems to be a new, different error with the recu.me Plugin. I'm pretty sure I set up UA, Cookies etc. correctly and it also starts to download a video, but after a view seconds it stops with the error:

Code:
Try restarting the link (plugin outdated?)
In the PluginErrors.log I could see an exception thrown:
Code:
FFmpeg Failed->ERROR_PLUGIN_DEFECT|Value:-1
Maybe it's something we can fix on JD-side? I have the logs here:

30.06.24 13.14.42 <--> 30.06.24 13.16.25 jdlog://3473411370661/

As always, thanks for your support!
Reply With Quote
  #18  
Old 01.07.2024, 10:16
jeonje jeonje is offline
Wind Gust
 
Join Date: Nov 2023
Posts: 40
Default

Dear team, bless you all for gods work.
every download new and old already in the download list inside jdownloader after few seconds it gives an error :

Try restarting the link (plugin outdated?)

please have a look
Reply With Quote
  #19  
Old 01.07.2024, 12:37
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

@Docoakere
According to a notice on their website, they are doing a maintenance so my guess is tha the item you were trying to download via stream-download is also not watchable in your browser.

Also in your log i can see that you are using a recu.me account.
Is that a free or a premium account?
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #20  
Old 01.07.2024, 12:49
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

Thanks for your feedback.

I just tested it, I can watch this very video in browser. The maintenace was not displayed over the weekend when the problem started, I still had a page open from them where this message was not yet shown, so I would assume maintenace started today. Sure, it's possible that they already had maintenance and just did not show it. You can decide if you want to debug now or wait for them to finish maintenace. I can provide more information if needed.

It's a premium account.
Reply With Quote
  #21  
Old 01.07.2024, 12:51
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

I'am unable to reproduce this problem here but I'am also constantly running into Cloudflare.

Nevertheless I do not have access to a premium account for testing
Please send me your recu.me login credentials via PN.
I need the username & password, not the login-cookies!

Feel free to change your passwords before and/or once I'am done investigating.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 01.07.2024 at 12:57.
Reply With Quote
  #22  
Old 01.07.2024, 13:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Okay here are my findings:
For me it doesn't work at all due to Cloudflare so I can't do proper testing but according to your logs, the plugin is able to find the stream URL so the failure occurs right at the download-start.
This is the FFmpeg output of your logs:
Code:
[hls @ 0x7fe0f117a8c0] Failed to open segment 11236 of playlist 0
[hls @ 0x7fe0f117a8c0] A HLS playlist item '**External links are only visible to Support Staff** referred to an external file '**External links are only visible to Support Staff**. Opening this file was forbidden for security reasons
[hls @ 0x7fe0f117a8c0] Failed to open segment 11237 of playlist 0
[hls @ 0x7fe0f117a8c0] A HLS playlist item '**External links are only visible to Support Staff** referred to an external file '**External links are only visible to Support Staff**. Opening this file was forbidden for security reasons

I'm unable to investigate this further but I think [!this is not an ad in any way!] is that it might work with a recu.me "Ultimate" plan as that will provide an official download button so FFmpeg is not needed and JDownloader does not need to deal with downloading a possibly unstable HLS video stream.
Alternatively recu.me looks to provide a download software written by them though that also looks to be exclusively for 'Ultimate' plan members:
Code:
recu.me/downloader
Also, you might want to try this method without JDownloader.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #23  
Old 01.07.2024, 14:08
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

I see. Thanks again. Would you consider comparing the ffmpeg download command/process within JD to the manual test I did? It seems to work if I manually stream download (which is of course not as convinient as within JD).

I dont say that's the only way it works and probably not best (.ts instead of .mp4) but I wanted to give my feedback that this is currently downloading the segments:

Code:
ffmpeg -user_agent "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:127.0) Gecko/20100101 Firefox/127.0" -i "**External links are only visible to Support Staff** -c copy "max.ts"


ffmpeg version 6.1.1-full_build-www.gyan.dev Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 12.2.0 (Rev10, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --pkg-config=pkgconf --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libuavs3d --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libaom --enable-libjxl --enable-libopenjpeg --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-ffnvcodec --enable-nvdec --enable-nvenc --enable-dxva2 --enable-d3d11va --enable-libvpl --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      58. 29.100 / 58. 29.100
  libavcodec     60. 31.102 / 60. 31.102
  libavformat    60. 16.100 / 60. 16.100
  libavdevice    60.  3.100 / 60.  3.100
  libavfilter     9. 12.100 /  9. 12.100
  libswscale      7.  5.100 /  7.  5.100
  libswresample   4. 12.100 /  4. 12.100
  libpostproc    57.  3.100 / 57.  3.100
[hls @ 000001a98fecd840] Skip ('#EXT-X-ALLOW-CACHE:YES')
[hls @ 000001a98fecd840] Skip ('#EXT-X-VERSION:3')
[hls @ 000001a98fecd840] Opening '**External links are only visible to Support Staff** for reading
[hls @ 000001a98fecd840] Opening '**External links are only visible to Support Staff** for reading
Input #0, hls, from '**External links are only visible to Support Staff**:
  Duration: 02:25:04.00, start: 0.101000, bitrate: N/A
  Program 0
    Metadata:
      variant_bitrate : 0
  Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 30 fps, 30 tbr, 90k tbn
    Metadata:
      variant_bitrate : 0
  Stream #0:1: Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp
    Metadata:
      variant_bitrate : 0
  Stream #0:2: Data: timed_id3 (ID3  / 0x20334449)
    Metadata:
      variant_bitrate : 0
Output #0, mpegts, to 'max.ts':
  Metadata:
    encoder         : Lavf60.16.100
  Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 30 fps, 30 tbr, 90k tbn
    Metadata:
      variant_bitrate : 0
  Stream #0:1: Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp
    Metadata:
      variant_bitrate : 0
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
[https @ 000001a99032a1c0] Opening '**External links are only visible to Support Staff** for reading
It also works with yt-dlp.exe:

Code:
yt-dlp.exe --sleep-requests 5 --sleep-interval 5 --retries 30 --fragment-retries 30 --retry-sleep fragment:exp=4:20 --abort-on-unavailable-fragments --restrict-filenames --cookies-from-browser firefox --user-agent Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:127.0) Gecko/20100101 Firefox/127.0 --output Video.mp4 **External links are only visible to Support Staff**
But obviously nothing beats JD when it comes to ease of use and convenience
Reply With Quote
  #24  
Old 01.07.2024, 14:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

No worries.

Our FFmpeg handling is currently much stricter than a direct download using FFmpeg and I don't think that this will be changed in the near future.
Feel free to search our forums to find the related threads.
Examples:
https://board.jdownloader.org/showthread.php?t=91244
Tickets:


JDownloader is open source so feel free to do your own investigations, link:
https://support.jdownloader.org/know...up-ide-eclipse
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #25  
Old 02.07.2024, 11:39
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

As always thanks for the reply. I'm not a developer, so my options are limited but I did some reasearch, analyzed the logs to the best of my abilities and did some tests. I can share my finding. Maybe it sparks an idea on what is going wrong or how to solve it.

I post the log section you mentioned for reference:
Code:
[hls @ 0x7fdef702a8c0] Failed to open segment 2072 of playlist 0
[hls @ 0x7fdef702a8c0] A HLS playlist item '**External links are only visible to Support Staff** referred to an external file '**External links are only visible to Support Staff**. Opening this file was forbidden for security reasons
The error we see in the logs seems to be not a common one, I could not find any similar problems online but one thread in this forum which looks like it could be at least close to what I encountered: https://board.jdownloader.org/showth...ffmpeg+command

I checked the ffmpeg command which supposedly is used by JD in the background, if I can rely on what is mentioned here:

Code:
[org.jdownloader.controlling.ffmpeg.AbstractFFmpegBinary(runCommand)] -> runCommand(ProcessBuilderFactory):[/usr/bin/ffmpeg, -analyzeduration, 15000000, -i, **External links are only visible to Support Staff**
I replaced the local JD-Link with the real link from recu.me and tried to download locally on my desktop:
Code:
ffmpeg -analyzeduration 15000000 -i "**External links are only visible to Support Staff** -bsf:a aac_adtstoasc -c:v copy -c:a copy -f mp4 Video.mp4.part -y
It did not work. So I made a small change and added the user_agent:
Code:
ffmpeg -user_agent "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:127.0) Gecko/20100101 Firefox/127.0" -analyzeduration 15000000 -i "**External links are only visible to Support Staff** -bsf:a aac_adtstoasc -c:v copy -c:a copy -f mp4 Video.mp4.part -y
This works locally!

I also checked the advanced settings in JD for ffmpeg to see if I can change the command but it seems like there are only options for the binary path and file type convertion commands:

https://postimg.cc/B8jd4Y1L

Since I'm not able to change how JD calls the ffmpeg download command I'm kinda stuck. There is another thread where a user asked to modify the command but there seems to be not much progress: https://board.jdownloader.org/showth...ffmpeg+command. I could not find anything else which might be relevant. Any ideas or suggestions on how we could still try to make it work? Is the successfull test with the user_agent something we can investigate in further?

Last edited by Docoakere; 02.07.2024 at 12:07.
Reply With Quote
  #26  
Old 02.07.2024, 11:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

That could be it.

I'am not into that stuff so if at all, another team member needs to comment on this.
Feel free to grab our source code and do further tests, see:
https://support.jdownloader.org/de/k...up-ide-eclipse
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #27  
Old 04.07.2024, 12:51
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

May one of your team members can have a look?

I guess we should try to clarify:
Is it really "only" the missing user_agent in the ffmpeg command?
If yes:
  • a) Can it be solved by hard coding it into the ffmpeg command or adding some ort of variable/editor for the users?
  • b) Can it be solved in another way to not send the user_agent in the ffmpeg command?
If No: what else could we do?

I don't have any experience with java and very little knowledge with coding in general.
Reply With Quote
  #28  
Old 04.07.2024, 13:24
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Quote:
Originally Posted by Docoakere View Post
If No: what else could we do?
Inthis case, make use of the workarounds I linked (if needed, without the use of JDownloader).

Please be patient and wait until another staff member looks into this topic.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #29  
Old 04.07.2024, 14:33
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,514
Default

Issue is not caused by wrong UserAgent, as all Requests are made by JDownloader.
JDownloader launching ffmpeg and providing m3u8 to ffmpeg and ffmpeg connecting to JDownloader and requests are proxied through JDownloader. UA/Cookies/Proxy are used as in JDownloader but in this case it's caused because your local used ffmpeg in /usr/bin/ffmpeg blocks access due to
Quote:
Opening this file was forbidden for security reasons
__________________
JD-Dev & Server-Admin
Reply With Quote
  #30  
Old 04.07.2024, 15:23
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,514
Default

Please test again with next update as slight change to m3u8 to provide relative URLs
__________________
JD-Dev & Server-Admin
Reply With Quote
  #31  
Old 04.07.2024, 23:13
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

Thanks to both of you for investigating. And thanks for clarifying the user-agent thing.

The change did not solve it. The behaviour is slightly different though, before it looked liked it is starting to downlaod for a view seconds and then stopped with the plugin outdated error. Now it basically stops instant with the information "Try restarting the link (plugin outdated?)". The error also is also another one in the logs now (it was something with ffmpeg before now "Stored directurl expired->ERROR_RETRY") but you can probably identify it better than me. I uploaded the logs after a JD restart to have them clean: 04.07.24 22.53.28 <--> 04.07.24 22.54.06 jdlog://1283411370661/

It's possible they changed something on their website in the meantime, they had maintenance early this week. Not sure about that but it's possible.

You can probably see it yourself but the cookie login seems to work, it looks correct in the accounts and as far as I can tell I can see clouflare passed in logs. There is maybe something with the link, as we get a 410 Gone.
Reply With Quote
  #32  
Old 05.07.2024, 08:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

The "Stored directurl expired" is not related to your problem.
Indeed they did at least do one small change which additionally broke the plugin so it didn't even reach the step where it would get the .m3u8 link in this case.

I've just fixed this but again I'm fixing this blindly as I can't fully test this here due to Cloudflare.
According to your log, login is working fine and you are also not blocked by Cloudflare.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #33  
Old 05.07.2024, 11:35
Docoakere Docoakere is offline
Vacuum Cleaner
 
Join Date: Feb 2024
Posts: 15
Default

It's possible that @Jiaz did the right thing! With your additional fix @pspzockerscene it seems to be working again. I will do some test and have an eye on it. But so far it's downloading.

I guess it's time for my next little donation. Your hard work is appreciated! Thank you guys
Reply With Quote
  #34  
Old 05.07.2024, 11:37
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,112
Default

Thanks for your feedback!

I've re-set the status of this thread to "Declined" even though it's working for you as it will continue to fail for a lot of users due to Cloudflare.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #35  
Old 05.07.2024, 12:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 80,514
Default

@Docoakere: Thanks for the feedback about my changes in HLS download seem to be working
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 16:42.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.