JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 06.12.2021, 17:34
rypz79 rypz79 is offline
JD Addict
 
Join Date: Oct 2009
Location: Israel
Posts: 172
Exclamation [LinkCrawler Rule] bunker.is video gallery, offline file errors

Hi,

Cannot DL the entire video gallery at **External links are only visible to Support Staff****External links are only visible to Support Staff**
I get offline file(s) error(s)
Copying a single video link e.g the top left [right click on the thumbnail -> copy link] **External links are only visible to Support Staff****External links are only visible to Support Staff** or entering it [left click on the thumbnail] and copying the url from the browser **External links are only visible to Support Staff****External links are only visible to Support Staff** still gives me an offline file error.

Using latest JD2 on Win10x64

TNX
Reply With Quote
  #2  
Old 06.12.2021, 18:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,952
Default

Hi,
we don't have a plugin for this website.

Their URLs have a file-extension which looks like those are direct-URLs.
JD checks those then, sees that there is no file and displays them as offline.

You could easily "fix" this using a LinkCrawler rule of type "REWRITE" to e.g. change the "/v/" in video URLs to "/d/" to be able to download those.

Alternatively or additionally, you could create another rule to change the URLs from inside that album (starting with "cdn.bunkr.is/") to those with "/d/" right away.

Let us know if you need help with that.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 06.12.2021, 20:32
rypz79 rypz79 is offline
JD Addict
 
Join Date: Oct 2009
Location: Israel
Posts: 172
Thumbs up nice workaround

@psp I used a Firefox extension to extract all the vids links from the gallery
then as you suggested I replaced the 266 strings headers to **External links are only visible to Support Staff****External links are only visible to Support Staff**... then I had to change max simultaneous DLs to 2 because it gets stuck at offline if you try to DL more then 2 at the same time.

TNX
Reply With Quote
  #4  
Old 06.12.2021, 20:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,952
Default

Thanks for your feedback.
There are always multiple ways to achieve your goal

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #5  
Old 23.02.2022, 02:43
inso inso is offline
Baby Loader
 
Join Date: Nov 2021
Posts: 7
Default

Quote:
Originally Posted by rypz79 View Post
@psp I used a Firefox extension to extract all the vids links from the gallery
then as you suggested I replaced the 266 strings headers to **External links are only visible to Support Staff**...... then I had to change max simultaneous DLs to 2 because it gets stuck at offline if you try to DL more then 2 at the same time.

TNX
What Firefox-plugin are you referring to?
Reply With Quote
  #6  
Old 23.02.2022, 14:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,952
Default

That should work automatically after the release of our next CORE-update as we found out that we got a plugin for a very similar site "cyberdrop.me".

Regarding his addon:
I don't know which one he means but for Chrome I sometimes use "Link Gopher" which is also available for Firefox.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #7  
Old 13.03.2022, 13:55
inso inso is offline
Baby Loader
 
Join Date: Nov 2021
Posts: 7
Default

Where are we on this in terms of ETA? The problem at hand can be solved with a very simple link conversion from:

Code:
https //cdn.bunkr.is/video_<video_id>.mp4
to

Code:
https //stream.bunkr.is/v/video_<video_id>.mp4
This seems fairly simple, especially because as mentioned, there is already a plugin for cyberdrop which is basically identical (the sites even have a similar layout).

I'd really appreciate the effort to solve this simple but frustrating problem.
Reply With Quote
  #8  
Old 13.03.2022, 16:23
inso inso is offline
Baby Loader
 
Join Date: Nov 2021
Posts: 7
Default

^^https //stream.bunkr.is/v/video_<video_id>.mp4 ^^

EDIT: Sorry, correction: when you click the video in the bunkr.is folder it first goes to the stream.bunkr.is link above, then there you can click "Download media" which leads to the ultimate link that JDownloader needs;

Code:
https //media-files.bunkr.is/<filename>.mp4

Last edited by inso; 13.03.2022 at 16:25.
Reply With Quote
  #9  
Old 14.03.2022, 15:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,952
Default

Quote:
Originally Posted by inso View Post
Where are we on this in terms of ETA? The problem at hand can be solved with a very simple link conversion from:
?
The mentioned update has been released a while ago.

I'm not able to reproduce any issues with it.
If you're able to do so, please provide example URLs and a log.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #10  
Old 14.03.2022, 15:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,952
Default

Update:
Indeed our crawler output the wrong direct-URLs and also did not "fix" added single video URLs.
Next CORE-Update will fix this issue.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #11  
Old 16.03.2022, 17:43
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,952
Default

CORE-Updates have been released!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #12  
Old 17.03.2022, 00:10
academyoffetishes academyoffetishes is offline
Mega Loader
 
Join Date: Feb 2018
Posts: 66
Default

Somehow they are set up to only let one download happen at a time, and jdownloader normally respects this. But if multiple "simultaneous download" threads try to start a different bunkr.is file at the same time, this triggers DDoS protection. I suspect this will happen over and over again unless you reduce your simultaneous downloads to 1, which is an inconvenient setting, because this host downloads very very slow.

To reproduce this, add 6+ bunkr.is files to your download tab and have ~6 "simultaneous download". Restart so that it tries to start downloads on all bunkr.is files simultaneously.

16.03.22 16.04.03 <--> 16.03.22 16.05.30 jdlog://5296925302851/

Last edited by academyoffetishes; 17.03.2022 at 00:22.
Reply With Quote
  #13  
Old 17.03.2022, 11:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,241
Default

@academyoffetishes: you can setup DomainRule for this generic http and limit it to 1 concurrent download
Settings->Advanced Settings->GeneralSettings.domainrules

Code:
[ {
"domainPattern" : "bunkr.is",
"enabled" : true,
"maxSimultanDownloads" : 1,
"allowToExceedTheGlobalLimit" : false
} ]
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 17.03.2022, 22:01
academyoffetishes academyoffetishes is offline
Mega Loader
 
Join Date: Feb 2018
Posts: 66
Default

okay thanks a lot. I think this would be useful to every person who downloads multiple files from "bunkr.is". At what point does it cross the threshold to be worthy of its own plug-in?
Reply With Quote
  #15  
Old 17.03.2022, 22:07
academyoffetishes academyoffetishes is offline
Mega Loader
 
Join Date: Feb 2018
Posts: 66
Default

From another perspective: if jdownloader users have a tendency to trigger bunkr.is' DDOS attacks, doesn't it make it more likely that bunkr.is (and perhaps cyberdrop.me, if they share the same codebase) will look into what's happening and try to find a way to ban jdownloader, causing more work for you in the long run?
Reply With Quote
  #16  
Old 17.03.2022, 22:11
academyoffetishes academyoffetishes is offline
Mega Loader
 
Join Date: Feb 2018
Posts: 66
Default

Edit: nevermind, please ignore this msg.

Last edited by academyoffetishes; 17.03.2022 at 22:48.
Reply With Quote
  #17  
Old 18.03.2022, 10:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,241
Default

@academyoffetishes: I will think of a way to set those limits automatically
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 18.03.2022, 21:46
academyoffetishes academyoffetishes is offline
Mega Loader
 
Join Date: Feb 2018
Posts: 66
Default

Thanks!
Reply With Quote
  #19  
Old 19.03.2022, 12:36
inso inso is offline
Baby Loader
 
Join Date: Nov 2021
Posts: 7
Default

Quote:
Originally Posted by Jiaz View Post
@academyoffetishes: you can setup DomainRule for this generic http and limit it to 1 concurrent download
Settings->Advanced Settings->GeneralSettings.domainrules

Code:
[ {
"domainPattern" : "bunkr.is",
"enabled" : true,
"maxSimultanDownloads" : 1,
"allowToExceedTheGlobalLimit" : false
} ]
How/where do I enter this? When I try and paste it in the "Value" field beneath the standard code ( "domainPattern": ".*jdownloader\\.org",) and hit enter, a window, "An error has occurred" pops up.
Reply With Quote
  #20  
Old 19.03.2022, 15:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,241
Default

@inso:
Quote:
Originally Posted by inso View Post
where do I enter this?
Settings->Advanced Settings->GeneralSettings.domainrules

Quote:
Originally Posted by inso View Post
How do I enter this?
It's a JSON Object array
Code:
[ {
"domainPattern" : "bunkr.is",
"enabled" : true,
"maxSimultanDownloads" : 1,
"allowToExceedTheGlobalLimit" : false
} ]
Quote:
Originally Posted by inso View Post
When I try and paste it in the "Value" field beneath the standard code ( "domainPattern": ".*jdownloader\\.org",) and hit enter, a window, "An error has occurred" pops up.
The value must be properly JSON syntax
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:14.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.