#1
|
|||
|
|||
[LinkCrawler Rule] bunker.is video gallery, offline file errors
Hi,
Cannot DL the entire video gallery at **External links are only visible to Support Staff****External links are only visible to Support Staff** I get offline file(s) error(s) Copying a single video link e.g the top left [right click on the thumbnail -> copy link] **External links are only visible to Support Staff****External links are only visible to Support Staff** or entering it [left click on the thumbnail] and copying the url from the browser **External links are only visible to Support Staff****External links are only visible to Support Staff** still gives me an offline file error. Using latest JD2 on Win10x64 TNX |
#2
|
||||
|
||||
Hi,
we don't have a plugin for this website. Their URLs have a file-extension which looks like those are direct-URLs. JD checks those then, sees that there is no file and displays them as offline. You could easily "fix" this using a LinkCrawler rule of type "REWRITE" to e.g. change the "/v/" in video URLs to "/d/" to be able to download those. Alternatively or additionally, you could create another rule to change the URLs from inside that album (starting with "cdn.bunkr.is/") to those with "/d/" right away. Let us know if you need help with that. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
nice workaround
@psp I used a Firefox extension to extract all the vids links from the gallery
then as you suggested I replaced the 266 strings headers to **External links are only visible to Support Staff****External links are only visible to Support Staff**... then I had to change max simultaneous DLs to 2 because it gets stuck at offline if you try to DL more then 2 at the same time. TNX |
#4
|
||||
|
||||
Thanks for your feedback.
There are always multiple ways to achieve your goal -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#5
|
|||
|
|||
Quote:
|
#6
|
||||
|
||||
That should work automatically after the release of our next CORE-update as we found out that we got a plugin for a very similar site "cyberdrop.me".
Regarding his addon: I don't know which one he means but for Chrome I sometimes use "Link Gopher" which is also available for Firefox. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#7
|
|||
|
|||
Where are we on this in terms of ETA? The problem at hand can be solved with a very simple link conversion from:
Code:
https //cdn.bunkr.is/video_<video_id>.mp4 Code:
https //stream.bunkr.is/v/video_<video_id>.mp4 I'd really appreciate the effort to solve this simple but frustrating problem. |
#8
|
|||
|
|||
^^https //stream.bunkr.is/v/video_<video_id>.mp4 ^^
EDIT: Sorry, correction: when you click the video in the bunkr.is folder it first goes to the stream.bunkr.is link above, then there you can click "Download media" which leads to the ultimate link that JDownloader needs; Code:
https //media-files.bunkr.is/<filename>.mp4 Last edited by inso; 13.03.2022 at 16:25. |
#9
|
||||
|
||||
Quote:
The mentioned update has been released a while ago. I'm not able to reproduce any issues with it. If you're able to do so, please provide example URLs and a log. Please post your log-ID here | bitte poste deine Log-ID hier. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#10
|
||||
|
||||
Update:
Indeed our crawler output the wrong direct-URLs and also did not "fix" added single video URLs. Next CORE-Update will fix this issue. Bitte auf das nächste CORE-Update warten! Please wait for the next CORE-Update! Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#11
|
||||
|
||||
CORE-Updates have been released!
Please update your JDownloader and report any issues you find asap. CORE-Updates wurden released! Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#12
|
|||
|
|||
Somehow they are set up to only let one download happen at a time, and jdownloader normally respects this. But if multiple "simultaneous download" threads try to start a different bunkr.is file at the same time, this triggers DDoS protection. I suspect this will happen over and over again unless you reduce your simultaneous downloads to 1, which is an inconvenient setting, because this host downloads very very slow.
To reproduce this, add 6+ bunkr.is files to your download tab and have ~6 "simultaneous download". Restart so that it tries to start downloads on all bunkr.is files simultaneously. 16.03.22 16.04.03 <--> 16.03.22 16.05.30 jdlog://5296925302851/ Last edited by academyoffetishes; 17.03.2022 at 00:22. |
#13
|
||||
|
||||
@academyoffetishes: you can setup DomainRule for this generic http and limit it to 1 concurrent download
Settings->Advanced Settings->GeneralSettings.domainrules Code:
[ { "domainPattern" : "bunkr.is", "enabled" : true, "maxSimultanDownloads" : 1, "allowToExceedTheGlobalLimit" : false } ]
__________________
JD-Dev & Server-Admin |
#14
|
|||
|
|||
okay thanks a lot. I think this would be useful to every person who downloads multiple files from "bunkr.is". At what point does it cross the threshold to be worthy of its own plug-in?
|
#15
|
|||
|
|||
From another perspective: if jdownloader users have a tendency to trigger bunkr.is' DDOS attacks, doesn't it make it more likely that bunkr.is (and perhaps cyberdrop.me, if they share the same codebase) will look into what's happening and try to find a way to ban jdownloader, causing more work for you in the long run?
|
#16
|
|||
|
|||
Edit: nevermind, please ignore this msg.
Last edited by academyoffetishes; 17.03.2022 at 22:48. |
#17
|
||||
|
||||
@academyoffetishes: I will think of a way to set those limits automatically
__________________
JD-Dev & Server-Admin |
#18
|
|||
|
|||
Thanks!
|
#19
|
|||
|
|||
Quote:
|
#20
|
||||
|
||||
@inso:
Settings->Advanced Settings->GeneralSettings.domainrules It's a JSON Object array Code:
[ { "domainPattern" : "bunkr.is", "enabled" : true, "maxSimultanDownloads" : 1, "allowToExceedTheGlobalLimit" : false } ]
__________________
JD-Dev & Server-Admin |
#21
|
|||
|
|||
Yes, I posted the code you provided - without modifying anything in terms of syntax - in the "Value" field under :
- "Settings->Advanced Settings->GeneralSettings.domainrules", beneath the standard code that was already written in that field ( "domainPattern": ".*jdownloader\\.org",.......etc.) But when I hit Enter as to try and save it, a pop-up box saying "An error has occurred" showed up.. You did not say where to paste it exactly; so the "Value" field was the only place that seemed obvious to me. Tell me if that was wrong, and where I should put it. Please give me a simple but complete, user friendly instruction on how to actually make it work, as I'm not a programmer. Last edited by inso; 19.03.2022 at 23:17. |
#22
|
|||
|
|||
Quote:
|
#23
|
|||
|
|||
I don't know if this is a bug or not, but sometimes when I start a bunkr.is download, the status changes from downloading, to nothing, to starting, to downloading again. You can see this within the last 10 minutes of my log. Is this the website's DDOS protection, or something jdownloader can prevent? I've often seen this happen multiple times within a short period (a minute) before leading to "service temporarily unavailable."
20.03.22 04.04.23 <--> 20.03.22 18.06.51 jdlog://9317925302851/ Is there any way for me as a user to see jdownloader logs about what's happening when this occurs? |
#24
|
|||||||
|
|||||||
Quote:
In general we prefer to use our generic plugins so in this case we do have a crawler plugin for galleries but no hoster plugin for downloading. If a lot of users are using a particular website and that website has particular limits or similar in place these factors can make it worth to add a host plugin. Quote:
You can use webtools like the following tool to easily test/verify json structures: jsoneditoronline.org (Paste the json into the left side, then click on the "Copy >" Button, then in the right column, left side click on the button "tree".) Quote:
Quote:
You've either copied something else along the json structure provided ba Jiaz and/or another application running on your system is messing around with your clipboard content. Quote:
1. The default value is: Code:
[ { "enabled" : false, "pluginPattern" : null, "domainPattern" : ".*jdownloader\\.org", "allowToExceedTheGlobalLimit" : false, "filenamePattern" : "\\.png$", "accountPattern" : "myUsername", "maxSimultanDownloads" : 20 } ] By clicking it you can reset a setting to its default. This is consistent through most of JDownloaders GUI too (e.g. also inside our plugin settings). 2. The default value is only an example so it's fine to select it (CTRL + A) and overwrite it with the json provided by Jiaz. Quote:
Set max. simultaneous downloads and max. chunks to 1 and try again. If that doesn't help, manually check the failing files in your browser and/or wait and try again later. Quote:
As described here, you can find your logs in the "logs" folder which is located in your JD install dir. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 22.03.2022 at 11:36. Reason: Fixed quotes |
#25
|
|||
|
|||
Thanks!
Just want to state that most of the things you were replying to weren't said by me, but the person I was replying to. |
#26
|
||||
|
||||
You're right.
I've fixed that. I hope my answer was helpful nevertheless -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#27
|
|||
|
|||
Quote:
|
#28
|
||||
|
||||
Umm not sure what to answer:
Yes, the default value doesn't do anything - you can safely overwrite it. Whenever you're playing around with any settings, I suggest to create a backup of your config in beforehand. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#29
|
|||
|
|||
I've been having an issue when trying to download .mkv video files from bunkr.
downloading mp4 files works fine, but when it's an .mkv video file, jdownloader says the file is missing or unavailable even though it's actually there and playable in a web browser. is there a workaround or fix for this issue? |
#30
|
||||
|
||||
Hi phpremium9000,
I believe that we've already fixed it but haven't released the fix yet. Please provide example URLs so I can check this.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#31
|
|||
|
|||
I'm having some difficulty figuring out if the 4 bunkr threads are about the same issue, or different ones:
this one https://board.jdownloader.org/showth...ighlight=bunkr https://board.jdownloader.org/showth...ighlight=bunkr https://board.jdownloader.org/showth...ighlight=bunkr I have more logs that reproduce the issue. Is this helpful, or do you already have enough information? 09.11.22 17.01.02 <--> 09.11.22 17.35.38 jdlog://9001311370661/ Here is the URL I downloaded: **External links are only visible to Support Staff****External links are only visible to Support Staff** 5/6 videos said "file not found." In my experience, if I go directly to the video and download that url instead, it works correctly. I tried that with this URL: **External links are only visible to Support Staff****External links are only visible to Support Staff** That's the last video in the gallery. |
10.11.2022, 07:30 |
rachelgomez123 |
Message deleted by pspzockerscene.
Reason: Bot spam
|
#32
|
||||
|
||||
@academyoffetishes
Indeed the status of this was somehow chaotically spread over multiple threads. I've merged thread 90961 into 91374 and closed thread 91629. I've posted a (hopefully) clear status update here. This thread is closed now as it is outdated as Link Crawler rules are not needed anymore more bunkr.is/cyberdrop.me websites because we do have plugins now although (as explained) they're still partially broken in the current stable version of JDownloader. Please use this thread if you want to leave a comment about this topic. *Thread closed*
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 10.11.2022 at 14:45. Reason: Added one more hyperlink to new/open bunkr.is/cyberdrop.me related thread. |
Thread Tools | |
Display Modes | |
|
|