JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 30.10.2016, 20:39
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Arrow Deutsche Welle support.

Hi, could you please add direct support to DW's streaming website?

Main streaming website (ES):

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Example links:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I don't know if you can make JD2 replicates what browsers do, regarding the RTMP streams' request, but that's not the most important issue about my request. Reading each source pages from the aforementioned example links, there is always a direct "HTTP" link for the higher quality version from the videos, which for some weird reason they hide.

Since downloading through direct links is a lot better than doing it via RTMP ones, it would be good if JD2 just grabs them directly after copying such links to the clipboard, and uses the websites' titles as filenames.

Thanks.
Reply With Quote
  #2  
Old 31.10.2016, 12:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 29.11.2016, 01:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,620
Default

Hi
No need for a plugin.
Simply go to Settings --> Advanced Settings --> Search for "link crawler rules" --> Enter this:
Code:
[
  {
    "enabled": true,
    "maxDecryptDepth": 1,
    "id": 1422443765154,
    "name": "dw.com TEST",
    "pattern": "https?://(www\\.)?dw\\.com/.+av\\-\\d+",
    "rule": "DEEPDECRYPT",
    "packageNamePattern": "<title>(.*?)</title>",
    "formPattern": null,
    "deepPattern": null,
    "rewriteReplaceWith": null
  }
]
Best regards,
pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 06.12.2016 at 17:24. Reason: Added packageNamePattern
Reply With Quote
  #4  
Old 29.11.2016, 09:25
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

@pspzocker: you should also learn to specify the packageNamePattern and deepPattern
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 30.11.2016, 19:01
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,620
Default

I'm usually making minimalistic crawler rules - if a user wants it to do more, simply ask

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #6  
Old 06.12.2016, 23:25
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

Thanks, I just tried it and it works, but I would like it grabs just the video files and leaves out all the rest of links. For example, for this link:

Code:
**External links are only visible to Support Staff**
JD2 will grab 159 links, from which 158 are useless, since just the video related one is needed.
Reply With Quote
  #7  
Old 07.12.2016, 02:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,620
Default

Updated - try this:
Code:
[
  {
    "enabled": true,
    "maxDecryptDepth": 1,
    "id": 1422443765154,
    "name": "dw.com TEST",
    "pattern": "https?://(www\\.)?dw\\.com/.+av\\-\\d+",
    "rule": "DEEPDECRYPT",
    "packageNamePattern": "<title>(.*?)</title>",
    "formPattern": null,
    "deepPattern": "\"(http[^\"]+\\.mp4)\"",
    "rewriteReplaceWith": null
  }
]
GreeZ pspzockerscene
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #8  
Old 08.12.2016, 01:26
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

It works completely fine now, thanks.
Reply With Quote
  #9  
Old 08.12.2016, 09:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

Danke fürs Feedback!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 12.06.2017, 19:47
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

False alarm. Delete please.

Last edited by ElCho; 12.06.2017 at 21:42.
Reply With Quote
  #11  
Old 13.06.2017, 10:13
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

Thanks for the feedback!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #12  
Old 10.10.2017, 16:36
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

Hi, since some weeks ago, I just noted they dropped their habit of hiding the HD MP4 direct download link of the videos in the source pages; now, they leave just a low quality, FLV vp6 direct link over there. Despite that, at least two other qualities of the videos can still be downloaded once they are reproduced by the embedded player. So, it would be good if you can make JD2 grab those ones from now on.

Example links:

Quote:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
The first links have two qualities (as far as I can see):

pri20170928_9673mikrobenHD_sd_sor.mp4 (121,54 MB)

pri20170928_9673mikrobenHD_sd_avc.mp4 (808.87 MB)


The second one has two as well:

pri20171010_9684SterneNahHD_sd_sor.mp4 (184,20 MB)

pri20171010_9684SterneNahHD_sd_avc.mp4 (805,18 MB)


Thanks.
Reply With Quote
  #13  
Old 10.10.2017, 16:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 10.10.2017, 16:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

we will check and add proper plugin support
__________________
JD-Dev & Server-Admin
Reply With Quote
  #15  
Old 03.11.2017, 13:39
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

I just saw this issue got a %100 progress status and has been already closed, but it still has the "bugtracker" tag in its title and downloads are still not working.
Reply With Quote
  #16  
Old 03.11.2017, 13:53
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,044
Default

Forgot to reopen the ticket, sorry
__________________
JD-Dev & Server-Admin
Reply With Quote
  #17  
Old 03.11.2017, 14:44
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

It's OK.
Reply With Quote
  #18  
Old 13.02.2020, 04:00
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

Hello, is there some hope left about adding support for this website?

Thanks.
Reply With Quote
  #19  
Old 13.02.2020, 19:12
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,620
Default

Added basic crawler plugin.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #20  
Old 13.02.2020, 23:52
ElCho ElCho is offline
Tornado
 
Join Date: May 2014
Posts: 232
Default

Very nice, it's getting the streams correctly so far I tested it.

There is a missing detail about the saved streams' filenames, which maybe can be automatized as well. Basically, naming files to be saved according to the web page they are on, like this:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Original name: "pri200205_10618redchildren_sd_avc.mp4"

Renamed: "Niños rojos - La infancia bajo el gobierno de Mao.mp4"

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Original name: "pri20200212_10613dresden_sd_avc.mp4"

Renamed: "El mito de Dresde - La sombra de una noche de bombardeos.mp4"

Thanks.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:34.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.