JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 15.02.2019, 15:14
Mara Mara is offline
Junior Loader
 
Join Date: Nov 2016
Posts: 13
Default Resources now hidden on npr.org?

Hi dear JD people,

for years it used to work catching the URLs on npr.org’s weekly First Listen program to get available download links from the tracks.
I figured out to retrieve “uid” numbers in the page resources – current example: “693863220:694560826” – and add a link on JD2 as follows:

**External links are only visible to Support Staff**www.npr.or/player/embed/693863220:694560826

After changing the double-dot to slash I started the search by the following URL:

**External links are only visible to Support Staff**www.npr.or/player/embed/693863220/694560826

This ALWAYS lead to an array of results, including all the mp3 files of the pre-listening sets. For a couple of years now.

From today this doesn’t seem to work any more. It still finds all the files—but the mp3 files are marked as “not available”.
Now, is there someone who may figure out a solution for that? I tried several workarounds for the last few hours but nothing seems to work.
Any help is much appreciated.

Cheers, Mara
Reply With Quote
  #2  
Old 15.02.2019, 15:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

Can you provide more example links?
Yours is marked as unavailable for me (in browser)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 15.02.2019, 17:24
Mara Mara is offline
Junior Loader
 
Join Date: Nov 2016
Posts: 13
Default

www npr dot org/player/embed/693863220/694560826
Does this help?
Reply With Quote
  #4  
Old 15.02.2019, 17:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

site uses javascript player that builds stream urls on the fly
open the developer tools of your browser while playback and you will see the audio streams
and their url format. Didn't find out yet where those infos come from.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 15.02.2019, 19:47
Mara Mara is offline
Junior Loader
 
Join Date: Nov 2016
Posts: 13
Default

Thanks!
I’ve found those URLs on the fly. Pasting them into JD2 it finds the file(name) but marks it as “unknown”. So, same result.
What does that mean, eventually? No chance fpr JD2 to fetch these files?
Reply With Quote
  #6  
Old 15.02.2019, 19:53
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

I will check on monday
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 21.02.2019, 23:56
Mara Mara is offline
Junior Loader
 
Join Date: Nov 2016
Posts: 13
Default

Hi Jiaz,
did you have any chance to check this? I’m still stuck with this (formerly working) issue …
Cheers
Reply With Quote
  #8  
Old 22.02.2019, 11:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

At the moment there is no way to manually specify the referer in JDownloader



for example with wget it works
wget --header="Referer: URL" "MP3URL"
replace URL with the one from tab, MP3URL with the one from developer tools
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 08.03.2019, 15:35
Mara Mara is offline
Junior Loader
 
Join Date: Nov 2016
Posts: 13
Default

Thanks for your time, Jiaz.

Unfortunately I can’t figure it out, yet.
Is there a way to get/execute wget on MacOS? I tried a curl command via Terminal but without success.
Reply With Quote
  #10  
Old 08.03.2019, 15:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

can you provide the tried curl command line? should work fine as well
if you want you can post here or to support@jdownloader.org
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 14.03.2019, 23:57
Mara Mara is offline
Junior Loader
 
Join Date: Nov 2016
Posts: 13
Default

Example command line:

curl **External links are only visible to Support Staff****External links are only visible to Support Staff** -o 20190305_fl_com01.mp3

(Out of several URL variations this was the only one to deliver certain values other than zeros only–but no result/download; Terminal reply: "% 100 Total 33322 % 100 Received 33322 % 0 Xferd 0 Average Speed Dload 28041 Upload 0 Time Total 0:00:01 Time Spent 0:00:01 Time Left --:--:-- Current Speed 28048")

(example taken from page **External links are only visible to Support Staff****External links are only visible to Support Staff**)
Reply With Quote
  #12  
Old 15.03.2019, 10:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

You've got to specify the referer as well

curl -e Website-URL MP3-URL
__________________
JD-Dev & Server-Admin
Reply With Quote
  #13  
Old 15.03.2019, 15:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 60,554
Default

I've answered via mail
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 00:45.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.