JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 20.11.2017, 00:36
ghost2248 ghost2248 is offline
Baby Loader
 
Join Date: Nov 2017
Posts: 5
Default artofx.org link crawling

A long time ago, jd2 could crawl artofx.org's links to the filehosters, but atm you need to manually open thier links in browser to get to the hosts and add that to jd2. I think the website is throwing jd2 off because of referrer url.

example links:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Could the crawling be restored? I tried setting up a link crawler rule but without success.
Reply With Quote
  #2  
Old 20.11.2017, 00:44
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,285
Default

not the case
we listen to the aHR0 string within the url (base64 encoding) from that we decode it, and find uploaded.to link

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 20.11.2017, 00:53
ghost2248 ghost2248 is offline
Baby Loader
 
Join Date: Nov 2017
Posts: 5
Default

Thanks for the reply.
Are you saying jd2 *is* correctly getting the download links from artofx's urls?
Damn... now i need to figure out what setting i have that is breaking that function.
Reply With Quote
  #4  
Old 20.11.2017, 00:58
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,285
Default

correct JD automatically searches for known strings within text/urls
it actually doesn't return bubble notify for that actual task but only for supported links found.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #5  
Old 20.11.2017, 11:30
ghost2248 ghost2248 is offline
Baby Loader
 
Join Date: Nov 2017
Posts: 5
Default

Would it be possible to add support for these links?
Reply With Quote
  #6  
Old 20.11.2017, 14:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,635
Default

wait for next plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 21.11.2017, 12:45
ghost2248 ghost2248 is offline
Baby Loader
 
Join Date: Nov 2017
Posts: 5
Default

the links are crawled/decoded now.
Thanks!
Reply With Quote
  #8  
Old 04.02.2018, 02:10
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,285
Default

reverted change to plugin as it wasn't needed, just adjust the regex pattern so core function can work as intended.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 23:13.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.