JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 13.09.2012, 23:34
Dirk
Guest
 
Posts: n/a
Default Let jD scan an entire website for download links?

Is it possible to let jD scan an entire website for download links? Can you change the depth jD shall crawl for downloads with the "Crawling for Downloads" option?

And may be to filter the download links, e.g. add all the links of mediafire?

When I enter an URL with download links on the index page, jD does find anything.

Last edited by Jiaz; 14.09.2012 at 09:41.
Reply With Quote
  #2  
Old 14.09.2012, 09:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

JD already has deep crawling but it will only work 1 level. not deeper!
you can customize filters yourself in linkgrabber filter settings
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 14.09.2012, 10:02
Dirk
Guest
 
Posts: n/a
Default

OK, thanks Jiaz.

Yes, but it doens't seem to be possible to show the created filers by oneself on the right side in the link grabber window in "Views" to activate / deactivate when needed.

Last edited by Dirk; 14.09.2012 at 10:07.
Reply With Quote
  #4  
Old 14.09.2012, 10:22
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

what you mean? I don't understand, sorry
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 14.09.2012, 10:35
Dirk
Guest
 
Posts: n/a
Default

In the link grabber window on the right side you can de/activate filters in "Views". The filters / views created by yourself you can not de/activate on the right side in "Views", I assume. The filters created by yourself in "Settings" will not displayed in "Views" in the link grabber window, I assume, is that true?
Reply With Quote
  #6  
Old 14.09.2012, 10:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

You need to create View filters. The filters are not displayed because filtered stuff never reaches JD!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 14.09.2012, 10:53
Dirk
Guest
 
Posts: n/a
Default

Do I understand right, the filtered links do not appear in the link grabber window? So it is not that way it is with the filters in "Views" in the link grabber window, which are listed in the link grabber window and you can display or undisplay them.
Reply With Quote
  #8  
Old 14.09.2012, 10:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

linkgrabber filter = you dont want jd to process those links. thats why those links never will be in JD, so no filter...what you want is a view filter so you still let jd process the links and then can hide/show them in list!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 14.09.2012, 11:00
Dirk
Guest
 
Posts: n/a
Default

I understand, thank you Jiaz.
Reply With Quote
  #10  
Old 21.04.2015, 19:42
mverte mverte is offline
Vacuum Cleaner
 
Join Date: Dec 2010
Posts: 17
Default

Where I can find examples to create filters in Jdownloader
Reply With Quote
  #11  
Old 21.04.2015, 19:48
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Do you mean linkgrabber filter?
No examples needed as its easy to understand!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 22.04.2015, 07:41
mverte mverte is offline
Vacuum Cleaner
 
Join Date: Dec 2010
Posts: 17
Exclamation scan an entire website for download links?

the original title is scan an entire website for download links?

but I can not do the site is a wordpress with this structure

**External links are only visible to Support Staff****External links are only visible to Support Staff**

TO

**External links are only visible to Support Staff****External links are only visible to Support Staff**


but failed to get the links from the site in any way, that's my question and I do not understand

Thanks
Reply With Quote
  #13  
Old 22.04.2015, 09:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

JDownloader does only deep decrypt a single page by default.
For what you want to do you need
1.) an index page that lists all available urls to deep decrypt
2.) create a customized linkcrawler rule (contact me via support@jdownloader.org) which auto decrypts specific urls. Or you use Browser Extensions, like flashgot, that can travel through pages.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 20.11.2020, 08:32
bloodsucker3011 bloodsucker3011 is offline
Modem User
 
Join Date: Sep 2020
Posts: 3
Default

I also ran into the same problem with this website: **External links are only visible to Support Staff****External links are only visible to Support Staff**

for example, I try to garb all link on this page:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

and the software understands and grab all link on the page:

GOFILE **External links are only visible to Support Staff****External links are only visible to Support Staff**
MEGA **External links are only visible to Support Staff****External links are only visible to Support Staff**
GOOGLE DRIVE **External links are only visible to Support Staff****External links are only visible to Support Staff**

but now I have to manually garb every single link. it looks like software refuse to run 2 level.
Reply With Quote
  #15  
Old 20.11.2020, 13:46
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

The website uses Cloudflare and thus JDownloader cannot load the website/html for parsing.
The 3 example links are working fine. You can just open the website in browser and select the download links/area and copy to clipboard.
With blocking adf.ly domain javascript, the links are all plain
__________________
JD-Dev & Server-Admin

Last edited by pspzockerscene; 20.11.2020 at 13:47. Reason: Hyperlinked "Cloudflare"
Reply With Quote
  #16  
Old 20.11.2020, 22:08
bloodsucker3011 bloodsucker3011 is offline
Modem User
 
Join Date: Sep 2020
Posts: 3
Default

Thank you for the info, that why I can't use the trick anymore. So there is no way to surpass it? or a way around it? it really painful to go to each one by one tab, it makes my web browser freeze.
Reply With Quote
  #17  
Old 21.11.2020, 12:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

I'm sorry but until newest Cloudflare is supported, then doing this manually in browser is the only way
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 22.11.2020, 21:49
bloodsucker3011 bloodsucker3011 is offline
Modem User
 
Join Date: Sep 2020
Posts: 3
Default

Thank you Jiaz, that very helpful.
Reply With Quote
  #19  
Old 23.11.2020, 09:15
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,524
Default

Nothing to thank me for! I just answered/explained the situation without providing an real solution
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:22.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.