JDownloader Community - Appwork GmbH
 

Go Back   JDownloader Community - Appwork GmbH > International Support > JDownloader 2
Reply
 
Thread Tools Display Modes
  #1  
Old 15.04.2018, 03:36
jetpacksam
Guest
 
Posts: n/a
Default Multiple page linksgrabber code

Hello,
I have tried several dozens of different ways to get this to happen and cannot make it work. I am not asking for a plug in, though I wouldn't mind one.

What I want to know is how to tell JDownloader to scan all pages in a directory:


xxxxxxxxx/t123456-p1-xxxxxx-xxxxxxx.html

What would go here to make JDownloader scan to the last page in the directory?

xxxxxxxxx/t123456-p75-xxxxxx-xxxxxxx.html


This would be much easier than listing every page in a directory on a separate line in Linksgrabber.
Any ideas or coding help would be greatly appreciated, because I am stumped.

Thank you.

Last edited by jetpacksam; 15.04.2018 at 03:39. Reason: Clarity
Reply With Quote
  #2  
Old 15.04.2018, 05:01
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,614
Default

link crawler rule with regex pattern listening for that url structure?
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 15.04.2018, 06:04
jetpacksam
Guest
 
Posts: n/a
Default

Everything I try in rules loads one page then stops
Reply With Quote
  #4  
Old 16.04.2018, 14:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,562
Default

Please provide real working example links, then we can help better
You can also send them to support@jdownloader.org
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 04.02.2019, 02:27
jetpacksam
Guest
 
Posts: n/a
Default

Sorry for the delay - life and such.

The 1st page of the thread is listed
**External links are only visible to Support Staff****External links are only visible to Support Staff**

The last page:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

The only change is the -p###- sequence. Is there a coding i can use to scan all pages in a thread? There's enough filters already that it doesn't need to be that detailed.

Is there something I am missing?
Reply With Quote
  #6  
Old 04.02.2019, 12:25
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,562
Default

You've got to create a linkcrawler rule that matches on the pages url and the crawler will then find the other pages and that will make JDownloader to *walk* through all the pages of the thread.

In case you need example rules, just let me know
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 04.02.2019, 12:28
jetpacksam
Guest
 
Posts: n/a
Default

Oh yes please.
A general template would be wonderful thank you.
Reply With Quote
  #8  
Old 04.02.2019, 15:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,562
Default

Quote:

[ {
"enabled" : true,
"maxDecryptDepth" : 0,
"name" : null,
"pattern" : "(?i)https?://(www\\.)?vintage-erotica-forum\\.com/t\\d+-(p\\d+-)?.*?\\.html",
"rule" : "DEEPDECRYPT",
"packageNamePattern" : null,
"passwordPattern" : null,
"formPattern" : null,
"deepPattern" : null,
"rewriteReplaceWith" : null
} ]

The example rule will match on threads and threads+page urls and will find all *useful* including the next pages

Settings-Advanced Settings-LinkCrawler.linkcrawlerrules

deepPattern will specify the pattern where to look for links
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 04.02.2019, 15:55
jetpacksam
Guest
 
Posts: n/a
Default

Thank you. Thank you so much.
Reply With Quote
  #10  
Old 04.02.2019, 16:08
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,562
Default

In case you got questions about this, just let me know
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:25.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.