JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 17.02.2011, 23:50
elvis1
Guest
 
Posts: n/a
Default would it be possible to parse links from same level in forum?

Hi. I sometimes have to download lots of stuff from forums and as you know files are distributed in lots of pages in a same thread.

would it be possible to have the links from all the pages of a thread?

thanks

Last edited by Jiaz; 18.02.2011 at 10:48.
Reply With Quote
  #2  
Old 18.02.2011, 10:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 70,019
Default

setup your thread to have a posts listed in one page, then just copy the html source of that page.
without browser addon it will be a lot of work to add such feature as every board works differently and so on
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 20.02.2011, 05:42
drbits's Avatar
drbits drbits is offline
JD English Support (inactive)
 
Join Date: Sep 2009
Location: Physically in Los Angeles, CA, USA
Posts: 4,437
Default

@ Jiaz,

I think you have the context backwards. People post a message a day or a message a week and links appear in each message (not like TV series).

Does FlashGot All work on Child Pages?

@ elvis1,

Sometimes you cab use Add Links in the LinkGrabber. You click on Add Links and then copy and paste the URL of each page. LinkGrabber will say it cannot find anything to download and ask permission to search a level deeper (which is what you want).

In the current version (9581), this will not work if the entire URL of the link is not displayed (live links are often abbreviated). In the next major version (or Nightly Test), this should be able to read the abbreviated links as well.

If you do this, you will have a lot of junk to remove in your LinkGrabber. You can set up a LinkGrabber filter to remove most of the junk. Edit this example to leave or remove what you want:
Code:
#ignore these extensions
.+?\.gif
.+?\.png
.*?\.jp[e]?g

#eliminate most thumbnails
.*?/tm\_.*?\.jp[e]?g
.*?/th\_.*?\.jp[e]?g
.*?\_thumb.*?\.jp[e]?g

# ignore imdb.com and similar sites
.*?[./]imdb\.com.*?
.*?[./]tv\.com.*?
.*?[./]tvrage\.com.*?
.*?[./]wikipedia\..*?

#ignore these image sites also
.*?[./]imagebam\.com.*?
.*?[./]tubenow\.net.*?
.*?[./]picturetrail\.com.*?
.*?[./]nedds.pl\/img.*?
.*?[./]tinypic\.com.*?
.*?[./]stooorage\.com.*?
Reply With Quote
  #4  
Old 20.02.2011, 13:09
remi
Guest
 
Posts: n/a
Default

I'm curious about the outcome of this because I understand elvis1's requirement exactly the same way as Jiaz does.
Reply With Quote
  #5  
Old 21.02.2011, 16:31
elvis1
Guest
 
Posts: n/a
Default

drbits : many thanks for such useful code

thx guys.



This is what I would like to ask .

For example :


**External links are only visible to Support Staff****External links are only visible to Support Staff**0tfileserve.com/conan-2010-11-18-jesse-eisenberg-hdtv-xvid-fqm-221025/


0 should be replace by o. I am not spamming , just trying to make myself clear as possible.


In such example I would like to grab all content from the multiple posts without having to copy and paste each :

**External links are only visible to Support Staff****External links are only visible to Support Staff**0tfileserve.com/conan-2010-11-18-jesse-eisenberg-hdtv-xvid-fqm-221025-2/
**External links are only visible to Support Staff****External links are only visible to Support Staff**0tfileserve.com/conan-2010-11-18-jesse-eisenberg-hdtv-xvid-fqm-221025-3/

please notice that ive bolded that number changes when passing of page.

Ive seen some commercial software that intends to grab such urls ( from threads )and export them into txt, csv , etc.

thanks again

edit: found something useful: you guys make reference to this?

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Any chance of having it added to JD?

Last edited by elvis1; 21.02.2011 at 16:38.
Reply With Quote
Old 21.02.2011, 16:39
pspzockerscene
Message deleted by pspzockerscene. Reason: Quatsch
  #6  
Old 22.02.2011, 11:26
remi
Guest
 
Posts: n/a
Default

This is not about protecting links.

@elvis1

I understood your request, just as Jiaz did.

If the board doesn't have a feature "Show All Posts in a thread on a single page", then you can take the URIs of the first and the last page of the thread.
If you can program then you could write a small script generating all the URIs for the in-between pages.
If you can't program you could simply do that in a spreadsheet program with the increment and concatenate functions.
Reply With Quote
  #7  
Old 13.02.2013, 13:38
Unicorn! Unicorn! is offline
JD Beta
 
Join Date: Jan 2010
Posts: 51
Default

Sorry to dreg up an old thread here but I just wanted to voice my support for this feature too. At the moment I use excel to generate URLs and then paste all the URLs into the Add Links. Would be great if JD took care of this for me.

Seen as all forums are different I'm wondering if you could have forum plugins just like hosters? I understand that it's probably more effort than it's worth though.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:30.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.