JDownloader Community - Appwork GmbH

Thread Tools Display Modes
Old 09.04.2024, 20:55
Castawat Castawat is offline
Modem User
Join Date: Jan 2023
Posts: 3
Default Erome.com paginated links crawl entire user profile


I used to download by letting jdownloader scrape each URL with a page number, and it'd find all albums and the files contained within for that page number only.

Recently i tried again but was stumped by it returning more files than were in the page. Some checking shows me that the [url]?page=3 is now ignored and jdownloader scrapes the entire user profile instead!

Recent changes were done to this to allow user profile scraping, see thread: https://board.jdownloader.org/showthread.php?t=94928

It seems that following this, pagination is now ignored in URL's!

Example links: **External links are only visible to Support Staff** Should return 9 video files that are on that page, 1 file from each album on the page, but instead returns 297 files in the link grabber, as it scrapes the entire profile(297 albums with 1 file each for that link)

Best regards and thanks for an amazing download manager/link crawling/everything else this wonderful software does

Extra's incase needed:
09.04.24 19.50.19 <--> 09.04.24 20.47.20 jdlog://9602411370661/
Win 10 22H2
Jdownloader 2 Core: #48254
Java: Oracle Corporation - Java(TM) SE Runtime Environment - 1.8.0_40(64bit/X86)(included with jdownloader)
Reply With Quote
Old 09.04.2024, 21:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
Join Date: Mar 2009
Location: Germany
Posts: 80,442

@Castawat: nearly no plugin does support specific page of a profile/album/xy. Plugin only supports album and profile. If you want to only add the page 9, see https://support.jdownloader.org/de/k...orted-websites
You can also just select the videos on the website and CTRL+C
With next plugin update, specific page will be supported as well
JD-Dev & Server-Admin
Reply With Quote

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 21:54.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.