JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #21  
Old 04.02.2023, 14:24
toby666123 toby666123 is offline
Vacuum Cleaner
 
Join Date: Jan 2023
Posts: 16
Default

Wow, nice one! Thanks a lot for your swift support!!!
Reply With Quote
  #22  
Old 24.03.2023, 14:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #23  
Old 25.03.2023, 17:57
leroyeur leroyeur is offline
JD Beta
 
Join Date: Apr 2021
Posts: 57
Default

Hello!
Thank you for the awesome support, and wonderful Spring Break gift.

Seems that when I try to add a link of a movie's webpage (5 examples below), it fetches videos past that respective page.

1. **External links are only visible to Support Staff****External links are only visible to Support Staff**
2. **External links are only visible to Support Staff** tits" rel="noopener noreferrer nofollow" target="_blank">**External links are only visible to Support Staff**
3. **External links are only visible to Support Staff****External links are only visible to Support Staff**
4. **External links are only visible to Support Staff****External links are only visible to Support Staff**
5. **External links are only visible to Support Staff****External links are only visible to Support Staff**

Adding a link would get over 100 videos

The following log is me adding **External links are only visible to Support Staff**this link to JD

25.03.23 19.51.25 <--> 25.03.23 19.53.03 jdlog://8824311370661/
25.03.23 19.51.25 <--> 25.03.23 19.53.03 jdlog://8824311370661/
25.03.23 19.51.25 <--> 25.03.23 19.53.03 jdlog://8824311370661/

BTW, I've elaborated more on the site's mechanisms before in this forum. I've also mentioned the multiple available formats thing, and I wonder how you guys worked on that.

Last edited by pspzockerscene; 27.03.2023 at 17:31. Reason: Removed LOGLINK and SPOILER tags. LOGLINK tag is only for mods to remind users to post logs.
Reply With Quote
  #24  
Old 26.03.2023, 16:59
toby666123 toby666123 is offline
Vacuum Cleaner
 
Join Date: Jan 2023
Posts: 16
Default

Similar Issue here. Can be tested wonderfully w/ Packagizer Rules.

E.g. w/ the following Link, Packagizer will find tons of videos as well as PNGs and other files from completely different videos on the site.

**External links are only visible to Support Staff****External links are only visible to Support Staff**



And the following two videos for example do not work with Packagizer at all.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #25  
Old 27.03.2023, 18:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

@leroyeur
Links in that "/dvd/..." format are not supported.
...but this was not the main issue.
The main issue was this:
1. bang.com has changed the video URLs in the meantime - they can now also contain "-" which was not the case before.
If a pattern is not matched by any of our plugins, the deep-parser will be used instead which explains your "weird results".
2. They've changed the website layout and the video downloadurls were now in a different part of the html code thus the crawler failed.

@toby666123
Packagizer rules are not needed here so I don't really understand how- and why you were trying to use them here.

Changes for the next plugin update:
- Fixed video crawler
- Added trick to get thumbnails in higher quality

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 05.04.2023 at 17:08. Reason: Fixed typos
Reply With Quote
  #26  
Old 03.04.2023, 21:27
toby666123 toby666123 is offline
Vacuum Cleaner
 
Join Date: Jan 2023
Posts: 16
Default

Possible to release the update before / independently from the next Core Update?
Reply With Quote
  #27  
Old 04.04.2023, 02:31
leroyeur leroyeur is offline
JD Beta
 
Join Date: Apr 2021
Posts: 57
Default

Quote:
Originally Posted by toby666123 View Post
Possible to release the update before / independently from the next Core Update?
Seconded - wondering the same
Reply With Quote
  #28  
Old 04.04.2023, 14:06
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Quote:
Originally Posted by toby666123 View Post
Possible to release the update before / independently from the next Core Update?
No.

If you can't wait, you can get our dev build here:
https://support.jdownloader.org/Know...up-ide-eclipse
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #29  
Old 05.04.2023, 16:58
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 504
Default

@toby666123:
@leroyeur:

update is live. please test and provide feedback
Reply With Quote
  #30  
Old 05.04.2023, 19:16
toby666123 toby666123 is offline
Vacuum Cleaner
 
Join Date: Jan 2023
Posts: 16
Default

First of all: Thanks a lot for the quick update, awesome!!!!:)

I tested and it works now!

Found one bug:
If I do neither select "grab preview video" nor "grab thumbnail", JD will not download anything. I do have to select one of these two options in order for JD to download the actual video. Could that be fixed?

Anyways, still many thanks for your development work guys!!!!!
Reply With Quote
  #31  
Old 06.04.2023, 11:39
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 504
Default

@toby666123:Thank you for the error report. Should be working as excpected with next plugin update
Reply With Quote
  #32  
Old 06.04.2023, 17:00
toby666123 toby666123 is offline
Vacuum Cleaner
 
Join Date: Jan 2023
Posts: 16
Default

Just downloaded the new update but unfortunately the Bug is still there. I still do need to download thumbnail or preview video in order to be able to download the actual video.
Reply With Quote
  #33  
Old 06.04.2023, 17:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

The changes haven't been released yet as the code hasn't been uploaded yet.

I've changed the thread-prefix accordingly.
Try again once the thread prefix is set to "Solved" again.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #34  
Old 08.04.2023, 18:11
leroyeur leroyeur is offline
JD Beta
 
Join Date: Apr 2021
Posts: 57
Default

Pages of **External links are only visible to Support Staff**individual videos/scenes are working well (URLs of bang.com/video/).



Although I'd rather opt out of downloading the preview if I could, as JD is grabbing both the full video + the preview, so that's one suggestion - but otherwise this feature is working.

However, with "full movies" (bang.com/dvd/), it still grabs videos/content from irrelevant pages. **External links are only visible to Support Staff**This is the link I copied to JD, and the following image is the results I got.



One more note: I don't remember how JD parsed links before, but I think it's better this time? What I've noticed, is that the first few links it got were links of the individuals scenes in the movie I was trying to download. Below, you will find the packages of all 5 scenes in the movie, thanks to the parse job JD did when I copied the movie's link to it.



Final suggestions:
1. It's better if the scenes from one movie would end up in a single package, rather than each scene in its own package. This would help in bigger scrape jobs, for when a user copies the links of more than 1 movie, so that each movie would be contained in its own respective package.
2. It would be cool if there was an option for changing the filename scheme so that it has the original filename fetched from the server (which usually is in the format of [movie-name-scene1.540p.mp4; movie-name-scene2.540p.mp4; etc]) AND the video title from the website (which is shown in the package's names).
So, "movie-name-scene1.540p - [Video title].mp4".

A dropdown menu for the filename schemes would be great, like what's done for Brazzers



Awesome work guys, thanks.
Reply With Quote
  #35  
Old 08.04.2023, 20:00
leroyeur leroyeur is offline
JD Beta
 
Join Date: Apr 2021
Posts: 57
Default

Sorry, forgot to add the Log (if needed).

Spoiler:
08.04.23 18.42.36 <--> 08.04.23 20.35.25 jdlog://1364311370661/


Spoiler:
08.04.23 18.42.36 <--> 08.04.23 20.35.25 jdlog://1364311370661/


Also, upon reading my comment; I'm not sure if this is necessary, but I thought I'd clarify:

1. There are no "full" movies on the site. All movies are split into multiple scenes. So, in every /dvd/ page, there should be 1 or more /video/ page.
However, there are movies with only one scene. But generally, there is no /dvd/ link that does not contain /video/ links.

2. As explained, the filenaming structure of practically all videos in the website (except for previews and videos that are not related to movies) are:
[movie-name-separated-with-hyphens]-scene[number].[resolution].[extension]
e.g alpha-beta.scene3.3gp
lorem-ipsum.scene9.avi

However: sometimes there are bonus scenes, like in **External links are only visible to Support Staff**this movie

Their filename structure is
[movie-name]-bonus-scene[number].[resolution].[extension]
So, "bonus" is added before "-scene" is the only difference.
e.g lorem-ipsum-bonus-scene1.mp4
lorem-ipsum-bonus-scene2.mp4

There can be multiple bonus scenes in a movie and their numbering is irrespective of the original/regular scenes.

--

I hope this helps. Also, you might find one of the old replies I've left in this thread useful. It contains details that I felt were important, in terms of user experience from my side.

Last edited by pspzockerscene; 11.04.2023 at 15:49. Reason: Removed LOGLINK tags those are only for moderators
Reply With Quote
  #36  
Old 11.04.2023, 15:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Quote:
Originally Posted by leroyeur View Post
Although I'd rather opt out of downloading the preview if I could...
As described, you can turn that off in the bang.com plugin settings.
Due to a bug though that didn't always work -> Try again after the release of our next CORE-updates.

Quote:
Originally Posted by leroyeur View Post
However, with "full movies" (bang.com/dvd/), it still grabs videos/content from irrelevant pages.
That is not considered as a bug.
Currently the crawler plugin only supports links matching the following pattern:
Code:
"https?://(?:www\\.)?" + buildHostsPatternPart(domains) + "/video/([\\w\\-]+)/([a-z0-9\\-]+)"
All other links will go through the generic deep-crawler (the deep-crawler is also "not logged in") so that explains the "irrelevant" results you get.
You can use the following method to collect such URLs:
https://support.jdownloader.org/Know...orted-websites
...or, if you want to, you can request support for those URLs here.

Quote:
Originally Posted by leroyeur View Post
Final suggestions:...
1. It's better if the scenes from one movie would end up in a single package, rather than each scene in its own package. This would help in bigger scrape jobs, for when a user copies the links of more than 1 movie, so that each movie would be contained in its own respective package.
Please provide example URLs.

Quote:
Originally Posted by leroyeur View Post
2. It would be cool if there was an option for changing the filename scheme so that it has the original filename fetched from the server (which usually is in the format of [movie-name-scene1.540p.mp4; movie-name-scene2.540p.mp4; etc]) AND the video title from the website (which is shown in the package's names).
You can always change filenames using Packagizer rules, see:
https://support.jdownloader.org/Know...the-packagizer

Quote:
Originally Posted by leroyeur View Post
A dropdown menu for the filename schemes would be great, like what's done for Brazzers
I'm not planning on doing that.
We got separate threads though in which we're open for discussions about better generic file naming capabilities, see:
https://board.jdownloader.org/showthread.php?t=90744
You're welcome to join the talk.

Quote:
Originally Posted by leroyeur View Post
Sorry, forgot to add the Log (if needed).
Not needed.
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #37  
Old 11.04.2023, 18:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #38  
Old 11.04.2023, 19:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Further changes:
- Added support for '/dvd/' links
- Added packagizer property 'title' which can be used for filename customizations
- Fixed ability to disable "Preview" setting when user owns premium account
- Added support for links matching the following pattern: /video/download/<videoID>

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #39  
Old 17.04.2023, 18:20
leroyeur leroyeur is offline
JD Beta
 
Join Date: Apr 2021
Posts: 57
Default

17.04.23 16.03.31 <--> 17.04.23 18.53.48 jdlog://4974311370661

New error: Started seeing "Account missing".
I even tried re-adding the account with fresh cookies.
Notes:
1. I have successfully downloaded 200+ videos. 120+ GB
2. Downloading in browser works fine. Tried multiple browsers.

Example URLs of movies:
Note: It's all URLs of /dvd/. My point was that JD should pack downloads from the same page in one folder/pack rather than each scene in its own pack

1. **External links are only visible to Support Staff**Movie 1. This should be packed as one pack called "The Houseman" (per the movie title), the pack should contain scene 1, scene 2, scene 3, etc - all the way to the final scene + previews (or w/out).
2. **External links are only visible to Support Staff**Movie 2. Same idea. Pack named "I confess", etc
3. **External links are only visible to Support Staff**Movie 3
4. **External links are only visible to Support Staff**Movie 4
5. **External links are only visible to Support Staff**Movie 5

Last edited by notice; 17.04.2023 at 18:29.
Reply With Quote
  #40  
Old 18.04.2023, 02:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,455
Default

Quote:
Originally Posted by leroyeur View Post
New error: Started seeing "Account missing".
Fixed bug in handling which refreshes expired direct-URLs.

Quote:
Originally Posted by leroyeur View Post
Note: It's all URLs of /dvd/. My point was that JD should pack downloads from the same page in one folder/pack rather than each scene in its own pack
Done.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:19.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.