JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 20.08.2020, 09:28
accelheim accelheim is offline
JD Adviser
 
Join Date: Jan 2020
Posts: 104
Default xvideos.com - Playlists not downloaded

Grabbing the links from uploads from users seems to be working. But not downloading playlists and favorite playlists. It grabs the links of lots of different stuff and wrong video links without any title (only numbers).

List example:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Log:

20.08.20 09.27.50 <--> 20.08.20 09.28.29 jdlog://6370225302851/

Also when links are downloaded from the upload list the file name is something like this:

56053485_*Videoname

instead of just *Videoname*
Reply With Quote
  #2  
Old 20.08.2020, 14:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

Hi,

1. We currently don't have a crawler for xvideos.com playlists and "favourite playlists".
Please post working example URLs for both cases.
Your example URL seems to be offline at least I get the following error in my browser:
Code:
Sorry, this favorites list is not available.
2. Every plugin has its own naming scheme.
In this case, filenames start with the video-ID.
If you want to remove the video-ID you can do so using a packagizer rule (as already explained in other threads ...).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 21.08.2020, 23:34
accelheim accelheim is offline
JD Adviser
 
Join Date: Jan 2020
Posts: 104
Default

Quote:
Originally Posted by pspzockerscene View Post
Hi,

1. We currently don't have a crawler for xvideos.com playlists and "favourite playlists".
Please post working example URLs for both cases.
Your example URL seems to be offline at least I get the following error in my browser:
Code:
Sorry, this favorites list is not available.
2. Every plugin has its own naming scheme.
In this case, filenames start with the video-ID.
If you want to remove the video-ID you can do so using a packagizer rule (as already explained in other threads ...).

-psp-
Hey,

here is another playlist link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

and

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #4  
Old 24.08.2020, 14:49
accelheim accelheim is offline
JD Adviser
 
Join Date: Jan 2020
Posts: 104
Default

Can you check these links and see if it works?
Reply With Quote
  #5  
Old 24.08.2020, 15:00
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

Added "favourites" crawler.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #6  
Old 03.09.2020, 10:08
accelheim accelheim is offline
JD Adviser
 
Join Date: Jan 2020
Posts: 104
Default

Quote:
Originally Posted by pspzockerscene View Post
Added "favourites" crawler.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!


-psp-
Great. Thanks!
Reply With Quote
  #7  
Old 15.01.2021, 08:33
elvis_ef's Avatar
elvis_ef elvis_ef is offline
Linkgrabbing Monster
 
Join Date: Oct 2019
Location: Polska
Posts: 84
Exclamation 2 questions about crawling from xvideos

Quote:
Originally Posted by pspzockerscene View Post
Added "favourites" crawler.

-psp-
So.. for instance, this URL should be crawled, if visible as a public list ?
**External links are only visible to Support Staff****External links are only visible to Support Staff**

The list is set to be visible as a public list.
But in my incognito window, it is not - incognito rules ?

Alright, one more question - the crawler reads all videos from the list, not just from current page ?

EDIT
-------------
Alright, I see it now. I need to go into list management, and the link is a bit different:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

and it works.. : )

EDIT 2 - problem !
===================
There is an issue with adding playlist.

First problem - Only the first time my "CTRL + C" worked. Next time JD didn't receive any clipboard requests. So even with PC mouse copying, didn't work. The effect is only one list is in my JD, that was detected, all 3 lists are visible to public.

Second problem - Adding/Detecting list works but ONLY if I am NOT logged into my account in JD. And ONLY if I add it by a context menu on the grabber list, by choosing "add new links". So if I am logged into my account, even this method doesn't work. It just flashes once the popup with adding/detecting links and vanishes - no skipped links were found.

JDLOG:
Code:
15.01.21 08.42.14 <--> 15.01.21 08.48.15 jdlog://6583625302851/
Links to sample lists:

1 - **External links are only visible to Support Staff****External links are only visible to Support Staff**
2 - **External links are only visible to Support Staff****External links are only visible to Support Staff**
3 - **External links are only visible to Support Staff****External links are only visible to Support Staff**

All are public.

Last edited by elvis_ef; 15.01.2021 at 08:53. Reason: just a note, and it works
Reply With Quote
  #8  
Old 15.01.2021, 11:39
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,577
Default

@elvis_ef: only the public favourites link format is supported. The /account/favourites is not, because it's bound to account
I could not reproduce the "first time CTRL+C" issue. worked fine every time.
We need username/password to the account to check/add support for /account/favourites links
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 15.01.2021 at 12:55.
Reply With Quote
  #9  
Old 15.01.2021, 12:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 69,577
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 15.01.2021, 14:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

Added support for private favorites.

Please keep in mind that I wasn't able to test with big playlist containing multiple pages so of such ones exist, please send me login credentials to an account which contains such lists.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 01.02.2021 at 18:45. Reason: Fixed typo
Reply With Quote
  #11  
Old 01.02.2021, 08:46
elvis_ef's Avatar
elvis_ef elvis_ef is offline
Linkgrabbing Monster
 
Join Date: Oct 2019
Location: Polska
Posts: 84
Default

Quote:
Originally Posted by pspzockerscene View Post
Added support for private favorites.

Please keep in mind that I wasn't able to test with big playlist containing multiple pages so of such ones exist, please sendc me login credentials to an account which contains such lists.

-psp-
Alright, I will send You credentials in a moment. Please check the forum inbox.
Reply With Quote
  #12  
Old 01.02.2021, 18:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

I was unable to find any playlist issues - your recently posted example playlist URLs containing multiple pages of videos were all working fine here.
Please post exmple URLs if you've found playlists which JD was unable to parse.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #13  
Old 01.02.2021, 21:05
elvis_ef's Avatar
elvis_ef elvis_ef is offline
Linkgrabbing Monster
 
Join Date: Oct 2019
Location: Polska
Posts: 84
Default

Alright, now it works. Thanks for help : )
So if I am logged in I can use CTRL + C to copy my private lists and links are being grabbed by the link grabber. Nice.

By the way, I don't know why I am having issues with CTR+C - I cannot reproduce it..
Sometimes it happens when I click a link to copy it to JD, then remove it, and the try to copy it again.. so nothing happens even if I click about several times..

weird..
Reply With Quote
  #14  
Old 01.02.2021, 21:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

If you copy URL A, add it to the linkgrabber ( & delete it again there) and then copy the same URL A again, nothing will happen - that is not a bug.

... or can you reproduce this with different clipboard contents?
If you find a way to reproduce your issue, please add a proper bug description and a log.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #15  
Old 01.02.2021, 21:16
elvis_ef's Avatar
elvis_ef elvis_ef is offline
Linkgrabbing Monster
 
Join Date: Oct 2019
Location: Polska
Posts: 84
Default

Quote:
Originally Posted by pspzockerscene View Post
If you copy URL A, add it to the linkgrabber ( & delete it again there) and then copy the same URL A again, nothing will happen - that is not a bug.
-psp-
Wait.. why this is not a bug ?
I have no rules active. But I am copying the same URL A, once then delete, and the second time.. it will not be catched by the link grabber ? Why ?
Reply With Quote
  #16  
Old 01.02.2021, 21:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

Quote:
Originally Posted by elvis_ef View Post
it will not be catched by the link grabber ? Why ?
Well only if your clipboard contents have not been changed in the meantime / you copy exactly the same again there is no change.

Imagine the clipboard observation working always - this would mean if you delete something from the linkgrabber but it's still in your clipboard in that moment, it will just get added again right away.

Solution:
Copy something else and then copy that same URL again.

I'am unsure whether there is an option available to change this behavior - I couldn't find anything.

-psp-

EDIT

I've mixed things up!
It is working as intended here.

Please post a detailed report if you think you've found a bug.
Please also include example URLs and a log!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #17  
Old 02.02.2021, 08:05
elvis_ef's Avatar
elvis_ef elvis_ef is offline
Linkgrabbing Monster
 
Join Date: Oct 2019
Location: Polska
Posts: 84
Default

I think Your struck out text is the solution for me.
So Thanks for explaining : )

Yes, it makes sens. Would be nice to have solution to not add the same link manually.
Reply With Quote
  #18  
Old 02.02.2021, 15:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 57,128
Default

Quote:
Originally Posted by elvis_ef View Post
I think Your struck out text is the solution for me.
That was outdated information.

As said it was working fine here without the need to copy anything else in between.
Disabling and re-enabling the clipboard observation did the trick.

As said if you're able to reproduce any issues, please post another report.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:41.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.