#1
|
|||
|
|||
xvideos.com - Playlists not downloaded
Grabbing the links from uploads from users seems to be working. But not downloading playlists and favorite playlists. It grabs the links of lots of different stuff and wrong video links without any title (only numbers).
List example: **External links are only visible to Support Staff****External links are only visible to Support Staff** Log: 20.08.20 09.27.50 <--> 20.08.20 09.28.29 jdlog://6370225302851/ Also when links are downloaded from the upload list the file name is something like this: 56053485_*Videoname instead of just *Videoname* |
#2
|
||||
|
||||
Hi,
1. We currently don't have a crawler for xvideos.com playlists and "favourite playlists". Please post working example URLs for both cases. Your example URL seems to be offline at least I get the following error in my browser: Code:
Sorry, this favorites list is not available. In this case, filenames start with the video-ID. If you want to remove the video-ID you can do so using a packagizer rule (as already explained in other threads ...). -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
Quote:
here is another playlist link: **External links are only visible to Support Staff****External links are only visible to Support Staff** and **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#4
|
|||
|
|||
Can you check these links and see if it works?
|
#5
|
||||
|
||||
Added "favourites" crawler.
Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#6
|
|||
|
|||
Quote:
|
#7
|
||||
|
||||
2 questions about crawling from xvideos
So.. for instance, this URL should be crawled, if visible as a public list ?
**External links are only visible to Support Staff****External links are only visible to Support Staff** The list is set to be visible as a public list. But in my incognito window, it is not - incognito rules ? Alright, one more question - the crawler reads all videos from the list, not just from current page ? EDIT ------------- Alright, I see it now. I need to go into list management, and the link is a bit different: **External links are only visible to Support Staff****External links are only visible to Support Staff** and it works.. : ) EDIT 2 - problem ! =================== There is an issue with adding playlist. First problem - Only the first time my "CTRL + C" worked. Next time JD didn't receive any clipboard requests. So even with PC mouse copying, didn't work. The effect is only one list is in my JD, that was detected, all 3 lists are visible to public. Second problem - Adding/Detecting list works but ONLY if I am NOT logged into my account in JD. And ONLY if I add it by a context menu on the grabber list, by choosing "add new links". So if I am logged into my account, even this method doesn't work. It just flashes once the popup with adding/detecting links and vanishes - no skipped links were found. JDLOG: Code:
15.01.21 08.42.14 <--> 15.01.21 08.48.15 jdlog://6583625302851/ 1 - **External links are only visible to Support Staff****External links are only visible to Support Staff** 2 - **External links are only visible to Support Staff****External links are only visible to Support Staff** 3 - **External links are only visible to Support Staff****External links are only visible to Support Staff** All are public. Last edited by elvis_ef; 15.01.2021 at 08:53. Reason: just a note, and it works |
#8
|
||||
|
||||
@elvis_ef: only the public favourites link format is supported. The /account/favourites is not, because it's bound to account
I could not reproduce the "first time CTRL+C" issue. worked fine every time. We need username/password to the account to check/add support for /account/favourites links
__________________
JD-Dev & Server-Admin Last edited by Jiaz; 15.01.2021 at 12:55. |
#9
|
||||
|
||||
__________________
JD-Dev & Server-Admin |
#10
|
||||
|
||||
Added support for private favorites.
Please keep in mind that I wasn't able to test with big playlist containing multiple pages so of such ones exist, please send me login credentials to an account which contains such lists. Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 01.02.2021 at 18:45. Reason: Fixed typo |
#11
|
||||
|
||||
Alright, I will send You credentials in a moment. Please check the forum inbox.
|
#12
|
||||
|
||||
I was unable to find any playlist issues - your recently posted example playlist URLs containing multiple pages of videos were all working fine here.
Please post exmple URLs if you've found playlists which JD was unable to parse. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#13
|
||||
|
||||
Alright, now it works. Thanks for help : )
So if I am logged in I can use CTRL + C to copy my private lists and links are being grabbed by the link grabber. Nice. By the way, I don't know why I am having issues with CTR+C - I cannot reproduce it.. Sometimes it happens when I click a link to copy it to JD, then remove it, and the try to copy it again.. so nothing happens even if I click about several times.. weird.. |
#14
|
||||
|
||||
If you copy URL A, add it to the linkgrabber ( & delete it again there) and then copy the same URL A again, nothing will happen - that is not a bug.
... or can you reproduce this with different clipboard contents? If you find a way to reproduce your issue, please add a proper bug description and a log. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#15
|
||||
|
||||
Quote:
I have no rules active. But I am copying the same URL A, once then delete, and the second time.. it will not be catched by the link grabber ? Why ? |
#16
|
||||
|
||||
Imagine the clipboard observation working always - this would mean if you delete something from the linkgrabber but it's still in your clipboard in that moment, it will just get added again right away. Solution: Copy something else and then copy that same URL again. I'am unsure whether there is an option available to change this behavior - I couldn't find anything. -psp- EDIT I've mixed things up! It is working as intended here. Please post a detailed report if you think you've found a bug. Please also include example URLs and a log!
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#17
|
||||
|
||||
I think Your struck out text is the solution for me.
So Thanks for explaining : ) Yes, it makes sens. Would be nice to have solution to not add the same link manually. |
#18
|
||||
|
||||
That was outdated information.
As said it was working fine here without the need to copy anything else in between. Disabling and re-enabling the clipboard observation did the trick. As said if you're able to reproduce any issues, please post another report. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
Thread Tools | |
Display Modes | |
|
|