JDownloader Community - Appwork GmbH
 

Closed Thread
 
Thread Tools Display Modes
  #1  
Old 26.07.2022, 05:44
zylaxabi zylaxabi is offline
Mega Loader
 
Join Date: Oct 2020
Posts: 67
Default [VSCO.co] Plugin Defect

There's a problem with grabbing vsco profiles, for example:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

jd gives you:

Plugin Defect!vibrancylensphotography

Is there a way to fix this?

Thanks
  #2  
Old 26.07.2022, 15:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Fixed crawler plugin.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #3  
Old 31.07.2022, 08:54
zylaxabi zylaxabi is offline
Mega Loader
 
Join Date: Oct 2020
Posts: 67
Default

this was working until recently when it randomly stopped. Is there a quick fix?
Thanks
  #4  
Old 01.08.2022, 13:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Please re-read my previous post.
Updates haven't been released yet...
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #5  
Old 08.08.2022, 10:43
crash_override_1997 crash_override_1997 is offline
I will play nice!
 
Join Date: Dec 2017
Posts: 4
Default

Opened latest developer build of JDownloader and adding any vsco profile only adds first 28 files.
  #6  
Old 09.08.2022, 18:12
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Fixed.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #7  
Old 10.08.2022, 19:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 81,326
Default

Quote:
Originally Posted by crash_override_1997 View Post
Opened latest developer build of JDownloader and adding any vsco profile only adds first 28 files.
You mean you run JDownloader from source/IDE? or what do you mean by *latest developer build*?
__________________
JD-Dev & Server-Admin
  #8  
Old 10.08.2022, 19:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Yes he ment this as the current stable crawler would fail completely and return nothing.
This problem is already fixed [dev build].
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 12.08.2022 at 20:05. Reason: Added clarification that updates containing this bugfix haven't been released yet.
  #9  
Old 12.08.2022, 23:58
crash_override_1997 crash_override_1997 is offline
I will play nice!
 
Join Date: Dec 2017
Posts: 4
Default

Quote:
Originally Posted by Jiaz View Post
You mean you run JDownloader from source/IDE? or what do you mean by *latest developer build*?
Yes i was talking about (running) JDownloader from IDE. I was looking to fix or see what changed in jdowloader . the problem was fixed.
  #10  
Old 16.08.2022, 17:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 81,326
Default

@crash_override_1997: Thanks for the feedback! Please feel free to report issues you encounter while working with dev version please contact us via support@jdownloader.org
__________________
JD-Dev & Server-Admin
  #11  
Old 29.08.2022, 17:45
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #12  
Old 29.08.2022, 23:11
Shmi Shmi is offline
DSL Light User
 
Join Date: Jan 2020
Posts: 32
Default

1.

It looks like the Crawler is having problems with the new video method/player of vsco.

Example profile: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Right now JD grabs 12 images and then stops/fails. (That's about when the first video appears)

Crawler is working fine with full profiles when there is no new video. (Older videos do not cause any problem)

_____

2.

Some time ago it was possible to drag & drop a single image into the link collector and jd would return max available size image. Now it returns only a smaller version.

Example single image page: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Drag & drop the image into jd link collector. (drag & drop images of vsco might not work with all browsers. It works with Chrome.

JD returns/downloads this image: **External links are only visible to Support Staff****External links are only visible to Support Staff**
instead of this: **External links are only visible to Support Staff****External links are only visible to Support Staff**

_____

3.

just me being unhappy, because filenames changed
//ignore no 3.
  #13  
Old 30.08.2022, 12:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

1. Fixed.

2. Looks good to me but I've also fixed / added support for single images.
Until now that crawler would have always crawled the full profile even if you added a single media item.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #14  
Old 30.08.2022, 13:51
Shmi Shmi is offline
DSL Light User
 
Join Date: Jan 2020
Posts: 32
Default

Thank you so far.
I'm patiently waiting for the next core update.


Quote:
Originally Posted by pspzockerscene View Post
...

2. ...
Until now that crawler would have always crawled the full profile even if you added a single media item.
Yes. When drag & dropping a single image of the full profile page it would add full profile.
When drag & dropping the image of the single media page it would only add that 1 image.

Anyways, can't wait for the fixes.
  #15  
Old 30.08.2022, 14:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 81,326
Default

@Shmi: updates are available, please test and provide feedback
__________________
JD-Dev & Server-Admin
  #16  
Old 30.08.2022, 14:22
Shmi Shmi is offline
DSL Light User
 
Join Date: Jan 2020
Posts: 32
Default

Quote:
Originally Posted by Jiaz View Post
@Shmi: updates are available, please test and provide feedback
All full profiles seem to work fine now. Thank you

_____

Single media drag & dropping works now when drag & dropping from full profile pages

Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Drag & drop the first image, JD will return 2 images. 1 smaller, 1 max available size. It's fine.

When u drag & drop the exact same image of the single media page, JD will still return 1 smaller version image.
That example single media page: **External links are only visible to Support Staff****External links are only visible to Support Staff**


Copy & pasting the single media url works fine. (JD returns 1 image max available size)

So, basically it's drag & dropping of single media pages that's not working.
Of course up to you guys if you want to fix that.
I personally don't need that to be fixed, when everything else is working.
  #17  
Old 30.08.2022, 15:29
DukeM's Avatar
DukeM DukeM is offline
Fibre Channel User
 
Join Date: Sep 2019
Posts: 128
Default

Waiting for the core update felt like forever. Haha. I had a lot of VSCO profiles building on my queue for a good while but thank you so much for the constant support and updates!

If I may add another report, any possible reason why JD2 can't crawl a specific profile at all? Not even an error.txt file. I remember encountering this once before but I just brushed it off. But with the amount of profiles I had on queue, there are two profiles that JD2 can't seem to crawl at all. I feel like this isn't JD2's fault but just want to bring it up just in case.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I'm currently on Core #46618 which is the latest, I think.
  #18  
Old 30.08.2022, 16:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Quote:
Originally Posted by Shmi View Post
Drag & drop the first image, JD will return 2 images. 1 smaller, 1 max available size. It's fine.
Cannot reproduce.

Quote:
Originally Posted by Shmi View Post
thank you so much for the constant support and updates!
Thanks for your feedback

Quote:
Originally Posted by Shmi View Post
If I may add another report, any possible reason why JD2 can't crawl a specific profile at all?
Fixed.

Quote:
Originally Posted by Shmi View Post
Not even an error.txt file.
Which error.txt file?
You can find your logs in the "logs" folder in your JD install directory and yes that does typically contain errors when plugins fail.

Changelog for this plugin for the next update:
- removed duplicated code
- removed leftover debug code (try catch dontcare block)
- fixed NPE due to field 'captureDateMs' not always being present
- added host plugin so HLS streams can be grabbed superfast [best quality only]

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #19  
Old 30.08.2022, 16:39
DukeM's Avatar
DukeM DukeM is offline
Fibre Channel User
 
Join Date: Sep 2019
Posts: 128
Default

Quote:
Originally Posted by pspzockerscene View Post
Which error.txt file?
Hey, @psp!

Oh, I just meant it's not returning any .txt files to let you know what went wrong like with most errors (i.e. Plugin Defect, Missing Account, etc) which probably means it's not a known error that's why I decided to ask here. If you try pasting the two VSCO links I provided above in LinkGrabber, nothing happens (like the profile doesn't exist but they do).

But it only happened with those two accounts out of dozens I've tried since the latest core update.

Last edited by DukeM; 30.08.2022 at 16:43.
  #20  
Old 30.08.2022, 16:51
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Quote:
Originally Posted by DukeM View Post
I just meant it's not returning any .txt files to let you know what went wrong like with most errors (i.e. Plugin Defect, Missing Account, etc) which probably means it's not a known error
Exactly. It's more or less like that.

Quote:
Originally Posted by DukeM View Post
If you try pasting the two VSCO links I provided above in LinkGrabber, nothing happens (like the profile doesn't exist but they do).
Yap as said I've fixed that. They will work fine after the release of our next CORE-updates.

Quote:
Originally Posted by DukeM View Post
But it only happened with those two accounts out of dozens I've tried since the latest core update.
It happened because a specific image property was missing for those and the plugin expected it to always be there.
This lead to a classic NPE (NullPointerException).

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #21  
Old 30.08.2022, 17:38
DukeM's Avatar
DukeM DukeM is offline
Fibre Channel User
 
Join Date: Sep 2019
Posts: 128
Default

A-ha! Thanks for clarifying AND the quick update!
  #22  
Old 31.08.2022, 17:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #23  
Old 01.09.2022, 23:01
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

Thanks for this but is it possible to make it behave and display what is scraped like before?
It doesn't detect links already in the download list from the previous version and it neither give you the original filename or the image URL.
  #24  
Old 02.09.2022, 15:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Quote:
Originally Posted by inzzzomnia View Post
Thanks for this but is it possible to make it behave and display what is scraped like before?
It doesn't detect links already in the download list from the previous version...
We're looking into it but I won't promise anything.
I've updated the plugin to e.g. also in theory be able to return multiple videoIDs.
This ment that I changed the internal IDs used for dupe-checking.
At least for images I should be able to add "backwards compatibility".

Quote:
Originally Posted by inzzzomnia View Post
...and it neither give you the original filename or the image URL.
Hm going back to crawler revision 46302 from 2022-06-23 to the presumably last working old crawler version it loks like filenames have always been like this: <username>_<mediaID>.<fileExtension>
What would be the "original filename" according to you?
Random example:
vsco.co/summerlovells/media/56a7282f1a523f780190bef1
Current filename:
Code:
summerlovells_56a7282f1a523f780190bef1.jpg
Direct-URL:
image.vsco.co/1/56a7032d667f014346727/56a7282f1a523f780190bef1/vsco_012616.jpg
Filename you may want to have:
Code:
vsco_012616.jpg
Also, which "original filenames" would you expect for new HLS videos?
Example profile:
vsco.co/a-thepineapple
Directurl to a random video:
stream.mux.com/ocaS6lqRzPATqf7m1sCISr01qqGJHXlra.m3u8
Current filename:
Code:
a-thepineapple_1af7da86-8025-45ff-90d1-7054096a70eb.mp4
Possible "original filename (?)":
Code:
ocaS6lqRzPATqf7m1sCISr01qqGJHXlra.mp4
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #25  
Old 05.09.2022, 16:47
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Addition to my previous posts:
I just remembered that the reverting the dupe-ID changes only makes sense if the directURLs haven't changed.

Please check if the old direct-URLs of items you've added to JD before the big vsco.co API changes are still working and post some of them here.
Please do this for audio- and video items!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #26  
Old 05.09.2022, 17:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 81,326
Default

Quote:
Originally Posted by inzzzomnia View Post
It doesn't detect links already in the download list from the previous version
Please check with next plugin update, it should work for mp4/images again.
__________________
JD-Dev & Server-Admin
  #27  
Old 06.09.2022, 18:06
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
  #28  
Old 17.02.2024, 00:44
Nightwalker Nightwalker is offline
I will play nice!
 
Join Date: Nov 2022
Posts: 7
Default

The plugin can't grab more than the initial page now, since VSCO has added a login requirement.
  #29  
Old 19.02.2024, 15:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 73,523
Default

Thread closed - please continue here:
https://board.jdownloader.org/showthread.php?t=95237
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Closed Thread

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 23:40.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.