[zylaxabi]

There's a problem with grabbing vsco profiles, for example:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

jd gives you:

Plugin Defect!vibrancylensphotography

Is there a way to fix this?

Thanks

[pspzockerscene]

Fixed crawler plugin.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[zylaxabi]

this was working until recently when it randomly stopped. Is there a quick fix?
Thanks

[pspzockerscene]

Please re-read my previous post.
Updates haven't been released yet...

[crash_override_1997]

Opened latest developer build of JDownloader and adding any vsco profile only adds first 28 files.

[pspzockerscene]

Fixed.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Jiaz]

Originally Posted by crash_override_1997

Opened latest developer build of JDownloader and adding any vsco profile only adds first 28 files.

You mean you run JDownloader from source/IDE? or what do you mean by *latest developer build*?

[pspzockerscene]

Yes he ment this as the current stable crawler would fail completely and return nothing.
This problem is already fixed [dev build].

[crash_override_1997]

Originally Posted by Jiaz

You mean you run JDownloader from source/IDE? or what do you mean by *latest developer build*?

Yes i was talking about (running) JDownloader from IDE. I was looking to fix or see what changed in jdowloader . the problem was fixed.

[Jiaz]

@crash_override_1997: Thanks for the feedback! Please feel free to report issues you encounter while working with dev version please contact us via support@jdownloader.org

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-

[Shmi]

1.

It looks like the Crawler is having problems with the new video method/player of vsco.

Example profile: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Right now JD grabs 12 images and then stops/fails. (That's about when the first video appears)

Crawler is working fine with full profiles when there is no new video. (Older videos do not cause any problem)

_____

2.

Some time ago it was possible to drag & drop a single image into the link collector and jd would return max available size image. Now it returns only a smaller version.

Example single image page: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Drag & drop the image into jd link collector. (drag & drop images of vsco might not work with all browsers. It works with Chrome.

JD returns/downloads this image: **External links are only visible to Support Staff****External links are only visible to Support Staff**
instead of this: **External links are only visible to Support Staff****External links are only visible to Support Staff**

_____

3.

just me being unhappy, because filenames changed
//ignore no 3.

[pspzockerscene]

1. Fixed.

2. Looks good to me but I've also fixed / added support for single images.
Until now that crawler would have always crawled the full profile even if you added a single media item.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[Shmi]

Thank you so far.
I'm patiently waiting for the next core update.

Originally Posted by pspzockerscene

...

2. ...
Until now that crawler would have always crawled the full profile even if you added a single media item.

Yes. When drag & dropping a single image of the full profile page it would add full profile.
When drag & dropping the image of the single media page it would only add that 1 image.

Anyways, can't wait for the fixes.

[Jiaz]

@Shmi: updates are available, please test and provide feedback

[Shmi]

Originally Posted by Jiaz

@Shmi: updates are available, please test and provide feedback

All full profiles seem to work fine now. Thank you

_____

Single media drag & dropping works now when drag & dropping from full profile pages

Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Drag & drop the first image, JD will return 2 images. 1 smaller, 1 max available size. It's fine.

When u drag & drop the exact same image of the single media page, JD will still return 1 smaller version image.
That example single media page: **External links are only visible to Support Staff****External links are only visible to Support Staff**


Copy & pasting the single media url works fine. (JD returns 1 image max available size)

So, basically it's drag & dropping of single media pages that's not working.
Of course up to you guys if you want to fix that.
I personally don't need that to be fixed, when everything else is working.

[DukeM]

Waiting for the core update felt like forever. Haha. I had a lot of VSCO profiles building on my queue for a good while but thank you so much for the constant support and updates!

If I may add another report, any possible reason why JD2 can't crawl a specific profile at all? Not even an error.txt file. I remember encountering this once before but I just brushed it off. But with the amount of profiles I had on queue, there are two profiles that JD2 can't seem to crawl at all. I feel like this isn't JD2's fault but just want to bring it up just in case.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I'm currently on Core #46618 which is the latest, I think.

[pspzockerscene]

Originally Posted by Shmi

Drag & drop the first image, JD will return 2 images. 1 smaller, 1 max available size. It's fine.

Cannot reproduce.

Originally Posted by Shmi

thank you so much for the constant support and updates!

Thanks for your feedback

Originally Posted by Shmi

If I may add another report, any possible reason why JD2 can't crawl a specific profile at all?

Fixed.

Originally Posted by Shmi

Not even an error.txt file.

Which error.txt file?
You can find your logs in the "logs" folder in your JD install directory and yes that does typically contain errors when plugins fail.

Changelog for this plugin for the next update:
- removed duplicated code
- removed leftover debug code (try catch dontcare block)
- fixed NPE due to field 'captureDateMs' not always being present
- added host plugin so HLS streams can be grabbed superfast [best quality only]

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[DukeM]

Originally Posted by pspzockerscene

Which error.txt file?

Hey, @psp!

Oh, I just meant it's not returning any .txt files to let you know what went wrong like with most errors (i.e. Plugin Defect, Missing Account, etc) which probably means it's not a known error that's why I decided to ask here. If you try pasting the two VSCO links I provided above in LinkGrabber, nothing happens (like the profile doesn't exist but they do).

But it only happened with those two accounts out of dozens I've tried since the latest core update.

[pspzockerscene]

Originally Posted by DukeM

I just meant it's not returning any .txt files to let you know what went wrong like with most errors (i.e. Plugin Defect, Missing Account, etc) which probably means it's not a known error

Exactly. It's more or less like that.

Originally Posted by DukeM

If you try pasting the two VSCO links I provided above in LinkGrabber, nothing happens (like the profile doesn't exist but they do).

Yap as said I've fixed that. They will work fine after the release of our next CORE-updates.

Originally Posted by DukeM

But it only happened with those two accounts out of dozens I've tried since the latest core update.

It happened because a specific image property was missing for those and the plugin expected it to always be there.
This lead to a classic NPE (NullPointerException).

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!
---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

-psp-

[DukeM]

A-ha! Thanks for clarifying AND the quick update!

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-

[inzzzomnia]

Thanks for this but is it possible to make it behave and display what is scraped like before?
It doesn't detect links already in the download list from the previous version and it neither give you the original filename or the image URL.

[pspzockerscene]

Originally Posted by inzzzomnia

Thanks for this but is it possible to make it behave and display what is scraped like before?
It doesn't detect links already in the download list from the previous version...

We're looking into it but I won't promise anything.
I've updated the plugin to e.g. also in theory be able to return multiple videoIDs.
This ment that I changed the internal IDs used for dupe-checking.
At least for images I should be able to add "backwards compatibility".

Originally Posted by inzzzomnia

...and it neither give you the original filename or the image URL.

Hm going back to crawler revision 46302 from 2022-06-23 to the presumably last working old crawler version it loks like filenames have always been like this: <username>_<mediaID>.<fileExtension>
What would be the "original filename" according to you?
Random example:
vsco.co/summerlovells/media/56a7282f1a523f780190bef1
Current filename:

summerlovells_56a7282f1a523f780190bef1.jpg

Direct-URL:
image.vsco.co/1/56a7032d667f014346727/56a7282f1a523f780190bef1/vsco_012616.jpg
Filename you may want to have:

vsco_012616.jpg

Also, which "original filenames" would you expect for new HLS videos?
Example profile:
vsco.co/a-thepineapple
Directurl to a random video:
stream.mux.com/ocaS6lqRzPATqf7m1sCISr01qqGJHXlra.m3u8
Current filename:

a-thepineapple_1af7da86-8025-45ff-90d1-7054096a70eb.mp4

Possible "original filename (?)":

ocaS6lqRzPATqf7m1sCISr01qqGJHXlra.mp4

[pspzockerscene]

Addition to my previous posts:
I just remembered that the reverting the dupe-ID changes only makes sense if the directURLs haven't changed.

Please check if the old direct-URLs of items you've added to JD before the big vsco.co API changes are still working and post some of them here.
Please do this for audio- and video items!

[Jiaz]

Originally Posted by inzzzomnia

It doesn't detect links already in the download list from the previous version

Please check with next plugin update, it should work for mp4/images again.

[pspzockerscene]

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-

[Nightwalker]

The plugin can't grab more than the initial page now, since VSCO has added a login requirement.

[pspzockerscene]

Thread closed - please continue here:
https://board.jdownloader.org/showthread.php?t=95237