JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 28.09.2020, 06:20
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default Update to get higher quality on instagram

So Instagram apparently offers a higher quality image than what JD is able to download since sometime last year.

Can't tell you exactly how to fix it but I guess you guys can **External links are only visible to Support Staff**read this and quite easy figure out what to change to get the 1440x* instead of the 1080x* that JD get now since you know your way around code stuff way better than me.

Cheers!
Reply With Quote
  #2  
Old 28.09.2020, 17:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,

indeed you're right.
It should work as expected after the next CORE-update:

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 29.09.2020, 02:41
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

Thank you, looking forward to it.
Reply With Quote
  #4  
Old 01.10.2020, 05:09
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

So the core# has jumped several steps since your post and it still only get the 1080 versions so is it delayed or is it just not working?

Tried finding info about what the updates that's been done contains but can't find a thing. Don't know if it's even available to see for everyone but if it is you've managed to hide it a little too well. That would be a nice thing to have in that FAQ you posted, how to actually find info about updates. Or put a link to the more day to day updates on changelog since that page isn't exactly specific.

Cheers!
Reply With Quote
  #5  
Old 01.10.2020, 14:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by inzzzomnia View Post
So the core# has jumped several steps since your post and it still only get the 1080 versions so is it delayed or is it just not working?
Iny my examples, 1080 was the highest version.
If you got URLs with higher resolutions available, please post them here.
HERE is an article about our update behavior.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 01.10.2020 at 15:36.
Reply With Quote
  #6  
Old 02.10.2020, 02:08
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

Quote:
Originally Posted by pspzockerscene View Post
Iny my examples, 1080 was the highest version.
If you got URLs with higher resolutions available, please post them here.
**External links are only visible to Support Staff****External links are only visible to Support Staff** is available in 1440x1079 but JD only get the 1080x809 version.
Quote:
**External links are only visible to Support Staff**... is an article about our update behavior.
Yes that's the same page you posted above and the one I was referring to. I might have gone temporary blind and missed something but that only shows how your work is done and how to check your version but it doesn't say anything about how to find out what you are working on and what stuff is included in what update.
Cause as I said I tried to find out if this issue had been included or not so I knew if I should just wait a bit longer or give feedback on it.
I guess it would make a lot of posts with questions about updates disappear if that info was easy to access even for the ones not involved in the development.
As in my example I would have just needed to report that the issue wasn't solved instead of also having to ask if the fix was included in one of the latest updates or not, you follow?
Reply With Quote
  #7  
Old 02.10.2020, 13:42
mrc's Avatar
mrc mrc is offline
Guardian of the Droids
 
Join Date: Jan 2013
Location: Germany
Posts: 288
Default

what makes you think there is 1440x1079 available? how do you check? source only contains max 1080 version. could not find any sign of higher resolution image. also checked while being logged in.
__________________
My.JDownloader.org Web Interface | Android App | Browser Extensions [Feedback Thread]
Reply With Quote
  #8  
Old 02.10.2020, 14:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@inzzzomnia
Please describe your way on how to get that higher resolution.
If I grab the direct-URL of the image of your linked post (it will probably expire once you click on it), it would e.g. look like this:
Code:
scontent-frt3-2.cdninstagram.com/v/t51.2885-15/e35/s1080x1080/120202845_793520428134033_3637413561951656742_n.jpg?_nc_ht=scontent-frt3-2.cdninstagram.com&_nc_cat=1&_nc_ohc=8KmzvU9Hoq4AX8iWvFo&_nc_tp=15&oh=977faa163eeded398b49d9f91ed1c32c&oe=5FA18EA5
According to your linked source "instaloader", all you have to do to get the highest quality is to remove the param "se=XX" from that URL ... but it is not there so I guess this is not possible anymore (?)
Code:
github.com/instaloader/instaloader/issues/630#issuecomment-640028019
-psp-
EDIT

Seems like the "get best quality" feature either is not possible anymore or broken in "Instaloader" too:
Code:
github.com/instaloader/instaloader/issues/827
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 02.10.2020 at 15:12.
Reply With Quote
  #9  
Old 03.10.2020, 01:22
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

Quote:
Originally Posted by mrc View Post
what makes you think there is 1440x1079 available? how do you check? source only contains max 1080 version. could not find any sign of higher resolution image. also checked while being logged in.
Because I downloaded it using Instaloader.
**External links are only visible to Support Staff****External links are only visible to Support Staff**


Quote:
Originally Posted by pspzockerscene View Post
@inzzzomnia
Please describe your way on how to get that higher resolution.
If I grab the direct-URL of the image of your linked post (it will probably expire once you click on it), it would e.g. look like this:
Code:
scontent-frt3-2.cdninstagram.com/v/t51.2885-15/e35/s1080x1080/120202845_793520428134033_3637413561951656742_n.jpg?_nc_ht=scontent-frt3-2.cdninstagram.com&_nc_cat=1&_nc_ohc=8KmzvU9Hoq4AX8iWvFo&_nc_tp=15&oh=977faa163eeded398b49d9f91ed1c32c&oe=5FA18EA5
According to your linked source "instaloader", all you have to do to get the highest quality is to remove the param "se=XX" from that URL ... but it is not there so I guess this is not possible anymore (?)
Code:
github.com/instaloader/instaloader/issues/630#issuecomment-640028019
Sorry but as I said in my first post I don't know much about the technical stuff, but I thought the info on the linked page (or maybe by taking a closer look to instaloader) was enough for someone that knew the inner workings of things to get it to work with JD.
And I used instaloader to download the profile and it is absolutely still possible, did it just now to double check and once again download the image posted above.

If you want to see it yourself download isntaloader and use the command
Code:
instaloader natgeo -l USERNAME -p PASSWORD
Quote:
Seems like the "get best quality" feature either is not possible anymore or broken in "Instaloader" too:
Code:
github.com/instaloader/instaloader/issues/827
Just as that post says it still works while downloading the whole profile, it's only when downloading a single post it doesn't work so that issue is about instaloader doing something different when downloading profiles and single posts.
Reply With Quote
  #10  
Old 05.10.2020, 15:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Ticket:


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 07.10.2020, 15:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Updated our plugin to behave similar to Instaloader.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 07.10.2020 at 15:49.
Reply With Quote
  #12  
Old 07.10.2020, 15:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

What I forgot to mention in my last post:
- This will only work for items, added AFTER the update!
- This will only work if you've added a valid instagram account in your JD!
- The feature is optional and disabled by default for two reasons:
--> it will slow down the download process significantly -
--> downloading original images means, the applied effects will be missing and I guess a lot of people want to have exactly the pictures they see on the Instagram website so they don't really care so much about the quality

You can enable this feature via Settings -> Plugins -> instagram.com


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 07.10.2020 at 15:59.
Reply With Quote
  #13  
Old 08.10.2020, 04:29
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

Quote:
Originally Posted by pspzockerscene View Post
- This will only work for items, added AFTER the update!
Is this a typo or how come?

Either way much appreciated, will test it out and come back with a review
Reply With Quote
  #14  
Old 08.10.2020, 14:14
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by inzzzomnia View Post
Is this a typo or how come?
In the new version, the host plugin needs a new property that gets set in the crawler and was not set before --> Items added before the update cannot be downloaded in "original" quality without deleting- and re-adding them.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #15  
Old 09.10.2020, 18:15
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

Quote:
Originally Posted by pspzockerscene View Post
In the new version, the host plugin needs a new property that gets set in the crawler and was not set before --> Items added before the update cannot be downloaded in "original" quality without deleting- and re-adding them.

-psp-
So you meant in JD, when you wrote it like in the first post I got the impression it would only work on posts added on Instagram after the update. This make much more sense
Reply With Quote
  #16  
Old 12.10.2020, 06:18
inzzzomnia inzzzomnia is offline
JD Fan
 
Join Date: Apr 2017
Posts: 77
Default

First of it sadly doesn't work. Scraping @natgeo the image and post I posted above with the dogs are only downloaded in the 1080x809 version.

On top of that.
The scraper skips posts with multiple images, when scraping the first 100 "items" of @natgeo it skips these posts **External links are only visible to Support Staff**1, **External links are only visible to Support Staff**2 but catch the surrounding ones.

And finally it seems to have broken the possibility to scrape single posts.
JD doesn't even react when you copy the link of a single post and when you then Ctrl+V it into JD it starts the scrape but the nothing shows in the LinkGrabber, even though the image URL is visible in the log created.

JD react if you copy two or more links at the same time but the result is the same, the URL to the image is visible in the log but the LinkGrabber window stays empty.

12.10.20 04.59.05 <--> 12.10.20 05.05.26 jdlog://5314325302851/
Log contains

Scrape of @natgeo 100 items where **External links are only visible to Support Staff**1, **External links are only visible to Support Staff**2 are skipped and all images are 1080x*.

Ctrl+V of **External links are only visible to Support Staff**this posts that is scraped but nothing shows in LinkGrabber.
Reply With Quote
  #17  
Old 12.10.2020, 15:06
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,
1. The crawler has not been changed - it is still crawling all images fine here.
I'm unable to reproduce your issues regarding missing items.
2. Indeed I did break the "grab original quality" procedure again after adding further improvements.

Please try again after the next update.
Again - it will only work for all items, added AFTER the update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:56.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.