JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 20.01.2022, 22:12
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default Instagram /p/ links Issue not all pictures of single /p URLs detected

I'm finding that when I add IG /p/ links with multiple, photos/video, it only downloads the first in the series. For instance:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Is there a fix or workaround for this?
Reply With Quote
  #2  
Old 21.01.2022, 02:27
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default Instagram /p/ links Issue

Posted this on the wrong board earlier perhaps?

I'm finding that when I add IG /p/ links with multiple, photos/video, it only downloads the first in the series. For instance:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Is there a fix or workaround for this?
Reply With Quote
  #3  
Old 21.01.2022, 13:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Works fine here - finds 3 images for me.

Please enable debug mode and post a log as described here:

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
EDIT

I just merged your duplicated posts.
Please avoid double-posts and don't push your threads so early!
We do not provide instant/24H support!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 21.01.2022 at 13:36.
Reply With Quote
  #4  
Old 21.01.2022, 19:38
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default

the link i originally posted works now, but I'm having the same issue with this link:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #5  
Old 22.01.2022, 12:32
mikban mikban is offline
I will play nice!
 
Join Date: Oct 2019
Posts: 7
Default

Same problem here. Any post with multiple images, linkgrabber finds multiple images but gives them all the same filename and treats them as duplicates. When you add to download list the first image will finish, but any subsequent images get the message 'Finished(Mirror)' and does not download.

Here is an example link - **External links are only visible to Support Staff****External links are only visible to Support Staff**

I just tested and it should have 3 images but only downloads the first one and treats the others as duplicates.
Reply With Quote
  #6  
Old 24.01.2022, 17:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Are you using any kind of Packagizer rules to modify filenames?
I'm unable to reproduce this issue so as already requested in my last reply:

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 26.01.2022, 18:58
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default

No, I'm not using any Packagizer rules. Some links work fine, and the multiple images have unique file names but some links all of them are assigned the same file name.
Reply With Quote
  #8  
Old 27.01.2022, 00:04
OniiW5ZNlOdq69MNwC*jC3mDK OniiW5ZNlOdq69MNwC*jC3mDK is offline
Modem User
 
Join Date: Sep 2017
Posts: 3
Default

I can confirm this is happening to me to. Started about a week or two ago. I haven't had any profiles were this didn't occur. I've been using Instander as a stopgap which isn't very ideal.

[edit] no packegizer rules applied.
Reply With Quote
  #9  
Old 27.01.2022, 13:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

I've asked for logs in my last two replies and you still didn't provide any so I'll repeat myself:
I need DEBUG logs so please enable debug mode first (see linked instructions!).

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 27.01.2022, 20:30
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default

Sorry, I overlooked that request.

Here is a link I'm having trouble with (all photos have the same file name in linkgrabber)

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Here's the log:

27.01.22 11.00.54 <--> 27.01.22 11.30.15 jdlog://5044925302851/

This might also show that i'm getting a "Plugin Defect" on some IG links when I copy the mobile share URL and it hands off to my computer through iCloud.
Reply With Quote
  #11  
Old 28.01.2022, 02:18
OniiW5ZNlOdq69MNwC*jC3mDK OniiW5ZNlOdq69MNwC*jC3mDK is offline
Modem User
 
Join Date: Sep 2017
Posts: 3
Default

I managed to figure out a workaround. I turned on the use server names were possible option in the plugin settings. Seems to be working for now. Fingers crossed.
Reply With Quote
  #12  
Old 28.01.2022, 02:53
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default

Dude! While that didn't do exactly what I wanted, I found that the check box right underneath it (Include Order ID in File Names) totally does!

High five
Reply With Quote
  #13  
Old 28.01.2022, 12:41
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Quote:
Originally Posted by busheetop View Post
This might also show that i'm getting a "Plugin Defect" on some IG links when I copy the mobile share URL and it hands off to my computer through iCloud.
This issue will be fixed with our next set of CORE-updates.

Quote:
Originally Posted by OniiW5ZNlOdq69MNwC*jC3mDK View Post
I managed to figure out a workaround. I turned on the use server names were possible option in the plugin settings. Seems to be working for now. Fingers crossed.
I've found- and fixed this issue - thanks for reporting!
Sometimes there is no individual 'shortcode' value available for an item.
In this case the filenames were the same which of course should not happen.

I've updated that handling so that, if this individual ID is missing, this "order-ID" will be added to the filename even if that setting is disabled.
In my case, the filenames were fine when I added that example URL without being logged in.
However after enabling an Instagram Account in JD, I was able to reproduce this "same filename" issue.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
EDIT

lol Indeed this was a known issue see this thread.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 28.01.2022 at 12:58.
Reply With Quote
  #14  
Old 28.01.2022, 17:02
Shmi Shmi is offline
DSL Light User
 
Join Date: Jan 2020
Posts: 30
Default

Quote:
Originally Posted by pspzockerscene View Post
Sometimes there is no individual 'shortcode' value available for an item.
In this case the filenames were the same which of course should not happen
Sometimes? I tried updating/downloading some profiles and it is now always the case. Even for older posts where there used to be individual names for every element.

Is it not possible to get the old shortcodes/names, because Instagram made a change on their end?

Quote:
Originally Posted by pspzockerscene View Post
I've updated that handling so that, if this individual ID is missing, this "order-ID" will be added to the filename even if that setting is disabled.
It may fixes that you can download all content in a post, but you won't be able to update existing folders without creating duplicates.

New filenames = creating duplicates

That is a huge problem for some of us.
Reply With Quote
  #15  
Old 28.01.2022, 20:52
busheetop busheetop is offline
JD Alpha
 
Join Date: Jul 2020
Posts: 23
Default

Quote:
Originally Posted by pspzockerscene View Post
This issue will be fixed with our next set of CORE-updates.


I've found- and fixed this issue - thanks for reporting!
Sometimes there is no individual 'shortcode' value available for an item.
In this case the filenames were the same which of course should not happen.

I've updated that handling so that, if this individual ID is missing, this "order-ID" will be added to the filename even if that setting is disabled.
In my case, the filenames were fine when I added that example URL without being logged in.
However after enabling an Instagram Account in JD, I was able to reproduce this "same filename" issue.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!


-psp-
EDIT

lol Indeed this was a known issue see **External links are only visible to Support Staff**....

Thanks for your help!
Reply With Quote
  #16  
Old 31.01.2022, 16:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Quote:
Originally Posted by pspzockerscene View Post
Is it not possible to get the old shortcodes/names, because Instagram made a change on their end?
I didn't find them.
IOf course you're free to look for them too and let us know about your findings.

Quote:
Originally Posted by pspzockerscene View Post
It may fixes that you can download all content in a post, but you won't be able to update existing folders without creating duplicates.
Exactly...but you could easily either re-download all of them or update existing files using a rename script that removes those IDs so the filename structure of your existing filename is the same as the "new filename structure".

Quote:
Originally Posted by pspzockerscene View Post
That is a huge problem for some of us.
I understand this but how would you resolve this without the mentioned "shortcode" values?

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 31.01.2022 at 16:22. Reason: Fixed QUOTE tags
Reply With Quote
  #17  
Old 01.02.2022, 12:28
Shmi Shmi is offline
DSL Light User
 
Join Date: Jan 2020
Posts: 30
Default

Quote:
Originally Posted by pspzockerscene View Post
I understand this but how would you resolve this without the mentioned "shortcode" values?

-psp-
I wouldn't. I asked to be sure that there is no chance for old names. Because checking for dupes, checking for deletions, deleting by hand will take a lot of time in my case.

___
And it is true. Sometimes the old shortcodes do appear. But very rarely I assume.

I downloaded 1 post 2 days ago with the old names. Today the same post shows up without the shortcodes in jd.
Me personally, I would like to see no shortcodes at all then. Because changing names from time to time is another problem
___
Whatever. Waiting patiently for the new core update.
Thanks for the fixes/workarounds so far.

Last edited by Shmi; 01.02.2022 at 12:29. Reason: writting mistake
Reply With Quote
  #18  
Old 01.02.2022, 14:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Quote:
Originally Posted by Shmi View Post
I asked to be sure that there is no chance for old names.
I don't want to answer this with "no" for 100% but for now you get a "no".
Other developers might be able to find this "shortcode" value in another place...

Quote:
Originally Posted by Shmi View Post
Because checking for dupes, checking for deletions, deleting by hand will take a lot of time in my case.
As explained, you can easily fix this by mass-renaming your already downloaded files so they're in the other format...though I must say if they do not include that "orderID" this will indeed be impossible.

Quote:
Originally Posted by Shmi View Post
Me personally, I would like to see no shortcodes at all then. Because changing names from time to time is another problem
I've added a plugin setting for this.
I've disabled it by default so after the next CORE-update, shortcodes will not be included in filenames by default.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 01.02.2022 at 15:01.
Reply With Quote
  #19  
Old 03.02.2022, 22:45
avada avada is offline
Linkgrabbing Monster
 
Join Date: Dec 2010
Posts: 83
Default It seems like instagram fails when there's a multi-image gallery

Hi!

I think this was working before. I noticed that I get duplicate items when downloading whole account images.
I have this packagizer rule, which was working fine:
Code:
<jd:prop:date> - <jd:prop:uploader> - <jd:prop:shortcode>.<jd:orgfiletype>
By the looks of it it's related to multi-image (gallery?) items. Where there is a second smaller set of arrows to flip through.

It seems like grabbing the image id fails in this case and I get duplicate items, so only one of them is downloaded, which is not necessarily the one that's visible on the user page.

Example, this account: **External links are only visible to Support Staff****External links are only visible to Support Staff**
and for example this collection of images:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
the single downloaded file:
Code:
2021-11-29 - glembozora - .jpg
Code:
With the same packagizer rule two IDs were added to the filename, when it was still working.
Such as this collection: **External links are only visible to Support Staff****External links are only visible to Support Staff**
And the resulting filenames:
Code:
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXTlL8D.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXUFyIc.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXUltbx.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVF9S-.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVFqKi.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVlGyF.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVlLlB.jpg
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXWFRjI.jpg
Meanwhile is there a workaround?

I guess some numbering for identical filenames would help. Though it would still bunch together different files on the same date, and won't fully compensate for the lack of the identifier code.
Reply With Quote
  #20  
Old 06.02.2022, 00:46
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default Instagram - Not Able To Grab Full Format Code

So, I use a custom Packagizer rule for grabbing Instagram links.

Code:
Downloadurl contains instagram.com

...then set

Filename <jd:prop:uploader> <jd:prop:date> [<jd:prop:shortcode>].<jd:orgfiletype>
With those parameters, what happens is, a few initial links are grabbed and named properly, but then, the grabber is unable to grab the format code.

I thought maybe it is a packagizer issue, but the problem manifests itself differently without the custom Packagizer rule. Without any custom parameters, Instagram filename is "<jd:prop:uploader> - <jd:prop:shortcode>.<jd:orgfiletype>".

Both instances are a problem where multiposts are involved. In default, multipost files are supposed to add two format codes. The url of the post, and the unique code of the particular file in the multipost. But, because of the bug, only the url code is being grabbed. So, with a multipost, all files are ending up having the same filename, and if the filenames are not manually changed and made unique, then JD will automatically skip all subsequent files with the same name.

With my custom Packagizer rule, no format code is grabbed once the error starts occurring. Regardless, this causes the same problem. Without manually changing the filenames, many files will be skipped if the filenames are not manually changed.

I think the best way to reproduce this issue, is to test with an account link instead of an individual post link.

So, here is an account with a small number of posts.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

And, here is an account with a larger number of posts.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

If the issue doesn't appear from using the first account, then try the second one and see what happens.
Reply With Quote
  #21  
Old 08.02.2022, 14:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Merged similar Instagram Threads

@avada and goldensun87
Next time please use the boardsearch before posting.
Also please read my previous replies in this theread.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #22  
Old 08.02.2022, 17:47
avada avada is offline
Linkgrabbing Monster
 
Join Date: Dec 2010
Posts: 83
Default

Quote:
Originally Posted by pspzockerscene View Post
This issue will be fixed with our next set of CORE-updates.


I've found- and fixed this issue - thanks for reporting!
Sometimes there is no individual 'shortcode' value available for an item.
In this case the filenames were the same which of course should not happen.

I've updated that handling so that, if this individual ID is missing, this "order-ID" will be added to the filename even if that setting is disabled.
In my case, the filenames were fine when I added that example URL without being logged in.
However after enabling an Instagram Account in JD, I was able to reproduce this "same filename" issue.
What doesn't make sense that it's not only the "individual shortcode" is missing, but the main one as well.
So the filename pretty much becomes just the date and the account name for me.

Which makes even using the "include order id..." function problematic, because there can be multiple separate galleries for one day.
Reply With Quote
  #23  
Old 09.02.2022, 07:03
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Quote:
Originally Posted by pspzockerscene View Post
Merged similar Instagram Threads

@avada and goldensun87
Next time please use the boardsearch before posting.
Also please read my previous replies in this theread.

-psp-
Sorry that you had to merge multiple threads. I should say, though, that using the search might not have been the best solution for everybody. Certainly not for me. I perceived the issue differently than busheetop did, and I did my best to explain the issue. In any case, I am glad that this turned out to be a widespread issue instead of an isolated issue. Hope you guys will be able to fix the issue eventually.
Reply With Quote
  #24  
Old 09.02.2022, 07:07
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Quote:
Originally Posted by busheetop View Post
I'm finding that when I add IG /p/ links with multiple, photos/video, it only downloads the first in the series. For instance:

**External links are only visible to Support Staff**...

Is there a fix or workaround for this?
As I tried to explain in my post, which got merged into this thread, multipost links are being grabbed, but the crawler is unable to extract the unique shortcode of each file within the multipost. As a result, all files grabbed from each url end up having the same filename, which is why subsequent files with the same name get automatically skipped.
Reply With Quote
  #25  
Old 15.02.2022, 09:06
aseeda aseeda is offline
Modem User
 
Join Date: Feb 2022
Posts: 1
Default Instagram - issue will linkgrabber with multiple files

Facing issues with multiple images in one thread...

For multiple images, the linkgrabber only grabs one image..below is log created for your reference..

15.02.22 12.46.42 <--> 15.02.22 13.35.18 jdlog://9135925302851/
Reply With Quote
  #26  
Old 15.02.2022, 15:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Quote:
Originally Posted by goldensun87 View Post
I should say, though, that using the search might not have been the best solution for everybody. Certainly not for me. I perceived the issue differently than busheetop did, and I did my best to explain the issue.
No problem that's why there are forum moderators

@aseeda
Please read the previous posts in this thread and/or enable:
Settings -> Plugins -> instagram.com -> "Include order-ID in filenames if an album contains more than one element?"

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #27  
Old 25.02.2022, 16:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

CORE-Updates have been released!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 01.03.2022 at 15:40. Reason: Fixed typo
Reply With Quote
  #28  
Old 26.02.2022, 08:51
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Unfortunately, this issue is still present. On my end, after 16 properly grabbed files, the rest are missing the format code.
Reply With Quote
  #29  
Old 26.02.2022, 19:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

@goldensun87
This is not a bug.
I've answere questions about this missing value here.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #30  
Old 28.02.2022, 00:45
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Ok so, I tried turning off my custom packagizer rule. Without it, the crawler is grabbing Instagram multiposts and adding numbers to make the filenames unique. Which is a solution for the default function.

So now, it seems the Packagizer is the problem. Here are the properties I am using:

<jd:prop:uploader> <jd:prop:date> <jd:prop:shortcode>.<jd:orgfiletype>

The only one of those which is not working properly, is the shortcode one. Perhaps that particular property needs to be fixed or reworked? Because the unique shortcodes of multiposts are still there, but apparently, the packagizer property is not able to generate them. Or, it works after several hours of inactivity, but then breaks after a few crawls.

Or, would it be possible to add the capability to add the upload dates, into the Instagram plugin? Because as it stands now, the crawler, by default, is grabbing the url shortcode of the post, and adding numbers to multiposts. The only info missing, which I want/need, is the upload dates. If grabbing this could be added into the plugin, then I would not need to use a custom packagizer rule.
Reply With Quote
  #31  
Old 28.02.2022, 14:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Quote:
Originally Posted by goldensun87 View Post
So now, it seems the Packagizer is the problem. Here are the properties I am using:

<jd:prop:uploader> <jd:prop:date> <jd:prop:shortcode>.<jd:orgfiletype>

The only one of those which is not working properly, is the shortcode one. Perhaps that particular property needs to be fixed or reworked?
No.
Again:
In my last replies I've explained that shortcodes are/were serverside missing -> Sure they will be missing in JD then too
Also as explained, I was unable to find the shortcode anywhere else.
If a shortcode is available in the filename, ther Packagizer property will also exist!
Also as explained, it seemed like IG did still deliver shortcodes sometimes but only for logged-OUT users if I remember correctly.

Quote:
Originally Posted by goldensun87 View Post
Because the unique shortcodes of multiposts are still there, but apparently, the packagizer property is not able to generate them. Or, it works after several hours of inactivity, but then breaks after a few crawls.
Please provide example URLs for items where the shortcode is still available.

Quote:
Originally Posted by goldensun87 View Post
Or, would it be possible to add the capability to add the upload dates, into the Instagram plugin? Because as it stands now, the crawler, by default, is grabbing the url shortcode of the post, and adding numbers to multiposts. The only info missing, which I want/need, is the upload dates. If grabbing this could be added into the plugin, then I would not need to use a custom packagizer rule.
I'm not planning to change the default filenames again.
As explained your issue is not a "Packagizer bug".

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #32  
Old 28.02.2022, 19:27
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

No matter how many example urls I provide, we will get nowhere, if said urls are not tested properly. So, I will try something else. I will post the filenames that I was able to grab, with my custom Packagizer rule on.

hildasigurdsson 2022-02-28 [CahealPNeZU]
hildasigurdsson 2022-02-28 [CahealQNVil]
hildasigurdsson 2022-02-28 [CahealRNNwK]
hildasigurdsson 2022-02-28 [CahealRtxPV]
hildasigurdsson 2022-02-28 [CahealSNCpX]
hildasigurdsson 2022-02-28 [CahealTNY5c]

And, for extra clarity, here are the filenames I grabbed for the same files, with my custom packagizer rule off.

hildasigurdsson - CaheaqctemO - 1_CahealSNCpX
hildasigurdsson - CaheaqctemO - 2_CahealRtxPV
hildasigurdsson - CaheaqctemO - 3_CahealTNY5c
hildasigurdsson - CaheaqctemO - 4_CahealQNVil
hildasigurdsson - CaheaqctemO - 5_CahealPNeZU
hildasigurdsson - CaheaqctemO - 6_CahealRNNwK

As you can see, all the shortcodes extracted, are different from the post's unique url. And yes, that upload date is correct, you can use the url code to view the post and confirm.

You are partially correct, that there seems to be no way for us to find these shortcodes manually. I looked in the source code of the post whose files I copypasted, and none of the shortcodes were in there. And yet, the crawler still grabbed the shortcodes. Not only that, you can substitute any of the shortcodes I provided here into the post url, and it will automatically redirect to the entire post. That is how it has been ever since I started using this custom packagizer. So, the shortcodes are definitely not "serverside missing" as you are assuming. All shortcodes, past, present, and future, are present, but JD is not able to grab them. Well, to be clear, it may successfully grab one or few, and then the crawler partially breaks and is unable to grab the shortcodes for several hours it seems.

Perhaps the best way to reproduce the issue, is to work with exactly one multipost url. You can work with the url ID I provided above. Provided you have not crawled any Instagram links for many hours, and without any packagizer rules on, the first attempt should grab both the url ID and the unique shortcode of each file in the post. Save those results, and then crawl the same url multiple times, until the shortcodes fail to get grabbed.

Honestly, I do not think I can break it down any further than that. Obviously, I do not have any programming knowledge, but I am trying everything I can to make your work easier. Good luck.
Reply With Quote
  #33  
Old 01.03.2022, 15:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

I believe we're still talking past each other.

Your point:
JD finds the shortcodes and adds them to filenames if wished but you cannot use them in your Packagizer rules.

My point:
Shortcodes are sometimes not available anymore.
And no I wasn't only talking about the plain html code of IG but also about their jsons which JD processes when crawling profiles -> Shortcodes simply do not exist anymore for some cases.

Quote:
Originally Posted by goldensun87 View Post
All shortcodes, past, present, and future, are present, but JD is not able to grab them. Well, to be clear, it may successfully grab one or few, and then the crawler partially breaks and is unable to grab the shortcodes for several hours it seems.
No.
I'd say maybe there is a mistake in your Packagizer rule.
Here is a simple rule I've setup to easily test this.
If shortcodes were missing, I'd get corrupted filenames:
Screenshot of the Packagizer rule:

Screenshot of the resulting filenames:


In todays test, shortcodes were always available (with- and without account).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #34  
Old 01.03.2022, 15:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Unrelated to my last post:
I've added a plugin setting to include the date in the filename.

@goldensun87
Please keep in mind that this is not a direct reaction to your post/problem!
You should be able to use the Packagizer ín a normal way even with shortcodes -> As explained my guess is that your Packagizer rule is buggy.
Please post a screenshot of your Packagizer rule here.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #35  
Old 01.03.2022, 23:58
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Here is my screenshot.

Reply With Quote
  #36  
Old 02.03.2022, 11:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Your rule is working just fine here so I guess either you somehow aren't using the current JD revision or maybe shortcodes are missing for you in account mode which again makes no sense as you did get them in your filenames.
Please try the following:
1. Remove or disable your Instagram Account in JD and re-add that test-URL -> Does it work now?
2. If 1. does not work, enable debug mode and provide a logID.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #37  
Old 02.03.2022, 12:47
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

02.03.22 05.42.35 <--> 02.03.22 05.42.31 jdlog://7616925302851/

I may have messed up a little bit. I wanted to log both successful and failed attempts at correct grabbing, but I forgot that enabling debug mode requires a restart. In this time frame, I tested exactly one url multiple times. The first 5 tests were successful, and the 6th one onward was a failure. This log may or may not reflect that. In any case, I hope you receive the info you need.
Reply With Quote
  #38  
Old 02.03.2022, 13:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

I'm unable to find the response containing the IDs in your log thus it's nut a debug log.

I still think that whenever the IDs are missing for you, they're also missing on IGs end.
Please post another log.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #39  
Old 02.03.2022, 21:32
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

02.03.22 14.19.14 <--> 02.03.22 14.25.06 jdlog://1916925302851/

All right, I made sure debug mode was enabled, before attempting to grab the link. After enabling debug mode, I am just supposed to open Help => Create A Log, right? The chosen time interval should be correct this time, the one I chose last time might have been before enabling debug. Maybe that is why you did not find anything in the log. I hope I did it correct this time. For reference, on this grab attempt, the shortcodes were not found, and my custom packagizer rule was on.
Reply With Quote
  #40  
Old 03.03.2022, 17:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

That log looks alright and yes, shortcodes are missing.
You can by the way also view your own logs, see [JD install dir]/logs.
Your log clearly shows the following:
- First the crawler tries it without IG account
- IG account is required according to the IG website so JD logs in and tries again
- Instagram response does not contain any shortcodes
You can check this yourself by looking either into your log or into the html code in your browser:
Rough guide:
Search for the following text (with "") to find the json data of single images:
Code:
"media_id"
Search for the following text to find the proo that there are no shortcodes given:
Code:
"shortcode"
--> As you can see in our code, this is where our plugin gets them from.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 20:30.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.