[pspzockerscene]

Merged similar Instagram Threads

@avada and goldensun87
Next time please use the boardsearch before posting.
Also please read my previous replies in this theread.

-psp-

[avada]

Originally Posted by pspzockerscene

This issue will be fixed with our next set of CORE-updates.


I've found- and fixed this issue - thanks for reporting!
Sometimes there is no individual 'shortcode' value available for an item.
In this case the filenames were the same which of course should not happen.

I've updated that handling so that, if this individual ID is missing, this "order-ID" will be added to the filename even if that setting is disabled.
In my case, the filenames were fine when I added that example URL without being logged in.
However after enabling an Instagram Account in JD, I was able to reproduce this "same filename" issue.

What doesn't make sense that it's not only the "individual shortcode" is missing, but the main one as well.
So the filename pretty much becomes just the date and the account name for me.

Which makes even using the "include order id..." function problematic, because there can be multiple separate galleries for one day.

[goldensun87]

Originally Posted by pspzockerscene

Merged similar Instagram Threads

@avada and goldensun87
Next time please use the boardsearch before posting.
Also please read my previous replies in this theread.

-psp-

Sorry that you had to merge multiple threads. I should say, though, that using the search might not have been the best solution for everybody. Certainly not for me. I perceived the issue differently than busheetop did, and I did my best to explain the issue. In any case, I am glad that this turned out to be a widespread issue instead of an isolated issue. Hope you guys will be able to fix the issue eventually.

[goldensun87]

Originally Posted by busheetop

I'm finding that when I add IG /p/ links with multiple, photos/video, it only downloads the first in the series. For instance:

**External links are only visible to Support Staff**...

Is there a fix or workaround for this?

As I tried to explain in my post, which got merged into this thread, multipost links are being grabbed, but the crawler is unable to extract the unique shortcode of each file within the multipost. As a result, all files grabbed from each url end up having the same filename, which is why subsequent files with the same name get automatically skipped.

[aseeda]

Facing issues with multiple images in one thread...

For multiple images, the linkgrabber only grabs one image..below is log created for your reference..

15.02.22 12.46.42 <--> 15.02.22 13.35.18 jdlog://9135925302851/

[pspzockerscene]

Originally Posted by goldensun87

I should say, though, that using the search might not have been the best solution for everybody. Certainly not for me. I perceived the issue differently than busheetop did, and I did my best to explain the issue.

No problem that's why there are forum moderators

@aseeda
Please read the previous posts in this thread and/or enable:
Settings -> Plugins -> instagram.com -> "Include order-ID in filenames if an album contains more than one element?"

-psp-

[pspzockerscene]

CORE-Updates have been released!
Please update your JDownloader and report any issues you find asap.

CORE-Updates wurden released!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.

-psp-

[goldensun87]

Unfortunately, this issue is still present. On my end, after 16 properly grabbed files, the rest are missing the format code.

[pspzockerscene]

@goldensun87
This is not a bug.
I've answere questions about this missing value here.

-psp-

[goldensun87]

Ok so, I tried turning off my custom packagizer rule. Without it, the crawler is grabbing Instagram multiposts and adding numbers to make the filenames unique. Which is a solution for the default function.

So now, it seems the Packagizer is the problem. Here are the properties I am using:

<jd:prop:uploader> <jd:prop:date> <jd:prop:shortcode>.<jd:orgfiletype>

The only one of those which is not working properly, is the shortcode one. Perhaps that particular property needs to be fixed or reworked? Because the unique shortcodes of multiposts are still there, but apparently, the packagizer property is not able to generate them. Or, it works after several hours of inactivity, but then breaks after a few crawls.

Or, would it be possible to add the capability to add the upload dates, into the Instagram plugin? Because as it stands now, the crawler, by default, is grabbing the url shortcode of the post, and adding numbers to multiposts. The only info missing, which I want/need, is the upload dates. If grabbing this could be added into the plugin, then I would not need to use a custom packagizer rule.

[pspzockerscene]

Originally Posted by goldensun87

So now, it seems the Packagizer is the problem. Here are the properties I am using:

<jd:prop:uploader> <jd:prop:date> <jd:prop:shortcode>.<jd:orgfiletype>

The only one of those which is not working properly, is the shortcode one. Perhaps that particular property needs to be fixed or reworked?

No.
Again:
In my last replies I've explained that shortcodes are/were serverside missing -> Sure they will be missing in JD then too
Also as explained, I was unable to find the shortcode anywhere else.
If a shortcode is available in the filename, ther Packagizer property will also exist!
Also as explained, it seemed like IG did still deliver shortcodes sometimes but only for logged-OUT users if I remember correctly.

Originally Posted by goldensun87

Because the unique shortcodes of multiposts are still there, but apparently, the packagizer property is not able to generate them. Or, it works after several hours of inactivity, but then breaks after a few crawls.

Please provide example URLs for items where the shortcode is still available.

Originally Posted by goldensun87

Or, would it be possible to add the capability to add the upload dates, into the Instagram plugin? Because as it stands now, the crawler, by default, is grabbing the url shortcode of the post, and adding numbers to multiposts. The only info missing, which I want/need, is the upload dates. If grabbing this could be added into the plugin, then I would not need to use a custom packagizer rule.

I'm not planning to change the default filenames again.
As explained your issue is not a "Packagizer bug".

-psp-

[goldensun87]

No matter how many example urls I provide, we will get nowhere, if said urls are not tested properly. So, I will try something else. I will post the filenames that I was able to grab, with my custom Packagizer rule on.

hildasigurdsson 2022-02-28 [CahealPNeZU]
hildasigurdsson 2022-02-28 [CahealQNVil]
hildasigurdsson 2022-02-28 [CahealRNNwK]
hildasigurdsson 2022-02-28 [CahealRtxPV]
hildasigurdsson 2022-02-28 [CahealSNCpX]
hildasigurdsson 2022-02-28 [CahealTNY5c]

And, for extra clarity, here are the filenames I grabbed for the same files, with my custom packagizer rule off.

hildasigurdsson - CaheaqctemO - 1_CahealSNCpX
hildasigurdsson - CaheaqctemO - 2_CahealRtxPV
hildasigurdsson - CaheaqctemO - 3_CahealTNY5c
hildasigurdsson - CaheaqctemO - 4_CahealQNVil
hildasigurdsson - CaheaqctemO - 5_CahealPNeZU
hildasigurdsson - CaheaqctemO - 6_CahealRNNwK

As you can see, all the shortcodes extracted, are different from the post's unique url. And yes, that upload date is correct, you can use the url code to view the post and confirm.

You are partially correct, that there seems to be no way for us to find these shortcodes manually. I looked in the source code of the post whose files I copypasted, and none of the shortcodes were in there. And yet, the crawler still grabbed the shortcodes. Not only that, you can substitute any of the shortcodes I provided here into the post url, and it will automatically redirect to the entire post. That is how it has been ever since I started using this custom packagizer. So, the shortcodes are definitely not "serverside missing" as you are assuming. All shortcodes, past, present, and future, are present, but JD is not able to grab them. Well, to be clear, it may successfully grab one or few, and then the crawler partially breaks and is unable to grab the shortcodes for several hours it seems.

Perhaps the best way to reproduce the issue, is to work with exactly one multipost url. You can work with the url ID I provided above. Provided you have not crawled any Instagram links for many hours, and without any packagizer rules on, the first attempt should grab both the url ID and the unique shortcode of each file in the post. Save those results, and then crawl the same url multiple times, until the shortcodes fail to get grabbed.

Honestly, I do not think I can break it down any further than that. Obviously, I do not have any programming knowledge, but I am trying everything I can to make your work easier. Good luck.

[pspzockerscene]

I believe we're still talking past each other.

Your point:
JD finds the shortcodes and adds them to filenames if wished but you cannot use them in your Packagizer rules.

My point:
Shortcodes are sometimes not available anymore.
And no I wasn't only talking about the plain html code of IG but also about their jsons which JD processes when crawling profiles -> Shortcodes simply do not exist anymore for some cases.

Originally Posted by goldensun87

All shortcodes, past, present, and future, are present, but JD is not able to grab them. Well, to be clear, it may successfully grab one or few, and then the crawler partially breaks and is unable to grab the shortcodes for several hours it seems.

No.
I'd say maybe there is a mistake in your Packagizer rule.
Here is a simple rule I've setup to easily test this.
If shortcodes were missing, I'd get corrupted filenames:
Screenshot of the Packagizer rule:

Screenshot of the resulting filenames:


In todays test, shortcodes were always available (with- and without account).

-psp-

[pspzockerscene]

Unrelated to my last post:
I've added a plugin setting to include the date in the filename.

@goldensun87
Please keep in mind that this is not a direct reaction to your post/problem!
You should be able to use the Packagizer ín a normal way even with shortcodes -> As explained my guess is that your Packagizer rule is buggy.
Please post a screenshot of your Packagizer rule here.

-psp-

[goldensun87]

Here is my screenshot.

[pspzockerscene]

Your rule is working just fine here so I guess either you somehow aren't using the current JD revision or maybe shortcodes are missing for you in account mode which again makes no sense as you did get them in your filenames.
Please try the following:
1. Remove or disable your Instagram Account in JD and re-add that test-URL -> Does it work now?
2. If 1. does not work, enable debug mode and provide a logID.

-psp-

[goldensun87]

02.03.22 05.42.35 <--> 02.03.22 05.42.31 jdlog://7616925302851/

I may have messed up a little bit. I wanted to log both successful and failed attempts at correct grabbing, but I forgot that enabling debug mode requires a restart. In this time frame, I tested exactly one url multiple times. The first 5 tests were successful, and the 6th one onward was a failure. This log may or may not reflect that. In any case, I hope you receive the info you need.

[pspzockerscene]

I'm unable to find the response containing the IDs in your log thus it's nut a debug log.

I still think that whenever the IDs are missing for you, they're also missing on IGs end.
Please post another log.

-psp-

[goldensun87]

02.03.22 14.19.14 <--> 02.03.22 14.25.06 jdlog://1916925302851/

All right, I made sure debug mode was enabled, before attempting to grab the link. After enabling debug mode, I am just supposed to open Help => Create A Log, right? The chosen time interval should be correct this time, the one I chose last time might have been before enabling debug. Maybe that is why you did not find anything in the log. I hope I did it correct this time. For reference, on this grab attempt, the shortcodes were not found, and my custom packagizer rule was on.

[pspzockerscene]

That log looks alright and yes, shortcodes are missing.
You can by the way also view your own logs, see [JD install dir]/logs.
Your log clearly shows the following:
- First the crawler tries it without IG account
- IG account is required according to the IG website so JD logs in and tries again
- Instagram response does not contain any shortcodes
You can check this yourself by looking either into your log or into the html code in your browser:
Rough guide:
Search for the following text (with "") to find the json data of single images:

"media_id"

Search for the following text to find the proo that there are no shortcodes given:

"shortcode"

--> As you can see in our code, this is where our plugin gets them from.

-psp-