#1
|
|||
|
|||
Instagram /p/ links Issue not all pictures of single /p URLs detected
I'm finding that when I add IG /p/ links with multiple, photos/video, it only downloads the first in the series. For instance:
**External links are only visible to Support Staff****External links are only visible to Support Staff** Is there a fix or workaround for this? |
#2
|
|||
|
|||
Instagram /p/ links Issue
Posted this on the wrong board earlier perhaps?
I'm finding that when I add IG /p/ links with multiple, photos/video, it only downloads the first in the series. For instance: **External links are only visible to Support Staff****External links are only visible to Support Staff** Is there a fix or workaround for this? |
#3
|
||||
|
||||
Works fine here - finds 3 images for me.
Please enable debug mode and post a log as described here: Please post your log-ID here | bitte poste deine Log-ID hier. -psp- EDIT I just merged your duplicated posts. Please avoid double-posts and don't push your threads so early! We do not provide instant/24H support!
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 21.01.2022 at 13:36. |
#4
|
|||
|
|||
the link i originally posted works now, but I'm having the same issue with this link:
**External links are only visible to Support Staff****External links are only visible to Support Staff** |
#5
|
|||
|
|||
Same problem here. Any post with multiple images, linkgrabber finds multiple images but gives them all the same filename and treats them as duplicates. When you add to download list the first image will finish, but any subsequent images get the message 'Finished(Mirror)' and does not download.
Here is an example link - **External links are only visible to Support Staff****External links are only visible to Support Staff** I just tested and it should have 3 images but only downloads the first one and treats the others as duplicates. |
#6
|
||||
|
||||
Are you using any kind of Packagizer rules to modify filenames?
I'm unable to reproduce this issue so as already requested in my last reply: Please post your log-ID here | bitte poste deine Log-ID hier. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#7
|
|||
|
|||
No, I'm not using any Packagizer rules. Some links work fine, and the multiple images have unique file names but some links all of them are assigned the same file name.
|
#8
|
|||
|
|||
I can confirm this is happening to me to. Started about a week or two ago. I haven't had any profiles were this didn't occur. I've been using Instander as a stopgap which isn't very ideal.
[edit] no packegizer rules applied. |
#9
|
||||
|
||||
I've asked for logs in my last two replies and you still didn't provide any so I'll repeat myself:
I need DEBUG logs so please enable debug mode first (see linked instructions!). Please post your log-ID here | bitte poste deine Log-ID hier. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#10
|
|||
|
|||
Sorry, I overlooked that request.
Here is a link I'm having trouble with (all photos have the same file name in linkgrabber) **External links are only visible to Support Staff****External links are only visible to Support Staff** Here's the log: 27.01.22 11.00.54 <--> 27.01.22 11.30.15 jdlog://5044925302851/ This might also show that i'm getting a "Plugin Defect" on some IG links when I copy the mobile share URL and it hands off to my computer through iCloud. |
#11
|
|||
|
|||
I managed to figure out a workaround. I turned on the use server names were possible option in the plugin settings. Seems to be working for now. Fingers crossed.
|
#12
|
|||
|
|||
Dude! While that didn't do exactly what I wanted, I found that the check box right underneath it (Include Order ID in File Names) totally does!
High five |
#13
|
||||
|
||||
Quote:
Quote:
Sometimes there is no individual 'shortcode' value available for an item. In this case the filenames were the same which of course should not happen. I've updated that handling so that, if this individual ID is missing, this "order-ID" will be added to the filename even if that setting is disabled. In my case, the filenames were fine when I added that example URL without being logged in. However after enabling an Instagram Account in JD, I was able to reproduce this "same filename" issue. Bitte auf das nächste CORE-Update warten! Please wait for the next CORE-Update! Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp- EDIT lol Indeed this was a known issue see this thread.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 28.01.2022 at 12:58. |
#14
|
|||
|
|||
Quote:
Is it not possible to get the old shortcodes/names, because Instagram made a change on their end? Quote:
New filenames = creating duplicates That is a huge problem for some of us. |
#15
|
|||
|
|||
Quote:
Thanks for your help! |
#16
|
||||
|
||||
Quote:
IOf course you're free to look for them too and let us know about your findings. Quote:
I understand this but how would you resolve this without the mentioned "shortcode" values? -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 31.01.2022 at 16:22. Reason: Fixed QUOTE tags |
#17
|
|||
|
|||
Quote:
___ And it is true. Sometimes the old shortcodes do appear. But very rarely I assume. I downloaded 1 post 2 days ago with the old names. Today the same post shows up without the shortcodes in jd. Me personally, I would like to see no shortcodes at all then. Because changing names from time to time is another problem ___ Whatever. Waiting patiently for the new core update. Thanks for the fixes/workarounds so far. Last edited by Shmi; 01.02.2022 at 12:29. Reason: writting mistake |
#18
|
||||
|
||||
I don't want to answer this with "no" for 100% but for now you get a "no".
Other developers might be able to find this "shortcode" value in another place... Quote:
Quote:
I've disabled it by default so after the next CORE-update, shortcodes will not be included in filenames by default. Bitte auf das nächste CORE-Update warten! Please wait for the next CORE-Update! Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 01.02.2022 at 15:01. |
#19
|
|||
|
|||
It seems like instagram fails when there's a multi-image gallery
Hi!
I think this was working before. I noticed that I get duplicate items when downloading whole account images. I have this packagizer rule, which was working fine: Code:
<jd:prop:date> - <jd:prop:uploader> - <jd:prop:shortcode>.<jd:orgfiletype> It seems like grabbing the image id fails in this case and I get duplicate items, so only one of them is downloaded, which is not necessarily the one that's visible on the user page. Example, this account: **External links are only visible to Support Staff****External links are only visible to Support Staff** and for example this collection of images: **External links are only visible to Support Staff****External links are only visible to Support Staff** the single downloaded file: Code:
2021-11-29 - glembozora - .jpg Code:
With the same packagizer rule two IDs were added to the filename, when it was still working. And the resulting filenames: Code:
2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXTlL8D.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXUFyIc.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXUltbx.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVF9S-.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVFqKi.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVlGyF.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXVlLlB.jpg 2019-07-25 - amyejohnston - B0WcxZkl56g_B0WcxXWFRjI.jpg I guess some numbering for identical filenames would help. Though it would still bunch together different files on the same date, and won't fully compensate for the lack of the identifier code. |
#20
|
|||
|
|||
Instagram - Not Able To Grab Full Format Code
So, I use a custom Packagizer rule for grabbing Instagram links.
Code:
Downloadurl contains instagram.com ...then set Filename <jd:prop:uploader> <jd:prop:date> [<jd:prop:shortcode>].<jd:orgfiletype> I thought maybe it is a packagizer issue, but the problem manifests itself differently without the custom Packagizer rule. Without any custom parameters, Instagram filename is "<jd:prop:uploader> - <jd:prop:shortcode>.<jd:orgfiletype>". Both instances are a problem where multiposts are involved. In default, multipost files are supposed to add two format codes. The url of the post, and the unique code of the particular file in the multipost. But, because of the bug, only the url code is being grabbed. So, with a multipost, all files are ending up having the same filename, and if the filenames are not manually changed and made unique, then JD will automatically skip all subsequent files with the same name. With my custom Packagizer rule, no format code is grabbed once the error starts occurring. Regardless, this causes the same problem. Without manually changing the filenames, many files will be skipped if the filenames are not manually changed. I think the best way to reproduce this issue, is to test with an account link instead of an individual post link. So, here is an account with a small number of posts. **External links are only visible to Support Staff****External links are only visible to Support Staff** And, here is an account with a larger number of posts. **External links are only visible to Support Staff****External links are only visible to Support Staff** If the issue doesn't appear from using the first account, then try the second one and see what happens. |
#21
|
||||
|
||||
Merged similar Instagram Threads
@avada and goldensun87 Next time please use the boardsearch before posting. Also please read my previous replies in this theread. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#22
|
|||
|
|||
Quote:
So the filename pretty much becomes just the date and the account name for me. Which makes even using the "include order id..." function problematic, because there can be multiple separate galleries for one day. |
#23
|
|||
|
|||
Sorry that you had to merge multiple threads. I should say, though, that using the search might not have been the best solution for everybody. Certainly not for me. I perceived the issue differently than busheetop did, and I did my best to explain the issue. In any case, I am glad that this turned out to be a widespread issue instead of an isolated issue. Hope you guys will be able to fix the issue eventually.
|
#24
|
|||
|
|||
As I tried to explain in my post, which got merged into this thread, multipost links are being grabbed, but the crawler is unable to extract the unique shortcode of each file within the multipost. As a result, all files grabbed from each url end up having the same filename, which is why subsequent files with the same name get automatically skipped.
|
#25
|
|||
|
|||
Instagram - issue will linkgrabber with multiple files
Facing issues with multiple images in one thread...
For multiple images, the linkgrabber only grabs one image..below is log created for your reference.. 15.02.22 12.46.42 <--> 15.02.22 13.35.18 jdlog://9135925302851/ |
#26
|
||||
|
||||
Quote:
@aseeda Please read the previous posts in this thread and/or enable: Settings -> Plugins -> instagram.com -> "Include order-ID in filenames if an album contains more than one element?" -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#27
|
||||
|
||||
CORE-Updates have been released!
Please update your JDownloader and report any issues you find asap. CORE-Updates wurden released! Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 01.03.2022 at 15:40. Reason: Fixed typo |
#28
|
|||
|
|||
Unfortunately, this issue is still present. On my end, after 16 properly grabbed files, the rest are missing the format code.
|
#29
|
||||
|
||||
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#30
|
|||
|
|||
Ok so, I tried turning off my custom packagizer rule. Without it, the crawler is grabbing Instagram multiposts and adding numbers to make the filenames unique. Which is a solution for the default function.
So now, it seems the Packagizer is the problem. Here are the properties I am using: <jd:prop:uploader> <jd:prop:date> <jd:prop:shortcode>.<jd:orgfiletype> The only one of those which is not working properly, is the shortcode one. Perhaps that particular property needs to be fixed or reworked? Because the unique shortcodes of multiposts are still there, but apparently, the packagizer property is not able to generate them. Or, it works after several hours of inactivity, but then breaks after a few crawls. Or, would it be possible to add the capability to add the upload dates, into the Instagram plugin? Because as it stands now, the crawler, by default, is grabbing the url shortcode of the post, and adding numbers to multiposts. The only info missing, which I want/need, is the upload dates. If grabbing this could be added into the plugin, then I would not need to use a custom packagizer rule. |
#31
|
||||
|
||||
Quote:
Again: In my last replies I've explained that shortcodes are/were serverside missing -> Sure they will be missing in JD then too Also as explained, I was unable to find the shortcode anywhere else. If a shortcode is available in the filename, ther Packagizer property will also exist! Also as explained, it seemed like IG did still deliver shortcodes sometimes but only for logged-OUT users if I remember correctly. Quote:
Quote:
As explained your issue is not a "Packagizer bug". -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#32
|
|||
|
|||
No matter how many example urls I provide, we will get nowhere, if said urls are not tested properly. So, I will try something else. I will post the filenames that I was able to grab, with my custom Packagizer rule on.
hildasigurdsson 2022-02-28 [CahealPNeZU] hildasigurdsson 2022-02-28 [CahealQNVil] hildasigurdsson 2022-02-28 [CahealRNNwK] hildasigurdsson 2022-02-28 [CahealRtxPV] hildasigurdsson 2022-02-28 [CahealSNCpX] hildasigurdsson 2022-02-28 [CahealTNY5c] And, for extra clarity, here are the filenames I grabbed for the same files, with my custom packagizer rule off. hildasigurdsson - CaheaqctemO - 1_CahealSNCpX hildasigurdsson - CaheaqctemO - 2_CahealRtxPV hildasigurdsson - CaheaqctemO - 3_CahealTNY5c hildasigurdsson - CaheaqctemO - 4_CahealQNVil hildasigurdsson - CaheaqctemO - 5_CahealPNeZU hildasigurdsson - CaheaqctemO - 6_CahealRNNwK As you can see, all the shortcodes extracted, are different from the post's unique url. And yes, that upload date is correct, you can use the url code to view the post and confirm. You are partially correct, that there seems to be no way for us to find these shortcodes manually. I looked in the source code of the post whose files I copypasted, and none of the shortcodes were in there. And yet, the crawler still grabbed the shortcodes. Not only that, you can substitute any of the shortcodes I provided here into the post url, and it will automatically redirect to the entire post. That is how it has been ever since I started using this custom packagizer. So, the shortcodes are definitely not "serverside missing" as you are assuming. All shortcodes, past, present, and future, are present, but JD is not able to grab them. Well, to be clear, it may successfully grab one or few, and then the crawler partially breaks and is unable to grab the shortcodes for several hours it seems. Perhaps the best way to reproduce the issue, is to work with exactly one multipost url. You can work with the url ID I provided above. Provided you have not crawled any Instagram links for many hours, and without any packagizer rules on, the first attempt should grab both the url ID and the unique shortcode of each file in the post. Save those results, and then crawl the same url multiple times, until the shortcodes fail to get grabbed. Honestly, I do not think I can break it down any further than that. Obviously, I do not have any programming knowledge, but I am trying everything I can to make your work easier. Good luck. |
#33
|
||||
|
||||
I believe we're still talking past each other.
Your point: JD finds the shortcodes and adds them to filenames if wished but you cannot use them in your Packagizer rules. My point: Shortcodes are sometimes not available anymore. And no I wasn't only talking about the plain html code of IG but also about their jsons which JD processes when crawling profiles -> Shortcodes simply do not exist anymore for some cases. Quote:
I'd say maybe there is a mistake in your Packagizer rule. Here is a simple rule I've setup to easily test this. If shortcodes were missing, I'd get corrupted filenames: Screenshot of the Packagizer rule: Screenshot of the resulting filenames: In todays test, shortcodes were always available (with- and without account). -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#34
|
||||
|
||||
Unrelated to my last post:
I've added a plugin setting to include the date in the filename. @goldensun87 Please keep in mind that this is not a direct reaction to your post/problem! You should be able to use the Packagizer ín a normal way even with shortcodes -> As explained my guess is that your Packagizer rule is buggy. Please post a screenshot of your Packagizer rule here. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#35
|
|||
|
|||
|
#36
|
||||
|
||||
Your rule is working just fine here so I guess either you somehow aren't using the current JD revision or maybe shortcodes are missing for you in account mode which again makes no sense as you did get them in your filenames.
Please try the following: 1. Remove or disable your Instagram Account in JD and re-add that test-URL -> Does it work now? 2. If 1. does not work, enable debug mode and provide a logID. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#37
|
|||
|
|||
02.03.22 05.42.35 <--> 02.03.22 05.42.31 jdlog://7616925302851/
I may have messed up a little bit. I wanted to log both successful and failed attempts at correct grabbing, but I forgot that enabling debug mode requires a restart. In this time frame, I tested exactly one url multiple times. The first 5 tests were successful, and the 6th one onward was a failure. This log may or may not reflect that. In any case, I hope you receive the info you need. |
#38
|
||||
|
||||
I'm unable to find the response containing the IDs in your log thus it's nut a debug log.
I still think that whenever the IDs are missing for you, they're also missing on IGs end. Please post another log. -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#39
|
|||
|
|||
02.03.22 14.19.14 <--> 02.03.22 14.25.06 jdlog://1916925302851/
All right, I made sure debug mode was enabled, before attempting to grab the link. After enabling debug mode, I am just supposed to open Help => Create A Log, right? The chosen time interval should be correct this time, the one I chose last time might have been before enabling debug. Maybe that is why you did not find anything in the log. I hope I did it correct this time. For reference, on this grab attempt, the shortcodes were not found, and my custom packagizer rule was on. |
#40
|
||||
|
||||
That log looks alright and yes, shortcodes are missing.
You can by the way also view your own logs, see [JD install dir]/logs. Your log clearly shows the following: - First the crawler tries it without IG account - IG account is required according to the IG website so JD logs in and tries again - Instagram response does not contain any shortcodes You can check this yourself by looking either into your log or into the html code in your browser: Rough guide: Search for the following text (with "") to find the json data of single images: Code:
"media_id" Code:
"shortcode" -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
Thread Tools | |
Display Modes | |
|
|