#1
|
|||
|
|||
![]()
Hello, this has happened at random times in the past during update cycles, but for the past few days the linkgrabber won't grab anything from instagram.
Direct URLs will work (e.g. instagram.com/username/p/blahblah but the profile itself (instagram.com/username) won't. Nothing has changed on my system. I'm just updating when updates are released. Account is also fine. Just making the thread as I couldn't find anything for several pages here, so apologies if it exists and I missed it. |
#2
|
||||
|
||||
![]()
Hi serrato,
As a long-time member of this forum, you probably already know what information we need to help with plugin-related issues. ![]() To make things easier and get faster support, it would be great if you could provide this info right away in the future. Since it’s missing in this post, here’s my usual info block for you: Please post your log-ID here. For plugin or download issues, please provide example URLs. For login or crawler plugin issues, enable debug mode before creating logs (see guide). Bitte poste deine Log-ID hier. Bei Plugin- oder Download-Problemen füge bitte Testlinks hinzu. Bei Login- oder Crawler-Plugin-Problemen aktiviere bitte den Debug-Modus vor dem Log-Erstellen (siehe Anleitung). Thanks & best, -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#3
|
|||
|
|||
![]()
Haha drats, the logs! Which file is most relevant? I'll attach that. But I just cleared old logs and started fresh, so there are no distractions. I added one link (one picture from Porsche Taiwan's instagram page). That loaded fine, and shows up in the log and linkgrabber. Then I added the whole page (just insta/porschetaiwan). I can see it finally mentioned in the log after a long time, but nothing appears in the linkgrabber itself and it's just perpetually crawling (bottom right icon in JD). The log does mention some huge timeout numbers like
HTML Code:
----------------Request Information------------- URL: **External links are only visible to Support Staff** SSLCipher: JVM|Protocol:TLSv1.2|CipherSuite:TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 ConnectIP: www.instagram.com/31.13.78.174:443 Connection-Timeout: 20000ms Read-Timeout: 60000ms |
#4
|
|||
|
|||
![]()
Finally after like 3 hours a package appears with the title:
HTML Code:
Wrong Captcha!RATE_LIMIT_REACHED_EXHAUSTED_RETRY_COUNT_⁄api⁄v1⁄users⁄web_profile_info⁄ HTML Code:
--ID:177TS:1741953732735-3/15/25, 1:02:12 AM - [jd.plugins.decrypter.InstaGramComDecrypter(getPage)] -> Waiting 380 seconds on error 403/429 until retry --ID:177TS:1741954113667-3/15/25, 1:08:33 AM - [jd.plugins.decrypter.InstaGramComDecrypter(getPage)] -> Trying to get around rate limit 25 / 30 |
#5
|
||||
|
||||
![]()
The best option is a complete log upload following the instructions I linked.
Of course, it's entirely up to you which log data you want to share. In this case, any files containing "instagram" are relevant. The file you've attached is exactly the one I needed—thank you! If you do a full-text search for "429 Too Many Requests," you'll see the issue yourself. This is not a plugin failure! I realize I used the wrong wording for this error—sorry about that! I've just corrected it: The issue is not captcha-related. Possible solutions: - Try again later. - Adjust the Instagram plugin to increase the delay between requests: Go to Instagram.com plugin settings -> "Global request limit," then try again. ---> Also, check similar forum threads about Instagram blocks/rate limits, e.g.: this thread. - Try using a different IP. - Try with another Instagram account. - Consider using other tools specifically designed for Instagram downloads, such as ["Instaloader"](**External links are only visible to Support Staff****External links are only visible to Support Staff**). I’m unable to reproduce the issue on my end. For some reason, Instagram has rate-limited your request: Code:
i.instagram.com/api/v1/users/web_profile_info/?username=porschetaiwan
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#6
|
|||
|
|||
![]()
I see ... but that's ironic, because not too long ago I increased the delay between requests lol.
Any idea why it grabs direct links then? |
#7
|
||||
|
||||
![]()
Crawling single posts is using another method to obtain the data from the website/API and not the request that instagram is blocking in your case.
I just had an idea though - to put it very simple: When cawling a profile, we have the username but we need to find the internal userID. This is where the API request that is blocked for you is needed. However, when crawling a post, both data is available. I've updated the plugin to save the data when crawling a single post so when crawling the profile afterwards, with a bit of luck it will just work for you then. Wartest du auf einen angekündigten Bugfix oder ein neues Feature? Updates werden nicht immer sofort bereitgestellt! Bitte lies unser Update FAQ! | Please read our Update FAQ! --- Are you waiting for recently announced changes to get released? Updates to not necessarily get released immediately! Bitte lies unser Update FAQ! | Please read our Update FAQ! -psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 14.03.2025 at 16:55. |
#8
|
||||
|
||||
![]()
The update is live.
Install it and restart JDownloader. Now you can try this: 1. Add any single post of that profile. 2. Once the single post is crawled, add the profile link. If it still fails, provide a fresh log, maybe other profile related API requests are also blocked for your IP by instagram.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#9
|
|||
|
|||
![]()
So far so good! Thanks! Will monitor and hopefully it keeps working.
|
![]() |
Thread Tools | |
Display Modes | |
|
|