JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 14.03.2025, 11:19
serrato serrato is offline
Bandwidth Beast
 
Join Date: Dec 2017
Posts: 134
Default [Not a JD bug] Instagram - direct links work, profile doesn't

Hello, this has happened at random times in the past during update cycles, but for the past few days the linkgrabber won't grab anything from instagram.

Direct URLs will work (e.g. instagram.com/username/p/blahblah

but the profile itself (instagram.com/username) won't.

Nothing has changed on my system. I'm just updating when updates are released. Account is also fine.

Just making the thread as I couldn't find anything for several pages here, so apologies if it exists and I missed it.
Reply With Quote
  #2  
Old 14.03.2025, 11:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,731
Default

Hi serrato,

As a long-time member of this forum, you probably already know what information we need to help with plugin-related issues.

To make things easier and get faster support, it would be great if you could provide this info right away in the future.

Since it’s missing in this post, here’s my usual info block for you:

Please post your log-ID here.
For plugin or download issues, please provide example URLs.
For login or crawler plugin issues, enable debug mode before creating logs (see guide).

Bitte poste deine Log-ID hier.
Bei Plugin- oder Download-Problemen füge bitte Testlinks hinzu.
Bei Login- oder Crawler-Plugin-Problemen aktiviere bitte den Debug-Modus vor dem Log-Erstellen (siehe Anleitung).

Thanks & best,
-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 14.03.2025, 12:05
serrato serrato is offline
Bandwidth Beast
 
Join Date: Dec 2017
Posts: 134
Default

Haha drats, the logs! Which file is most relevant? I'll attach that. But I just cleared old logs and started fresh, so there are no distractions. I added one link (one picture from Porsche Taiwan's instagram page). That loaded fine, and shows up in the log and linkgrabber. Then I added the whole page (just insta/porschetaiwan). I can see it finally mentioned in the log after a long time, but nothing appears in the linkgrabber itself and it's just perpetually crawling (bottom right icon in JD). The log does mention some huge timeout numbers like

HTML Code:
----------------Request Information-------------
URL: **External links are only visible to Support Staff**
SSLCipher: JVM|Protocol:TLSv1.2|CipherSuite:TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
ConnectIP: www.instagram.com/31.13.78.174:443
Connection-Timeout: 20000ms
Read-Timeout: 60000ms
but I dunno if that's just info or an actual problem.
Reply With Quote
  #4  
Old 14.03.2025, 14:54
serrato serrato is offline
Bandwidth Beast
 
Join Date: Dec 2017
Posts: 134
Default

Finally after like 3 hours a package appears with the title:

HTML Code:
Wrong Captcha!RATE_LIMIT_REACHED_EXHAUSTED_RETRY_COUNT_⁄api⁄v1⁄users⁄web_profile_info⁄
First time seeing a captcha mentioned for instagram. I see in the log file there are a bunch of retry attempts like

HTML Code:
--ID:177TS:1741953732735-3/15/25, 1:02:12 AM -  [jd.plugins.decrypter.InstaGramComDecrypter(getPage)] -> Waiting 380 seconds on error 403/429 until retry
--ID:177TS:1741954113667-3/15/25, 1:08:33 AM -  [jd.plugins.decrypter.InstaGramComDecrypter(getPage)] -> Trying to get around rate limit 25 / 30
Reply With Quote
  #5  
Old 14.03.2025, 16:33
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,731
Default

Quote:
Originally Posted by serrato View Post
Which file is most relevant?
The best option is a complete log upload following the instructions I linked.
Of course, it's entirely up to you which log data you want to share.
In this case, any files containing "instagram" are relevant.

The file you've attached is exactly the one I needed—thank you!
If you do a full-text search for "429 Too Many Requests," you'll see the issue yourself. This is not a plugin failure!

Quote:
Originally Posted by serrato View Post
First time seeing a captcha mentioned for Instagram.
I realize I used the wrong wording for this error—sorry about that!
I've just corrected it: The issue is not captcha-related.

Possible solutions:
- Try again later.
- Adjust the Instagram plugin to increase the delay between requests: Go to Instagram.com plugin settings -> "Global request limit," then try again.
---> Also, check similar forum threads about Instagram blocks/rate limits, e.g.: this thread.
- Try using a different IP.
- Try with another Instagram account.
- Consider using other tools specifically designed for Instagram downloads, such as ["Instaloader"](**External links are only visible to Support Staff****External links are only visible to Support Staff**).

I’m unable to reproduce the issue on my end.
For some reason, Instagram has rate-limited your request:
Code:
i.instagram.com/api/v1/users/web_profile_info/?username=porschetaiwan
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #6  
Old 14.03.2025, 16:36
serrato serrato is offline
Bandwidth Beast
 
Join Date: Dec 2017
Posts: 134
Default

I see ... but that's ironic, because not too long ago I increased the delay between requests lol.

Any idea why it grabs direct links then?
Reply With Quote
  #7  
Old 14.03.2025, 16:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,731
Default

Quote:
Originally Posted by serrato View Post
Any idea why it grabs direct links then?
Crawling single posts is using another method to obtain the data from the website/API and not the request that instagram is blocking in your case.

I just had an idea though - to put it very simple:
When cawling a profile, we have the username but we need to find the internal userID.
This is where the API request that is blocked for you is needed.

However, when crawling a post, both data is available.

I've updated the plugin to save the data when crawling a single post so when crawling the profile afterwards, with a bit of luck it will just work for you then.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 14.03.2025 at 16:55.
Reply With Quote
  #8  
Old 14.03.2025, 17:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,731
Default

The update is live.
Install it and restart JDownloader.
Now you can try this:
1. Add any single post of that profile.
2. Once the single post is crawled, add the profile link.
If it still fails, provide a fresh log, maybe other profile related API requests are also blocked for your IP by instagram.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 15.03.2025, 11:29
serrato serrato is offline
Bandwidth Beast
 
Join Date: Dec 2017
Posts: 134
Default

So far so good! Thanks! Will monitor and hopefully it keeps working.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 01:46.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.