JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 31.05.2021, 10:08
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 80
Default Instagram download speed

When I download video from Instagram it's limited speed to ~32kb/s. Even with added account.
Also it's can't grab link from for example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

But when I add this video to "saved" it's can grab it from "saved" media:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Build date Sat May 29 18:13:51 CEST 2021
Core 44370
Reply With Quote
  #2  
Old 31.05.2021, 14:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

I can reproduce the slow speed. Does this happen on all videos or just some?

I cannot reproduce the *can't grab* issue. Please make sure that you have not setup any filter or quickfilter in linkgrabber.
In case you still have this issue, please provide a debug log. Enable Settings->Advanced Settings->Log.debugmodeenabled
and restart JDownloader. Now try again to crawl the link and create a log, see https://support.jdownloader.org/Know...d-session-logs
and post shown logID here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 31.05.2021, 15:36
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 80
Default

Quote:
Originally Posted by Jiaz View Post
I can reproduce the slow speed. Does this happen on all videos or just some?

I cannot reproduce the *can't grab* issue. Please make sure that you have not setup any filter or quickfilter in linkgrabber.
In case you still have this issue, please provide a debug log. Enable Settings->Advanced Settings->Log.debugmodeenabled
and restart JDownloader. Now try again to crawl the link and create a log, see **External links are only visible to Support Staff**...
and post shown logID here
After I remove the video from "saved" it's grabbed fine.

Slow speed on all videos now and seems like it's not JD issue:
github.com/instaloader/instaloader/issues/1145

Last edited by Jiaz; 31.05.2021 at 17:13.
Reply With Quote
  #4  
Old 31.05.2021, 15:43
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default


Thanks for the hint, we will watch this other project
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 06.06.2021, 04:22
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Any progress on finding the cause of this problem? Insta video download speeds are still slow. What do you guys think? Is something in Insta's code causing this problem? Or is Insta intentionally throttling all downloader programs like this?
Reply With Quote
  #6  
Old 07.06.2021, 12:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by goldensun87 View Post
Or is Insta intentionally throttling all downloader programs like this?
I would say this is the reason
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 07.06.2021, 12:37
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

Quote:
Originally Posted by goldensun87 View Post
Any progress on finding the cause of this problem?
I'm sorry but we're not actively working on this issue but waiting for community/other projects (dedicated to IG) finding cause/solution.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #8  
Old 16.06.2021, 17:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by Neurotoxin001 View Post
github.com/instaloader/instaloader/issues/1145
According to some users they really only blocked a User-Agent.

However in my tests (downloading IG stories videos), using a different User-Agent did not help:
I continued to be speed-limited at about 40KiB/s.

We don't have much time to dig deeper into this so if any of our users finds a possible solution: Just let us know

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 01.07.2021, 17:47
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 80
Default

Users fix slow speed issue, can you check it please:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Also I have feature request — can you please make possibly to add timestamp (for example) in file names of instagram stories? Because when they download it's have random file names and go out of order. Or do something else to make instagram stories went in order.

Last edited by Neurotoxin001; 01.07.2021 at 17:51.
Reply With Quote
  #10  
Old 01.07.2021, 18:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,290
Default

That fix looks too simply and too easy to block again but we will check it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 02.07.2021, 11:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by Neurotoxin001 View Post
Also I have feature request — can you please make possibly to add timestamp (for example) in file names of instagram stories? Because when they download it's have random file names and go out of order. Or do something else to make instagram stories went in order.
Should already be possible.
See:
https://board.jdownloader.org/showthread.php?t=71859
and:
https://support.jdownloader.org/Know...the-packagizer
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 03.07.2021, 08:56
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 80
Default

Quote:
Originally Posted by pspzockerscene View Post
Should already be possible.
See:
**External links are only visible to Support Staff**...
and:
**External links are only visible to Support Staff**...
Can't get it work :(

https://i.imgur.com/6QWEkIw.png
https://i.imgur.com/hVvGTDi.png

Filenames become the same and without extension + when they download it's replaces each other.

Update:
If I add <jd:prop:date>.<jd:orgfiletype> I got extension but it's still replaces each other.

Also I noticed this setting:
https://i.imgur.com/YEDBtce.png
And seems like it's not working in any case for stories. But working for posts with multiple photos/videos:
https://i.imgur.com/egbZ7yy.png

Can you please maybe share this setting to stories too?

Last edited by Neurotoxin001; 03.07.2021 at 09:10.
Reply With Quote
  #13  
Old 03.07.2021, 10:18
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 1,533
Default

Code:
If -> sourceurl(s) -> contains -> instagram.com
then set -> Filename -> <jd:prop:date> - <jd:orgfilename>
Reply With Quote
  #14  
Old 03.07.2021, 12:22
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 80
Default

Quote:
Originally Posted by mgpai View Post
Code:
If -> sourceurl(s) -> contains -> instagram.com
then set -> Filename -> <jd:prop:date> - <jd:orgfilename>
https://i.imgur.com/dMIaDBn.png
Stories still downloading not in order. It's must be like for posts with multiple media that I mentioned in my post above (1-2-3 etc):
https://i.imgur.com/sixcO9l.png

Or maybe add hours and seconds to <jd:prop:date>, but how.

Update:
<jd:simpledate:yyyy-MM-dd'T'HH:mm:ss> - this is not work, it's add my time, not time that stories posted.

Update 2:
<jd:indexof> - this is WORKS, but it's downloading stories in reverse order. First storie become last. And sometimes second storie become last.

I tested <jd:indexof>-<jd:prop:date>-<jd:orgfilename> and <jd:indexof>-<jd:orgfilename>.

You can test it **External links are only visible to Support Staff**here for example.

How can I fix it?

Last edited by Neurotoxin001; 03.07.2021 at 12:43.
Reply With Quote
  #15  
Old 05.07.2021, 13:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Sorry my fault:
We already have a setting AND a property for that but it was not always set.
After the next update you got two options:
1. Settings -> Plugins -> instagram.com -> "Include order-ID in filenames" --> Enable -> Is only applied for items added AFTER changing this setting!
or:
2. Packagizer -> Use plugin property orderid just like before but now it will be available for stories and some other Instagram linktypes.
--> Is only applied for items added AFTER adding such a Packagizer rule!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #16  
Old 05.07.2021, 22:39
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 80
Default

Quote:
Originally Posted by pspzockerscene View Post
Sorry my fault:
We already have a setting AND a property for that but it was not always set.
After the next update you got two options:
1. Settings -> Plugins -> instagram.com -> "Include order-ID in filenames" --> Enable -> Is only applied for items added AFTER changing this setting!
or:
2. Packagizer -> Use plugin property orderid just like before but now it will be available for stories and some other Instagram linktypes.
--> Is only applied for items added AFTER adding such a Packagizer rule!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser **External links are only visible to Support Staff**...! | Please read our **External links are only visible to Support Staff**...!


-psp-
Thanks but it's still downloading not in order because of numbers in filenames before JD's 01 02 etc, example:
https://i.imgur.com/7Jcz41A.png
https://i.imgur.com/400Oedu.png

Last edited by Neurotoxin001; 05.07.2021 at 22:41.
Reply With Quote
  #17  
Old 06.07.2021, 12:32
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by Neurotoxin001 View Post
Or maybe add hours and seconds to <jd:prop:date>, but how.
Sorry - not possible at this moment.

Quote:
Originally Posted by Neurotoxin001 View Post
Update:
<jd:simpledate:yyyy-MM-dd'T'HH:mm:ss> - this is not work, it's add my time, not time that stories posted.
Yap it is the current time - as described in our docs:
https://support.jdownloader.org/Know...the-packagizer

Quote:
Originally Posted by Neurotoxin001 View Post
Update 2:
<jd:indexof> - this is WORKS, but it's downloading stories in reverse order. First storie become last. And sometimes second storie become last.
This is not what you want.

As said you can use <jd:prop:orderid> freely via Packagizer and place it wherever you want.

Quote:
Originally Posted by Neurotoxin001 View Post
Thanks but it's still downloading not in order because of numbers in filenames before JD's 01 02 etc, example:
Indeed you're right: The position is bad!
This will be fixed via our next update and will only be applied for items added AFTER the update!

Quote:
Originally Posted by Neurotoxin001 View Post
Users fix slow speed issue, can you check it please:
Implemented.

Let's see how long this will last...

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #18  
Old 10.07.2021, 04:54
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Ok so, my wireless speed is shit compared to my max modem/service speed, but this problem seems to be finally solved (for now). Can anyone else confirm if they are getting their max speeds?
Reply With Quote
  #19  
Old 12.07.2021, 16:17
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Well I'm not getting "max speeds" but the slow speed issue/block is definitely fixed!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #20  
Old 15.07.2021, 07:33
goldensun87 goldensun87 is offline
Giga Loader
 
Join Date: Feb 2012
Posts: 90
Default

Quote:
Originally Posted by pspzockerscene View Post
Well I'm not getting "max speeds" but the slow speed issue/block is definitely fixed!

-psp-
Awesome! And thank you for getting around to solving this issue.
Reply With Quote
  #21  
Old 15.07.2021, 12:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Thanks for your feedback!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:31.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.