[DukeM]

I tried searching the forum for a recent post but didn't find any.

As the title states, whenever I paste an instagram link in Linkgrabber, it only retrieves a handful of links.

I noticed a new change where you can't view Instagram profiles without being logged in anymore but I have several active IG accounts logged in on my JD2 so that couldn't have caused it.

Example link: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Here is all JD2 grabbed out of potentially 6,751 posts: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Clearing linkgrabber and trying to parse again results in the same exact files only being retrieved.

Thank you.

[alejoreba]

Hola!
Regreso al Foro porque en estos días, el JD dejó de descargar la totalidad de imágenes de cada perfil, para descargar apenas unas pocas docenas.

Hasta comienzos de esta semana, podía descargar fácilmente más de 1.000 fotos.

Sé que esto ha sucedido en el pasado (Fallo en Descarga Fotos Instagram), que pone "Solucionado".

Y ahora vuelve a suceder.

Un ejemplo: perfil **External links are only visible to Support Staff**elementalescostadeleste, que tiene más de 560 publicaciones (así que el total de fotos será mucho mayor), y el JD sólo me descarga 79.

Espero que esto no sea causado por la actualización del 27 de abril. Pero bien podría ser.
¿Será eso? ¿Cómo puedo regresar atrás una actualización?

Agradeceré asistencia.

Uso JDownloader 2 actualizado al 27 de abril de 2021.
Java 1.8.0_31
Windows 10 x64
Antivirus Norton 360 actualizado.
Firewall del antivirus.

Muchas gracias!

[Jiaz]

Could you please provide a debug log? Enable Settings->Advanced Settings->Log.debugmodeenabled
and restart JDownloader. Now reproduce the issue and create a log, see https://support.jdownloader.org/Know...d-session-logs
and post shown logID here

[DukeM]

Yeah, sorry about that. I wanted to provide a log but the latest session ranged for like 14 hours (which would have had a ton of unrelated stuff included) and I only figured out now that the log sessions simply depend on when you ran and closed JD2. Haha.

Here's a very short and clear logfile just for this issue:
01.05.21 02.06.17 <--> 01.05.21 02.08.25 jdlog://4831825302851/

[cemreguzeel]

It doesn't capture all the photos in instagram profile. it only finds the photos on the first page.

[Jiaz]

Yes, just restart JDownloader to start a fresh log
Please wait for next update (about 5 mins), install/restart JDownloader and create new log please. I've added some debug infos to find the cause of the issue

[DukeM]

Here you go: 01.05.21 12.09.16 <--> 01.05.21 12.11.47 jdlog://9931825302851/

Is this an isolated case for me? Or is it just no one else has been using JD2 to download Instagram profiles in the last week or so? Unless @cemreguzeel has been experiencing the same?

[cemreguzeel]

I uninstalled the program with all settings and installed it again. It still goes the same way or I'm doing something wrong

[DukeM]

Originally Posted by cemreguzeel

I uninstalled the program with all settings and installed it again. It still goes the same way or I'm doing something wrong

There's still no fix. The update Jiaz mentioned only included additional debugging tools.

[Jiaz]

Thanks, seems there is still some debug infos missing. I will work on this on monday

[beronz]

i have the same issue, here's my log

02.05.21 23.50.13 <--> 02.05.21 23.53.51 jdlog://4841825302851/

Thanks as always for the quick support

[uzarluzar]

Originally Posted by DukeM

Here you go: 01.05.21 12.09.16 <--> 01.05.21 12.11.47 jdlog://9931825302851/

Is this an isolated case for me? Or is it just no one else has been using JD2 to download Instagram profiles in the last week or so? Unless @cemreguzeel has been experiencing the same?

No, same thing happens for me, I too only get 12 images out of hundreds.

[DukeM]

Originally Posted by uzarluzar

No, same thing happens for me, I too only get 12 images out of hundreds.

Thanks for confirming. I don't download full Instagram profiles regularly so I just noticed this issue recently and if my memory is good, the new Instagram thing where you can't view profiles through a browser without being logged in anymore is quite recent as well. The two might be connected.

[pspzockerscene]

Merged Instagram threads.

-psp-

[Jiaz]

Please check again after next plugin update

[Shmi]

:helpsmilie:
Program just updated.
When trying to grab 1 profile it grabs various profiles. (Maybe profiles that commented in posts or followed accounts?)

It also doesn't grab entire profiles.

I tried this with a public profile and with a private profile. Same result.

(And it seems like that not all file names are correct (it shows lots of short file names while trying to grab from a private profile).

[Jiaz]

Please provide example links! It worked fine for me

[cemreguzeel]

still does not capture all photos in private profiles. When capturing from open profiles, it creates lots of files other than the main file. I tried this link **External links are only visible to Support Staff****External links are only visible to Support Staff**
I guess it's also capture tags to.

[uzarluzar]

Originally Posted by Jiaz

Please provide example links! It worked fine for me

for example, this **External links are only visible to Support Staff****External links are only visible to Support Staff** grabs images from the main profile but also many which are related but from other profiles, and which wrongly show up in the package for the main link.

[beronz]

after the update the crawler has for sure a different approach than before. i've chosen a couple of instagram profiles

first maddie ziegler one, usually JD creates a folder with all the files of the profile. now it's creating a lot of folders and i don't know if they're from maddie's one or post that were shared by her. BTW, it's creating at least 200 separate folders



profile link

**External links are only visible to Support Staff****External links are only visible to Support Staff**

i've checked another profile and from this one it checks only a smaller part (23 files even it has 99 posts)

**External links are only visible to Support Staff****External links are only visible to Support Staff**

here's the log (almost 5000 files, the crawling is still going)

03.05.21 21.01.45 <--> 03.05.21 21.31.35 jdlog://4351825302851/

[DukeM]

My JD2 seem to not be doing anything different from before. Lol.

04.05.21 00.26.08 <--> 04.05.21 00.27.32 jdlog://4451825302851/

[pspzockerscene]

@beronz
Works as expected here and finds over 1400 items.

Also the thing with the multiple packages is not new!
There are instagram posts containing multiple pictures --> In order to keep those together, all media belonging to such will be added to a single package each.

@DukeM
Indeed I'm able to reproduce the issue with your example profile but not with any other profile atm.

-psp-

[beronz]

Originally Posted by pspzockerscene

@beronz
Works as expected here and finds over 1400 items.

Also the thing with the multiple packages is not new!
There are instagram posts containing multiple pictures --> In order to keep those together, all media belonging to such will be added to a single package each.

-psp-

for me it's the first time, cause all the post were included on a single folder belonging to the instagram handle which i've crawled. also the other profile keeps stopping at 23 items although she had 99 post (and ive already tried other account, disabling vpn etc etc.

EDIT: since the update the crawling, even for the smaller profile (<100 posts) takes ages. is it normal?

just asking cause until the bug of some days ago the crawler worked different, also the very "big" ones (at least 1000 posts)

[pspzockerscene]

Originally Posted by beronz

for me it's the first time, cause all the post were included on a single folder belonging to the instagram handle which i've crawled.

I can't confirm that.
We could either change it to that behavior or add a plugin setting.
As said by mergin all into one package, you will possibly lose the connection between multiple items that belong to one post.

Originally Posted by beronz

also the other profile keeps stopping at 23 items although she had 99 post (and ive already tried other account, disabling vpn etc etc.

As said we're aware of the remaining issues and it is being worked on.
You can't expect it to always work flawlessly as IG can- and will change their website whenever they want to

-psp-

[beronz]

Originally Posted by pspzockerscene

I can't confirm that.
We could either change it to that behavior or add a plugin setting.
As said by mergin all into one package, you will possibly lose the connection between multiple items that belong to one post.


As said we're aware of the remaining issues and it is being worked on.
You can't expect it to always work flawlessly as IG can- and will change their website whenever they want to

-psp-

It was only a "confirmation" questions cause i know you always do your best to resolve all the issues as long as it's made possibile by the site itself.

I'll keep an eye in this thread and if it's needed i can provide new logs if it can help the team to resolve it.

As for the instagram plugin option settings it would be a good thing cause using JD for a lot of sites, having different settings would be good. When it's possible i say to all of my friends that need a good download manager i always tell them to use JD, at least for my internet usage it's the best option by far.

[DukeM]

@psp
Ah thanks. My bad for not thinking of trying a different link. Lol.

I tried a personal account and it only fetched 90/246 posts.

I also tried a couple public profiles:

**External links are only visible to Support Staff****External links are only visible to Support Staff** - 2849/3044
**External links are only visible to Support Staff****External links are only visible to Support Staff** - 3955/5732

In the past, downloaded images almost always goes over the number of posts due to multiple images in a single post, so something Instagram did is making JD2 miss a lot of posts. Stupid Facebook and Instagram, ugh.

I'm also gonna echo what @beronz said about different random accounts being added. I randomly download a few of them to see what they are and it makes me think JD2 is maybe crawling the 'Tagged' sections of the profiles as well?

[Jaguar]

It was working fine before. Now it doesn't.
The Number of account that it wasn't able to get the pictures from was slim before.
Now it says :
Aucun compte valide trouvé!CObV_PEraueWB9WzFVbYGgCI88GGuHevSU1TX80

[goldensun87]

This seems to have started earlier today or maybe yesterday (May 3 or May 4). When I copy a username url, instead of grabbing all of the account's main posts, it only grabs somewhere between 175-190 of the main posts, and then the Linkgrabber grabs tagged posts linked to the account. The latter of which has never happened in the 7 years that I have been using JDownloader to save Instagram files.

Here is an example url.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[mex]

When I paste an instagram link in linkgrabber, it gives me zero links and says "No valid account found!".

Log: 05.05.21 00.25.38 <--> 05.05.21 00.26.15 jdlog://9851825302851/

Thanks

[mex]

New log with debug enabled: 05.05.21 01.35.43 <--> 05.05.21 01.37.26 jdlog://1951825302851/

[j4sch4]

Hi, I got the same problem. It looks like Instagram has changed something because I also get an download error with Bulk Image Downloader and Instagram Downloader, while those two where also working until a couple of days ago. If I change the download speed to 1sec between each download it works for a couple of images but then it also stops downloading and gives the error that it can't find the image. I think Instagram has made it harder to download the images :-(

[nostril]

I can't grab Instagram links anymore. It says "No valid account found!". :(

Log: 05.05.21 18.40.47 <--> 05.05.21 18.42.49 jdlog://7061825302851/

[PocasNuckie]

Hi, first post here

Just thought i'd let know I too am affected by this issue.

First I was only getting between 12 and 23 files per profile.

And after the update not only that issue remained but it also started collecting unrelated profiles.

Thanks for your work. JD has been awesome for me and i hope this gets fixed eventually.

[pspzockerscene]

Merged Instagram threads!
Please be patient!
1. This issue is not user-specific: It happens for all users but not for all Instagram URLs!
2. We're working on it, please be patient...

-psp-

[goldensun87]

Thanks for working on this, JD Staff. Ironically, in the past, the JD Crawler could never properly fetch all of my saved posts. But, after I created a couple of Collections while using Insta on my tablet, and copied my Saves url with JD, the Crawler grabbed EVERYTHING. Over 11,000 saved posts, and over 18,000 total files, all grabbed with a single url copy! I could not believe my eyes. But yeah, Insta must have changed something under the hood, which has messed up the Crawler. I remember a while back when an internal Insta change broke the crawler completely. So hopefully, you guys will find the solution.

Also, as pspzockerscene said, the Insta crawler is not completely broken. Individual post urls can still be grabbed. This means you can still load every post on a user profile, and copy the ones you want, one at a time. This is viable as long as the profile in question does not have too many posts. Trying to load too many posts on a single page runs out the IP traffic limit. Which is why JD being able to scrub an entire profile is useful for saving everything and deleting what I do not want, without running out the IP traffic limit.

Originally Posted by PocasNuckie

Hi, first post here

Just thought i'd let know I too am affected by this issue.

First I was only getting between 12 and 23 files per profile.

And after the update not only that issue remained but it also started collecting unrelated profiles.

Thanks for your work. JD has been awesome for me and i hope this gets fixed eventually.

From what I observed, the crawler is grabbing tagged posts on that profile.

[pspzockerscene]

Originally Posted by beronz

first maddie ziegler one, usually JD creates a folder with all the files of the profile. now it's creating a lot of folders and i don't know if they're from maddie's one or post that were shared by her. BTW, it's creating at least 200 separate folders

Update:
You're right and I was wrong!

Also we won't be adding an extra setting - we'll make it add all items of a profile into one package.
I was even wrong with the assumption that you won't be able to find items of a gallery afterwards as filenames will contain the Item-ID by default.

We even have a setting to apply the "order ID" (index value) to the filenames so you could even restore the original order of multiple items of a gallery.
See Settings -> Plugins -> instagram.com -> Include order-id in filenames
(The name of this setting will change accordingly after the next update.)

-psp-
EDIT

Originally Posted by goldensun87

Thanks for working on this, JD Staff. Ironically, in the past, the JD Crawler could never properly fetch all of my saved posts. But, after I created a couple of Collections while using Insta on my tablet, and copied my Saves url with JD, the Crawler grabbed EVERYTHING.

Nic! Thanks for your feedback!

By the way issues with crawling your own saved posts haven't been reported so far.
Is this also broken?

[goldensun87]

Originally Posted by pspzockerscene

Nic! Thanks for your feedback!

By the way issues with crawling your own saved posts haven't been reported so far.
Is this also broken?

I tried it a little while ago, crawling own saved posts does not seem to be broken. Although, for own saved posts, I would test the crawler with and without collections, to see if the crawler gives different results. I do not know if my crawler results changed due to me creating collections, or if you guys actually fixed that before I created collections. I remember in the past when I used to try crawling my saved posts, it would not fetch any of my saved posts, it would only fetch the same handful of random files.

[pspzockerscene]

I'll test this once we got the other issue fixed.

I'm surprised at how many users seem to use this particular plugin :D

-psp-

[beronz]

Originally Posted by pspzockerscene

Update:
You're right and I was wrong!

Also we won't be adding an extra setting - we'll make it add all items of a profile into one package.
I was even wrong with the assumption that you won't be able to find items of a gallery afterwards as filenames will contain the Item-ID by default.

We even have a setting to apply the "order ID" (index value) to the filenames so you could even restore the original order of multiple items of a gallery.
See Settings -> Plugins -> instagram.com -> Include order-id in filenames
(The name of this setting will change accordingly after the next update.)

-psp-
[/B]

Thanks! As an avid user of JD i always notice when something isn't working as usual so i report on the forum only the ones that aren't typical (in the recent past i had some issues but after posting the log 99% of the times are issues on my account\ my vpn usage, so now i tend to "pre-test" every scenario before posting something, so i add as many details as possibile. When it will be possibile (as soon as i'll find a new job) i will support again your work.

Also thanks for the explanation on the settings that are already avalaible.

[beronz]

Originally Posted by pspzockerscene

I'll test this once we got the other issue fixed.

I'm surprised at how many users seem to use this particular plugin :D

-psp-

Lol, coomers are EVERYWHERE. Jokes aside, JD for me is the most useful tool as a complete download manager. I've started using it for multihosters account and then I switched everything to that, from Youtube to social media in general.

For example, for Youtube videos allowing me to decide what type of video, quality, folder i want to download etc.... in a couple of clicks (and mantaing that as a default option) is truly gamechanging, at least for me.