Hello I am trying to download all the media files from certain Twitter accounts. Trying to paste in the Twitter media URL of a certain account only grabs about 700-1000 of the media/photo files of any given account. Not any more than that. Here is an example of some of the accounts I am trying to download from:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I have also tried the 'deep analysis' feature but it fails to grab any more of the photos. Is there any way I could achieve this for downloading ALL images for a certain account?

Thank you

[Jiaz]

Did I post in the wrong place?

[Jiaz]

I moved to correct one

[pspzockerscene]

Hi
I've checked this and this is definitly not a JD issue.
Seems like twitter has a public limit of 40 "load more" actions.
E.g.:

**External links are only visible to Support Staff**

Loadmore 1:

**External links are only visible to Support Staff**

2:

**External links are only visible to Support Staff**

... and so on.
Loadmore 40:

**External links are only visible to Support Staff**

As you can see it then says this inside the json:

"has_more_items":false

Now we can go one step further:

**External links are only visible to Support Staff**

... but we will not get more content - only this:

{"min_position":null,"has_more_items":false,"items_html":"\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n \n","new_latent_count":0}

Twitter has to fix this / raise the limits - without this it is impossible for us to crawl more content.

GreeZ pspzockerscene

[Jiaz]

I think it is a limit to prevent crawling

[Jiaz]

@Pspzocker: did you try out little wait between the requests?

[pspzockerscene]

@Jiaz
I actually tried it via browser to check what I saw in JD and no, that didn't change anything

GreeZ psp