[Solved] Scraping twitter

[Azuriyr]

Hello is it possible to scrape my Twitter home feed if I log in to my account or do I need any developer API keys to do so?

Furthermore, is there a way to monitor any updates/changes from my home feed after I get it to work and maybe if an account retweets something it gets downloaded?

So far I'm familiar with rate limits for a public API key and private but how does logging in with Twitter change those rate limits? Is it the same or different? Since I follow a lot of accounts and my home feed keeps being updated several times within a few hours.

[Jiaz]

Originally Posted by Azuriyr

Hello is it possible to scrape my Twitter home feed if I log in to my account or do I need any developer API keys to do so?

no developer API keys required as JDownloader uses the web api

[Jiaz]

Originally Posted by Azuriyr

if an account retweets something it gets downloaded?

retweets are currently not possible, see
https://board.jdownloader.org/showth...hlight=twitter

[Jiaz]

Originally Posted by Azuriyr

Furthermore, is there a way to monitor any updates/changes from my home

JDownloader does not support this.
For this I would recommend dedicated tools/scripts that monitor stuff and then download changes, also other tools maybe do support retweets

[pspzockerscene]

While JDownloader is not the ideal application for what you want to do, the plugin has some extra features to e.g. only crawl the X latest results or only up to date XY: Click

These features have been added a while ago upon this user request.

-psp-