JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 15.06.2022, 06:55
Azuriyr Azuriyr is offline
Modem User
 
Join Date: Jun 2022
Posts: 1
Default Scraping twitter

Hello is it possible to scrape my Twitter home feed if I log in to my account or do I need any developer API keys to do so?

Furthermore, is there a way to monitor any updates/changes from my home feed after I get it to work and maybe if an account retweets something it gets downloaded?

So far I'm familiar with rate limits for a public API key and private but how does logging in with Twitter change those rate limits? Is it the same or different? Since I follow a lot of accounts and my home feed keeps being updated several times within a few hours.
Reply With Quote
  #2  
Old 15.06.2022, 11:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,897
Default

Quote:
Originally Posted by Azuriyr View Post
Hello is it possible to scrape my Twitter home feed if I log in to my account or do I need any developer API keys to do so?
no developer API keys required as JDownloader uses the web api
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 15.06.2022, 11:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,897
Default

Quote:
Originally Posted by Azuriyr View Post
if an account retweets something it gets downloaded?
retweets are currently not possible, see
https://board.jdownloader.org/showth...hlight=twitter
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 15.06.2022, 12:00
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 76,897
Default

Quote:
Originally Posted by Azuriyr View Post
Furthermore, is there a way to monitor any updates/changes from my home
JDownloader does not support this.
For this I would recommend dedicated tools/scripts that monitor stuff and then download changes, also other tools maybe do support retweets
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 17.06.2022, 13:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 62,600
Default

While JDownloader is not the ideal application for what you want to do, the plugin has some extra features to e.g. only crawl the X latest results or only up to date XY: Click

These features have been added a while ago upon this user request.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 06:06.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.