JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 06.06.2022, 14:32
dominika992 dominika992 is offline
JD Beta
 
Join Date: May 2020
Posts: 53
Default Twitter.com profile crawler re-tweets only 4 to show while I can see tons of posts

I try to add this twitter to JD
**External links are only visible to Support Staff****External links are only visible to Support Staff**

As I can see there are tons of posts, pics and vids, a lot of material
But JD shows me only 4 things
https://imgur.com/a/8TvqJB9
or this one too
**External links are only visible to Support Staff****External links are only visible to Support Staff**

It looks like twitter JD plugin broke?
Or maybe it just doesnt work in some cases?

Last edited by dominika992; 06.06.2022 at 16:08.
Reply With Quote
  #2  
Old 07.06.2022, 16:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

I'm able to reproduce this issue but so far I wasn't able to find a solution.
My guess is that we're probably simply using wrong parameters in our current API call but I was unable to find any more information about the call "api.twitter.com/2/timeline/media/<userID>.json".

Ticket:


Also I noticed that this issue mostly happens with profiles containing a lot of tweets with explicit content.
My current workaround suggestion for you:
1. Open the desired profile in your browser and scroll all the way down so all of the tweets get loaded.
2. Use a browser addon like "Link Gopher" to get all links to the single tweets or simply press CTRL + A to mark all items + CTRL + C and add those to JD.
Single tweets are all crawled without problems atm.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 07.06.2022, 18:24
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

@dominika992: the current used api no longer/does not return retweets, which is the case here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #4  
Old 08.06.2022, 08:42
dominika992 dominika992 is offline
JD Beta
 
Join Date: May 2020
Posts: 53
Default

Something to be done about this? Or it just will stay that way now, not crwaling retweets?
Reply With Quote
  #5  
Old 08.06.2022, 15:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,343
Default

@dominika992: we'll have to look into it but currently it won't be supported/possible.
Can't tell if we're gonna find a way or when.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 09.06.2022, 16:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

I'm sorry but I don't see this coming in the near future because:
- Other twitter downloaders are using the official twitter API for that -> We will not implement that
- The graphQL web-API does also return retweets but at this moment our plugin completely relies on the public "API v2" so this would require quite some work only to add profile re-tweet crawl functionality

I'll leave this thread and the ticket open.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 19.07.2022, 16:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Next update will contain unfinished BETA functionality to download re-tweets.

It needs to be manually activated under:
Settings -> Plugins -> twitter.com -> "[BETA] Crawl retweets?"

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #8  
Old 12.10.2022, 13:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

I've put some more time into this.
Please test it after the release of our next set of CORE-Updates and provide feedback.
EDIT but please don't be disappointed if it's still not working 100%.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 12.10.2022 at 17:12.
Reply With Quote
  #9  
Old 16.11.2022, 19:05
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

CORE-Updates have been released!
All announced bugfixes and features are live!
Please update your JDownloader and report any issues you find asap.
If this thread gets marked as "[Solved]" by our forum staff you can still post in it and we will read- and reply to it!

CORE-Updates wurden released!
Alle angekündigten Bugfixes/Features sind nun verfügbar!
Bitte JDownloader updaten und eventuelle Bugs schnellstmöglich an uns melden.
Falls dieser Thread vom Team als "[Erledigt]" markiert wird, kannst du weiterhin darin antworten und wir lesen/beantworten auch solche Threads!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 12:30.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.