JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 01.12.2023, 12:18
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default Twitter Plugins Description

Hi all,

I'm trying to figure out what these settings in the Twitter plugins actually do. No idea how each option works, I've been searching for a source or topic to help me out but no luck so far.

Any help is appreciated
Attached Images
File Type: png 2023-12-01_18-08-02.png (51.0 KB, 1 views)
Reply With Quote
  #2  
Old 01.12.2023, 12:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

Most of them should be self explanatory.

If you have trouble understanding some of them please ask specific questions about specific settings.
We also got a support article about our twitter plugin which explains some of its advanced functionality:
https://support.jdownloader.org/Know...anced-features

Are you a new JDownloader user or a long time JDownloader user?
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 01.12.2023, 15:15
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

Hi pspzockerscene,

Thank you for replying to my question.

I've been using JDownloader for a while and have faced some issues with crawling media. I want to gather all media from a specific Twitter account, including pictures, videos, and text from their posts.

However, I've noticed that I also end up getting some media from other accounts, marked by a red rectangle. I'd like to avoid downloading content from accounts other than the specified one.

I believe there might be a setting that can help me with this, and that's why I'm seeking clarification on the meaning of each setting. One setting that is particularly confusing to me is "Text crawl mode." What is its purpose, and how does it affect the crawling?
Attached Images
File Type: png 2023-12-01_19-17-36.png (27.3 KB, 1 views)
Reply With Quote
  #4  
Old 01.12.2023, 15:27
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

Quote:
Originally Posted by mochiza555 View Post
However, I've noticed that I also end up getting some media from other accounts, marked by a red rectangle. I'd like to avoid downloading content from accounts other than the specified one.
Usually as long as "Crawl retweets" in the twitter plugin settings is disabled, this should not happen.
Please post a link to a twitter profile where this happens.

Quote:
Originally Posted by mochiza555 View Post
I'm seeking clarification on the meaning of each setting.
I'm not going to explain each setting. Please ask specific questions for each settings where the functionality is not clear to you.
However I'm always open for suggestions so if there are settings where the meaning is unclear, I'am willing to re-phrase them.

Quote:
Originally Posted by mochiza555 View Post
One setting that is particularly confusing to me is "Text crawl mode." What is its purpose, and how does it affect the crawling
This setting decides when the text of a Tweet (if text is available) should be crawled- and appear in your linkgrabber as <title.txt> file.
If you only want to download media (images/video) of added twitter links, you may want to set this to "Never (disabled)".
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 01.12.2023, 16:02
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

Quote:
Originally Posted by pspzockerscene View Post
Usually as long as "Crawl retweets" in the twitter plugin settings is disabled, this should not happen.
Please post a link to a twitter profile where this happens.
Here is the profile that I mentioned before,
**External links are only visible to Support Staff****External links are only visible to Support Staff**

And these 2 profiles also has the same issue,
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I always keep the "Crawl retweets" disabled.
Reply With Quote
  #6  
Old 01.12.2023, 16:25
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

First of all:
For now you can also filter/remove those items in your linkgrabbber for example by using the bottom search bar to search for the name of your target-profile -> Then only add all positive results to your downloadlist and delete the rest.
Of course this only works as long as th name of the Twitter profile you're adding is contained in the filenames but by default that is the case.

Secondly:
I see what you mean but I'm really unsure what that is - it looks like a tweet embedded in another tweet or is it an advertisement.
Here is an example:
This tweet one is part of the profile you want to crawl:
Code:
twitter.com/ArcheWorld_NFT/status/1691724487178518842
...but that also kind of embeds this one:
Code:
twitter.com/lusio_gg/status/1688912437649854464
--> Or is that a retweet?
From what I remember, retweets look differently.

I'm off into the weekend now.
I will reply to this thread again on the next german workday (typically monday).
Have a nice weekend!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 10.12.2023, 15:11
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

Quote:
Originally Posted by pspzockerscene View Post
First of all:
For now you can also filter/remove those items in your linkgrabbber for example by using the bottom search bar to search for the name of your target-profile -> Then only add all positive results to your downloadlist and delete the rest.
Of course this only works as long as th name of the Twitter profile you're adding is contained in the filenames but by default that is the case.
Thanks for the advice, it really helped!

But, is there an easier way to get rid of stuff I don't need when I paste a bunch of URLs into LinkGrabber, like if I paste 10 to 20 URLs, there might be some Twtitter user has the issue as we discussed. It's taking a while to remove them.

I appreciate your support, and hopefully, there will be an update about this in the future.
Reply With Quote
  #8  
Old 20.12.2023, 11:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

I've updated the plugin to ignore all Tweets which do not belong to the main profile.
This logic only applies if you crawl profiles in "non-retweet-mode" meaning only as long as the plugin setting "Crawl retweets" is disabled as re-tweets are iny many cases from other profiles than from the one inside the URL you are adding.

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 20.12.2023 at 11:17.
Reply With Quote
  #9  
Old 28.02.2025, 16:37
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

Hello,

It seems like tweets from other users have also been grabbed. Crawl retweets is disabled as usual.

Here is a url for test : **External links are only visible to Support Staff****External links are only visible to Support Staff**
Attached Images
File Type: png Untitled.png (102.2 KB, 1 views)
Reply With Quote
  #10  
Old 28.02.2025, 16:43
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

More info needed:
- Screenshot of: Settings -> Plugins -> x.com
- Logs

Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

Bitte poste deine Log-ID hier.
Falls dein Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.
Geht es um einen nicht funktionierenden Account-Login, aktiviere vor dem Erstellen deines Logs den debug Modus (siehe zuvor verlinkte Anleitung).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #11  
Old 28.02.2025, 17:22
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

more account for testing
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Log :
Quote:
27.02.25 00.04.54 <--> 28.02.25 23.19.19 jdlog://2249411370661/
please see the attached image for X'setting and result screenshot
Attached Images
File Type: png test account.png (45.2 KB, 1 views)
File Type: png setting.png (60.4 KB, 1 views)
Reply With Quote
  #12  
Old 28.02.2025, 17:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

I've looked into this and as far as I can see, those are quoted Tweets which are not Retweets.
See older thread where this topic has been discussed in detail with another user:
https://board.jdownloader.org/showth...719#post530719

At this moment, there is no extra setting to filter quoted tweets so if you want to ignore them, feel free to simply add a generic filter or just put the name of your target profile, in this case "_elonmusk_" in the bottom search bar to only see items posted by that particular user.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #13  
Old 28.02.2025, 17:36
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

Thank you for your continuous support. Stay tuned for the next update
Reply With Quote
  #14  
Old 28.02.2025, 17:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

Thanks for your kind words.

Quote:
Originally Posted by mochiza555 View Post
Stay tuned for the next update
No Twitter plugin changes are planned for next update.
It will contain some nice new features though
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #15  
Old 03.03.2025, 18:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

Quote:
Originally Posted by pspzockerscene View Post
No Twitter plugin changes are planned for next update.
I've changed my mind.

With todays' update, the Twitter plugin comes with a setting where you can turn off crawling of quoted Tweets
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #16  
Old 02.04.2025, 16:48
mochiza555's Avatar
mochiza555 mochiza555 is offline
Junior Loader
 
Join Date: Sep 2023
Posts: 11
Default

Quote:
Originally Posted by pspzockerscene View Post
I've changed my mind.

With todays' update, the Twitter plugin comes with a setting where you can turn off crawling of quoted Tweets
Hi pspzockerscene,

This is a good news.
It works great, and I really appreciate your effort in making it so useful.
Reply With Quote
  #17  
Old 03.04.2025, 10:27
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 74,705
Default

Thanks for your feedback!
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 07:53.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.