JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 21.09.2023, 15:38
serrato serrato is offline
Giga Loader
 
Join Date: Dec 2017
Posts: 99
Default [Possible Bug?] Twitter plugin .txt crawling, GUI confusing

Hello,

For some time now over the past year or so I've noticed that twitter crawls everything including tweets as text files. I don't want the text files, so I remember enabling a setting to ignore text files. Somewhere along the way I got busy and didn't investigate further but I saw that the text files were back. I can't figure out what the setting is supposed to be and the GUI is confusing me as to which line represents what and several lines are repeated in standard text as well the 'explanation' colour text. Meanwhile I had setup a linkgrabber filter to filter .txt but that still collects an enormous number of txts in the filter queue.

Can you help me understand what is happening, especially the GUI options? I've attached a screenshot to illustrate the confusion. I tried searching for explanations of these options but I can't really find much.

So not much of an issue but nice if I can get some help. Thanks!
Attached Images
File Type: png image_104.png (70.5 KB, 3 views)

Last edited by serrato; 21.09.2023 at 16:10.
Reply With Quote
  #2  
Old 21.09.2023, 17:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,028
Default

Quote:
Originally Posted by serrato View Post
I don't want the text files, so I remember enabling a setting to ignore text files. Somewhere along the way I got busy and didn't investigate further but I saw that the text files were back.
I'm rarely resetting defaults but I remember that at the beginning I had a simple on-off switch for this behavior which I've later changed to a dropdown.
See Settings -> Plugins -> twitter.com -> Single Tweet crawler: Text crawl mode -> Set this to "Never (disabled)"
According to your screenshot, you've already disabled .txt files from twitter...

Quote:
Originally Posted by serrato View Post
Can you help me understand what is happening, especially the GUI options?
The greyed out part is each settings' description.
It may look distracting but it's just a GUI thing and no, this will not be addressed in the near future.

Quote:
Originally Posted by serrato View Post
Meanwhile I had setup a linkgrabber filter to filter .txt but that still collects an enormous number of txts in the filter queue.
Yap the more filtered items oyu keep, the more RAM will be needed. Over longer periods of time this can be a problem.
FYI there is at least two ways how to auto-clean filtered items:
Rightclick anywhere in the empty space in the linkgrabber tab -> Open menu manager
1. "Add to Download List" or "Add all to Download List" -> Right side there is a checkbox "Clean Linkgrabber after adding links"
WARNING: This will delete all items in your linkgrabber except the ones you've moved to your downloadlist.
The end action "Add all to Download List" might be better suited:
If you move all contents of your linkgrabber to the downloadlist (except the filtered ones obviously), only all filtered items will be cleared then.

2. Still in menu manager: Scroll down until you see the action "Delete links: <any>" -> "Clear filtered links".
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 21.09.2023, 18:05
serrato serrato is offline
Giga Loader
 
Join Date: Dec 2017
Posts: 99
Default

Thanks, I just noticed that after I disabled my linkgrabber filter for txt files, it was no longer adding txt files to the filter queue. Hopefully this resolves it (and maybe points out a potential unwanted behaviour of linkgrabber filters).
Reply With Quote
  #4  
Old 21.09.2023, 18:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,028
Default

Quote:
Originally Posted by serrato View Post
(and maybe points out a potential unwanted behaviour of linkgrabber filters).
You mean the behavior that filtered items are never deleted automatically?
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 21.09.2023, 18:57
serrato serrato is offline
Giga Loader
 
Join Date: Dec 2017
Posts: 99
Default

Quote:
Originally Posted by pspzockerscene View Post
You mean the behavior that filtered items are never deleted automatically?
I mean that when the linkgrabber filter was enabled, the linkgrabber was catching txt files and putting them in the queue (I mean the little counter on the bottom that counts how many links are filtered - not the package in the linkgrabber table) even though in the plugin the setting is set to Disabled. But once I disabled the linkgrabber filter, it was then respecting the plugin's setting.
Reply With Quote
  #6  
Old 21.09.2023, 19:02
pspzockerscene's Avatar
pspzockerscene pspzockerscene is online now
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 72,028
Default

That is not true / only your impression.

The mentioned filter works globally and the twitter setting works separately.
If you disable .txt files in that setting, they will not even get added to the linkgrabber (so that "not adding them" happens before a filter is even checked.

You've either experienced a bug here or mixed two different things.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 17:46.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.