[serrato]

Hello,

For some time now over the past year or so I've noticed that twitter crawls everything including tweets as text files. I don't want the text files, so I remember enabling a setting to ignore text files. Somewhere along the way I got busy and didn't investigate further but I saw that the text files were back. I can't figure out what the setting is supposed to be and the GUI is confusing me as to which line represents what and several lines are repeated in standard text as well the 'explanation' colour text. Meanwhile I had setup a linkgrabber filter to filter .txt but that still collects an enormous number of txts in the filter queue.

Can you help me understand what is happening, especially the GUI options? I've attached a screenshot to illustrate the confusion. I tried searching for explanations of these options but I can't really find much.

So not much of an issue but nice if I can get some help. Thanks!

[pspzockerscene]

Originally Posted by serrato

I don't want the text files, so I remember enabling a setting to ignore text files. Somewhere along the way I got busy and didn't investigate further but I saw that the text files were back.

I'm rarely resetting defaults but I remember that at the beginning I had a simple on-off switch for this behavior which I've later changed to a dropdown.
See Settings -> Plugins -> twitter.com -> Single Tweet crawler: Text crawl mode -> Set this to "Never (disabled)"
According to your screenshot, you've already disabled .txt files from twitter...

Originally Posted by serrato

Can you help me understand what is happening, especially the GUI options?

The greyed out part is each settings' description.
It may look distracting but it's just a GUI thing and no, this will not be addressed in the near future.

Originally Posted by serrato

Meanwhile I had setup a linkgrabber filter to filter .txt but that still collects an enormous number of txts in the filter queue.

Yap the more filtered items oyu keep, the more RAM will be needed. Over longer periods of time this can be a problem.
FYI there is at least two ways how to auto-clean filtered items:
Rightclick anywhere in the empty space in the linkgrabber tab -> Open menu manager
1. "Add to Download List" or "Add all to Download List" -> Right side there is a checkbox "Clean Linkgrabber after adding links"
WARNING: This will delete all items in your linkgrabber except the ones you've moved to your downloadlist.
The end action "Add all to Download List" might be better suited:
If you move all contents of your linkgrabber to the downloadlist (except the filtered ones obviously), only all filtered items will be cleared then.

2. Still in menu manager: Scroll down until you see the action "Delete links: <any>" -> "Clear filtered links".

[serrato]

Thanks, I just noticed that after I disabled my linkgrabber filter for txt files, it was no longer adding txt files to the filter queue. Hopefully this resolves it (and maybe points out a potential unwanted behaviour of linkgrabber filters).

[pspzockerscene]

Originally Posted by serrato

(and maybe points out a potential unwanted behaviour of linkgrabber filters).

You mean the behavior that filtered items are never deleted automatically?

[serrato]

Originally Posted by pspzockerscene

You mean the behavior that filtered items are never deleted automatically?

I mean that when the linkgrabber filter was enabled, the linkgrabber was catching txt files and putting them in the queue (I mean the little counter on the bottom that counts how many links are filtered - not the package in the linkgrabber table) even though in the plugin the setting is set to Disabled. But once I disabled the linkgrabber filter, it was then respecting the plugin's setting.

[pspzockerscene]

That is not true / only your impression.

The mentioned filter works globally and the twitter setting works separately.
If you disable .txt files in that setting, they will not even get added to the linkgrabber (so that "not adding them" happens before a filter is even checked.

You've either experienced a bug here or mixed two different things.