[Jiaz]

Originally Posted by Soporius

Do you mean that a specific 'illegal' character will be replaced with a speicific 'legal' character consistently? I have no problem with renaming post-download, it's just that currently I don't know exactly what character '_' is replacing.

Check with next update, you can now define the replacement by yourself, see Settings->Advanced Settings->
GeneralSettings.filenamecharacterregexreplacemap
GeneralSettings.packagenamecharacterregexreplacemap

[pspzockerscene]

Said update is now live.

[Soporius]

Excellent, thank you very much! This is a great solution.

Everything's working here, except custom replacements on YT. It always reverts to the defaults.

ex: **External links are only visible to Support Staff****External links are only visible to Support Staff**
The colon always changes to semi, no matter the replacement.

[Jiaz]

@Soporius: thanks for the report, will take a look at that
Update: found the bug, will be fixed with next update, thanks for the report!

[Thinkerbelle]

Hi,
until Friday, JDownloader used to grab and download subtitle files from Youtube in srt format. However, today I noticed they don't get downloaded anymore. JDownloader grabs them in the link grabber with their srt extension, but the links have a red background.
When I download them, the file extension that is shown in JDownloader is xml. It shows them as downloaded but they are not in my download folder.

Could someone plase look into that?
Thank you!

[Thinkerbelle]

It suddenly resolved itself... This thread can be deleted. Sorry if this caused any inconvenience!

[Soporius]

All good now, thank you kindly~

[Jiaz]

@Soporius: Thanks for the feedback and you're welcome!

[Jiaz]

@Thinkerbelle: Thanks for the feedback. In case it happens again, please provide a log, see https://support.jdownloader.org/de/k...d-session-logs
wait for issue to happen, create log and post logID here

[Jiaz]

Originally Posted by Thinkerbelle

It suddenly resolved itself... This thread can be deleted. Sorry if this caused any inconvenience!

Issue was caused by new feature that is not *finished* yet

[minixbox]

Has anyone tried downloading members only videos using cookies? Does it work?

[Jiaz]

@minixbox: counter question, have you tried to add your account and checked if it works? don't see a reason why it should fail.

[Xirix]

I was just curious. Youtube is/has started rolling out a new way of injecting advertisements when you're watching on the site, is this going to affect downloading in any way?

I hope it's not how it works, I'm just concerned that youtube might interpret downloading as a person watching, and end up with advertisements in the video we download, I just wanted to ask to see if I'm getting concerned for nothing.

Thanks.

[Jiaz]

@Xirix: Can't tell as I have not got yet such a new video/stream. if the ad is embedded in video stream, maybe even at random positioin, it will be very very complicated to remove this automaically without image/video analysis.

[Xirix]

Fair enough, I'll be sure to keep checking any new videos I download to see if it happens then for now, I'll report if I find anything.

[Jiaz]

@Xirix: Thanks for your help

[minixbox]

Originally Posted by Jiaz

@minixbox: counter question, have you tried to add your account and checked if it works? don't see a reason why it should fail.

Not yet, I want to check if it's possible before signing up to the membership they charge $9.99 a month.

[TGU]

Originally Posted by Xirix

end up with advertisements in the video we download

This will most likely be the case in the future if you don't have the youtube "premium"

Youtube will not (easily) allow you to detect when an advert starts and ends, it will be like you are just watching (or downloading) the video as normal.
As the feature is current an experiment you might be able to see it at youtube[dot]com[slash]new or they might just be sending it to a % of the userbase. It's currently not applied to everyone, but when it is you will see news articles about it.

[minixbox]

1. Some 8K videos are only downloading as 4K, video is tagged as 8K on the site, I have tested another downloader and it is able to download in 8K.

Pic:

Spoiler:

Example video:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

2. Crawling is not complete. This started happening today, when I add 100 links to crawl, it will have a few missing each time and it won't show the missing as offline, it will show something like 96 online. I thought it was due to duplicates but if I try to crawl the same 100 links again, it is able to crawl the remaining 4 links. If I crawl 80 links at a time, it looks like it can crawl all 80.

[pspzockerscene]

@minixbox
1. According to YT interface, max resolution of this item is 4k.
Maybe the other downloader upscaled it?
Which application did you use there?

2. Please provide example URLs and a log.

Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

Bitte poste deine Log-ID hier.
Falls dein Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.
Geht es um einen nicht funktionierenden Account-Login, aktiviere vor dem Erstellen deines Logs den debug Modus (siehe zuvor verlinkte Anleitung).

-psp-

[minixbox]

Originally Posted by pspzockerscene

@minixbox
1. According to YT interface, max resolution of this item is 4k.
Maybe the other downloader upscaled it?
Which application did you use there?
-

Not sure if upscaled, it shows the 8K tag on youtube, the application is yt-dlp.

Here is another video:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

8K tag on youtube

Spoiler:

4k is the max possible in JD

Spoiler:

yt-dlp is downloading the 8k 51.72mb av1 variant, JD is downloading the 4k 39.43mb av1 variant

Spoiler:

And for some reason my other installation of JD is showing all av1 videos as mp4 in variants but it downloaded and file name is av1

Spoiler:

[minixbox]

I tested more and here is what I found

For this URL
The video is 8k in 4320 x 7680 resolution
**External links are only visible to Support Staff****External links are only visible to Support Staff**

JD is showing it as 4k in 2160 x 3840 resolution but the higher resolution is hidden

Spoiler:

Clicking on the arrow does not bring up the higher resolution, you need to go inside variants and pick the higher resolution

Spoiler:

After picking the higher resolution, the variant is displayed as 7680p

Spoiler:

The problem is that JD does not inform you that a higher resolution exist and why wouldn't it try to download the highest resolution available? Is it because the resolution list max out at 4320p so it won't show the 7680p variant?

And it doesn't save the variant on the add a variant box so you need manually pick the variant on every 8k 4320 x 7680 video.

For the other issue of JD not able to get some 8k videos.

This is a video **External links are only visible to Support Staff****External links are only visible to Support Staff** from LG promoting their 8K QNED TV, it has the 8k tag on the video under the description but the web player can only play at 4k, are these videos really 8k or not? Why does it have the 8k tag if it isn't? The other downloader yt-dlp is able to download it at 8k so I am wondering if it's upscaled 4k but I think that is unlikely. Someone told me there are hidden formats, could that be it?

Spoiler:

Spoiler:

Since its looking like yt-dlp will download the max resolution available either hidden or otherwise, at least for 8k videos I switched to using it for now but only for 8k videos, I use the file name filter in JD to filter out the 8k links.

[pspzockerscene]

@minixbox
I've understood your problem but someone else needs to look into this.

[minixbox]

Originally Posted by pspzockerscene

@minixbox
I've understood your problem but someone else needs to look into this.

Thanks.

I found another problem that could be kind of serious but I think I found a solution, please take a look.

Is there a reason why the linkcollector is not able to detect missing links that disappeared?

This is a big issue because the linkcollector doesn't tell you there are missing links, most users are going to assume nothing was missed.

The expected behavior is you add 100 links, when finished crawling it should tell you the results of the 100 links like 100 online or 90 online 10 offline. The linkcollector should have a built in check.

As it is now, you add 100 links, it finished crawling and tells you something like 88 links online. 12 links disappeared but you wouldn't know it unless you kept track of how many links you added.

If 100 non duplicate links (the add link automatically trims duplicate links) was added and it doesn't return 100 total online/offline links when it finish crawling, shouldn't it be able to easily detect that?

Solution I found that fixed the missing links, changed Xms64m to Xms1000m:
I followed this guide to increase the RAM, I tried to do 2g but JD2 won't start, no error message it just wouldn't start at all.
https://support.jdownloader.org/en/k...vmoptions-file

Remove all -Xms and -Xmx lines if existent.
Add a new line e.g. -Xmx2g (for 2GB max) or -Xmx1000m (for 1000MB max)

-Xmx2g doesn't work, JD2 doesn't start
-Xms2000m doesn't work, JD2 doesn't start

[Jiaz]

Originally Posted by minixbox

Solution I found that fixed the missing links, changed Xms64m to Xms1000m:

Once java hits Out-of-Memory, everything may happen and you cannot properly handle this as errors might appear/happen everywhere. So correct solution was to increase memory!

Originally Posted by minixbox

-Xmx2g doesn't work, JD2 doesn't start
-Xms2000m doesn't work, JD2 doesn't start

From https://support.jdownloader.org/de/k...vmoptions-file

Please know that larger memory settings (e.g. larger than 1GB or larger than 2GB) do require a 64bit Java version and will fail on 32bit Java version.

[Jiaz]

Originally Posted by minixbox

1. Some 8K videos are only downloading as 4K, video is tagged as 8K on the site, I have tested another downloader and it is able to download in 8K.

Originally Posted by minixbox

For this URL
The video is 8k in 4320 x 7680 resolution
JD is showing it as 4k in 2160 x 3840 resolution but the higher resolution is hidden.

Issue/confusion is due aspect ratio. JDownloader does *know* about the higher resolutions but a setting Settings->Advanced Settings->Youtube.maxvideoresolution is currently limited to 4k height. but the video has 8k due to aspect ratio and thus filtered.
Please wait for next update and then you can select higher max height in settings

[minixbox]

Originally Posted by Jiaz

Once java hits Out-of-Memory, everything may happen and you cannot properly handle this as errors might appear/happen everywhere. So correct solution was to increase memory!


From **External links are only visible to Support Staff**...

Will the app ever have a way to verify that all the links added were processed?

The problem is that the the user does not know the app ran out of memory. The app does not alert the user that a portion of the links were never processed. Many users incorrectly assume all the links were processed.

Here is another scenario where the user might assume the links were offline when it's possible they were never checked. I add 50 links, due to memory issues, the app processed 40 links all 40 shows online. I keep a list of offline links in the linkgrabber tab. In this scenario, even if I knew I added 50 links and only 40 is online, I would assume the other 10 was offline, I go look for 10 replacement links. But these 10 links might actually be online and the app didn't process them at all due to being out of memory.

[Jiaz]

Originally Posted by minixbox

Will the app ever have a way to verify that all the links added were processed?

JDownloader *knows* how many links it has parsed/processed but that doesn't mean that this number is the same as you expect. There is no such feature because a link you have added might not be supported at all, so is the link missing due to missing support or because you added something you did not want to process (eg your amazon link or a link to newspaper article). Also a plugin might be broken, so instead of crawling all 100 entries, plugin stops after 10, so because of the error, JDownloader *thinks* all good because 10/10 are done. Even when you add each link separately, there might be no results because of special handling in plugin, or duplicates in your input, or no supported/empty links.

Originally Posted by minixbox

The problem is that the the user does not know the app ran out of memory. The app does not alert the user that a portion of the links were never processed.

In case of Out-of-Memory, it doesn't make sense to have special handling for this, as the error can happen everywhere. Issues/failures can happen during clipboard reading(nothing gets added) or while parsing the links (only part of the input is read/processed) or while distributing the workload (so some links are processed, others just died) or while collecting the results or or or....If you have many links in list, you should have proper memory settings in place for your workload/usecase.

Originally Posted by minixbox

But these 10 links might actually be online and the app didn't process them at all due to being out of memory.

Or the links were processed/added but gone due to out-of-memory while adding to the interal list/database.

[SorryForMyEN]

Please, I just updated JDownloader and most YouTube videos download without any problems. However, around 2% of videos from before 2023 report "unavailable" even if the video runs normally on the YT page. I appreciate any help.

example link:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

That video is age protected (JD also displays this as a dummy-filename) so you need to add your YT account to JD in order to be able to crawl and download it.
https://support.jdownloader.org/de/k...remium-account
(Article is about "premium accounts" - just ignore the word premium in this context.)

[minixbox]

Originally Posted by Jiaz

JDownloader *knows* how many links it has parsed/processed but that doesn't mean that this number is the same as you expect. There is no such feature because a link you have added might not be supported at all, so is the link missing due to missing support or because you added something you did not want to process (eg your amazon link or a link to newspaper article). Also a plugin might be broken, so instead of crawling all 100 entries, plugin stops after 10, so because of the error, JDownloader *thinks* all good because 10/10 are done.

The main point is, Jdownloader stops processing links but the user doesn't know it stopped. Links that are actually online are thought of as offline. How about a summary to show the user the current add links crawling session? 10 online, 90 offline/unsupported instead of 10 online and no alert about the remaining 90 links that weren't processed due to error. If links are unsupported or it is an empty link, why not display them as offline or categorize as unsupported? The expected behavior from a user's point of view is that if they put 100 links in, they expect 100 to be processed, if 100 weren't processed the app needs to alert the user or better yet alert the user which links were not processed.

I am still using 32-bit JD2, the same installation from 10 years ago, limited to 247.50 MB, I wouldn't know links disappeared if I wasn't tracking how many I added. These were not unsupported links, they were youtube links and I have to add them many times to get all 100 processed. There are probably a lot of installations like mine out there and so many links mistakenly thought of as offline when they were never processed.

I am not affected by this problem after increasing the memory. This is only a suggestion because there are probably many other users out there on 32-bit Jdownloader who don't know and the app does not have a way to let the user know that links got cut off.

Even when you add each link separately, there might be no results because of special handling in plugin, or duplicates in your input, or no supported/empty links.

If no results, why can't the app show the link as offline in the right side panel? If the app shows nothing, it looks like it never got processed.

[minixbox]

Originally Posted by Jiaz

Issue/confusion is due aspect ratio. JDownloader does *know* about the higher resolutions but a setting Settings->Advanced Settings->Youtube.maxvideoresolution is currently limited to 4k height. but the video has 8k due to aspect ratio and thus filtered.
Please wait for next update and then you can select higher max height in settings

How about the other issue of not able to get certain 8k videos in 4320p?

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Jdownloader sees the 2160p 343 mb av1 as the best available
yt-dlp finds the 4320p 699 mb av1 version


This video is tagged as 8k but does not have 8k available on the web player. The other app can see the 8k version id=702, how is it able to do that? This is not the same issue as the 7680p earlier.

[Jiaz]

@minixbox: answer is simple, itag 702 is not yet supported, wait for next plugin update
Will be supported with next update

[SorryForMyEN]

Originally Posted by pspzockerscene

That video is age protected (JD also displays this as a dummy-filename) so you need to add your YT account to JD in order to be able to crawl and download it.
**External links are only visible to Support Staff**...
(Article is about "premium accounts" - just ignore the word premium in this context.)

Thanks, it worked. But the resolution downloaded by JD is very low (360p), while on YT it is 1080p. I haven't found any settings in JD that are limiting this.

[pspzockerscene]

Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

Bitte poste deine Log-ID hier.
Falls dein Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.
Geht es um einen nicht funktionierenden Account-Login, aktiviere vor dem Erstellen deines Logs den debug Modus (siehe zuvor verlinkte Anleitung).

-psp-

[MarqFJA87]

Originally Posted by pspzockerscene

Yap I read that.
So as we can't reproduce your issue and we were unable to fix it based on your logs, please re-contact us via support@jdownloader.org and be ready for a Teamviewer live session [EDIT not today - I'll be offline soon].

Sorry for the late reply; I had struggling with sickness and irregular sleep in the past several weeks, and I couldn't find the time for such a session.

... That said, for some inexplicable reason, it appears that the problem has completely stopped as of a few days ago. I'm still in the process of verifying this by tracking down all the videos that I had to download via alternate methods, but I suspect that I'll find they're now all downloadable again, so it's probably safe to close this issue as "resolved via some unknown change in whatever third-party entity that was causing the problem in the first place".

[pspzockerscene]

Thanks for your feedback!

[Soporius]

The regex replace settings reset a few days ago. (Update, I assume.) No trouble, I re-customised.

But since then, package names aren't working at all. Filenames are working well.

[SorryForMyEN]

Thanks for your time wasted, pspzockerscene, but I managed to resolve it another way. If it fails again, I'll try your suggestion.

[Soporius]

Things seem to be working again, maybe it was just something on my end, sorry about that. The only hitch I notice now are periods in the user name. Not a big deal, just thought I'd mention it.

Ex. **External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**