JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 28.12.2020, 08:36
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default jdownloader and unicode non-letter characters.

I have recently seen that when I add a link to jdownloader with a name that has characters that are non-letters like emojies then the filename are not shown in jdownloader, but they are used for the filename saved on the system.

like this youtube link
**External links are only visible to Support Staff****External links are only visible to Support Staff**
in jdownloader it shows this:
(، ،) 720p 30fps VP9 AAC128-2020.11.28-10s (y2IQtj5iT9c).mkv
but if I select to rename it in jdownloader and select all and copy it I see that it get pasted in os file manager like this
https://imgur.com/a/BUoUqMr
so jdownloader knows the correct filename but just doesnt show the emojies.

Last edited by rezad; 28.12.2020 at 09:16.
Reply With Quote
  #2  
Old 28.12.2020, 13:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

It depends on used Unicode Version (might require newer Java version) and used Font in Java/JDownloader if it's able to disable the Unicode symbol/Emoji. There is nothing we can fix here because java must support the newer unicode version and the font must have support for it

You might wanna try to set font name to Dialog in Settings->Advanced Settings->search for font name
Also maybe newer java can solve this, see https://jdownloader.org/jdownloader2
With newer installer/launcher you can rename/remove the bundled jre/java folder and make the launcher your system installed java
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 29.12.2020, 09:27
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

I am on linux (archlinux) with jre-openjdk 14.0.2.u12-1
and I dont know exactly what font name to use that covers everything?
so that I dont lose cjk (chinese japanese korean) and also covers emojies.
also I dont know the exact name to use. so for example I have all the noto fonts (main extra emoji and cjk) installed as four packages. but when I use noto for font name in advanced setting and restart jdownloader it doesnt fix it.

and I see and empty java folder inside jdownloader so I dont see anything to remove

Last edited by rezad; 29.12.2020 at 09:31.
Reply With Quote
  #4  
Old 29.12.2020, 14:22
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

Can you show a screenshot how it looks in JDownloader? I get two *default* emoji with Java16
where can I find the font for some testing? I found
google.com/get/noto/
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 29.12.2020 at 14:30.
Reply With Quote
  #5  
Old 29.12.2020, 14:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 29.12.2020, 14:47
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

Quote:
Originally Posted by Jiaz View Post
Can you show a screenshot how it looks in JDownloader? I get two *default* emoji with Java16
where can I find the font for some testing? I found
google.com/get/noto/
no need for screenshots.
I typed how I see it in jdownloader:
like this (، ،) 720p 30fps VP9 AAC128-2020.11.28-10s (y2IQtj5iT9c).mkv
but it actualy has the three emojies in the start, just doesnt show it, like they are invisible.
so I can select all the filename and copy it in firefox and see the correct name. like this google search done on the pasted text from jdownloader.
https://www.google.com/search?q=%F0%...y2IQtj5iT9c%29

update: the forum procedure that manages outgoing links messes with this. how do I paste that link here?
you can right click on this link and paste it and remove the starting part before google.

also that font is 1.1GB and I have installed it from archlinux repo.
do you see the emojies but two of them instead of three?

are you on linux or windows and also java16 in the proprietary one right? an early access one?

Last edited by rezad; 29.12.2020 at 15:09.
Reply With Quote
  #7  
Old 29.12.2020, 15:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

@rezard: Please leave the links as they are, the forum will censor non whitelisted domains for non staff members.
It looks like this for me
ibb.co/PTc60mr
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 29.12.2020 at 15:25.
Reply With Quote
  #8  
Old 29.12.2020, 15:22
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

Quote:
Originally Posted by Jiaz View Post
@rezard: Please leave the links as they are, the forum will censor non whitelisted domains for non staff members.
no, I meant when I click on that link the last link I get is not the same as the link I pasted there.
so you can right click on it and copy and paste it and remove the start. so that you get the original link as I intended.
Reply With Quote
  #9  
Old 29.12.2020, 15:27
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

@rezard:
I'm on Ubuntu Mate 18.04, tested with zulu 16 ea builds

Your link is fine for me. You mean the referrer hider, I will look into it
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 29.12.2020, 15:28
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

Quote:
Originally Posted by Jiaz View Post
@rezard:
I tested with zulu 16 ea builds

Your link is fine for me. You mean the referrer hider, I will look into it
yes
Reply With Quote
  #11  
Old 29.12.2020, 15:38
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

Quote:
Originally Posted by Jiaz View Post
It looks like this for me
ibb.co/PTc60mr

this is inside jdownloader?
so you get two out of three emojies.
I have a similar problem with my plasma/linux with filename. the same way that jdownloader didnt show those characters, my file manger (And other desktop environment affected apps and window decorations ) didnt show the emojie and showed a placeholder (a rectangle) instead.
after asking for help in archlinux forum I get half way fixed by removing a font which made the first two emojie show in grey but the last one still showed a rectangle. I have to change some font configuration (copy pasted from the forum answer) to fix it all and force it to use the noto emoji for those characters and the first two characters also become in color and third got fixed two.

so you are still half way in jdownloader because you get two gray characters and you get the same error as me for the third character.
if you select the filename (by clicking on it to make it editable) and then copy then paste that in firefox for example, you get the correct name like the link I gave on google.

you can see my archlinux issue here:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

inside it you see my screenshot for good and bad text.
like this:

https://imgur.com/a/Gg0evkZ
https://imgur.com/a/om2fu5M

and the second one https://imgur.com/a/om2fu5M is what you are getting right now. you just dont see the third placeholder.

you can test with this link in jdownloader and see zero characters if I am right.
**External links are only visible to Support Staff****External links are only visible to Support Staff** because I saw zero character on firefox titlebar (not tab title, but the title bar that DE manages not firefox)

so you are half fixed but not completely fixed.

also isntalling oracle java version 15 (last version available in archlinux aur repos) didnt help.

Last edited by rezad; 29.12.2020 at 15:58.
Reply With Quote
  #12  
Old 29.12.2020, 17:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

The first two emoji are working fine (grey ones because of default emoji and not special color emoji font)
Third one emojiterra.com/pleading-face/ is unicode11 and should be supported since java13, see herongyang.com/Unicode/Java-Unicode-Version-Supported-in-Java-History.html
__________________
JD-Dev & Server-Admin
Reply With Quote
  #13  
Old 29.12.2020, 17:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

Unicode is read correct, maybe some string manipulation breaks the unicode, testing that

It's the font rendering that breaks the unicode. I will try to find a way to load custom/working font
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 29.12.2020 at 17:32.
Reply With Quote
  #14  
Old 29.12.2020, 17:28
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

ok so I dont need to track this anymore? you see it for yourself at least for the third emoji.
but my issue is that I dont see any of emojies.
Reply With Quote
  #15  
Old 29.12.2020, 17:34
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

Quote:
Originally Posted by rezad View Post
but my issue is that I dont see any of emojies.
It highly depends on used font and font environment on the system. I will look into it but no promises when I will find a solution
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 29.12.2020, 17:39
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

Quote:
Originally Posted by Jiaz View Post
It highly depends on used font and font environment on the system. I will look into it but no promises when I will find a solution
that's ok.
the file is correctly saved on storage so....
if it is fixed even better.
I am happy that I helped find a new bug
Reply With Quote
  #17  
Old 29.12.2020, 17:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

;)
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 02.08.2021, 00:41
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default UPDATE: jdownlaoder ignore noto sans font.

actually I had a new issue with mvp video player like this **External links are only visible to Support Staff**...
so I fixed that, the issue was with libass not supportig colorfull emoji.
but in fixing that I added a ttf-symbola font to the sans family at the end of all my other font at this
~/.config/fontconfig/fonts.conf like this

Code:
<?xml version='1.0'?>
<!DOCTYPE fontconfig SYSTEM 'fonts.dtd'>
<fontconfig>
 <dir>~/.fonts</dir>
 <match target="font">
  <edit mode="assign" name="hinting">
   <bool>true</bool>
  </edit>
 </match>
 <match target="font">
  <edit mode="assign" name="hintstyle">
   <const>hintslight</const>
  </edit>
 </match>
         <alias>
        <family>sans-serif</family>
        <prefer>
        <family>Noto Sans</family>
     <family>Noto Color Emoji</family>
     <family>Noto Emoji</family>
     <family>DejaVu Sans</family>
            <family>Symbola</family>
        </prefer>
    </alias>
        <family>Noto Sans</family>
     <family>Noto Color Emoji</family>
     <family>Noto Emoji</family>
     <family>DejaVu Sans</family>
</fontconfig>
now it seems that jdownloader like this last added font and uses that (even though other apps use noto and dejavu font that are higher in prefer list for sans)

I dont know why that is but now I know that jdownloader ignores my noto family font and maybe the issue that I started in this thread is that jdownlaoder ignores noto font.

because it actually sees this new font I installed and uses that and I SEE the emojis in the jdownloader now but they are colorless because this symbola font is a colorless font that I added to see emojis with libass at least in colorless form.
also this font is very thin and almost unreadable unless I scale the font in jdownloader so I prefer if JD used noto font.


so maybe the issue is this.
Reply With Quote
  #19  
Old 02.08.2021, 18:28
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 72,936
Default

@rezad: First of all thanks for your work/interest/time on this topic!
could you provide step by step how to setup the font in JDownloader and then I can do some more tests but no promises.

It's not about *ignoring* the font, but font configuration/handlig is more than just telling the application what font to use. You should also use your system java because most likely font configuration changes are only applied to system java or I don't know if java checks system font configuration.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 18.09.2021, 23:48
rezad rezad is offline
Linkgrabbing Monster
 
Join Date: Jan 2014
Posts: 83
Default

late response:
I use my system java
is there any other java? I am on archlinux.
I removed all font and only have
local/adobe-source-code-pro-fonts
local/cantarell-fonts
local/noto-fonts
local/noto-fonts-cjk
local/noto-fonts-emoji
local/noto-fonts-extra
local/ttf-twemoji-color
local/vazir-fonts

these setting caused the jdownloader to at least show emoji in black and white (after adding ttf-twemoji-color, before that it didnt show it)
but it caused other kde apps (After logout and login to take effect) to use black and white emoji which is not good.

on recommendation of someone I added this to my font config at my home directory:
<alias>
<family>sans-serif</family>
<prefer>
<family>Noto Sans</family>
<family>Noto Color Emoji</family>
<family>Noto Emoji</family>
</prefer>
</alias>
<family>Noto Sans</family>
<family>Noto Color Emoji</family>
<family>Noto Emoji</family>

this fixed the kde apps to show the color emoji and jdownloader shows at least the black and white emoji.

is there any plan to show color emoji in java/jdownloader?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 22:22.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.