JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 13.02.2020, 06:51
stelec stelec is offline
Modem User
 
Join Date: Feb 2020
Posts: 3
Default Problem handling UTF-8 characters on FreeNAS/ZFS

I am running JDownloader in a FreeNAS 11.2 jail on a ZFS volume, and controlling JD through My.JDownloader.

When I try to download a YouTube video with UTF-8 characters in its name (such as fancy quotes, accented letters, signs), the corresponding folder and video file names on disk are messed up. The UTF-8 characters are replaced by a question mark.

For instance, take the video:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
and select "subfolder by package" before downloading. Download the mp4.

The resulting file path will be:
Code:
Friandises de No?l _ attention aux exc?s ! - Le Magazine de la sant?/Friandises de No?l _ attention aux exc?s ! - Le Magazine de la sant? (1080p_25fps_H264-128kbit_AAC).mp4
instead of the expected:
Code:
Friandises de Noël : attention aux excès ! - Le Magazine de la santé/Friandises de Noël : attention aux excès ! - Le Magazine de la santé (1080p_25fps_H264-128kbit_AAC).mp4
I tried to download the same video with JD on Windows and the names were correct. I can also successfully create a folder with the correct name through command line, so this is not something to do with the filesystem not supporting these characters.

Also, having question marks in the filename makes the problem worse when the folder is browsed through a Windows network share, since question marks are illegal characters on Windows. So when I access my FreeNAS server over \\myserver, I only see some 8.3-like folder/file names like "FVNAKE~N" and "FW6HS3~D.MP4" for that video.
Reply With Quote
  #2  
Old 13.02.2020, 16:58
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 52,451
Default

I have absolutely no idea.

Please post a log so I can ask our other teammembers.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 13.02.2020, 22:07
stelec stelec is offline
Modem User
 
Join Date: Feb 2020
Posts: 3
Default

OK, this got complicated. I cleared my download history and applied the latest JD update, then I could not reproduce the problem (i.e., the file and folder names were fine).

Looking at the changelog for JD, I couldn't find any change that may solve my problem, so it must have been the other factor: the download list. I restored the previous downloadList.zip in the cfg folder, then tried to download again this YouTube video and the problem came back. So that may have to do with the format or encoding of the download history. I downloaded quite a few videos, some with weird names that may have corrupted the download history somehow. I will try to investigate further. In the meantime, this is my log id: jdlog://7326430900751

Thanks.
Reply With Quote
  #4  
Old 17.02.2020, 18:36
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 52,451
Default

There were no changes to solve your problem.

You have to update your locale setting then this issue should be solved:
https://board.jdownloader.org/showpo...&postcount=929

Sorry for the delay!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
How to create a log || Wie man einen Log erstellt
Captcha FAQ EN || Captcha FAQ DE || Erste Schritte & Tutorials
JDownloader 2 Setup Download
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #5  
Old 20.02.2020, 04:30
stelec stelec is offline
Modem User
 
Join Date: Feb 2020
Posts: 3
Default

The locale setting is not the issue. The problem is also difficult to reproduce. I currently have two JD installations, one with the problem, the other one without.

FreeNAS already runs with
Code:
MM_CHARSET=UTF-8
LANG=en_US.UTF-8
I added:
Code:
LC_CTYPE=en_US.UTF-8
LC_COLLATE=C
and restarted JDownloader. Still having the problem.

Is the jdlog I submitted helpful?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 07:46.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.