JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 28.01.2020, 15:43
Luke M Luke M is offline
Ultra Loader
 
Join Date: May 2012
Posts: 47
Default Markdown "\" escapes in URLs

Some sites use Markdown (spec.commonmark.org/0.29/), which inserts \ escape characters in URLs. For example,

mega.nz/#!example_escape

becomes

mega.nz/#!example\_escape

(Real example: **External links are only visible to Support Staff****External links are only visible to Support Staff**)

In this case, it's probably safe to blindly replace \_ with _, assuming that mega doesn't use \. I'm not sure what the best general solution is. Maybe add a linkcrawler option?

Last edited by Luke M; 28.01.2020 at 15:53.
Reply With Quote
  #2  
Old 29.01.2020, 14:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 51,115
Default

I don't see any issue here as I can simply add your URL via deep crawler without having to replace anything.

If you want JD to automatically pickup all URLs of this website you can simply create a link crawler rule for this website.

-psp-
__________________

Ad-free installers || Werbefreie Installer
Windows Setup<--JD2 BETA-->Linux Setup x86 || Linux Setup x64 || Mac Setup
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #3  
Old 29.01.2020, 19:13
Luke M Luke M is offline
Ultra Loader
 
Join Date: May 2012
Posts: 47
Default

Are you sure? There are two mega links on that page, one is OK (no \).

I'm using DEEPDECRYPT mode.

Also does not work via clipboard (note: turn off javascript).

Last edited by Luke M; 29.01.2020 at 19:17.
Reply With Quote
  #4  
Old 30.01.2020, 22:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 51,115
Default

Quote:
Originally Posted by Luke M View Post
Are you sure? There are two mega links on that page, one is OK (no \).

I'm using DEEPDECRYPT mode.
Just to make sure that we're talking about the same things.
I mean LinkGrabber --> Add New Links --> Continue
When I do this, I get a lot of irrelevant URLs but among those are also two MEGA URLs, one with a filesize of 401MiB and one with 449MiB.

Quote:
Originally Posted by Luke M View Post
Also does not work via clipboard (note: turn off javascript).
JDownloader will by default only accept clipboard contents of websites for which we either have plugins for or direct-URLs which e.g. end with ".rar" or ".jpg".
Your website matches none of these cases.

If you want JD to automatically scan your site for URLs when you copy that URL you will have to make a link crawler rule for that (see forum search).

-psp-
__________________

Ad-free installers || Werbefreie Installer
Windows Setup<--JD2 BETA-->Linux Setup x86 || Linux Setup x64 || Mac Setup
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #5  
Old 31.01.2020, 00:23
Luke M Luke M is offline
Ultra Loader
 
Join Date: May 2012
Posts: 47
Default

I was using a linkcrawler rule, but manually entering the URL into linkcrawler gives the same result: "unknownFilename". (Somehow it does have a correct file size).

The link with the \ in it really works for you? Forget about link crawling, just copy it to the clipboard:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #6  
Old 31.01.2020, 00:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 51,115
Default

No it doesn't.

Sorry I've not watched the online status but only looked at the filesize - my bad!

This is indeed an edge-case which is not possible via current linkcrawler rule.
Linkcrawler rules can also be used to e.g. modify URLs but plugins always have the highest priority which means MEGA URLs will be handled by our plugin before they would even get the chance to go through a linkcrawler rule.
I just found out that we even have a ticket for that:

See also THIS thread.

So what you could do is:
- Check if this is possible via EventScripter script
- Write your own plugin
- Write some script which auto-fixes such MEGA URLs whenever you copy them and then copies them in your clipboard again

... this would be my ideas so far.

-psp-
__________________

Ad-free installers || Werbefreie Installer
Windows Setup<--JD2 BETA-->Linux Setup x86 || Linux Setup x64 || Mac Setup
-----=>Support Chat<=-----
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:57.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.