JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 28.01.2020, 16:43
Luke M
Guest
 
Posts: n/a
Default Markdown "\" escapes in URLs

Some sites use Markdown (spec.commonmark.org/0.29/), which inserts \ escape characters in URLs. For example,

mega.nz/#!example_escape

becomes

mega.nz/#!example\_escape

(Real example: **External links are only visible to Support Staff****External links are only visible to Support Staff**)

In this case, it's probably safe to blindly replace \_ with _, assuming that mega doesn't use \. I'm not sure what the best general solution is. Maybe add a linkcrawler option?

Last edited by Luke M; 28.01.2020 at 16:53.
Reply With Quote
  #2  
Old 29.01.2020, 15:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

I don't see any issue here as I can simply add your URL via deep crawler without having to replace anything.

If you want JD to automatically pickup all URLs of this website you can simply create a link crawler rule for this website.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 29.01.2020, 20:13
Luke M
Guest
 
Posts: n/a
Default

Are you sure? There are two mega links on that page, one is OK (no \).

I'm using DEEPDECRYPT mode.

Also does not work via clipboard (note: turn off javascript).

Last edited by Luke M; 29.01.2020 at 20:17.
Reply With Quote
  #4  
Old 30.01.2020, 23:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

Quote:
Originally Posted by Luke M View Post
Are you sure? There are two mega links on that page, one is OK (no \).

I'm using DEEPDECRYPT mode.
Just to make sure that we're talking about the same things.
I mean LinkGrabber --> Add New Links --> Continue
When I do this, I get a lot of irrelevant URLs but among those are also two MEGA URLs, one with a filesize of 401MiB and one with 449MiB.

Quote:
Originally Posted by Luke M View Post
Also does not work via clipboard (note: turn off javascript).
JDownloader will by default only accept clipboard contents of websites for which we either have plugins for or direct-URLs which e.g. end with ".rar" or ".jpg".
Your website matches none of these cases.

If you want JD to automatically scan your site for URLs when you copy that URL you will have to make a link crawler rule for that (see forum search).

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 31.01.2020, 01:23
Luke M
Guest
 
Posts: n/a
Default

I was using a linkcrawler rule, but manually entering the URL into linkcrawler gives the same result: "unknownFilename". (Somehow it does have a correct file size).

The link with the \ in it really works for you? Forget about link crawling, just copy it to the clipboard:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #6  
Old 31.01.2020, 01:39
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,140
Default

No it doesn't.

Sorry I've not watched the online status but only looked at the filesize - my bad!

This is indeed an edge-case which is not possible via current linkcrawler rule.
Linkcrawler rules can also be used to e.g. modify URLs but plugins always have the highest priority which means MEGA URLs will be handled by our plugin before they would even get the chance to go through a linkcrawler rule.
I just found out that we even have a ticket for that:

See also THIS thread.

So what you could do is:
- Check if this is possible via EventScripter script
- Write your own plugin
- Write some script which auto-fixes such MEGA URLs whenever you copy them and then copies them in your clipboard again

... this would be my ideas so far.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:11.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.