[Solved] Download link with query string

Hi guys,

I'm struggling with a download link that contains a query string (hxxp://host.com/download.php?a=b&c=d...) Everything after the question mark seems to be ignored... Inversely, when I say "Open in Browser" it opens the URL without the query string, so I suppose JD ignores the query string. Why?
As the query string contains the session ID needed to download, it doesn't work.
Maybe it's trivial but how do I make this work?

Bye,
Marki

[tony2long]

Please provide real examples.

Take this for example

hxxp://cdn2.novell.com/prot/Q_VbW21Bixx~/SLES-11-SP3-DVD-x86_64-GM-DVD2.iso?__tk1__=st=NNNNNN+exp=NNNNNN+acl=/prot/Q_VbW21Bixx~/*+hmac=b19b9908c36b84efabcabcbacbacbacabcacbacbacbacd29f562426bd

[raztoki]

add link as direct**External links are only visible to Support Staff**

Not working...

Link given by the download site:

cdn2.novell.com/prot/Q_VbW21Bixx~/SLES-11-SP3-DVD-x86_64-GM-DVD2.iso?__tk1__=st=1373720NNN+exp=1373738NNN+acl=/prot/Q_VbW21BiB4~/*+hmac=e76...

Link as used with directhttp when clicking "Open Browser" in JD:

cdn2.novell.com/prot/Q_VbW21Bixx~/SLES-11-SP3-DVD-x86_64-GM-DVD2.iso?__tk1__=st=1373720NNN%20exp=1373738NNN%20acl=/prot/Q_VbW21BiB4~/*%20hmac=e76...

Note the difference: + has become %20

[tony2long]

Novell needs password for download.

Originally Posted by tony2long

Novell needs password for download.

Not at all (you log in beforehand obviously).

As I said, the session id in the query strings suffices, but if the query string is not correctly passed (as I've shown above) it can't work...

Here's the wireshark capture for reference.

Just using %20 instead of + doesn't seem to be liked by the Novell site.

So who is wrong?
JD or Novell?



(The first packet is using IE, the second using JD)

[raztoki]

urlencoding of space is %20

JD will url encode all requests.

+ is generally used by search engines etc between string values
_http://www.google.com.au/search?client=opera&q=a+b+c

use flashgot within firefox or chrome extension that uses the same API to send links from browser to JD. It will also send the cookie session, some times required also.

raztoki

The main point here would have been to be INDEPENDENT of any browser to perform my downloads. Well.....

[raztoki]

it is independent, but if you need cookie session or a specific URL string providing it via API can prevent these issues. JD complies with RFC for http requests, which you need to URL Encode. The URL you gave or provided by copy is incorrect. So your choices are limited, this is not a fault of JDownloader.

raztoki

RFC 1738 (as modified by 2396 and 3986) defines the scheme (http), authority (//server.example.com), and path (/myfile/mypage.htm) component, and does not define any special meaning for the + character.

The HTML spec defines the query component to be mime type application/x-www-form-urlencoded which is defined as "replace spaces with + and other special characters as in RFC1738".

So, there's really no way with JD (no browser plugins etc.) of creating some string that in the end would represent the plus sign needed to perform the download? Even supplying spaces does not produce the wanted pluses in the query string.

[raztoki]

I added your first link (your second post) , Tested within JD2 SVN.

22|FavIcons.class.log 14/07/13 3:14:04 AM - FINE [ org.appwork.utils.swing.dialog.ConfirmDialog(<init>) ] -> Utils>FavIcons.class.log>Dialog [null][null]
flag: 110000
title: Analyse and Add Links
msg:
You really should know that...

...JDownloader helps you to parse text or websites for links. Enter Links, URLs, Websites, or text below,

choose a Download Destination, and click 'Start Analyse'.

All 'downloadable' Files will be listed in the the Linkgrabber view afterwards.

22|FavIcons.class.log 14/07/13 3:18:59 AM - FINE [ org.appwork.utils.swing.dialog.ConfirmDialog(<init>) ] -> Utils>FavIcons.class.log>Dialog    [null][null]
flag:  110000
title: Analyse and Add Links
msg:   
You really should know that...

...JDownloader helps you to parse text or websites for links. Enter Links, URLs, Websites, or text below, 

choose a Download Destination, and click 'Start Analyse'. 

All 'downloadable' Files will be listed in the the Linkgrabber view afterwards.
22|FavIcons.class.log 14/07/13 3:18:59 AM - FINE [ org.appwork.utils.swing.dialog.AbstractDialog(actionPerformed) ] -> Utils>FavIcons.class.log>Answer: Button<CANCEL:Cancel>
22|FavIcons.class.log 14/07/13 3:19:16 AM - FINER [ org.appwork.storage.config.handler.ListHandler(read) ] -> Utils>FavIcons.class.log>Read Config: C:\Users\User\.jd_home\cfg\org.jdownloader.gui.views.linkgrabber.addlinksdialog.LinkgrabberSettings.downloaddestinationhistory.json
java.awt.Point[x=370,y=378]
22|FavIcons.class.log 14/07/13 3:19:18 AM - FINE [ org.appwork.utils.swing.dialog.ConfirmDialog(<init>) ] -> Utils>FavIcons.class.log>Dialog    [null][null]
flag:  110000
title: Analyse and Add Links
msg:   
You really should know that...

...JDownloader helps you to parse text or websites for links. Enter Links, URLs, Websites, or text below, 

choose a Download Destination, and click 'Start Analyse'. 

All 'downloadable' Files will be listed in the the Linkgrabber view afterwards.

 THREAD: 25
25|jd.controlling.linkcollector.LinkCollector.log 14/07/13 3:19:19 AM - INFO [ jd.controlling.linkcollector.LinkCollector$16(run) ] -> Delete outdated CollectorList: C:\Users\User\.jd_home\cfg\linkcollector10597.zip true

 THREAD: 22
22|FavIcons.class.log 14/07/13 3:19:20 AM - FINE [ org.appwork.utils.swing.dialog.AbstractDialog(actionPerformed) ] -> Utils>FavIcons.class.log>Answer: Button<OK:Continue>

 THREAD: 877
877|DirectHTTP.log 14/07/13 3:19:20 AM - INFO [ jd.controlling.linkcrawler.LinkCrawler(processHostPlugin) ] -> Processing: direct**External links are only visible to Support Staff**JOB DONE: 1

 THREAD: 878
878|DirectHTTP.log 14/07/13 3:19:20 AM - INFO [ jd.controlling.linkchecker.LinkChecker$1(run) ] -> LinkChecker: directhttp_novell.com
878|DirectHTTP.log 14/07/13 3:19:20 AM - INFO [ jd.controlling.linkchecker.LinkChecker$1(run) ] -> Check Multiple FileInformation
878|DirectHTTP.log 14/07/13 3:19:20 AM - INFO [ jd.controlling.linkchecker.LinkChecker$1(run) ] -> Multiple FileInformation Available: false
878|DirectHTTP.log 14/07/13 3:19:20 AM - INFO [ jd.controlling.linkchecker.LinkChecker(updateAvailableStatus) ] -> Check FileInformation: **External links are only visible to Support Staff**878|DirectHTTP.log 14/07/13 3:19:21 AM - FINEST [ jd.http.Browser(connect) ] -> 
----------------Request Information-------------
URL: **External links are only visible to Support Staff**Host: cdn2.novell.com
HostIP: x.x.220.75
Connection-Timeout: 10000ms
Read-Timeout: 30000ms
----------------Request-------------------------
GET /prot/Q_VbW21Bixx~/SLES-11-SP3-DVD-x86_64-GM-DVD2.iso?__tk1__=st=NNNNNN+exp=NNNNNN+acl=/prot/Q_VbW21Bixx~/*+hmac=b19b9908c36b84efabcabcbacbacbacabcacbacbacbacd29f562426bd HTTP/1.1
Host: cdn2.novell.com
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.10) Gecko/2009042523 Ubuntu/9.04 (jaunty) Firefox/3.0.10
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: de, en-gb;q=0.9, en;q=0.8
Accept-Encoding: 
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
Cache-Control: no-cache
Pragma: no-cache
Connection: close

----------------Response Information------------
Connection-Time: 60ms
----------------Response------------------------
HTTP/1.1 403 Forbidden
server: Apache
etag: "390f0a860302637e798a4e86c7f2cd30:1362538385"
last-modified: Wed, 06 Mar 2013 02:53:05 GMT
accept-ranges: bytes
content-length: 1238
content-type: text/html
date: Sat, 13 Jul 2013 19:19:21 GMT
connection: close
------------------------------------------------


878|DirectHTTP.log 14/07/13 3:19:21 AM - SEVERE [ DirectHTTP.log ] -> jd.plugins.PluginException
	at jd.plugins.hoster.DirectHTTP.requestFileInformation(DirectHTTP.java:595)
	at jd.controlling.linkchecker.LinkChecker.updateAvailableStatus(LinkChecker.java:396)
	at jd.controlling.linkchecker.LinkChecker.access$4(LinkChecker.java:385)
	at jd.controlling.linkchecker.LinkChecker$1.run(LinkChecker.java:310)
	at java.lang.Thread.run(Thread.java:724)

878|DirectHTTP.log 14/07/13 3:19:21 AM - INFO [ jd.controlling.linkchecker.LinkChecker(updateAvailableStatus) ] -> Link **External links are only visible to Support Staff**
 THREAD: 25
25|jd.controlling.linkcollector.LinkCollector.log 14/07/13 3:19:26 AM - INFO [ jd.controlling.linkcollector.LinkCollector$16(run) ] -> Delete outdated CollectorList: C:\Users\User\.jd_home\cfg\linkcollector10598.zip true

adds the link as you provide.

the space issue could have been introduced by old version of JD maybe?

I just tested in JD 0.9.581

------------------------  Thread: 107  -----------------------
107 14/07/13 3:24:04 AM - FINEST [jd.http.Browser(openRequestConnection)] ->
-->**External links are only visible to Support Staff**----------------Request------------------
GET /prot/Q_VbW21Bixx~/SLES-11-SP3-DVD-x86_64-GM-DVD2.iso?__tk1__=st=NNNNNN%20exp=NNNNNN%20acl=/prot/Q_VbW21Bixx~/*%20hmac=b19b9908c36b84efabcabcbacbacbacabcacbacbacbacd29f562426bd HTTP/1.1
Accept-Language: de, en-gb;q=0.9, en;q=0.8
Host: cdn2.novell.com
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Accept-Encoding:
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.10) Gecko/2009042523 Ubuntu/9.04 (jaunty) Firefox/3.0.10
Connection: close
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Pragma: no-cache
Cache-Control: no-cache

----------------Response------------------
HTTP/1.1 403 Forbidden
ETag: "390f0a860302637e798a4e86c7f2cd30:1362538385"
Date: Sat, 13 Jul 2013 19:23:52 GMT
Content-Length: 1238
Last-Modified: Wed, 06 Mar 2013 02:53:05 GMT
Connection: close
Content-Type: text/html
Accept-Ranges: bytes
Server: Apache

so most likely the case.

You're right in the v2 beta version the Novell links for download managers seem to be working ok.

[raztoki]

Sorry should have triggered earlier, stable has that issue.