JDownloader Community - Appwork GmbH
 

Go Back   JDownloader Community - Appwork GmbH > English Support > Host Plugin Reports
Reply
 
Thread Tools Display Modes
  #1  
Old 25.02.2019, 18:33
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default Adv. setting problem deviantart

A lot of files have downloaded HTML, you should download image eg *.jpg (in the Save as... browser) and save the photo.


Download html code instead of the media (files/pictures)? ENABLED

I do not want HTML only a photo

25.02.19 14.51.33 <--> 25.02.19 18.33.26 jdlog://4583676935451/
**External links are only visible to Support Staff****External links are only visible to Support Staff**



Screen:
https://postimg.cc/472XDcJt/110041af
Reply With Quote
  #2  
Old 25.02.2019, 18:36
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

I'm sorry but I don't understand. Why enable *download html code* if you DON'T want html? Disable it then?!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 25.02.2019, 18:45
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

But when I had the options turned off, a few or more downloaded HTML,
so what to do to ensure that all files are downloaded as an image?
ENABLED = All download HTML
DISABLED = Some files downloaded as HTML + image
Reply With Quote
  #4  
Old 25.02.2019, 18:48
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Please provide example links that returned html and image, then I can check those
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 25.02.2019, 19:19
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

It seems to me that the html caused by the link contains only text, no photos.


A Dark Lord's Control by Punisher2006_196094074.html
**External links are only visible to Support Staff****External links are only visible to Support Staff**
25.02.19 14.51.33 <--> 25.02.19 19.17.18 jdlog://1783676935451/
Reply With Quote
  #6  
Old 26.02.2019, 10:41
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Thanks for the example link.
Plugin is working fine. Link is text so JDownloader downloads the html.
So it's fine.

If you don't want those, either setup a filter rule or remove all non images after crawling is finished
__________________
JD-Dev & Server-Admin
Reply With Quote
  #7  
Old 26.02.2019, 10:52
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

But after decrypting, it does not show the file extension. So how to add to the excluded Unknown extension?
And checking the file extension is not practical because it takes too much time.
Just as the Starting.... of the file download is very slow (!), it can take hours to download one larger album.
But for me, an album with 3000 photos, is not so huge that it has to download so many hours (!)
Reply With Quote
  #8  
Old 26.02.2019, 11:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

You've got to enable linkcheck in plugin settings, else JDownloader cannot know in advance the type of a link
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 26.02.2019 at 11:51.
Reply With Quote
  #9  
Old 26.02.2019, 11:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Quote:
Originally Posted by djmakinera View Post
And checking the file extension is not practical because it takes too much time.
If you know a faster method, please let us know
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 26.02.2019, 11:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

I've found a way to determine this faster, wait for plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #11  
Old 26.02.2019, 12:15
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

After all, on the site we immediately notice what extension the file has, write on the download button


JPG:
Example: **External links are only visible to Support Staff****External links are only visible to Support Staff**
<span class="text">JPG 2976 × 3178</span>

RAR:
<span class="text">RAR download, 2.8 MB</span>
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #12  
Old 26.02.2019, 12:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

LOL? to get this information you have to load the website.
With enabled filecheck this works perfectly fine in JDownloader as well.

I really feel the urge to grant you new *time to think* ban.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #13  
Old 26.02.2019, 12:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Quote:
Originally Posted by djmakinera View Post
But after decrypting, it does not show the file extension.
It does not show any fileinformation/extension because YOU have set plugin to NOT do linkchecks.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #14  
Old 26.02.2019, 12:50
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Do not be stern with this ban. I just presented my idea, which is not necessarily good, but at least it seemed to me that it was, but if you know better, it seems entirely to you.

Quote:
because YOU have set plugin to NOT do linkchecks.
Because I do not see such a need.
Checking a single link takes a few seconds. E.g. 4 seconds.

4 second x 3000 links = 3.3 hours
Reply With Quote
  #15  
Old 26.02.2019, 12:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Please tell me a faster way and I'll be happy to add support for it.
How do you tell size/type of
deviantart.com/punisher2006/art/Why-Won-t-You-754595183

without opening the url in browser? I can't wait for this magic solution

You know that linkcheck is the same as opening the url in browser and looking for filesize/type, don't you?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #16  
Old 26.02.2019, 12:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Quote:
Originally Posted by djmakinera View Post
After all, on the site we immediately notice what extension the file has, write on the download button
To see that download button you have to open the link in browser and that's what a linkcheck is doing.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #17  
Old 26.02.2019, 13:05
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

Quote:
Originally Posted by Jiaz View Post
I've found a way to determine this faster, wait for plugin update
update is live. literature links will be recognized during crawling and correctly marked as html/.html so you can filter them. this new feature only works for user/gallery and /gallery links
__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 26.02.2019, 13:26
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

The file size does not matter to me (usually a dozen KB or a few MB).
I hope you did not get banned for this comparison:

TEST
BID
Checking extension 3000 links (150-200 second)

JD2
Checking extension 3000 links (12000 second)


I have no idea how it processes it, but for some reason it is much faster. Maybe someone has a better processing technique.

I do not go deeper into the details, because I only use JD2 to download files.


https://postimg.cc/s1wjn9Ym
Reply With Quote
  #19  
Old 26.02.2019, 13:27
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Quote:
Originally Posted by Jiaz View Post
update is live. literature links will be recognized during crawling and correctly marked as html/.html so you can filter them. this new feature only works for user/gallery and /gallery links
I will test.
Reply With Quote
  #20  
Old 26.02.2019, 14:51
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

I've added another plugin setting to skip filesize check which speeds up check
__________________
JD-Dev & Server-Admin
Reply With Quote
  #21  
Old 26.02.2019, 15:20
djmakinera djmakinera is offline
Banned
 
Join Date: May 2010
Location: Poland
Posts: 8,387
Default

Availability: All Links Online (After finishing - parsing gallery)


Manual Onlie Check Status: Offline
The page you were looking for doesn't exist. (404)

Single:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

JD2: Plugin Defect!a2008648

For individual links correctly shows OFFLINE, but for the whole gallery - no longer.
All:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #22  
Old 26.02.2019, 16:50
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

I'm sorry but I don't understand?!

clawdeen4ever.deviantart.com/art/Awesome-rainbow-dash-465483152
fails in browser as well. shown as offline in JD

the link is part of the following gallery.
deviantart.com/punisher2006/gallery/

individual links work fine here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #23  
Old 26.02.2019, 17:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,554
Default

I've released another update to ignore non supported/invalid urls
__________________
JD-Dev & Server-Admin
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 05:35.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.