JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 07.02.2016, 14:36
sinbatm
Guest
 
Posts: n/a
Default Tumblr.com

Hello there!

I´ve been using jdownloader2 to download tumblr files with no problem until a few days ago
Since then I'm able to download only images but no videos
I don't know where is the problem
Anyy idea?

Thanks in advance
Sinbatm
Reply With Quote
  #2  
Old 07.02.2016, 14:49
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

@sinbatm

please provide links so I can test with

thanks
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #3  
Old 07.02.2016, 15:26
sinbatm
Guest
 
Posts: n/a
Default

An example:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

A couple of weeks ago I didin't have problems downloading all the stuff
Reply With Quote
  #4  
Old 07.02.2016, 18:57
sinbatm
Guest
 
Posts: n/a
Default

Excuse me, but it seems that it has nothing to be with the URL used.

I,ve redownloaded links that I downloaded 1 month ago without any problem (.jpg, .GIF. and .mp4) but know it doesn´t grab the -mp4 files.

It seems like if some preference were disabled

?
Reply With Quote
  #5  
Old 08.02.2016, 14:19
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #6  
Old 08.02.2016, 18:40
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Looked at this when I woke up yesterday,

first link failed due to changes on tumblr and how they show vine links, now via iframe html tag.
second link works as intended.
third I need to fix more (I wont commit just yet.)
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #7  
Old 08.02.2016, 21:28
sinbatm
Guest
 
Posts: n/a
Default

Thanks for your time and help Raztoki

But still having same problems
If I copy de URL: **External links are only visible to Support Staff****External links are only visible to Support Staff**
... it just add to jdownloader2 the links of the 4 video files with youtube movies.
But the page has a total of 20 movies (4 from youtube and the others "embedded")

It seems that jdownloader ignores the embedded video files (no problems with .jpg, .GIF and .mp4 videos from youtube.

The strange thing is that previously I didn't have probles with the same URL and all 20 archives were downloaded. And I'm not concerned to have changed any preference of the program

It seems that from about 2 weeks to date jdownloader2 ignores all the embedded videos of all the tumblr URL's I copy

Could it be that I have make any unconscious change in the program options?

I don't see a specific complement (plugin) for tumblr in the options of the program (as there are plugins for youtube, vimeo, uploaded.net, etc.

Do I have to have a plugin for tumblr?

Thanks again
Sinbatm
Reply With Quote
  #8  
Old 09.02.2016, 00:47
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

I haven't made my changes live yet so, you're still using the old plugin. Tumblr doesn't host all of there own content, but linked via iframes or what not. In doing so we need to look for these links, and not always will we have the regex patterns present to pick up this linked content.

there are only plugin settings, when plugin settings are required, so far its not required for tumblr

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #9  
Old 09.02.2016, 18:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,918
Default

raztoki as you wrote you worked on this, I assigned the ticket to you.

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 10.02.2016, 16:38
sinbatm
Guest
 
Posts: n/a
Default

First of all, thanks and excuse me for my poor english

I,ve check a few things and the problem seems to be a recent update of the program that does not allow to grab and download embedded video files from http_tumblr.com.

I,ve run an old version of jdownloader2 installed on a powerbook that I've not use long ago. [jdownloader2 Version may 19 10:52:29 CET 2015].
- With URL= **External links are only visible to Support Staff****External links are only visible to Support Staff** it grabs all the files, including embedded videos
Server
- http_tumblr.com 30
- http_ytimg.com 5
- youtube.com 12

All files are downloaded without any problem

After that, I up todate the program [jdownloader2 Version mon Feb 08 13:55:15 CET 2016] and tried again. The result:

- youtube.com 12

Nothing from - http_tumblr.com or http_ytimg.com.

When trying other URLs, it grabs links from http_tumblr.com but only the image ones, not videos.

So, as far as I see:
-The problem is not in the URL (the old jdownloader version gets all the links of the URLs)
-The update of the program doesn´t allow to grab/download video files (embedded) from http_tumblr.com
Reply With Quote
  #11  
Old 10.02.2016, 17:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,918
Default

Thanks for the information.
Please wait for developer feedback from raztoki.

GreeZ psp
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 11.02.2016, 09:26
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

@sinbatm
/archive is a unsupported link format at this stage (I've re-added it with my next commit). As I tightened up the regex patterns as it was finding to many false positives.

you must have deep decrypted and that will find false positives.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #13  
Old 11.02.2016, 23:44
sinbatm
Guest
 
Posts: n/a
Default

Thanks raztoki

But it is the same with *.tumblr.com/
**External links are only visible to Support Staff****External links are only visible to Support Staff** grabs exactly the same archives as *.tumblr.com/archive

As I told before, the problem seems to be a recent update.
Previously jdownloader grabbed all the links with no problem with the same URLs
And yesterday it grabbed all the links with an old version but again only the youtube videos when I updated the program

By the way I don't know what means to "have deep decrypted"

Sinbatm
Reply With Quote
  #14  
Old 12.02.2016, 06:33
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

committed changes

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #15  
Old 13.02.2016, 20:18
sinbatm
Guest
 
Posts: n/a
Default

SOLVED!!!!!
Thanks al lot Raztoki!!!

Sinbatm
Reply With Quote
  #16  
Old 15.02.2016, 08:42
future2004eg
Guest
 
Posts: n/a
Default Tumblr

Hi,

Since the last update 3 days back, jdownloader is not able to grab all images from Tumblr permalink. It grabs only the 1st image. It used to work fine and I think something now is broken.

Some example links:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

I didn't have such problem downloading all the stuff before..

Thanks in advanced..
Reply With Quote
  #17  
Old 15.02.2016, 10:21
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #18  
Old 15.02.2016, 15:07
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Thanks for report, I tried finding links like this and could not, so I removed the code and thought it be either reported (like you did) or feature had gone.

I've reintroduced support for photosets.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #19  
Old 16.02.2016, 03:51
future2004eg
Guest
 
Posts: n/a
Default

Thank you, it works now to grab the images but only for some links and when it downloads the images it gives MD5 CRC failed, ex:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

For some other links it will not grab any images at all, not even the 1st image, ex:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by future2004eg; 16.02.2016 at 05:13.
Reply With Quote
  #20  
Old 16.02.2016, 09:58
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

ok sorry my md5 checksum assumptions were wrong. I only tested couple links yesterday and they matched the url. others do not, so maybe the checksum present is of original file.

the other failed due to typo in regex pattern which i've now fixed.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #21  
Old 16.02.2016, 10:00
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

Thanks, I've reopened the ticket
__________________
JD-Dev & Server-Admin
Reply With Quote
  #22  
Old 16.02.2016, 10:07
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

no need too... beat you by 5minutes ;p
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #23  
Old 16.02.2016, 10:21
future2004eg
Guest
 
Posts: n/a
Default

The CRC error is fixed, but still for the following link it grabbed just the 1st image not the 5 or 6 images in the photoset, For some other links it grabs all images so I don't know what is the difference.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by future2004eg; 16.02.2016 at 10:37.
Reply With Quote
  #24  
Old 16.02.2016, 11:15
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

tumblr allows/has so many different templates which makes it hard to use generic regex.

should work now regardless
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #25  
Old 16.02.2016, 12:06
future2004eg
Guest
 
Posts: n/a
Default

Different templates could be the explanation really because until now it worked with the 1st link but didn't work with the 2nd. Sorry for that...
Reply With Quote
  #26  
Old 19.02.2016, 10:28
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Confirm, JD only gets one picture for second link: **External links are only visible to Support Staff****External links are only visible to Support Staff**
__________________
FAQ: How to upload a Log
Reply With Quote
  #27  
Old 19.02.2016, 10:56
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Sorry thought I fixed it already

fixed now

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #28  
Old 20.02.2016, 09:56
future2004eg
Guest
 
Posts: n/a
Default

Excellent, thank you so much, getting only one picture is now solved.

I hope it is not so much but I think I just stuck with another problem, some posts are not getting any images at all and return error "Offline Files", I include some example links from different blogs with the same error for better analysis. Some other posts in the same blogs work fine.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Thanks in advanced
Reply With Quote
  #29  
Old 21.02.2016, 03:44
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

@future2004eg

thetruthwillshine.tumblr.com/post/139094421362 works fine

rest suffered from the same error which now I fixed
there was null value which then created NPE

thanks for report.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #30  
Old 21.02.2016, 19:40
wanko wanko is offline
JD VIP
 
Join Date: Aug 2015
Posts: 300
Default Tumblr and packages

when i check tumblr, most of tumblr links will add (more package) than one (total) like before

example : **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #31  
Old 22.02.2016, 01:11
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

packages names are only set for /post/ or profile decrypt which have more than one result, which is how it worked previously, if I recall correctly.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #32  
Old 24.02.2016, 07:58
future2004eg
Guest
 
Posts: n/a
Default

It seems still some cases when JD only gets only one picture not the full photo set as on the following 3 blogs, ex:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

The following posts don't get any photo but other posts in the blogs work:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Also I have a quick question, was the support for tags removed from the plugin? I remember I used to use it to grab specific tagged posts from the blog but now JD doesn't respect the tag and grab the full blog....

Thanks in advanced.....
Reply With Quote
  #33  
Old 24.02.2016, 12:52
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,289
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #34  
Old 25.02.2016, 11:26
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

should be fixed

last two links is core issue as I see it. Jiaz is looking into it.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #35  
Old 25.02.2016, 19:08
future2004eg
Guest
 
Posts: n/a
Default

Works now, thank you so much. How about the tags question?
Reply With Quote
  #36  
Old 26.02.2016, 01:38
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

Sorry I just checked the links, and forgot to come back to the bottom question.

What are tags? screen shot me? as I don't use tumblr so not following.

previously it used to look at commenter and picked up there /posts/ references which meant the plugin lead into infinite like task. I now isolate all content to prevent comment/shares/originals
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #37  
Old 26.02.2016, 09:11
future2004eg
Guest
 
Posts: n/a
Default

Tags are optional keywords that the poster put while posting to make it easier for readers to find posts about a specific topic on the blog (it is not in the comments).

For ex, the following post has 3 tags, "mio scrittore", "Suzy Kassem", and "ossessione"
**External links are only visible to Support Staff****External links are only visible to Support Staff**

While this blog has hundreds of posts, if you follow the following link you will find that only 8 posts has the tag "Suzy-Kassem"
**External links are only visible to Support Staff****External links are only visible to Support Staff**

If you enter the previous link into linkgrabber, JD should follow only these 8 posts and return its contents. Currently JD ignores that and continue to parse the complete blog.

Please note that the tag result could be divided into pages if the result is high and will take the url format:
xxxxxxx.tumblr.com/tagged/Suzy-Kassem/page/2
xxxxxxx.tumblr.com/tagged/Suzy-Kassem/page/3 etc.....

Last edited by future2004eg; 26.02.2016 at 09:17.
Reply With Quote
  #38  
Old 26.02.2016, 09:50
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,611
Default

sorry no tags are not supported, nor were they supported previously other than really bad regex, there was a .+ which allowed all pages effectly... and I no longer allow this because it returns errors for all the non official supported content.

I don't foresee us adding support for tags at this point in time.

raztoki
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #39  
Old 26.02.2016, 09:56
future2004eg
Guest
 
Posts: n/a
Default

Ok, thank you for the answer, it is not a big deal anyway.....
Reply With Quote
  #40  
Old 27.02.2016, 08:20
future2004eg
Guest
 
Posts: n/a
Default

Hi,
I believe the plugin needs a way to shorten the file names, some posts have very long title and case the file names to exceed the 255 character and JD get an error "Invalid download directory" while try to download it....

**External links are only visible to Support Staff****External links are only visible to Support Staff**

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 14:49.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.