JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 17.07.2019, 14:21
ayanami ayanami is offline
Baby Loader
 
Join Date: Mar 2017
Posts: 8
Lightbulb Can't grab pictures and videos on Twitter.com

Hi

Jdownloder2 link grabber cannot find pictures and videos on Twitter.com

Also, when I try to use a direct link to any picture or video. It see the file as an offline file / file not found.
Reply With Quote
  #2  
Old 17.07.2019, 15:06
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Testlinks please ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 17.07.2019, 19:11
ayanami ayanami is offline
Baby Loader
 
Join Date: Mar 2017
Posts: 8
Default

example twitter links:

video link: **External links are only visible to Support Staff****External links are only visible to Support Staff**

picture link : **External links are only visible to Support Staff****External links are only visible to Support Staff**

twitter Page link: **External links are only visible to Support Staff****External links are only visible to Support Staff**

(Normally Jdownloader2 link grabber will analyse the whole twitter page to get pictures and videos but now it can find nothing when I put the Twitter page link on LinkGrabber.)
Reply With Quote
  #4  
Old 17.07.2019, 21:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

For me, everything works fine.
It found over 700 URLs when I added the profile, then I stopped the crawl process.

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 18.07.2019, 13:05
ayanami ayanami is offline
Baby Loader
 
Join Date: Mar 2017
Posts: 8
Default

It is working now.

The program works ok when I use Jdownloader2 without using my twitter account.
So, I guess it might be some problem with my twitter account.
Reply With Quote
  #6  
Old 18.07.2019, 15:40
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

If you want me to check this, you may send me your twitter logindata via PN.

My test-twitter account was banned and I'm currently not planning to create a 2nd one - especially as they now always want to have a phone number ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 19.07.2019, 10:15
matzebob
Guest
 
Posts: n/a
Default

I can confirm the issue, neither direct links to tweets nor profile links can grab anything.

19.07.19 14.41.16 <--> 19.07.19 14.43.47 jdlog://0272186935451/
Reply With Quote
  #8  
Old 19.07.2019, 16:06
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

@matzebob: your log doesn't contain any activity
Enable Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader and create new logs
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 21.07.2019, 13:34
matzebob
Guest
 
Posts: n/a
Default

21.07.19 18.30.08 <--> 21.07.19 18.32.08 jdlog://5353186935451/

Mea Culpa, debugging turned on in the logfile options.

Linksauce: **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #10  
Old 17.08.2019, 21:18
Alexo_ Alexo_ is offline
Vacuum Cleaner
 
Join Date: Oct 2017
Posts: 19
Default

twitter didnt work, so ill try to unistall and install a clean version.
Reply With Quote
  #11  
Old 17.08.2019, 21:21
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by matzebob View Post
21.07.19 18.30.08 <--> 21.07.19 18.32.08 jdlog://5353186935451/

Mea Culpa, debugging turned on in the logfile options.[...]
Works fine here!

Quote:
Originally Posted by Alexo_ View Post
twitter didnt work, so ill try to unistall and install a clean version.
???
Sorry I don't understand your post!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #12  
Old 18.08.2019, 14:45
serrato serrato is offline
Giga Loader
 
Join Date: Dec 2017
Posts: 99
Default

Same here, twitter suddenly stopped working. It was fine at least a couple of weeks ago and it just stopped. Made no changes on my end, kept up with updates, etc.
Reply With Quote
  #13  
Old 18.08.2019, 16:37
tony2long's Avatar
tony2long tony2long is offline
English Supporter
 
Join Date: Jun 2009
Posts: 6,507
Default

Please try again.

@pspzockerscene
{"errors":[{"code":239,"message":"Bad guest token."}]}
at jd.plugins.hoster.TwitterCom.requestFileInformation(TwitterCom.java:185)
guest_token was re-used and was OK, but after some time, that error occur.
__________________
FAQ: How to upload a Log
Reply With Quote
  #14  
Old 20.08.2019, 21:15
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Try again after the next update.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #15  
Old 03.09.2019, 00:32
ymcdc ymcdc is offline
Baby Loader
 
Join Date: Mar 2016
Posts: 8
Default

Got the same problem,
but only happens when I login my twitter account.
If I can't login how to download protected twitter account?

Thanks.
Reply With Quote
  #16  
Old 03.09.2019, 18:47
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Please create a debug log. Enable Settings-Advanced Settings-Log.debugmodeenabled and restart JDownloader
now enable the account account and wait for error and then create a log, see https://support.jdownloader.org/Know...d-session-logs
and post shown logID here
__________________
JD-Dev & Server-Admin
Reply With Quote
  #17  
Old 20.09.2019, 07:54
serrato serrato is offline
Giga Loader
 
Join Date: Dec 2017
Posts: 99
Default

Yeah when I logged out of my account, it then successfully grabbed links. Seems to not work if logged in.
Reply With Quote
  #18  
Old 04.11.2019, 23:52
chris0192 chris0192 is offline
DSL User
 
Join Date: Mar 2015
Posts: 35
Default

Quote:
Originally Posted by serrato View Post
Yeah when I logged out of my account, it then successfully grabbed links. Seems to not work if logged in.
Quote:
Originally Posted by ymcdc View Post
Got the same problem,
but only happens when I login my twitter account.
If I can't login how to download protected twitter account?

Thanks.

Exactly the same here. Without login it works fine. I have this problem since couple months. I spotted that Twitter change it's Layout when i login. Don't know if it has something to do with it.

Last edited by chris0192; 04.11.2019 at 23:55.
Reply With Quote
  #19  
Old 05.11.2019, 16:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

Quote:
Originally Posted by chris0192 View Post
I spotted that Twitter change it's Layout when i login. Don't know if it has something to do with it.
That's indeed a useful information!
__________________
JD-Dev & Server-Admin
Reply With Quote
  #20  
Old 05.11.2019, 16:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,286
Default

__________________
JD-Dev & Server-Admin
Reply With Quote
  #21  
Old 02.12.2019, 18:39
beronz beronz is offline
JD Beta
 
Join Date: Jun 2019
Posts: 50
Default twitter.com

I have never been able to download any photo\video from twitter, i usually do "mass dump" downloading of the accounts i'm interested and for example instagram has always worked smoothlessly

instead twitter never worked

link of example (and you can understand why this is very important, lol)

**External links are only visible to Support Staff****External links are only visible to Support Staff**

if you need something, tell me (i know i have to give you a log but i don't know if you can see something, JD doesnt show me anything from twitter when i try to copy paste something)
Reply With Quote
  #22  
Old 02.12.2019, 18:46
beronz beronz is offline
JD Beta
 
Join Date: Jun 2019
Posts: 50
Default

i've created the log

this is the link of the page

**External links are only visible to Support Staff****External links are only visible to Support Staff**

this on of the video that gives me error

**External links are only visible to Support Staff****External links are only visible to Support Staff**

here's the log

02.12.19 17.43.55 <--> 02.12.19 17.44.51 jdlog://3056230900751/
Reply With Quote
  #23  
Old 26.12.2019, 09:17
Akasen Akasen is offline
DSL Light User
 
Join Date: Jul 2017
Posts: 34
Default Unable to Download From Twitter When Login Information Is In

So I've had this issue I'm reporting for a couple months now I think? I do apologize for not having brought this up earlier.

So I'm having an issue where if any login information is input for the Twitter Plugin, it is unable to do anything at all it seems. Whether the info I put in is for a Protected account or Regular account, nada.

And further note, also doesn't matter if the Twitter account I'm trying to download is also a protected account or not. Nothing

The first log I'm posting is tested with a Protected Account information input, and the second with a regular account, no protection.

Third log is just me adding the links of an unprotected twitter account and a protected twitter account to also maybe give info in the logs for what happens with a success of any kind. That's with NO account info at all enabled, inputted, or the like.

26.12.19 01.43.17 <--> 26.12.19 02.05.25 jdlog://2482330900751/

26.12.19 01.43.17 <--> 26.12.19 02.10.34 jdlog://7482330900751/

26.12.19 01.43.17 <--> 26.12.19 02.13.52 jdlog://8482330900751/
Reply With Quote
  #24  
Old 20.01.2020, 21:34
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Twitter login functionality is- and probably will remain broken.

Also - why did you try to login while an account is not required to view the content you want to download?

I've disabled twitter login functionality completely with the next update.

Also I was unable to reproduce your video downloading issues.
If you still have issues with downloading videos from Twitter, please post example URLs and a log ...

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #25  
Old 30.01.2020, 03:09
rominatrix
Guest
 
Posts: n/a
Default

In case this is useful, since I am having the same problem, I enabled debug mode and created 2 examples:
1. trying to download one video
2. trying to crawl through a user feed (i remember more than one time having to abort linkgrabber because it would start grabbing every image or video)

This is the log: 29.01.20 22.05.48 <--> 29.01.20 22.07.43 jdlog://0632430900751/


I never added an account btw.

Last edited by rominatrix; 30.01.2020 at 03:11. Reason: adding information
Reply With Quote
  #26  
Old 30.01.2020, 11:48
groinksan groinksan is offline
Wind Gust
 
Join Date: Dec 2018
Posts: 42
Default

I'm having problems as well. Fresh install of JDownloader and fresh new settings. When I copy the URL, LinkGrabber doesn't even blink. I tried manually adding the new link, and the LinkGrabber spins for only one second, and then it gives up.

29.01.20 23.42.14 <--> 29.01.20 23.38.21 jdlog://8142430900751/

I thought it may be because of a lack of an account. Tried adding one in Account Manager - says the host I'm searching for is not yet supported.
Reply With Quote
  #27  
Old 30.01.2020, 21:54
daemontohno
Guest
 
Posts: n/a
Default

30.01.20 14.54.23 <--> 30.01.20 14.54.49 jdlog://3552430900751/

Same issue here. For me, the problem not only happens with Twitter, but with other sites I've used as well. An example:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

About two or so weeks ago I could copy this URL to the clipboard and JDownloader would crawl the page, but now it only shows a clipboard icon on the bottom right and doesn't do anything.

My experience was that the issue would happen occasionally about two weeks ago (on Twitter), but would ultimately work after recopying the link once or twice or adding it manually. Now, it might work after a much larger number of attempts.

Last edited by daemontohno; 30.01.2020 at 21:55. Reason: fixing formatting
Reply With Quote
  #28  
Old 30.01.2020, 22:31
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default Twitter files are offline

Downloading status links from users including links, pictures and videos always worked but now it says the files are offline although it perfectly works in the browser even when not logged in.


Example:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #29  
Old 30.01.2020, 22:47
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by rominatrix View Post
In case this is useful, since I am having the same problem, I enabled debug mode and created 2 examples:
1. trying to download one video
I've fixed this for the next update as stated here:
https://board.jdownloader.org/showthread.php?t=79626

Quote:
Originally Posted by groinksan View Post
I thought it may be because of a lack of an account. Tried adding one in Account Manager - says the host I'm searching for is not yet supported.
Nope your content is public thus an account is not required.

Also, I've disabled account support for twitter with the last update as it is broken and unlikely to get fixed any time soon.

I've fixed the profile crawler too though it will be much much slower than before!

Quote:
Originally Posted by daemontohno View Post
Same issue here. For me, the problem not only happens with Twitter, but with other sites I've used as well. An example:
This is not a JDownloader issue.
JDownloader does not have any plugin for your mentioned website.
You can automate the process via link crawler rules though, at lest if the information here is still valid:
https://board.jdownloader.org/showthread.php?t=72339

Quote:
Originally Posted by daemontohno View Post
About two or so weeks ago I could copy this URL to the clipboard and JDownloader would crawl the page, but now it only shows a clipboard icon on the bottom right and doesn't do anything.

My experience was that the issue would happen occasionally about two weeks ago (on Twitter), but would ultimately work after recopying the link once or twice or adding it manually. Now, it might work after a much larger number of attempts.
As said - fixed!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #30  
Old 30.01.2020, 23:58
daemontohno
Guest
 
Posts: n/a
Default

Thanks for the quick response!

Yeah, I realized after the fact that the link I gave actually DID work, I just needed to add it in manually. My mistake.
Reply With Quote
  #31  
Old 31.01.2020, 18:54
lokan lokan is offline
Baby Loader
 
Join Date: Mar 2011
Posts: 7
Default

.

Last edited by lokan; 02.11.2022 at 20:54.
Reply With Quote
  #32  
Old 01.02.2020, 02:42
daemontohno
Guest
 
Posts: n/a
Default

I'm using the latest update as well.

JDownloader is finding images on twitter now, but it doesn't seem to crawl deep enough to get everything (or maybe it's something on my end). I'm getting around 15-20 images at most.

I used to be able to copy a twitter url to the clipboard and JDownloader would find not only the twitter account's tweets, but retweets as well. For me, it doesn't matter if I'm logged in or not.

Here's my log file if you need it:

31.01.20 19.40.40 <--> 31.01.20 19.41.30 jdlog://4682430900751/
Reply With Quote
  #33  
Old 01.02.2020, 02:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by daemontohno View Post
Thanks for the quick response!
Thanks for your feedback!

Quote:
Originally Posted by daemontohno View Post
Yeah, I realized after the fact that the link I gave actually DID work, I just needed to add it in manually. My mistake.
No worries

Quote:
Originally Posted by lokan View Post
[...]
While it doesn't say offline when grabbing the link now, there are 2 problems I saw.
When there is more than 1 photo in a tweet, it only grabs the link for the first photo and not the other photos.
As always, I need example URLs for every error case.

Quote:
Originally Posted by lokan View Post
Also, it only grabs the small version of the photo, not the original (orig) size that is available.
I've updated the plugin to replace the quality modifier to ":orig".
You will have to re-add previously added URLs after the update for the changes to work!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 01.02.2020 at 02:52.
Reply With Quote
  #34  
Old 01.02.2020, 02:51
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Quote:
Originally Posted by lokan View Post
Using the latest update (build date Jan 31 16:22:46).
While it doesn't say offline when grabbing the link now, there are 2 problems I saw.
When there is more than 1 photo in a tweet, it only grabs the link for the first photo and not the other photos.
Also, it only grabs the small version of the photo, not the original (orig) size that is available.
I have the same problem after the update. Some links are still offline when copying many links and all pictures are not original size.
Reply With Quote
  #35  
Old 01.02.2020, 02:52
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by accelheim View Post
I have the same problem after the update. Some links are still offline when copying many links and all pictures are not original size.
Please read my post above yours.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #36  
Old 01.02.2020, 08:43
lokan lokan is offline
Baby Loader
 
Join Date: Mar 2011
Posts: 7
Default

.

Last edited by lokan; 02.11.2022 at 20:54.
Reply With Quote
  #37  
Old 01.02.2020, 21:40
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Although it now downloads the pictures in original quality, there are still many links that doesn't work and are offline.

Some links which where offline this time are

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #38  
Old 02.02.2020, 02:39
groinksan groinksan is offline
Wind Gust
 
Join Date: Dec 2018
Posts: 42
Default

Wow, the Twitter plug-in is completely useless. Tried scraping through a page with thousands of imagery - not one image was found. Tried scraping a page with hundreds of videos - found two or three, and that was it. The plug-in no longer grabs re-tweets like it once did.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by groinksan; 02.02.2020 at 02:57.
Reply With Quote
  #39  
Old 02.02.2020, 07:03
Telephoton
Guest
 
Posts: n/a
Default I have the same problem

It has been working on and off but has gotten worse over the past few days. It started out that I had to click copy link to tweet or link to video address. Then link to tweet stopped working most of the time so I just went to copying video address. Then that stopped working so I was able to alternate between each multiple times and eventually it would recognize the link was online. This has gotten to the point now that it's basically impossible to download a video in a timely manner.

Just today it got better for some videos but it still only works occasionally with copying the video address directly not copying tweet link. I still have to use a video downloader website.
Reply With Quote
  #40  
Old 03.02.2020, 19:04
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by lokan View Post
Here are some URLs with multiple photos. It happens with all tweets for me.
I can download the content I get without any issues.

Quote:
Originally Posted by accelheim View Post
Although it now downloads the pictures in original quality, there are still many links that doesn't work and are offline.

Some links which where offline this time are
Twitter has changed their website.

We are currently using their legacy website mobile.twitter.com which will only work if you disable java script.
It seems like this is missing a lot of newer twitter features because:
- If a post contains multiple pictures, only the first one can be displayed
- If a post contains NSFW content, it won't get displayed at all

I'am currently unable to give any ETA on when/if ever we can fully fix our twitter plugin!

Quote:
Originally Posted by Telephoton View Post
I still have to use a video downloader website.
Please read my post.
Also, please post your mentioned video URLs so that I can check/fix this.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 21:01.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.