JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 18.01.2022, 01:06
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 82
Default [NOT a JD bug] TikTok issue - picks up duet videos when copying parts of html source

After they updated web version when I Ctrl+A all liked videos JD is downloading also original video that was "duet" with.

Example.
1. Like this video:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
2. Go to your likes
3. CTRL+A and CTRL+V to JD
4. JD will add 2 videos. This:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
And this:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Also sometimes when I downloading 40-50 videos it's creating new package with username of tiktok user but I only CTRL+A all my liked videos and nothing else. I can't catch it, but it's happened 2 times already. I think you can test it just by liking 40-50 videos and try to add them into JD.

Core: 45328
Log when I catch these issues 18.01.22 03.05.28 <--> 18.01.22 03.06.46 jdlog://3293925302851/
Reply With Quote
  #2  
Old 18.01.2022, 14:37
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

I'm sorry but I don't really understand your report and I do not have a tiktok account for testing.

Whenever you copy content from websites you may also copy advertising/"recommended" videos/content that you don't want.
This is nothing that JD has any control over - it will just parse whatever you copy.
I doubt that there is anything we can do about it.
You should probably look for a script/browser addon that will scrape all URLs of your liked items so you can add them to JD then nothing can go wrong.

Regarding your package name issue:
My guess is that you also added some profile URLs - probably by mistake.
In this case, JD will crawl the first (up to 30) items of that profile and put them into a package named after the profile.
You can test this with any tiktok profile URL in this format:
tiktok.com/@username

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 18.01.2022, 15:31
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 82
Default

Quote:
Originally Posted by pspzockerscene View Post
I'm sorry but I don't really understand your report and I do not have a tiktok account for testing.

Whenever you copy content from websites you may also copy advertising/"recommended" videos/content that you don't want.
This is nothing that JD has any control over - it will just parse whatever you copy.
I doubt that there is anything we can do about it.
You should probably look for a script/browser addon that will scrape all URLs of your liked items so you can add them to JD then nothing can go wrong.

Regarding your package name issue:
My guess is that you also added some profile URLs - probably by mistake.
In this case, JD will crawl the first (up to 30) items of that profile and put them into a package named after the profile.
You can test this with any tiktok profile URL in this format:
tiktok.com/@username

-psp-
JD is still parsing videos from "duet" even if I adblock this element. I don't even open this video so I don't know why JD parses original video from "duet". Before they update web-version of their site it didn't happen. I only select all (ctrl+a) videos from my likes without opening them 1 by 1.

You don't have plans to add tiktok support to do scrape links without any other scripts?
Reply With Quote
  #4  
Old 18.01.2022, 16:08
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Quote:
Originally Posted by Neurotoxin001 View Post
JD is still parsing videos from "duet" even if I adblock this element.
I don't even open this video so I don't know why JD parses original video from "duet".
Yes because those URLs are probably part of the context of what you copy.
You might be able to get only the elements you want using browser extensions like "Link Gopher":
Firefox:
addons.mozilla.org/de/firefox/addon/link-gopher/
Chrome:
chrome.google.com/webstore/detail/link-gopher/bpjdkodgnbfalgghnbeggfbfjpcfamkf

I don't even know what "duet" videos are and even if I would:
Without test-account and URLs I won't be able to test/reproduce it.

Do those URLs that you don't want to have follow a specific pattern, have similarities in their filenames or are all of them from the same user?
If so, you could as well block them using a LinkGrabber filter.

Quote:
Originally Posted by Neurotoxin001 View Post
You don't have plans to add tiktok support to do scrape links without any other scripts?
That request would be related to the tiktok profile crawler feature request.
Please do not expect any progress on this.
(Yes we do have a profile crawler at this moment but it will only find the first X items and we do not have any kind of tiktok account support (yet).)

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 18.01.2022, 16:51
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 82
Default

Quote:
I don't even know what "duet" videos are and even if I would:
Without test-account and URLs I won't be able to test/reproduce it.
Duets is like some users can "react" on your video.

This url:
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Have this thing:
https://i.imgur.com/BxaE8td.png
And if you click on @80babeyy username you will get original video:
**External links are only visible to Support Staff****External links are only visible to Support Staff**

So JD is downloading both - duet and original
Reply With Quote
  #6  
Old 18.01.2022, 17:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

As said it's not a bug that this gets added when you copy parts of the html source...because you will also copy this URL.

I was looking in their metadata to see if there is any information like "video is of type 'duet'" and so far I was unable to find anything.
...this way you could have filtered it by filename/metadata.

I don't really see any solution other than:
- Copying only exactly the URLs you want (without selecting parts of the page --> only rightclick -> Copy URL location or if the video is open in your current browser tab, only copy that current tabs url address)
- See my browser addon hints in my last reply

If any user finds information inside tiktoks metadata on "duets" it's not a problem for me to add this as a plugin property so you could filter such items by packagizer.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 19.01.2022, 19:44
Neurotoxin001's Avatar
Neurotoxin001 Neurotoxin001 is offline
Linkgrabbing Monster
 
Join Date: Feb 2021
Posts: 82
Default

I found reason of that issue. See:
https://i.imgur.com/hmLRa5A.png

They added video description in "Your likes" page so when I select all on that page all these @nicks and links is also copied. After I block this element with uBlock all become fine as before.
Reply With Quote
  #8  
Old 20.01.2022, 16:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,088
Default

Nice!
Thanks for your feedback.

Please still keep in mind that the issue you had is not related to JDownloader and simply happened because tiktok has changed the layout of their website.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 19:04.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.