JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 19.06.2022, 09:16
umbala umbala is offline
Vacuum Cleaner
 
Join Date: Apr 2022
Posts: 19
Default TikTok videos missing videoID when using profile crawler mode

I'm using the following Packagizer rule with the TikTok plugin:

<jd:prop:username>_<jd:prop:date>_<jd:prop:videoid>.mp4

If I go to someone's profile and highlight some videos, and then copy the link, everything works as expected. I get a filename like this:

UserName_2022-06-06_6973928623556300033.mp4

But if I try to use the profile crawler mode and I copy the person's profile link instead of copying specific video links, then the videoID portion is missing. I end with filenames like this:

UserName_2022-06-06_.mp4

Is there a way to use the new profile crawler mode and still be able to modify the filename the way I'm trying to do above?
Reply With Quote
  #2  
Old 19.06.2022, 10:00
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,288
Default

@umbala: videoid property will be available/set in profile crawler with next plugin update
__________________
JD-Dev & Server-Admin
Reply With Quote
  #3  
Old 19.06.2022, 10:32
umbala umbala is offline
Vacuum Cleaner
 
Join Date: Apr 2022
Posts: 19
Default

Ok, thank you, sounds great.

I was wondering if there are any future plans to add crawling support on TikTok for areas other than profiles? (I was hoping for crawling in /tags/ or /music/ links.)
Reply With Quote
  #4  
Old 19.06.2022, 10:46
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,288
Default

@umbala: no plans at the moment but never say never.
We can check how much work it would be to add simple support for it.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5  
Old 19.06.2022, 18:15
umbala umbala is offline
Vacuum Cleaner
 
Join Date: Apr 2022
Posts: 19
Default

Alright, thanks for the reply and thanks for the great software.
Reply With Quote
  #6  
Old 20.06.2022, 13:47
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by umbala View Post
I was wondering if there are any future plans to add crawling support on TikTok for areas other than profiles? (I was hoping for crawling in /tags/ or /music/ links.)
Please provide example URLs.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 25.06.2022, 08:18
hgore hgore is offline
Modem User
 
Join Date: Jun 2022
Posts: 2
Default

i really hope jdownloader can grab HD quality videos from tiktok
theres online web based tiktok downloader site can download no watermark HD quality videos that actually higher quality with sizes over 10mb rather than 800kib to 2mb
i think they are user uploaded source videos that stored somewhere in tiktok server
Reply With Quote
  #8  
Old 25.06.2022, 09:10
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,288
Default

@hgore: Please provide example tiktok links so we can check it.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #9  
Old 25.06.2022, 09:11
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,288
Default

Quote:
Originally Posted by hgore View Post
quality videos that actually higher quality with sizes over 10mb rather than 800kib to 2mb
Sure they are real higher quality and not just converted/upscaled? what website for example?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #10  
Old 25.06.2022, 09:44
umbala umbala is offline
Vacuum Cleaner
 
Join Date: Apr 2022
Posts: 19
Default

Quote:
Originally Posted by pspzockerscene View Post
Please provide example URLs.
Sorry for the late reply. Here are some /tag/ examples:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

And some /music/ examples:

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**

Some of those /music/ folders have 200k+ clips in them. When scrolling down the list in a browser it won't show more than 2-3k videos from any /music/ folder. I wonder if that's an API limitation or if it's possible to crawl for every clip.
Reply With Quote
  #11  
Old 25.06.2022, 10:33
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,288
Default

@umbala: thanks, we'll look into it
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 25.06.2022 at 10:39.
Reply With Quote
  #12  
Old 27.06.2022, 15:55
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

@umbala
/tag/bla URLs will be supported with our next set of CORE-updates.

By default JD will crawl max 20 items because tags can contain an "infinite" number of results and crawling more may as well trigger tiktoks bot protection and/or let you run into rate-limits faster.
You can change/remove this limitation under: Settings -> Plugins -> tiktok.com

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #13  
Old 27.06.2022, 16:11
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Update regarding "/music" URLs:
Seems like the tiktok API which handles that is broken at least I was unable to make it work and using the popular open source download project "yt-dlp", their extractor/crawler does support such URLs but it fails too.

If you find more information on this please let us know - we'll add support for "/music" URLs then.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 21:45.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.