[zylaxabi]

After the recent update JD stopped being able to grab videos from private profiles even when connected to an account with access to those videos & using website download mode. If we can get a fix to this that would be greatly appreciated.

Thanks for everything as always.

[pspzockerscene]

Merged tiktok profile crawler threads.
Please read the existing posts in this thread especially my update post here.

@zylaxabi
Which feature was working and is broken now according to you?
As explaioned in the other post, our tiktok profile crawler has nearly never been working completely.

[goldensun87]

Originally Posted by zylaxabi

After the recent update JD stopped being able to grab videos from private profiles even when connected to an account with access to those videos & using website download mode. If we can get a fix to this that would be greatly appreciated.

Thanks for everything as always.

I made my own guide detailing how I download TikTok profiles. It doesn't have visual steps like JD guides do, but I hope it will still be helpful.

pastebin.com/ZbMUf5kS

If the link is not visible, it is a pastebin link, and the link ID is ZbMUf5kS.

[RedViper]

Hi

I'm having trouble detecting this video, shows up as unavailable:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Apparently all the other Tiktok videos can be downloaded without problems.

Log:

08.05.23 23.05.50 <--> 08.05.23 23.08.17 jdlog://3625311370661/

[pspzockerscene]

@RedViper
Some items may not work in API mode.

Go to Settings -> Plugins -> tiktok.com -> Download mode -> Website
Re-add the link then and it should work fine.

[RedViper]

Originally Posted by pspzockerscene

@RedViper
Some items may not work in API mode.

Go to Settings -> Plugins -> tiktok.com -> Download mode -> Website
Re-add the link then and it should work fine.

Thanks, I understand.

But that will make the watermark appear, right?

[pspzockerscene]

Originally Posted by RedViper

But that will make the watermark appear, right?

Yap but other projects such as yt-dlp do not seem to be able to get a watermark-free version of this particular video either

[RedViper]

Originally Posted by pspzockerscene

Yap but other projects such as yt-dlp do not seem to be able to get a watermark-free version of this particular video either

I understand, thank you very much.

Without any additional intention and just for informational purposes, I want to tell you that I was able to download that video without the watermark from this site:

**External links are only visible to Support Staff****External links are only visible to Support Staff**

[pspzockerscene]

I believe that but that website is not part of an open source project so there is no way for us to look into it to find out how it works

If you find an open source software project which is able to download that video without watermark, I can look into it.

[goldensun87]

Some videos somehow get the watermark burned onto the video, as opposed to it being an external overlay. One possible reason for this, is if the video is a re-upload. Specifically, if the uploader downloaded the video with watermark, and then uploaded the watermarked video as a new video. At this point, the watermark is not an external overlay, but burned onto the video.

[umbala]

Originally Posted by goldensun87

At this point, the watermark is not an external overlay, but burned onto the video.

Yes, I can confirm this to be the case as well. An easy way to check for this is to load the video in your browser normally and see if it has two watermarks. The one burned onto the video and the second one added by the site. I've seen this many times before.

[goldensun87]

Originally Posted by umbala

Yes, I can confirm this to be the case as well. An easy way to check for this is to load the video in your browser normally and see if it has two watermarks. The one burned onto the video and the second one added by the site. I've seen this many times before.

Yup, that thought occurred to me after I posted, but didn't bother adding it, because I figured someone else would confirm it.

[zylaxabi]

JD isn't grabbing tikotk profiles for me at the moment. When adding a tiktok profile url linkgrabber will spin for a little bit but then stop & nothing appears.

Is this just a problem for me or is there an issue with JD & tiktok?

[pspzockerscene]

Merged tiktok profile related threads.

@zylaxabi
Please read the previous posts in this thread and next time please use the boardsearch to find existing threads before opening up a new thread.

[Viga562]

Originally Posted by goldensun87

I made my own guide detailing how I download TikTok profiles. [...] pastebin.com/ZbMUf5kS

If I undertand your method correctly, I think you can even go faster with a browser addon like "Link Gopher" (open source, and available on Chrome and Firefox).

Just like you say in your guide, load the entire TikTok Profile page. Then, with Link Gopher, you can "Extract All Links" and get all the links embedded on the Profile page. You can even "Extract Links by Filters" (regular expression can be used).

Here is Link Gopher website : sites.google.com/site/linkgopher/

[pspzockerscene]

@Viga562
That is correct!
We even got a guide that mentions that "Link Gopher" browser addon:
https://support.jdownloader.org/Know...orted-websites

[DukeM]

Hi, any guides on how to download TikTok profiles now? The direct video links aren't available in the profile page anymore so LinkGopher can't grab anything. Thanks!

[pspzockerscene]

LinkGopher is still working fine here - I'm on the current version of Chrome (Win 10).
Random example profile:
tiktok.com/@feriz.sula
I went to that profile, scrolled down (not all the way but multiple times) and then grabbed the links via LinkGopher - here is my result (those are not all videos of that profile) -> Over 350 items so definitely multiple "pages":
workupload.com/file/4EArsgCxvAh

[DukeM]

Huh, thanks @psp.

So, I visited your example profile to see if it'll work for me too and it did. Then, I tried it again on a profile that I wanted to download and LinkGopher was able to get the links (after a few refreshes). For the past couple of weeks, all I've been getting on any profile I tried were these: **External links are only visible to Support Staff****External links are only visible to Support Staff**

Pretty weird. But at least I seem to be able to make it work after refreshing the page a few times.

On another note, is it expected that nothing happens when I add a plain TikTok profile link to JD2?

Thanks again, @psp!

[pspzockerscene]

Originally Posted by DukeM

Then, I tried it again on a profile that I wanted to download and LinkGopher was able to get the links (after a few refreshes). For the past couple of weeks, all I've been getting on any profile I tried were these...

While I do believe you, I'm unable to reproduce this.
You might want to reach out to the developers of said LinkGopher browser addon and/or open an issue on their github.
Link to their github project:
github.com/az0/linkgopher/

Originally Posted by DukeM

On another note, is it expected that nothing happens when I add a plain TikTok profile link to JD2?

Depends on your settings.
In most cases you should at least get a dummy item as feedback if a crawler fails.
For tiktok, at this moment, it depends on your plugin settings:
- Profile crawl mode API: No feedback
- Profile crawl mode website: Crawler should find up to 30 items (first page of videos on tiktok website)

Originally Posted by DukeM

Thanks again, @psp!

No worries.