JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #81  
Old 05.04.2023, 16:50
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

Website is back online.
They indeed have a space in their json of "title" so that one was not my fault

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #82  
Old 05.04.2023, 23:58
lafhej lafhej is offline
Vacuum Cleaner
 
Join Date: Jun 2022
Posts: 19
Default

Thanks, I think everything is working now.
Reply With Quote
  #83  
Old 06.04.2023, 11:42
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

Thanks for your feedback.
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #84  
Old 13.05.2023, 01:33
Luzashix Luzashix is offline
Modem User
 
Join Date: Jan 2023
Posts: 1
Default

Seems like the Crawler broke again. It is not getting any of the links in a profile crawl.
Reply With Quote
  #85  
Old 14.05.2023, 00:05
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Default

Quote:
Originally Posted by Luzashix View Post
Seems like the Crawler broke again. It is not getting any of the links in a profile crawl.
it works fine for me.
Reply With Quote
  #86  
Old 14.05.2023, 00:10
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Default

hi guys, is there a way to exclude external youtube links from being grabbed/added into the linkgrabber and make jd2 catch only the ecchi links that are hosted on iwara ?
Reply With Quote
  #87  
Old 16.05.2023, 16:14
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 506
Default

Quote:
Originally Posted by Luzashix View Post
Seems like the Crawler broke again. It is not getting any of the links in a profile crawl.
Example Links? Debug logs? see https://support.jdownloader.org/Know...d-session-logs
Reply With Quote
  #88  
Old 16.05.2023, 16:37
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 506
Default

Quote:
Originally Posted by Snookie View Post
hi guys, is there a way to exclude external youtube links from being grabbed/added into the linkgrabber and make jd2 catch only the ecchi links that are hosted on iwara ?
Can you please provide example links to reproduce/work on this?
Reply With Quote
  #89  
Old 16.05.2023, 19:32
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Default

some MMD creators upload their non sexual videos to youtube then share those to their iwara profile so when jdownloader crowl, it captures those youtube videos as well



here is an example

**External links are only visible to Support Staff****External links are only visible to Support Staff**

if their is a way to exclude those youtube videos that would be great.


or maybe when it's crowling for an entire profile videos it's simply capturing the youtube link in the video discription


video example from creator above that has a youtube link in the description :

**External links are only visible to Support Staff****External links are only visible to Support Staff**

Last edited by Snookie; 16.05.2023 at 19:42.
Reply With Quote
  #90  
Old 17.05.2023, 15:49
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

Settings -> Advanced Settings -> GeneralSettings.crawlercrawlerpluginblacklist ->
Code:
["youtube.com"]
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #91  
Old 21.05.2023, 04:26
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Smile

i still want to have the ability to download from youtube, this solution solve the iwara problem but deprive me from using jd2 to download YT videos.
i knew it was a long shot and its not a big bother anyways, ill just delete the yt links and keep only the iwara links before adding to download list..

and again thank you so much for creating this amazing plugin and for responding so quickly whenever we ask for your help.
Reply With Quote
  #92  
Old 22.05.2023, 15:16
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

I've added a plugin setting for you for the next set of CORE-updates.
Screenshot:

That setting is only for the profile crawler so let me know if you also want to have it for single added iwara.tv video links.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #93  
Old 23.05.2023, 13:06
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Default

when checking for hundreds of profiles at once those youtube videos are an issue because they add up.. so skipping them is the best solution and there is no need for single added video links.
i’m grateful beyond words.
Reply With Quote
  #94  
Old 01.06.2023, 06:11
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Default

hi guys, is it possible to make the plugin grab external mega links in videos description just like you made it ignore the youtube links ?

here is an example with external mega link

**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #95  
Old 01.06.2023, 15:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

Added setting for that.

Keep in mind that this will override/disable fast linkcheck for profile crawling because the crawler needs to look into that videos' metadata to find- and parse such links.
That new setting will be disabled by default.

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #96  
Old 02.06.2023, 09:07
Snookie Snookie is offline
Giga Loader
 
Join Date: Jun 2015
Posts: 99
Default

i'm really sorry there is 2 things that just now came to my mind that i should have mentioned in my last request..

first thing is sometime video creators write a lot of lines in video description describing their work and they put the external link after all those lines so to see the actual external link you have to click on Show More button, here is an example :

**External links are only visible to Support Staff****External links are only visible to Support Staff**

i don't know if that going to be a problem for the crawler so i just felt like mentioning it

second thing is sometimes creators separate the mega link into 2 halves to make it hard for copyrighted models owners finding their links via search engines and copyright reporting those links.

also not all creators use mega as an external links.. others use google drive and rule34video..

here is an example of a creator using external google drive link :

**External links are only visible to Support Staff****External links are only visible to Support Staff**

i came across creators using rule34video before, i just can't remember any to provide an example right now.. but basically when a creator create a video of a taboo genre that is not allowed on mega or google drive and they know that it will be immediately taken down and their account banned if reported they instead will post their higher resolution external link on rule34video instead of google drive or mega because rule34video has no forbidden genre and their video wont be taken down.

also when crawling for entire profile videos it's preferable to have all the internally hosted iwara videos and externally hosted videos/zipped files all be inside one package in linkgrabber.

i'm sorry if i'm asking for too much, i'm just trying to have the best possible outcome from this plugin.. because otherwise manually checking every video description for external links is not feasible due to the ridiculous amount of time it will take.

Last edited by Snookie; 02.06.2023 at 09:20.
Reply With Quote
  #97  
Old 02.06.2023, 11:19
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

Quote:
Originally Posted by Snookie View Post
first thing is sometime video creators write a lot of lines in video description describing their work and they put the external link after all those lines so to see the actual external link you have to click on Show More button, here is an example :
The button is only cosmetic. All of the description gets loaded right away.
You can check this by looking into their API to find the metadata of each video.
Random example video:
Code:
iwara.tv/video/k2ayoueezfkx6gvq/defeat-of-irybelda
API link:
Code:
api.iwara.tv/video/k2ayoueezfkx6gvq
Quote:
Originally Posted by Snookie View Post
second thing is sometimes creators separate the mega link into 2 halves to make it hard for copyrighted models owners finding their links via search engines and copyright reporting those links.
I doubt that this is gonna help.
Ultimately, if they do this in a way that it is easy for us to automate to build the complete links, anyone with some technical knowledge will be able to do the same.
Also, the other way: If it is not possible to easily automatically build the original links, I won't be able to do it either and the only thing you can do is to download the description as .txt file and manually check for links later. Is there a demand to download the description text?

Quote:
Originally Posted by Snookie View Post
here is an example of a creator using external google drive link :
Works fine here in my dev version.
By the way you can get the dev version and test changes earlier, see:
https://support.jdownloader.org/Know...up-ide-eclipse


Quote:
Originally Posted by Snookie View Post
i came across creators using rule34video before
No further examples needed: As said, any http links in the description will be parsed
...except for ones that were crippled as explained in the beginning of my reply.
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #98  
Old 06.06.2023, 14:59
shinji2009 shinji2009 is offline
DSL User
 
Join Date: Aug 2021
Posts: 35
Default

hi. is there a way now to bring back old folder naming style (same as filenames)(uploader_videoid_title) when downloading single video from iwara?
Reply With Quote
  #99  
Old 06.06.2023, 15:22
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 68,393
Default

I haven't changed the defaults recently.

You can either use Packagizer rules or choose between some pre defined filename schemes here: Settings -> Plugins -> iwara.tv -> "Select preferred filename scheme"
__________________

On vacation / im Urlaub
START: 2023-09-26
END: TBA


JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Reply With Quote
  #100  
Old 06.06.2023, 15:58
shinji2009 shinji2009 is offline
DSL User
 
Join Date: Aug 2021
Posts: 35
Default

i was thinking it is a bug and waiting for updates to fix it but it is not) folders are now title only. started between june 3 and june 4

Last edited by shinji2009; 06.06.2023 at 16:02.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 20:10.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.