JDownloader Community - Appwork GmbH
 

Notices

Reply
 
Thread Tools Display Modes
  #1  
Old 17.08.2020, 17:10
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default [Wait for browser-extension update] Pixiv.net - JD doesn't find all packages

When copying a pixiv gallery link, jdownloader doesn't find all pictures in the gallery.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

This gallery has 55 images wih sets. JD only finds 44 links to packages.

Can this be fixed?
Reply With Quote
  #2  
Old 17.08.2020, 17:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

According to my browser, 44 is correct:


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #3  
Old 17.08.2020, 17:28
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Are you logged in? IE also says it's 44 images. Chrome incognito says it's 42. How can this be? I tried logging in but I can't click on "I'm no robot" captcha.
Reply With Quote
  #4  
Old 17.08.2020, 17:51
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi,

indeed it seems like there is more items visible when you're logged in and JD can already handle this fine ... BUT there is currently a bug in our browser extension which will make solving the reCaptchaV3 inpossible.
You will need to wait for the next myjd browser-addon update to be able to add your pixiv.net account to JD again.
Once your account is added, JD should find the "missing galleries".

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 17.08.2020 at 18:03.
Reply With Quote
  #5  
Old 17.08.2020, 18:24
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Quote:
Originally Posted by pspzockerscene View Post
Hi,

indeed it seems like there is more items visible when you're logged in and JD can already handle this fine ... BUT there is currently a bug in our browser extension which will make solving the reCaptchaV3 inpossible.
You will need to wait for the next myjd browser-addon update to be able to add your pixiv.net account to JD again.
Once your account is added, JD should find the "missing galleries".

-psp-
Alright, thanks for the update.
Reply With Quote
  #6  
Old 18.08.2020, 14:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi again,

I have a working workaround for you:
1. Install a Firefox (you can also use a portable Firefox) and our myjd addon.
2. Either make this Firefox your default OS browser or follow this guide to make JD use it for captcha solving.
3. You can now add your pixiv.net account --> JD will ask you for TWO login-captchas during this login process.
I've also tested it --> With account, 55 packages with a total of 135 items will be crawled!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 19.08.2020, 17:31
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Quote:
Originally Posted by pspzockerscene View Post
Hi again,

I have a working workaround for you:
1. Install a Firefox (you can also use a portable Firefox) and our myjd addon.
2. Either make this Firefox your default OS browser or **External links are only visible to Support Staff**... to make JD use it for captcha solving.
3. You can now add your pixiv.net account --> JD will ask you for TWO login-captchas during this login process.
I've also tested it --> With account, 55 packages with a total of 135 items will be crawled!

-psp-
Thanks for the workaround! It now found all packages for the profile. Could you give me the expression to change the filename only to the original file name, without artist name, tags and title? Because I've run into issues before that copying the files can cause errors with too long filenames.
Reply With Quote
  #8  
Old 20.08.2020, 14:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Hi again,
Quote:
Originally Posted by accelheim View Post
Thanks for the workaround! It now found all packages for the profile. Could you give me the expression to change the filename only to the original file name, without artist name, tags and title?
What is the "original" filename?
Please add real life examples & example URLs.
Do you mean the serverside filenames e.g.:
Code:
75920036_p0_master1200.jpg
?
Quote:
Originally Posted by accelheim View Post
Because I've run into issues before that copying the files can cause errors with too long filenames.
Do you mean the Windows path length limit?
You can turn this off:
https://support.jdownloader.org/Know...load-directory

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #9  
Old 20.08.2020, 17:09
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Quote:
Originally Posted by pspzockerscene View Post
Hi again,

What is the "original" filename?
Please add real life examples & example URLs.
Do you mean the serverside filenames e.g.:
Code:
75920036_p0_master1200.jpg
?

Do you mean the Windows path length limit?
You can turn this off:
**External links are only visible to Support Staff**...

-psp-
Original filenames like 75920036_p0, 75920036_p1, 75920036_p2, etc...

About filename length, before when I used JD for Pixiv, the filenames contained tags, title and artist name so some files did not copy correctly into other folders after download. I could open them normal though. But not copy or delete. I got the message that the file is not found or don't exist. And most of the time these images had long filenames. But I'm not 100% sure this was the reason.

In any case, is it possible to implement a plugin where you can change the way the filenames are downloaded from pixiv? Like that you can chose what you want your files to be named before download from tags, artists name, etc. in the filename.
Reply With Quote
  #10  
Old 20.08.2020, 17:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by accelheim View Post
Original filenames like 75920036_p0, 75920036_p1, 75920036_p2, etc...

About filename length, before when I used JD for Pixiv, the filenames contained tags, title and artist name so some files did not copy correctly into other folders after download. I could open them normal though. But not copy or delete.
Other users have requested the current file naming scheme and until now everyone was okay with it.

Quote:
Originally Posted by accelheim View Post
I got the message that the file is not found or don't exist. And most of the time these images had long filenames. But I'm not 100% sure this was the reason.
This is not possible.
You must have gotten the "Invalid download directory" message.
If you got another errormessage in this case:
Please post your log-ID here | bitte poste deine Log-ID hier.

Quote:
Originally Posted by accelheim View Post
In any case, is it possible to implement a plugin where you can change the way the filenames are downloaded from pixiv?
Nothing is impossible but my answer is: No.

Quote:
Originally Posted by accelheim View Post
Like that you can chose what you want your files to be named before download from tags, artists name, etc. in the filename.
Our existing "filename tag systems" (e.g. for YT and soundcloud) are implemented standalone in every plugin and are only available for popular plugins - they are not well designed and it makes no sense to continue developing them like this until we have a more generic system for filename modifications.

Also, again I know I'm repeating myself:
Our packagizer addon is the current generic solution to modify filenames.
Please either invest some time into learning regular expressions or download the files with JDs default filenames and use external tools that are easier to understand to modify your filenames afterwards e.g. "filebot" or explorer tools like "Total Commander" that also support batch renaming.
Again, here is my last packagizer example rule for you - it modifies the pixiv.net filenames exactly how you want them to be:

Additionally, there are tickets regarding improving our packagizer and adding more features:



You can either wait until someone starts working on them or do it on your own and contribute code - we're open source.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 20.08.2020 at 18:35. Reason: Some additions
Reply With Quote
  #11  
Old 20.08.2020, 18:29
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Alright, thanks a lot for the feedback and I'll check out the resources you recommended.
Reply With Quote
  #12  
Old 07.09.2020, 19:08
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Quote:
Originally Posted by pspzockerscene View Post
Other users have requested the current file naming scheme and until now everyone was okay with it.


This is not possible.
You must have gotten the "Invalid download directory" message.
If you got another errormessage in this case:
Please post **External links are only visible to Support Staff**... | bitte poste **External links are only visible to Support Staff**....


Nothing is impossible but my answer is: No.


Our existing "filename tag systems" (e.g. for YT and soundcloud) are implemented standalone in every plugin and are only available for popular plugins - they are not well designed and it makes no sense to continue developing them like this until we have a more generic system for filename modifications.

Also, again I know I'm repeating myself:
Our packagizer addon is the current generic solution to modify filenames.
Please either invest some time into learning regular expressions or download the files with JDs default filenames and use external tools that are easier to understand to modify your filenames afterwards e.g. "filebot" or explorer tools like "Total Commander" that also support batch renaming.
Again, here is my last packagizer example rule for you - it modifies the pixiv.net filenames exactly how you want them to be:

Additionally, there are tickets regarding improving our packagizer and adding more features:



You can either wait until someone starts working on them or do it on your own and contribute code - **External links are only visible to Support Staff**....

-psp-
I tried it again right now and it doesn't seem to work, although I entered everything in the rule as in the image.

I need the files to be like this:

75920036_p0, 75920036_p1, 75920036_p2, etc...

Not like this (as they're now when downloaded):

69648257_p0 street fighter, cammy, muscle _ みー4 - shu-mai


Because it happens, that AFTER the download, Windows 10 can't copy the files to other locations because some files will have way too long names, as tags, title and artist name is included in the filename. And it becomes too long.
Reply With Quote
  #13  
Old 07.09.2020, 19:24
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

1. Are we still talking about filenames or packagenames & download paths?
2. The rule is working just fine here - please remove it in your JD and import my exported rule:
workupload.com/file/Z7KDbAUNs9q

You've probably forgotten to check the "RegEx checkbox" in the bottom right corner of my screenshot which I'm unable to verify without you posting a screenshot of the rule you've actually added.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #14  
Old 07.09.2020, 20:45
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Quote:
Originally Posted by pspzockerscene View Post
1. Are we still talking about filenames or packagenames & download paths?
2. The rule is working just fine here - please remove it in your JD and import my exported rule:
workupload.com/file/Z7KDbAUNs9q

You've probably forgotten to check the "RegEx checkbox" in the bottom right corner of my screenshot which I'm unable to verify without you posting a screenshot of the rule you've actually added.

-psp-
Here's a screenshot:

https://imgur.com/a/jv8AJQc


I don't see any RegEx checkbox. Not exactly sure where you mean it is.

Yes, I'm talking about both the filenames and package names, they're the same.
Reply With Quote
  #15  
Old 09.09.2020, 13:41
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,922
Default

Quote:
Originally Posted by accelheim View Post
I don't see any RegEx checkbox. Not exactly sure where you mean it is.
I've modified my originally posted screenshot and added a big arrow to show you where that checkbox is:


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #16  
Old 09.09.2020, 16:14
accelheim accelheim is offline
JD Addict
 
Join Date: Jan 2020
Posts: 158
Default

Thank you. It works fine now.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 09:29.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.