[eaglef2]

My pixiv cookies recently expired, and when I try to update them I'm told that the cookies are not valid.

17.12.22 17.58.18 <--> 17.12.22 18.01.53 jdlog://9581311370661/

Operating System
Windows 10 (WINDOWS 64Bit) (x86 64Bit)
Java
1.8.0_265-b01 (32Bit)
AdoptOpenJDK
OpenJDK Client VM

Source Revisions:
Core: #47198
Launcher: #5660
AppWork Utilities: #3891
Browser: #47172
Updater: #1038

[accelheim]

So suddenly I was logged out of Pixiv on JD2, tried to login with correct cookies but it keeps showing "can't login, login cookies invalid". I've tried with Chrome and Firefox, using the guide like always, new session, etc.

[Jiaz]

pixiv login results in cloudflare protection/blocking page
Either it's just random or they have updated their cloudflare settings to also block cookie login

[accelheim]

Originally Posted by Jiaz

pixiv login results in cloudflare protection/blocking page
Either it's just random or they have updated their cloudflare settings to also block cookie login

I have tried for some days now. It's always happening. Can this be fixed?

[pspzockerscene]

Hi,

English / Englisch
the issue you've reported has been caused by our current Cloudflare issues.
Please read the first post of the linked thread and post in this thread if you have further questions!
In case you've posted a new thread and it will either get merged with the linked Cloudflare thread or we will lock it.
Please post Cloudflare related questions in the above linked thread only!
Attention: The first post of that linked thread contains useful information for you AND website-owners and also the hint that website-owners can solve this issue on their side which would also make our plugin work again!
There is no ETA for a Cloudflare fix from our side so it might be faster to ask website admins! Please read the first post of the linked thread completely and consider sending it to the admins of the website you are having issues with!

Deutsch / German
Das von dir gemeldete Problem wurde durch die aktuellen Cloudflare Probleme verursacht.
Bitte lies den ersten Post des Cloudflare Threads.
Falls du einen neuen Thread dazu geöffnet hast wurde dieser entweder in den bestehenden Cloudflare Thread verschoben oder mit diesem Post von mir beantwortet und geschlossen.
Weitere Fragen bitte im oben verlinkten Cloudflare Thread posten!
Achtung: Im ersten Post ist u.a. beschrieben, dass auch Webseiten-Admins das Problem auf ihrer Seite lösen können --> Unser Plugin würde dann sofort wieder funktionieren - das bitte beachten, den ersten Post vollständig lesen und ggf. an den Support der betroffenen Webseite weiterleiten!
Wie können derzeit nicht sagen, wann es von unserer Seite aus eine Lösung für das Cloudflare Problem geben wird!

-psp-

[accelheim]

Originally Posted by pspzockerscene

Hi,

English / Englisch
the issue you've reported has been caused by our current **External links are only visible to Support Staff**....
Please read the **External links are only visible to Support Staff**... and post in this thread if you have further questions!
In case you've posted a new thread and it will either get merged with the linked Cloudflare thread or we will lock it.
Please post Cloudflare related questions in the above linked thread only!
Attention: The first post of that linked thread contains useful information for you AND website-owners and also the hint that website-owners can solve this issue on their side which would also make our plugin work again!
There is no ETA for a Cloudflare fix from our side so it might be faster to ask website admins! Please read the first post of the linked thread completely and consider sending it to the admins of the website you are having issues with!

Deutsch / German
Das von dir gemeldete Problem wurde durch die aktuellen **External links are only visible to Support Staff**... verursacht.
Bitte lies den **External links are only visible to Support Staff**....
Falls du einen neuen Thread dazu geöffnet hast wurde dieser entweder in den bestehenden Cloudflare Thread verschoben oder mit diesem Post von mir beantwortet und geschlossen.
Weitere Fragen bitte im oben verlinkten Cloudflare Thread posten!
Achtung: Im ersten Post ist u.a. beschrieben, dass auch Webseiten-Admins das Problem auf ihrer Seite lösen können --> Unser Plugin würde dann sofort wieder funktionieren - das bitte beachten, den ersten Post vollständig lesen und ggf. an den Support der betroffenen Webseite weiterleiten!
Wie können derzeit nicht sagen, wann es von unserer Seite aus eine Lösung für das Cloudflare Problem geben wird!

-psp-

Thanks for the link. How can this issue be solved with Pixiv then? Ask the Pixiv admins to allow JD2 on their site?

[Jiaz]

Originally Posted by accelheim

Thanks for the link. How can this issue be solved with Pixiv then? Ask the Pixiv admins to allow JD2 on their site?

I doubt that they will help you as they don't have interest in tools/scripts/bots crawling/scraping their site, just a wild guess.
Have you already tried different IP/VPN/Proxy?

[accelheim]

Originally Posted by Jiaz

I doubt that they will help you as they don't have interest in tools/scripts/bots crawling/scraping their site, just a wild guess.
Have you already tried different IP/VPN/Proxy?

It worked with a different IP.

[pspzockerscene]

Thanks for your feedback.
As described in our Cloudflare thread, changing the IP can help.

[Jiaz]

@accelheim: Thanks for the feedback!

[accelheim]

Pixiv is completely unusable now. The Cloudflare issue is permanent now on many different IPs. I can't login or download anything. Is this problem solvable?

[pspzockerscene]

@accelheim
Please read the Cloudflare thread which we've linked here multiple times.
It contains all infor you need to know and all known solutions/workarounds.
Here it is again:
https://board.jdownloader.org/showthread.php?t=83712

[accelheim]

Originally Posted by pspzockerscene

@accelheim
Please read the Cloudflare thread which we've linked here multiple times.
It contains all infor you need to know and all known solutions/workarounds.
Here it is again:
**External links are only visible to Support Staff**...

So everyone who uses JD2 for Pixiv have to resort to a workaround? There is no chance for JD2 devs to fix this problem?

I tried with the cookies I got from cloudscraper, but they didn't work. I got the pop-up "how to login with cookies in JD2" as if the cookies were not in the password format. The cookies from "Edit This Cookie" is much, much longer and different to the cookies I got from cloudscraper. Seems like I can only login with cookies from Pixiv pasted into JD2 with the "Edit This Cookie" format. Is this so? Can you make the cloudscraper cookies work with JD2 as well?

[pspzockerscene]

Originally Posted by accelheim

So everyone who uses JD2 for Pixiv have to resort to a workaround?

No, not everyone.
Please re-read the Cloudflare FAQ: This issue does not affect all users as Cloudflare is not triggered for all users.

Originally Posted by accelheim

There is no chance for JD2 devs to fix this problem?

Please re-read the Cloudflare FAQ: Cloudflare related issues are not to be treated as a JDownloader bug.
There are separated projects which can be used to get through Cloudflare related blocks.

Originally Posted by accelheim

I tried with the cookies I got from cloudscraper, but they didn't work.

Please re-read the cookie login article: We only support cookies in the format of browser addons "Flag Cookies" and "EditThisCookie".

Originally Posted by accelheim

The cookies from "Edit This Cookie" is much, much longer and different to the cookies I got from cloudscraper.

If you think that when using EditThisCookie, some cookie information or some cookies would be missing: No this is not the case. Each supported cookie export format is just a different representation of the same data.
Different formats, different amount of details in the data but in the end JD is only using some of this data.

Originally Posted by accelheim

rd format. The cookies from "Edit This Cookie" is much, much longer and different to the cookies I got from cloudscraper. Seems like I can only login with cookies from Pixiv pasted into JD2 with the "Edit This Cookie" format. Is this so?

For supported cookie import formats, please read the cookie login article I linked at the beginning of this post.

Originally Posted by accelheim

Can you make the cloudscraper cookies work with JD2 as well?

Sure I can though at this moment I don't really see the need to.
Which benefits to you expect from using the cookies from Cloudscraper over using the already supported methods of cookie importing?
Please post an example string of exported Cloudscraper cookies.

[pspzockerscene]

My public reply to your private message:
It seems like you think that using the cookies from "Cloudscraper" will just magically let the pixiv JD plugin through Cloudflare.
This is not the case and this is not a good reason to add support for the Cloudscraper cookie format.

You can also easily verify this information:

1. Grab your current pixiv.net cookies via EditThisCookie and paste the exported cookies into a .txt document.
2. Now modify all cookie values from EditThisCookie and replace them with the values of Cloudscraper.
3. Now import them into JD -> You will most likely run into the same Cloudflare problem.

I do not want to sound rude but you are lacking the understanding of how Cloudflare works - what you are trying to do will not help you to bypass it!

As mentioned in the Cloudflare thread, the only possible solution at this moment is to use a proxy which does some magic in the background to process/bypass Cloudflare.
I did link some [untested] possible proxy solutions in the Cloudflare thread.

[accelheim]

Originally Posted by pspzockerscene

My public reply to your private message:
It seems like you think that using the cookies from "Cloudscraper" will just magically let the pixiv JD plugin through Cloudflare.
This is not the case and this is not a good reason to add support for the Cloudscraper cookie format.

You can also easily verify this information:

1. Grab your current pixiv.net cookies via EditThisCookie and paste the exported cookies into a .txt document.
2. Now modify all cookie values from EditThisCookie and replace them with the values of Cloudscraper.
3. Now import them into JD -> You will most likely run into the same Cloudflare problem.

I do not want to sound rude but you are lacking the understanding of how Cloudflare works - what you are trying to do will not help you to bypass it!

As mentioned in the Cloudflare thread, the only possible solution at this moment is to use a proxy which does some magic in the background to process/bypass Cloudflare.
I did link some [untested] possible proxy solutions in the Cloudflare thread.

Thanks for the reply.

I can't find the untested proxy solutions in the thread.

Why does it work for some users? Why doesn't changing IP solve this issue, or using the cookies from Edit This Cookie? Is it possible to contact Pixiv support in this case?

Can it help to enable debug mode and send you logs?

[pspzockerscene]

Originally Posted by accelheim

I can't find the untested proxy solutions in the thread.

This is what I mean:
github.com/NoahCardoza/CloudProxy
Indeed this idea was not posted by me but by another user in 2020:
https://board.jdownloader.org/showth...821#post471821

Originally Posted by accelheim

Why does it work for some users?

Similar to googles' reCaptchaV2 and hard to solve captchas: Cloudflare is a blackbox and only Cloudflare knows which pattern are used to determine whether or not to bot-test / block single users.
For example I can use pixiv.net cookie login just fine at this moment (no VPN, german residential IP).

Originally Posted by accelheim

or using the cookies from Edit This Cookie?

Those are simply your browsers' cookies.
Even if you import "good" Cloudflare cookies this does not just grant you access to go through Cloudflare with tools/"bots".
What Cloudflare will immediately notice: "Ohh the user-agent of JDownloader and the browser in which the cookies were previously used differ -> Let's check if this request was made by a bot" -> And just like this, JD plugin is already blocked for that user.
This is just an example. There are a lot more things Cloudflare can use to rate you as bot or human.

Originally Posted by accelheim

Is it possible to contact Pixiv support in this case?

Sure you can but I highly doubt that pixiv will assist you to use tools for automated downloading.
By doing this, you will not generate any ad revenue for them so the random blocks due to Cloudflare could even be a positive side-effect for them

[accelheim]

Originally Posted by pspzockerscene

This is what I mean:
github.com/NoahCardoza/CloudProxy
Indeed this idea was not posted by me but by another user in 2020:
**External links are only visible to Support Staff**...


Similar to googles' reCaptchaV2 and **External links are only visible to Support Staff**...: Cloudflare is a blackbox and only Cloudflare knows which pattern are used to determine whether or not to bot-test / block single users.
For example I can use pixiv.net cookie login just fine at this moment (no VPN, german residential IP).


Those are simply your browsers' cookies.
Even if you import "good" Cloudflare cookies this does not just grant you access to go through Cloudflare with tools/"bots".
What Cloudflare will immediately notice: "Ohh the user-agent of JDownloader and the browser in which the cookies were previously used differ -> Let's check if this request was made by a bot" -> And just like this, JD plugin is already blocked for that user.
This is just an example. There are a lot more things Cloudflare can use to rate you as bot or human.


Sure you can but I highly doubt that pixiv will assist you to use tools for automated downloading.
By doing this, you will not generate any ad revenue for them so the random blocks due to Cloudflare could even be a positive side-effect for them

Thanks for the clear up.

I'm a premium user on Pixiv so they don't lose anything if I use it, it actually motivates me to stay premium if I can use download managers.

Does it help to make another account?

I also have one PC with JD2 installed where it works and I'm logged into the plugin. I tried transferring the save file from that JD2 to my other PC and imported all the settings, so that even the same cookies are imported to that JD2 instance. But no, even then, on the second PC it doesn't work and the Cloudflare error appears. Very odd behavior.

[pspzockerscene]

Originally Posted by accelheim

I'm a premium user on Pixiv so they don't lose anything if I use it, it actually motivates me to stay premium if I can use download managers.

They might still be against using downloadmanagers but what do I know. Go ask them.

Originally Posted by accelheim

Does it help to make another account?

Against the Cloudflare problem? No.

Originally Posted by accelheim

But no, even then, on the second PC it doesn't work and the Cloudflare error appears.

Maybe you are using a VPN / other IP on the 2nd computer.

You need to figure this out on your own. We are not prividing any support on how to resolve Cloudflare blocks.
Contact the pixiv.net support.

[enbob]

Hi, it seems like this plugin works now, but it doesn't seem to download the full resolution images. Is it possible to make this grab full res images? Let me know if you need me to provide more information.

[pspzockerscene]

Please post your log-ID here
If your report is about a specific website which JD supports via plugin, please also provide example URLs which can be used to reproduce the issue you are having.
If your report is related to a login specific problem with a plugin supported website, enable debug mode before creating logs, see previously linked instructions.

Bitte poste deine Log-ID hier.
Falls dein Problem ein Problem mit einer Webseite ist, die per Plugin unterstützt wird, stelle bitte zusätzlich Testlinks zur Verfügung, mit denen sich dein Problem nachstellen lässt.
Geht es um einen nicht funktionierenden Account-Login, aktiviere vor dem Erstellen deines Logs den debug Modus (siehe zuvor verlinkte Anleitung).

-psp-