[eagleg]

any updates on this? Thanks!

[pspzockerscene]

Originally Posted by eagleg

any updates on this? Thanks!

No.
Friendly reminder:

Originally Posted by pspzockerscene

Hi eagleg,

please read the first post of this thread again ...

-psp-

[maximumfap]

A shame - thanks for the hard work :(

[deejay2]

i am using deepbrid premium, is this still affected with jdownloader2 as i have pop for captcha but there is not white square which i should tick and resolve......so plugin does not work....anyone using jdownloader2+deepbrid premium succesfully?

thx

[pspzockerscene]

@deejay2
Please stop posting your reports across multiple threads - this will NOT increase the priority of your request!

I've answered in your separate thread - your issue is not related to Cloudflare.

-psp-

[thetoad]

a thought on a generic way to provide a workaround for cloudflare (and possibly others in the future).

Enable jd2 to act as an http proxy, when one try to download a file from a "difficult" site, jd2 punts the "processing" work to a browser (so full experience is in the browser) except for the actual file downloading part, which jd2 will intercept.

as its an http proxy, all connections go through it. all it has to do is associate "sessions" (groups of request/responses) to an entry in jd2 download list and hwen it sees a request that it understands as the actual file download, handl it itself instead of proxying it back to the browser.

Now, one big thing that would have to be solved and would have security implications is https. generally the way this is solved is by the user generating a catch all (or perhaps specified to specific hosts) https certificate that is installed in one's browser and enables one to man in the middle the https connection. as noted this would have security implications. with that said, I think it can be mitigated with strong warnings about it, enabling users to limit it to specific hosts, encouraging users to only use it with a dedicated browser (for example using firefox profiles?). Another possiblity is bundling your own browser that you launch for these files?

just a thought

[Bostich]

Habe bei Goloady.com seit neuestem Cloudflare failure......Zeitweise deaktiviert und dann so nen Countdown.
Was bedeutet das? Einzelne Dateien händisch über die Goloady Seite runterladen geht problemlos - nur der Jdownloader will das zur Zeit nicht

[pspzockerscene]

@thetoad
At the moment I would say there is no way around other than using a real browser.
... and then it gets even more complicated once a user-interaction is needed e.g. user has to solve a captcha/"hcaptcha".

@Bostich
Bitte den ersten Post dieses Threads lesen & verstehen.
Bist du bei goloady.com ein premium User?
Falls ja empfehle ich, deren Support zu kontaktieren und sie darum zu bitten, ihre Cloudflare Einstellungen so zu setzen, dass Cloudflare JDownloader User nicht mehr stoppt (siehe erster Post).

Grüße, psp

[thetoad]

Originally Posted by pspzockerscene

@thetoad
At the moment I would say there is no way around other than using a real browser.
... and then it gets even more complicated once a user-interaction is needed e.g. user has to solve a captcha/"hcaptcha".

that's my point. if for these files you popped up a real browser that proxied through jd2, all you would have to do is intercept the "final" http request for the actual file and return a fake response to the browser (i.e. "jd2 thank you for your service", while downloading the file in jd2)

you would change from the plugin "scripting" a session to a plugin knowing how to intercept the requests correctly

[pspzockerscene]

Yes but whatever we do - it would be a huge amount of work to make this work!
At this moment we got other priorities ...
Also the Cloudflare change has caused less issues than I first thought.

-psp-

[eagleg]

any updates with this?
Thanks!

[pspzockerscene]

Originally Posted by eagleg

any updates with this?

No.

Please have a look at the linked bugtracker tickets - all of them are still at 0%.

Again:
I do not see any kind of bugfix coming anywhere in the near future ...

-psp-
EDIT

Again #2:
You will not find ANY working public open source Cloudflare crawler out in the wild/GitHub

[wow843658435]

Attention Required! Cloudflare
what is this? Cannot download from exhentai.

[pspzockerscene]

Hi,

English / Englisch
the issue you've reported has been caused by our current Cloudflare issues.
Please read the first post of the linked thread and post in this thread if you have further questions!
In case you've posted a new thread and it will either get merged with the linked Cloudflare thread or we will lock it.
Please post Cloudflare related questions in the above linked thread only!
Attention: The first post contains useful information for you AND website-owners and also the hint that website-owners can solve this issue on their side which would also make our plugin work again! There is no ETA for the Cloudflare fix so it might be faster to ask website admins! Please read the first post of the linked thread completely and consider sending it to the admins of the website you are having issues with!

Deutsch / German
Das von dir gemeldete Problem wurde durch die aktuellen Cloudflare Probleme verursacht.
Bitte lies den ersten Post des Cloudflare Threads.
Falls du einen neuen Thread dazu geöffnet hast wurde dieser entweder in den bestehenden Cloudflare Thread verschoben oder mit diesem Post von mir beantwortet und geschlossen.
Weitere Fragen bitte im Cloudflare Thread posten!
Achtung: Im ersten Post ist u.a. beschrieben, dass auch Webseiten-Admins das Problem auf ihrer Seite lösen können --> Unser Plugin würde dann sofort wieder funktionieren - das bitte beachten, den ersten Post vollständig lesen und ggf. an den Support der betroffenen Webseite weiterleiten!
Wie können derzeit nicht sagen, wann es von unserer Seite aus eine Lösung für das Problem geben wird!

-psp-

[Enomine]

Originally Posted by Jiaz

@Enomine: Scale from 1 to 10, the new Cloudflare Challenge is about ..maybe 1 Million. You can search for it on other projects and then you will have a clue about it. I don't want to link to that project here. As this Cloudflare changes affects ALL websites/ALL projects, more and more ppl will work on solutions/workarounds but at the moment I'm not aware of any *near finish* progress.

Hey Jiaz,
Hey other programmers and community managers,

are there new informations about solving the problem?
Have there been tries to solve it? What did you try or imagine of? Or didn't you write any line of code, because of no ideas?

Did you think about contacting Cloudflare to get into a conversation with them, to solve it cooperative? Did you try to contact Cloudflare? Could/should we organize an online-petition?

What possibilitys can we think of how Cloudflare can actually give us access again when they cooperate? My english is bad. I mean: Which different ways do you think are possible how we can get access while cloudflare would cooperate?
Example:
- Is it actually possible for cloudflare to set JDownloader as an exception (while JDownloader promisses not to DDOS the servers?)?
- Is some kind of API communications between the servers possible if Cloudflare would provide it? (which needs JDownloader-crew to actually implement it)


Thanks - Enomine

[raztoki]

@Enomine
Historically I made and maintained support for CloudFlare and other like providers, to suit JDownloader. Support was created based on my own observations, on how the providers work. Others have contributed for full disclosure, for example: Coalado with JavaScript, Jiaz with some of the JD Browser quirks.

The changes that happened in the beginning of the year/last year, was CloudFlare actively fighting 'bots' good or bad; friendly or foe. I don't believe we have contacted CloudFlare far as I'm aware. I believe they wouldn't allow support for us, or any like us. Mainly due to our open source which then would easily give others access which they could not control. I personally think they do give access or means to bypass, as google/bing crawler/scrapers need continue there tasks/jobs, but this would be private or commercial arrangements.

Publicly existing projects(libraries) prior to changes by CloudFlare are mostly if not all broken.

They have been fighting any project that provides support no matter to the new CloudFlare. They also claim the new backend learns &/or adaptive. I personally think that claim is a little far fetched, just the way the tit or tat changes made while fighting the main public project (now private && payment required to use library). But who knows, maybe it is.

I personally do now have time to invest into this issue.

raztoki

[ypp]

github.com/NoahCardoza/CloudProxy is the most promising project

[Enomine]

i think caused by a failure in the a computer system my post from 25.09.2020 16:26 is not shown on page 12 of this topic. i will provide it as a copy:

Hey Jiaz,
Hey other programmers and community managers,

are there new informations about solving the problem?
Have there been tries to solve it? What did you try or imagine of? Or didn't you write any line of code, because of no ideas?

Did you think about contacting Cloudflare to get into a conversation with them, to solve it cooperative? Did you try to contact Cloudflare? Could/should we organize an online-petition?

What possibilitys can we think of how Cloudflare can actually give us access again when they cooperate? My english is bad. I mean: Which different ways do you think are possible how we can get access while cloudflare would cooperate?
Example:
- Is it actually possible for cloudflare to set JDownloader as an exception (while JDownloader promisses not to DDOS the servers?)?
- Is some kind of API communications between the servers possible if Cloudflare would provide it? (which needs JDownloader-crew to actually implement it)


Thanks - Enomine

Thanks - Enomine

[pspzockerscene]

@Enomine does show up fine as post 235

Here is a small answer to your post from Jiaz regarding this topic:

Ideas but no actual work done yet. We took a look at other projects and how they handle the situation and have similiar ideas.
Cloudflare has no interest in any contact because it's their business to block tools/crawlers/bots/attacks... From their
Point-of-View the service works as it should
It's the responsibility of the site owner to whitelist something or provide special access via api or similiar.

-psp-

[Enomine]

Well... For me not. see.
**External links are only visible to Support Staff**