JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #21  
Old 29.03.2023, 17:15
mtsandersen mtsandersen is offline
Junior Loader
 
Join Date: Mar 2023
Posts: 12
Default

So you did. I was wary of switching off something important hidden away like this is, as my memory is not the most reliable. Nonetheless, I decided to try it, writing a big note on my desk. I suppose it reduced network traffic. Interesting to see the links added unsorted, with the jpg and raw mixed up, and the raws not renamed by Amazon after they are requested.
Anyway, I'm still doing it in relatively small batches to avoid the links expiring, as it's quite a lot of data to download. I'm working backwards and in the middle of 2020 atm, not necessarily downloading everything.
I've been reading a few DPReview articles and watched some of their videos, as it's all coming to an end very shortly, sadly. They should just leave it up in a locked state so people can still make use if it.

Edit While trying to get the rules to work, I ignored the query string, but I notice the AmazonAWS query string starts with what looks like a session expiry variable X-Amz-Expires=3600. So what happens if I change it...
Code:
{
  "enabled": true,
  "name": "DPReview rewrite expiry from 3600 to 36000",
  "pattern": "X-Amz-Expires=3600",
  "rule": "REWRITE",
  "rewriteReplaceWith": "X-Amz-Expires=36000"
}

Last edited by mtsandersen; 29.03.2023 at 19:54.
Reply With Quote
  #22  
Old 30.03.2023, 12:18
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 66,691
Default

Quote:
Originally Posted by mtsandersen View Post
So what happens if I change it...
It is super unlikely that that will have any effect as this is usually also checked serverside...

Also your REWRITE rule in your recent post #21 cannot work like this. I supposed it was only ment to be a mockup?
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #23  
Old 30.03.2023, 14:17
mtsandersen mtsandersen is offline
Junior Loader
 
Join Date: Mar 2023
Posts: 12
Default

Yeah, it was late, just a thought before bed. And no, it didn't work. It was on the Amazon link buried deep on the json file where people would normally not see it. My connection isn't the fastest (normally not needed), so it takes time as the links will expire.
Speaking of rewrite, I experimented with Regex in BBEdit (Mac text editor) to parse the links from the saved HTML of the links page into a neat list of links, just as an exercise.
Code:
Search:
https:\/\/www\.dpreview\.com\/sample-galleries\/([0-9]+)\/[^"]+\">(.+)(?=<\/a>)
Replace:
\2\n**External links are only visible to Support Staff**
Extract button

Result example:
Canon EOS R3 sample gallery (DPReview TV)
**External links are only visible to Support Staff**
Reply With Quote
  #24  
Old 14.04.2023, 18:54
notice notice is offline
JD Supporter
 
Join Date: Mar 2023
Posts: 506
Default

@mtsandersen: did you read that post? looks like you will have some more time to mirror/clone the galleries
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 03:58.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2023, Jelsoft Enterprises Ltd.