So I tried it out, Zillow comes up as a mess. If I just tell JD to crawl it without putting in a manual packagename it comes out as a giant mess, tons of folders with jpg/png and webp files, for every resolution available from the site, and it grabs all the analytics and some random stuff from their tiktok and their twitter. If I manually put in a package name everything for zillow is neatly tucked into the folder, with dozens of copies of each picture at every resolution, leading to thousands of files downloaded.
Redfin, for the same address gave a ton of twitter links? Still waiting for it to finish downloading.
|