View Single Post
  #86  
Old 09.10.2021, 12:27
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 1,533
Default

@psp / @EquiNox: Although dupes are allowed in linkgrabber, parser would still filter them. So, if the same link appears multiple times in a crawler job, only one of them will be crawled on each pass.
Reply With Quote