Thank you everyone for your help! I really appreciate it.

I actually solved this by setting the maxDecryptDepth to 125 and using linkfilter extensively. That probably took longer used more CPU resources, but I'll see if I can create a more efficient linkcrawler next time.