#1
|
|||
|
|||
Link crawler help needed
Hello,
I need help creating a link crawler rule for a selfhosted webapp. The webapp is called "**External links are only visible to Support Staff**Tgindex Pro", it crawls through your telegram channels, indexes and displays the files on a website, so they can be easily downloaded with a download manager. Unfortunatelly JD2 does not recognize the links, even though they are normally embedded into the html page. Link Schema: Channel overview with pages containing links: **External links are only visible to Support Staff****External links are only visible to Support Staff** Example links to crawl: **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** ... Example links to _not_ crawl: (they dont work) **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** ... There is a "Page 2" button and after clicking it, it gives a "Page 3" button and so on, after each click. **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** ... |
#2
|
||||
|
||||
Please provide real working example links, then we can check/try to help
__________________
JD-Dev & Server-Admin |
#3
|
|||
|
|||
Sorry, I cant make it run on the Internet. I will keep trying to figure it out with link crawler myself. Still, thanks for the quick reply.
Last edited by ELM0; 16.06.2021 at 04:34. |
#4
|
||||
|
||||
We can try to help via Teamviewer and check together. If you want, contact us via support@jdownloader.org
__________________
JD-Dev & Server-Admin |
#5
|
|||
|
|||
I will try to provide the website and re-open the thread if help still needed. thank you for your kind support.
Last edited by ELM0; 16.06.2021 at 17:38. |
#6
|
||||
|
||||
@ELM0 nothing to thank us!
We can still try to help via Teamviewer or get somehow us access to an instance of that website, so we can check/help you
__________________
JD-Dev & Server-Admin |
#7
|
|||
|
|||
SOLVED. I figured it out. I had to use DEEPCRYPT mode and use the correct regex. JD2 is really awesome. :o)
|
#8
|
||||
|
||||
Great to hear that you got it working by yourself
Whenever you need help/got questions, just let us know!
__________________
JD-Dev & Server-Admin |
#9
|
||||
|
||||
For further infos/examples
https://support.jdownloader.org/Know...kcrawler-rules https://support.jdownloader.org/Know...xample-rewrite https://support.jdownloader.org/Know...le-deepdecrypt https://support.jdownloader.org/Know...ple-directhttp https://support.jdownloader.org/Know...followredirect
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|