#1
|
|||
|
|||
Entire Youtube Channel Not Grabbed by Linkgrabber
**External links are only visible to Support Staff**www.youtube.com/user/RussiaToday channel has over 27000 videos. But, linkgrabber is grabbing only around 6500.
|
#2
|
||||
|
||||
@computermonster
please post your logs from that session so we can see why, I suspect timeout or too many requests in short succession https://support.jdownloader.org/Know...d-session-logs raztoki
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#3
|
|||
|
|||
31.12.15 06.17.31to31.12.15 06.05.29 jdlog://9421154739341/
|
#4
|
||||
|
||||
ok sorry about the delay, large log took some time to download and then I forgot to come back to it, thankfully I left your tab open in opera. From what I could determine is, decryption list, no more continuation links where provided by youtube and the decryption of the list stopped and videos started processing.
Not fault of JDownloader as I see it. raztoki
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#5
|
|||
|
|||
I want to download all videos of Putin from RussiaToday channel.
I searched Putin on RussiaToday channel to obtain following link: **External links are only visible to Support Staff****External links are only visible to Support Staff** 1. Will it grab links of entire RussiaToday 2. Will it grab links present till "Load More" tab at the bottom of the page 3. Will it grab all links that would be present if I click "Load More" tab infinite times |
#6
|
||||
|
||||
@computermonster
its not infinite times, button only shows or auto loads more videos based on the previous AJAX request. In your 200+meg log that you uploaded, it no longer gave a continue link. raztoki
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#7
|
|||
|
|||
What will happen under following circumstance:
1. I search Putin on RussiaToday channel to obtain following link: **External links are only visible to Support Staff****External links are only visible to Support Staff** 2. I press "Load More" button as long as it shows up when I scroll down the window 3. I let JD2 linkgrabber check this link Will JD2 check all links on RussiaToday channel or just those present on that page? |
#8
|
||||
|
||||
we support /user/username but not parameters query=value
__________________
raztoki @ jDownloader reporter/developer http://svn.jdownloader.org/users/170 Don't fight the system, use it to your advantage. :] |
#9
|
||||
|
||||
I guess that either that channel no longer has so many videos or youtube prevents mass crawling of such many videos. Even showing that many videos in browser won't work
__________________
JD-Dev & Server-Admin |
Thread Tools | |
Display Modes | |
|
|