#141
|
||||
|
||||
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#142
|
|||
|
|||
I have enabled debug mode, should I wait until I encounter the problem again or resubmit the previous logs?
*edit* I think I might have a example right now. **External links are only visible to Support Staff****External links are only visible to Support Staff** As of time of writing there is only 540 download and no source https://imgur.com/a/fUcMTRc https://imgur.com/a/nZqFGA7 27.10.23 23.39.10 <--> 27.10.23 23.36.45 jdlog://0668311370661/ Added log hopefully it captured it. Last edited by lafhej; 27.10.2023 at 18:53. |
#143
|
||||
|
||||
Wait until you encounter it again and the best would be if you would be able to reproduce it:
Then restart JD so you got a fresh session -> Reproduce the problem and upload a fresh log. What would be interesting to me: Usually JD will get the same response as your browser so technically if all of the sudden the "source" version is missing in JD, it should be missing in browser too when you're playing the video there. Sure it could also be a measure of iwara.tv to block/shadow-ban bots/tools like JDownloader but that would be a very vague assumption at this moment.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#144
|
|||
|
|||
How to reproduce, I can only identify, cause I only find out if when I reset the link and check if it will download source version. I can only show the initial download is not source but when I reset and it downloads the source video it will only download source video from then on.
I cannot say every video less than 100mb or have 540p res is not source video cause sometimes actual video is really less than 100mb and user only upload 540p. For example the above video I linked, linkgrabber show 20.51MiB size, but when download only 8.51 MiB. Here's even a recording. **External links are only visible to Support Staff****External links are only visible to Support Staff** That was earlier, at time of this post when I try to download it I cannot get the 8.51 MiB file anymore. Infact the current file is 20.54 MiB which is also different from the earlier. |
#145
|
||||
|
||||
EDIT The video you uploaded to streamable.com for me is down.
Also in your newest example, I get the ~20.5MiB video so for some reason you must get another API response from iwara.tv when downloading a lot of items. Please try to use a new IP or a VPN and check the results then. Maybe this is some kind of "shadow ban" by iwara.tv. I remember hat the famous porn website "xvideos.com" added a shadow ban. Whenever this was active, a user would only always get the lowest video quality.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 31.10.2023 at 14:02. Reason: EDIT |
#146
|
|||
|
|||
I didn't know you won't be around in weekend so video expire.
It's kinda time sensitive I show you link and then three days later you test high chance of being source file. Now when I grab old link it'll also be the 20mb file. How about this one **External links are only visible to Support Staff****External links are only visible to Support Staff** No VPN 01.11.23 12.03.33 <--> 01.11.23 12.05.37 jdlog://6378311370661/ Use VPN 01.11.23 12.08.01 <--> 01.11.23 12.09.32 jdlog://7378311370661/ I use no vpn and with vpn to download the same file, same result. When linkgrab it show 65MiB, download switch to 27MiB. **External links are only visible to Support Staff****External links are only visible to Support Staff** **External links are only visible to Support Staff****External links are only visible to Support Staff** |
#147
|
||||
|
||||
Quote:
In this case / for this video, this is not a bug: When you add the link, JDownloader will first take the filesize which the iwara.tv Web-API shows: iwara.tv/video/Aoa36TfzaxxaNl --> api.iwara.tv/video/Aoa36TfzaxxaNl --> "size":201881 -> That equals 64,76 MiB Then later when the download is started, JDownloader will show the real filesize. In this case, the source file is 27,41 MiB in size. --> You can verify this in your browser. Now you could argue that the iwara.tv Web-API is displaying wrong values but apart from that I'm still unable to find any kind of JDownloader bug here. My theory:
Either way I'm unable to find any version of the above video that is 60+ MiB in size.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#148
|
|||
|
|||
I really don't know how to show you the problem. I submit log and recording multiple times already, but you say no problem. Maybe not jdownloader bug but maybe jdownloader not checking if video is really source.
The best example was this video **External links are only visible to Support Staff****External links are only visible to Support Staff**, where in my screenshot you can see it was download button was "Download (540p)" maybe cause recently uploaded. But if you check the page now it will show "Download (Source)". I even show you screenshot of jdownload when it download 8mb file at that time. But now I'll always get 20mb file and I can't reproduce the problem even though I got proof in screenshot that jdownloader didn't download source video, I don't know what is included in logs so I can't say but I submit logs also looks like useless cause you can't find issue. The problem only occur during the time I post and lasts maybe a few hours. I understand if weekend no support but this problem is pretty time sensitive if I show you now and again it's almost weekend by the time you check the problem will almost 100% be unable to reproduce. You can say just wait and download again, the problem I automate the downloads and many files so I don't know which videos suffered from that issue, it's only when I suspect and check manually then I'll find out that jdownloader didn't download source at that time. |
#149
|
||||
|
||||
I didn't just look at it and say "no problem".
I've provided a detailed explanation. Can you download a 64,76 MiB version of the example video which I was using in my last reply using other tools? Quote:
Please re-check. Please re-read my last post. It explains in details, why JDownloader is first showing a higher filesize which then changes. It also explains why/how this can happen. Until you got a proof that you can get a higher quality version of the video "Aoa36TfzaxxaNl", this is not a JDownloader bug! Max in browser is: ~27MB Max in JD is: ~27MB Maybe you should also understand that our support is free of charge.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#150
|
|||
|
|||
For this video **External links are only visible to Support Staff****External links are only visible to Support Staff**
I cannot get 64MB, but I show as example cause it had the same effect as this video **External links are only visible to Support Staff****External links are only visible to Support Staff** as first time I showed so I thought maybe can help you find problem. The effect being when I link grab **External links are only visible to Support Staff****External links are only visible to Support Staff** it'll show 20MB but overwrite and download become 8mb. I show in video but expired. It is similar to the non expire video I show, link grab show 64MB but overwrite and download become 20MB. But I say many time it was then, now if I download same video **External links are only visible to Support Staff****External links are only visible to Support Staff** it'll be 20MB every time. So now when you check you'll say it's 20MB not 8mb. I cannot get proof for this video **External links are only visible to Support Staff****External links are only visible to Support Staff** 64MB file. But I have proof in screenshot for **External links are only visible to Support Staff****External links are only visible to Support Staff** that when I first download is 8MB, but only after many hours later when I try to download again now it'll be 20MB, so what am I supposed to do. |
#151
|
||||
|
||||
I still can't reproduce your problem.
Please either use other tools to download iwara.tv videos or deep-dive into this topic, re-read my post and provide the information needed to reproduce- and/or detect the "quality downgrade". Repeating your previous posts will not help me to gather more findings. I'm done here for now.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#152
|
|||
|
|||
Hi please check this video
**External links are only visible to Support Staff****External links are only visible to Support Staff** ~285MiB linkgrab ~79MiB download I have use vpn and no vpn to download same result Here are the logs 03.11.23 12.15.34 <--> 03.11.23 12.22.26 jdlog://1978311370661/ I have asked on iwara forum regarding "ip ban" "shadowban" and am sure it is not the cause. Instead it is slow encoding server affecting new uploads, that why so hard to reproduce. The video at time of post is up for 51 min but still serving 540p version. I will keep try until get source then upload logs again. *edit* Adding extra information Hi you keep thinking it is "ip ban" "shadowban" even though I disagree, so I ask on iwara and mod respond that is cause of slow encoding server. **External links are only visible to Support Staff****External links are only visible to Support Staff** That why so hard to reproduce, when I identify a video and by the time you check already hours past and encoding server process so you will say cannot reproduce. Now I can only say check new video but also difficult cause you see time range is so big and random, from minutes to hours cause depend on server load. If you still don't accept, I have another reasoning why it is not a "shadowban". If I download 100 videos and iwara have shadowban limit at for example, after 50 videos ban you, then I should get source video from video #1 to #50 then #51 to #100 will be 540p, that will mean a lot of my videos will be 540p. But this is not happen, I get random videos so maybe video #1 to #30 source, #31 will be 540p, then #32 to #80 will be source and than maybe #81 might be 540p than #82 to #100 is source. The occur is scattered and very random, so I ask why shadowban only 1 or 2 video when I donwloading 100 videos? What is point? What you save? If shadowban really happening then I should have a lot of these sort of videos not a few scattered in between. So iwara have lousy server, can't be help, I already set profile check to be 12 hours from 6 hours, but I cannot control when people will upload and what server load will be, maybe someone upload only half hour before when I start checking profile and server still encoding then I will still get the random non source videos. I suggest need some way to identify when you are downloading non source videos for example tag video resolution so when you see at least you can rectify instead of have archive polluted with non source and not know. I tried to change name convention from plugin customized to server original cause name convention is include 123_xxxYYY_Resolution.mp4 so at least can see if have source tag, but no work as it will still take date_uploader_videoid_title.ext Last edited by lafhej; 03.11.2023 at 14:54. Reason: Adding extra information |
#153
|
||||
|
||||
You didn't even read or understand my post #147(?)
One last time: - The iwara.tv API claims that this video is 285MiB in size. This is that you can see in JDownloader when adding that link. - Then when the download is started, the best quality / highest size is 79MiB --> You can verify this information via browser for example by using VideoDownloadHelper. Only the iwara.tv support can know what the 285MiB value that is in their Web-API stands for.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#154
|
|||
|
|||
Hi I understand, but I think you mistaken, I added extra information first but I need to post video first make you see right now download is 79MiB, please wait maybe 1 hour later and try download again if is 285MiB.
|
#155
|
||||
|
||||
Let's put it this way:
If you want I can add a setting so that if the size of the final file is less than 75% of the file-size value provided via API, you will get an error-message. ...though I'm not sure if this will really help. In the worst case, this will just happen for all downloads. EDIT I will soon be offline and back next week on monday.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 03.11.2023 at 15:08. Reason: EDIT |
#156
|
|||
|
|||
Hi, if you check video again Monday, you'll see now is source video, not ~285MiB but ~206MiB.
Logs 03.11.23 13.56.20 <--> 03.11.23 14.28.49 jdlog://5978311370661/ I mention in post earlier big problem is cannot identify these files are hiding in your downloads. Is there no way to see from my logs the difference and either tag to filename or delay download? I notice if you check website, if encoding still you will find download button only show 540p and 360p 1 hour from upload with 540p But once encode finish, download button will show Source, 540p and 360p. 3 hour from upload with source Can check website for this? Also in your post about api.iwara.tv/video/Aoa36TfzaxxaNl I don't know how to read api but I see two size, one 201881, another 68950834 one bigger than other is that help? |
#157
|
||||
|
||||
201881 is the size of an image (thumbnail).
You can view the json of that API request via this webtool: jsoneditoronline.org Again: My offer on what I can do is in my last post #155. I'm off into the weekend now.
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 03.11.2023 at 17:12. Reason: Fixed typo |
#158
|
||||
|
||||
Added simple detection of "too small files".
If the final file has less than 75% of the size previously detected via Web-API, an error can be displayed. Screenshot: This feature hasn't been released yet! If you want you can already test it in the developer version: https://support.jdownloader.org/Know...up-ide-eclipse
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download |
#159
|
|||
|
|||
After making packagizers for iwara, for example packagizer about "**External links are only visible to Support Staff**. if 729 updates new video is there anyway to auto scrap those new videos and download? Should I just put that link to jdownloader again?
|
#160
|
||||
|
||||
There is no official feature for this but with EventScripter scripts you could do it by creating a script which will only move all items which are not in downloadlist already to your downloadlist.
EventScripter forum thread: https://board.jdownloader.org/showthread.php?t=70525 EventScripter help article: https://support.jdownloader.org/Know...event-scripter
__________________
JD Supporter, Plugin Dev. & Community Manager
Erste Schritte & Tutorials || JDownloader 2 Setup Download Last edited by pspzockerscene; 28.12.2023 at 15:01. |
Thread Tools | |
Display Modes | |
|
|