JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #141  
Old 27.10.2023, 18:25
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Sure.
Log instructions:
https://support.jdownloader.org/Know...d-session-logs
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #142  
Old 27.10.2023, 18:41
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

I have enabled debug mode, should I wait until I encounter the problem again or resubmit the previous logs?

*edit*

I think I might have a example right now.

**External links are only visible to Support Staff****External links are only visible to Support Staff**

As of time of writing there is only 540 download and no source

https://imgur.com/a/fUcMTRc

https://imgur.com/a/nZqFGA7
27.10.23 23.39.10 <--> 27.10.23 23.36.45 jdlog://0668311370661/

Added log hopefully it captured it.

Last edited by lafhej; 27.10.2023 at 18:53.
Reply With Quote
  #143  
Old 27.10.2023, 18:47
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Wait until you encounter it again and the best would be if you would be able to reproduce it:
Then restart JD so you got a fresh session -> Reproduce the problem and upload a fresh log.

What would be interesting to me:
Usually JD will get the same response as your browser so technically if all of the sudden the "source" version is missing in JD, it should be missing in browser too when you're playing the video there.

Sure it could also be a measure of iwara.tv to block/shadow-ban bots/tools like JDownloader but that would be a very vague assumption at this moment.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #144  
Old 28.10.2023, 00:37
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

How to reproduce, I can only identify, cause I only find out if when I reset the link and check if it will download source version. I can only show the initial download is not source but when I reset and it downloads the source video it will only download source video from then on.
I cannot say every video less than 100mb or have 540p res is not source video cause sometimes actual video is really less than 100mb and user only upload 540p.

For example the above video I linked, linkgrabber show 20.51MiB size, but when download only 8.51 MiB. Here's even a recording.
**External links are only visible to Support Staff****External links are only visible to Support Staff**

That was earlier, at time of this post when I try to download it I cannot get the 8.51 MiB file anymore. Infact the current file is 20.54 MiB which is also different from the earlier.
Reply With Quote
  #145  
Old 30.10.2023, 13:07
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

EDIT The video you uploaded to streamable.com for me is down.


Also in your newest example, I get the ~20.5MiB video so for some reason you must get another API response from iwara.tv when downloading a lot of items.

Please try to use a new IP or a VPN and check the results then.
Maybe this is some kind of "shadow ban" by iwara.tv.
I remember hat the famous porn website "xvideos.com" added a shadow ban. Whenever this was active, a user would only always get the lowest video quality.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 31.10.2023 at 14:02. Reason: EDIT
Reply With Quote
  #146  
Old 01.11.2023, 06:21
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

I didn't know you won't be around in weekend so video expire.

It's kinda time sensitive I show you link and then three days later you test high chance of being source file. Now when I grab old link it'll also be the 20mb file.

How about this one

**External links are only visible to Support Staff****External links are only visible to Support Staff**

No VPN
01.11.23 12.03.33 <--> 01.11.23 12.05.37 jdlog://6378311370661/

Use VPN
01.11.23 12.08.01 <--> 01.11.23 12.09.32 jdlog://7378311370661/

I use no vpn and with vpn to download the same file, same result. When linkgrab it show 65MiB, download switch to 27MiB.

**External links are only visible to Support Staff****External links are only visible to Support Staff**
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #147  
Old 02.11.2023, 14:54
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Quote:
Originally Posted by lafhej View Post
I use no vpn and with vpn to download the same file, same result. When linkgrab it show 65MiB, download switch to 27MiB.
Maybe we were talking past each other.
In this case / for this video, this is not a bug:
When you add the link, JDownloader will first take the filesize which the iwara.tv Web-API shows:
iwara.tv/video/Aoa36TfzaxxaNl
-->
api.iwara.tv/video/Aoa36TfzaxxaNl
--> "size":201881 -> That equals 64,76 MiB

Then later when the download is started, JDownloader will show the real filesize.
In this case, the source file is 27,41 MiB in size.
--> You can verify this in your browser.

Now you could argue that the iwara.tv Web-API is displaying wrong values but apart from that I'm still unable to find any kind of JDownloader bug here.

My theory:
  • The iwara.tv Web-API is returning wrong filesize information
  • or: The iwara.tv Web-API is returning filesize-information about the original file while the stream API "source" file is not really the original but also a transcoded file

Either way I'm unable to find any version of the above video that is 60+ MiB in size.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #148  
Old 02.11.2023, 16:40
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

I really don't know how to show you the problem. I submit log and recording multiple times already, but you say no problem. Maybe not jdownloader bug but maybe jdownloader not checking if video is really source.

The best example was this video **External links are only visible to Support Staff****External links are only visible to Support Staff**, where in my screenshot you can see it was download button was "Download (540p)" maybe cause recently uploaded. But if you check the page now it will show "Download (Source)". I even show you screenshot of jdownload when it download 8mb file at that time. But now I'll always get 20mb file and I can't reproduce the problem even though I got proof in screenshot that jdownloader didn't download source video, I don't know what is included in logs so I can't say but I submit logs also looks like useless cause you can't find issue.

The problem only occur during the time I post and lasts maybe a few hours. I understand if weekend no support but this problem is pretty time sensitive if I show you now and again it's almost weekend by the time you check the problem will almost 100% be unable to reproduce.

You can say just wait and download again, the problem I automate the downloads and many files so I don't know which videos suffered from that issue, it's only when I suspect and check manually then I'll find out that jdownloader didn't download source at that time.
Reply With Quote
  #149  
Old 02.11.2023, 16:53
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Quote:
Originally Posted by lafhej View Post
but you say no problem
I didn't just look at it and say "no problem".
I've provided a detailed explanation.
Can you download a 64,76 MiB version of the example video which I was using in my last reply using other tools?

Quote:
Originally Posted by lafhej View Post
where in my screenshot you can see it was download button was "Download (540p)" maybe cause recently uploaded. But if you check the page now it will show "Download (Source)". I even show you screenshot of jdownload when it download 8mb file at that time. But now I'll always get 20mb file and I can't reproduce the problem even though I got proof in screenshot that jdownloader didn't download source video, I don't know what is included in logs so I can't say but I submit logs also looks like useless cause you can't find issue.
When I'm checking this video in my browser now, the max file size is ~20MiB so maybe that has changed serverside.
Please re-check.

Please re-read my last post.
It explains in details, why JDownloader is first showing a higher filesize which then changes.
It also explains why/how this can happen.


Until you got a proof that you can get a higher quality version of the video "Aoa36TfzaxxaNl", this is not a JDownloader bug!
Max in browser is: ~27MB
Max in JD is: ~27MB

Quote:
Originally Posted by lafhej View Post
I understand if weekend no support
Maybe you should also understand that our support is free of charge.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #150  
Old 02.11.2023, 17:14
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

For this video **External links are only visible to Support Staff****External links are only visible to Support Staff**
I cannot get 64MB, but I show as example cause it had the same effect
as this video **External links are only visible to Support Staff****External links are only visible to Support Staff** as first time I showed so I thought maybe can help you find problem.

The effect being when I link grab **External links are only visible to Support Staff****External links are only visible to Support Staff** it'll show 20MB but overwrite and download become 8mb. I show in video but expired. It is similar to the non expire video I show, link grab show 64MB but overwrite and download become 20MB. But I say many time it was then, now if I download same video **External links are only visible to Support Staff****External links are only visible to Support Staff** it'll be 20MB every time. So now when you check you'll say it's 20MB not 8mb.

I cannot get proof for this video **External links are only visible to Support Staff****External links are only visible to Support Staff** 64MB file.
But I have proof in screenshot for **External links are only visible to Support Staff****External links are only visible to Support Staff** that when I first download is 8MB, but only after many hours later when I try to download again now it'll be 20MB, so what am I supposed to do.
Reply With Quote
  #151  
Old 02.11.2023, 17:26
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

I still can't reproduce your problem.

Please either use other tools to download iwara.tv videos or deep-dive into this topic, re-read my post and provide the information needed to reproduce- and/or detect the "quality downgrade".
Repeating your previous posts will not help me to gather more findings.

I'm done here for now.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #152  
Old 03.11.2023, 14:29
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

Hi please check this video

**External links are only visible to Support Staff****External links are only visible to Support Staff**

~285MiB linkgrab
~79MiB download

I have use vpn and no vpn to download same result
Here are the logs
03.11.23 12.15.34 <--> 03.11.23 12.22.26 jdlog://1978311370661/

I have asked on iwara forum regarding "ip ban" "shadowban" and am sure it is not the cause. Instead it is slow encoding server affecting new uploads, that why so hard to reproduce. The video at time of post is up for 51 min but still serving 540p version. I will keep try until get source then upload logs again.

*edit*

Adding extra information

Hi you keep thinking it is "ip ban" "shadowban" even though I disagree, so I ask on iwara and mod respond that is cause of slow encoding server.
**External links are only visible to Support Staff****External links are only visible to Support Staff**
That why so hard to reproduce, when I identify a video and by the time you check already hours past and encoding server process so you will say cannot reproduce. Now I can only say check new video but also difficult cause you see time range is so big and random, from minutes to hours cause depend on server load.

If you still don't accept, I have another reasoning why it is not a "shadowban".

If I download 100 videos and iwara have shadowban limit at for example, after 50 videos ban you, then I should get source video from video #1 to #50 then #51 to #100 will be 540p, that will mean a lot of my videos will be 540p. But this is not happen, I get random videos so maybe video #1 to #30 source, #31 will be 540p, then #32 to #80 will be source and than maybe #81 might be 540p than #82 to #100 is source. The occur is scattered and very random, so I ask why shadowban only 1 or 2 video when I donwloading 100 videos? What is point? What you save? If shadowban really happening then I should have a lot of these sort of videos not a few scattered in between.


So iwara have lousy server, can't be help, I already set profile check to be 12 hours from 6 hours, but I cannot control when people will upload and what server load will be, maybe someone upload only half hour before when I start checking profile and server still encoding then I will still get the random non source videos.

I suggest need some way to identify when you are downloading non source videos for example tag video resolution so when you see at least you can rectify instead of have archive polluted with non source and not know. I tried to change name convention from plugin customized to server original cause name convention is include 123_xxxYYY_Resolution.mp4 so at least can see if have source tag, but no work as it will still take date_uploader_videoid_title.ext

Last edited by lafhej; 03.11.2023 at 14:54. Reason: Adding extra information
Reply With Quote
  #153  
Old 03.11.2023, 14:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

You didn't even read or understand my post #147(?)

One last time:
- The iwara.tv API claims that this video is 285MiB in size. This is that you can see in JDownloader when adding that link.
- Then when the download is started, the best quality / highest size is 79MiB
--> You can verify this information via browser for example by using VideoDownloadHelper.

Only the iwara.tv support can know what the 285MiB value that is in their Web-API stands for.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #154  
Old 03.11.2023, 14:56
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

Hi I understand, but I think you mistaken, I added extra information first but I need to post video first make you see right now download is 79MiB, please wait maybe 1 hour later and try download again if is 285MiB.
Reply With Quote
  #155  
Old 03.11.2023, 15:00
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Let's put it this way:
If you want I can add a setting so that if the size of the final file is less than 75% of the file-size value provided via API, you will get an error-message.
...though I'm not sure if this will really help.
In the worst case, this will just happen for all downloads.
EDIT

I will soon be offline and back next week on monday.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 03.11.2023 at 15:08. Reason: EDIT
Reply With Quote
  #156  
Old 03.11.2023, 17:03
lafhej lafhej is offline
DSL User
 
Join Date: Jun 2022
Posts: 35
Default

Hi, if you check video again Monday, you'll see now is source video, not ~285MiB but ~206MiB.
Logs
03.11.23 13.56.20 <--> 03.11.23 14.28.49 jdlog://5978311370661/

I mention in post earlier big problem is cannot identify these files are hiding in your downloads.
Is there no way to see from my logs the difference and either tag to filename or delay download?

I notice if you check website, if encoding still you will find download button only show 540p and 360p

1 hour from upload with 540p

But once encode finish, download button will show Source, 540p and 360p.

3 hour from upload with source

Can check website for this?

Also in your post about
api.iwara.tv/video/Aoa36TfzaxxaNl

I don't know how to read api but I see two size, one 201881, another 68950834 one bigger than other is that help?
Reply With Quote
  #157  
Old 03.11.2023, 17:10
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

201881 is the size of an image (thumbnail).
You can view the json of that API request via this webtool: jsoneditoronline.org

Again:
My offer on what I can do is in my last post #155.

I'm off into the weekend now.
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 03.11.2023 at 17:12. Reason: Fixed typo
Reply With Quote
  #158  
Old 07.11.2023, 15:41
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Added simple detection of "too small files".
If the final file has less than 75% of the size previously detected via Web-API, an error can be displayed.
Screenshot:

This feature hasn't been released yet!
If you want you can already test it in the developer version:

https://support.jdownloader.org/Know...up-ide-eclipse
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #159  
Old 25.12.2023, 09:31
ntljc16 ntljc16 is offline
Modem User
 
Join Date: Jun 2023
Posts: 3
Default

After making packagizers for iwara, for example packagizer about "**External links are only visible to Support Staff**. if 729 updates new video is there anyway to auto scrap those new videos and download? Should I just put that link to jdownloader again?
Reply With Quote
  #160  
Old 28.12.2023, 14:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

There is no official feature for this but with EventScripter scripts you could do it by creating a script which will only move all items which are not in downloadlist already to your downloadlist.

EventScripter forum thread:
https://board.jdownloader.org/showthread.php?t=70525
EventScripter help article:
https://support.jdownloader.org/Know...event-scripter
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?

Last edited by pspzockerscene; 28.12.2023 at 15:01.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 06:39.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.