JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #5221  
Old 05.09.2022, 10:42
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by JDmurphy View Post
After installing the first update from Sun Sep 04 13:20:37 (build #46668) yt dl speeds were still slow.
Later today, speeds went back to normal while I was still on that exact same build, JD running continuously, no restarts.
The update was released sunday at 13.20 o'clock. But it's unpredictable when/if existing links in list will benefit from the update to have better speeds because only if cached links are expired/failed then JDownloader will reprocess them and be able to incorporate the fix. I have prepared handling for auto refreshing links but this is not ready yet.

Quote:
Originally Posted by JDmurphy View Post
Is there any difference between the two that I might not be aware of which needed clarification?
I just wanted to explain that in case the issue/bugfix is within a plugin only, it can be fixed/updated(with the plugin only advantages in mind) and doesn't require/depend on any core changes. But in this case the required change was within a method part of the core (not in plugin and thus no plugin changes regarding this issue) and therefore a core update/restart was required. But with broken method in core, this can also have affect on plugin in meaning of *plugin broken*
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 05.09.2022 at 10:49.
Reply With Quote
  #5222  
Old 05.09.2022, 10:43
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by wppcproductions View Post
Sorry to say If the YT bugs dont get solved with JD2.
Solved with latest update on sunday 13.20 o'clock.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5223  
Old 05.09.2022, 11:28
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

@GNIREENIGNE
@jellytot
Please see https://board.jdownloader.org/showpo...postcount=5164
Thanks to @goldensun87 for taking time to explain this
You will have to wait (unknown how long it will take) till processing of the streams are finished but you will
have to readd the links.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5224  
Old 05.09.2022, 19:11
GNIREENIGNE GNIREENIGNE is offline
JD Beta
 
Join Date: Feb 2013
Posts: 53
Default

Quote:
Originally Posted by goldensun87 View Post
Maybe your video is/was a live stream
-Thanks. This was my first consideration. However, the stream is no longer live. In fact, it has been three days already since it was live.

That being said, I suppose that the video could still processing, since it is a 5-hour long video. I will keep trying and report back, either way.

Thank you for taking the time. I appreciate it.

Quote:
Originally Posted by Jiaz View Post
You will have to wait (unknown how long it will take) till processing of the streams are finished but you will
have to readd the links.
-Thank you, Jiaz. It is possible that the video is still processing. I will keep trying and report back after giving it more time.

Thank you. I appreciate your efforts here.
Reply With Quote
  #5225  
Old 05.09.2022, 19:40
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by GNIREENIGNE View Post
-Thanks. This was my first consideration. However, the stream is no longer live. In fact, it has been three days already since it was live.That being said, I suppose that the video could still processing, since it is a 5-hour long video. I will keep trying and report back, either way.
I know of reports that this process might take several days and even might take longer for longer videos. I guess live stream conversion are not high priority because the video already exists in a form (stored on server) that can be played back normally.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5226  
Old 05.09.2022, 20:38
GNIREENIGNE GNIREENIGNE is offline
JD Beta
 
Join Date: Feb 2013
Posts: 53
Default

Quote:
Originally Posted by Jiaz View Post
I know of reports that this process might take several days and even might take longer for longer videos.
-Okay. I will let you know what I experience with it and if anything changes.

Thanks, again.
Reply With Quote
  #5227  
Old 05.09.2022, 23:40
wppcproductions wppcproductions is offline
Giga Loader
 
Join Date: Jun 2019
Posts: 93
Default

Thanks a millions Jiaz for fixing this problem...I rerun my YT files with the DASH turned on in the advance settings and all download speeds are back to normal..

Users got to remember they have to delete to old YT links and reload Link Grabber with new YT links of video from the channels they chose to download from if they want the DASH versions..

Thanks again Jiaz and the JD2 Dev Team for your dedication to keep JD2 up and running through a fast pace of changes in the world of computer environment.

BTW Did not have a packaging problem as as reported by other users.
Reply With Quote
  #5228  
Old 06.09.2022, 00:07
wppcproductions wppcproductions is offline
Giga Loader
 
Join Date: Jun 2019
Posts: 93
Default

For live streams I usually wait until few hours later or until the next day after the stream is done. But as long the channel user want to share the stream for their subscribers to watch again or missed the live stream .Thats the bonus and the opportunity to download it for keepers.Depends how long the live stream video . The reason for the wait time is because the live stream has to go the process as it gets rendered at YT for it will get posted for replay.

For a 10 hour live stream that I wanted .I waited approx 12 hours until done rendering at YT to get posted on the users channel .And another 10 to 12 hours to download via JD2 at normal speed. It was will worth the wait..
Reply With Quote
  #5229  
Old 06.09.2022, 00:59
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Quote:
Originally Posted by Jiaz View Post
The update was released sunday at 13.20 o'clock.
I just so happened to catch the notification for that one immediately, installed the update, and after restart initiated a new download of a 224,244 KB video which according to logs took 53 mins to finish, averaging exactly to the widely reported 70 Kbit/s throttled speed - and only after sending my post above (and heading to sleep bc it was already midnight) I found this helpful hint:
Quote:
Originally Posted by TheRenegadist View Post
If anyone updates and still gets slow speeds I had that happen but only for the last video I had downloading in my queue, once that finished the speeds were good.
While that was true for two of my downloads, which resumed seamlessly, not only those but also newly queued links like the abovementioned one were throttled ...
Quote:
Originally Posted by Jiaz View Post
But it's unpredictable when/if existing links in list will benefit from the update to have better speeds because only if cached links are expired/failed then JDownloader will reprocess them and be able to incorporate the fix.
... and this explains it!
Once the LinkGrabber grabs a link, it's cached - so apparently all the affected links were already grabbed just recently before updating, hence not reprocessed, hence didn't get the fix applied, and were therefore throttled even though I had not added them to the download queue yet.

Assuming this is correct, there's only one question left (that would possibly require explanation :>) which is:
Quote:
I have prepared handling for auto refreshing links but this is not ready yet.
What's your thoughts on executing a refresh also when a RightClick>Other>Reset is initiated?
Because that turned out to be the only other obstacle: Even after resetting links, they were still throttled - so I guess a reset doesn't refresh them. Since resetting links clears a whole variety of issues, you could suppose this to be expected behavior.
Not that it matters much right now as youtube currently seems to chill with the throttles, but maybe this manual refresh is simple enough to amend before rolling out the auto refresh you mentioned, just to have something in the meantime.

Quote:
Originally Posted by Jiaz View Post
I just wanted to explain
Quote:
Originally Posted by JDmurphy View Post
to convey right away that I'm aware plugin fixes can be applied in the background so that JDownloader can directly make use of them while core updates do require a restart
... this? yet again?
Quote:
Originally Posted by Jiaz View Post
in case the issue/bugfix is within a plugin only, it can be fixed/updated(with the plugin only advantages in mind) and doesn't require/depend on any core changes. But in this case the required change was within a method part of the core (not in plugin and thus no plugin changes regarding this issue) and therefore a core update/restart was required.
Still looks like the same thing to me (just as the other two quotes compared above) but idk maybe that's just me

Quote:
Originally Posted by JDmurphy View Post
"Due to changes in the player.js library the JD youtube plugin wasn't working properly, and a core function had to be fixed to make the plugin work again while fixing the plugin itself wasn't required."
Quote:
Originally Posted by Jiaz View Post
But with broken method in core, this can also have affect on plugin in meaning of *plugin broken*
Sounds familiar
So I guess the quick&short answer is "no, there's no essential difference, you got that right straight away"

But since we're at it (again), both updates on Sunday 4th required a restart, but as noted in #5161 both still had the same build number #46668. I noticed the same on May 14th/15th with build #45992.
Given that only core updates (as I first mentioned in #5118 and since then got "confirmed" many many times) require a restart, that consequently means there are core updates that don't justify/receive a new build number?

Last edited by JDmurphy; 06.09.2022 at 02:51. Reason: plentiful clarifications to thwart extensive re-explanations :)
Reply With Quote
  #5230  
Old 06.09.2022, 08:58
GNIREENIGNE GNIREENIGNE is offline
JD Beta
 
Join Date: Feb 2013
Posts: 53
Default

Quote:
Originally Posted by GNIREENIGNE View Post
-Okay. I will let you know what I experience with it and if anything changes.

Thanks, again.
-Just for your information, after four days, the video is now available for complete download.

Thanks to everyone that has replied.
Reply With Quote
  #5231  
Old 06.09.2022, 11:15
rezad rezad is offline
JD Adviser
 
Join Date: Jan 2014
Posts: 109
Default

Quote:
Originally Posted by pspzockerscene View Post
@rezad
Filename for video files -->
Code:
*VIDEO_NAME* *quality*(*HEIGHT*p)*.EXT*
no.
I need a the info for max resolution not the downloaded resolution.
the one you suggested would put this in name 428p for 854x428 downloaded youtube link that has even 3840x1920 1920p.
what I need is for youtube download file to be named 854x428 1920p.
Reply With Quote
  #5232  
Old 06.09.2022, 11:26
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by GNIREENIGNE View Post
-Just for your information, after four days, the video is now available for complete download.
Thanks for the feedback

Quote:
Originally Posted by rezad View Post
I need a the info for max resolution not the downloaded resolution.
what I need is for youtube download file to be named 854x428 1920p.
Use the following to return the itag best resolution
Quote:
*BESTRESOLUTION*
or the following to return actual best video height
Quote:
*HEIGHT_BEST*
(after next update)
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 06.09.2022 at 11:52.
Reply With Quote
  #5233  
Old 06.09.2022, 14:05
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Regarding downloading whole channels/playlists with 100+ videos:

Quote:
Originally Posted by zToRm777 View Post
Video Liste in Youtube öffnen, mit FoxScroller (Firefox-Add-On) automatisch runterscrollen lassen, mit Link Gopher alle Links extrahieren, Links kopieren, in JD einfügen.
Especially for larger channels or longer playlists I found another interim solution; there are online tools/sites providing the benefit of extracting and downloading the whole "Uploads" list in a few seconds in .csv or .json format, with some of those lists even limited to videos that are de facto accessible ("available.json"), excluding unlisted and private videos.

Either by copypasting the lists entirely while clipboard monitoring is active, or even better after filtering them for actual video urls (to avoid included channel/playlist/random other urls being grabbed and then being prompted by JDownloader if you wish to process those as well), you get a clean LinkGrabber folder with a link collection of all the videos up to hundreds if not thousands at a time ... I haven't tested the limits yet.

Another option - with deactivated clipboard monitoring - is to copy those lists, open the Add and Analyse Links dialog with the Add New Links button bottom left in the LinkGrabber tab, and paste them there. This has the advantage of getting a progress dialog that illustrates the process.

The scrolling down method is limited by youtube just stopping after a couple hundred videos and just not populating more videos to the browser tab at some point, so this alternative might also be the only chance to fully get a complete list of a larger channel's whole uploads.


edit: The site I'm using myself for this (and for other purposes like upload date/time extraction as well) on a daily basis was intentionally not named/linked, because that specific application is traffic/request capped and already runs into its limits now every once in a while. It should be fairly easy to find it or a similar one tho.

Last edited by JDmurphy; 06.09.2022 at 14:33.
Reply With Quote
  #5234  
Old 06.09.2022, 14:32
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by JDmurphy View Post
... and this explains it!
Once the LinkGrabber grabs a link, it's cached - so apparently all the affected links were already grabbed just recently before updating, hence not reprocessed, hence didn't get the fix applied, and were therefore throttled even though I had not added them to the download queue yet.
Assuming this is correct, there's only one question left (that would possibly require explanation :>) which is:
What's your thoughts on executing a refresh also when a RightClick>Other>Reset is initiated?
Already working on that

Quote:
Originally Posted by JDmurphy View Post
Even after resetting links, they were still throttled - so I guess a reset doesn't refresh them. Since resetting links clears a whole variety of issues, you could suppose this to be expected behavior.
Because there are link local caches AND session caches. Reset currently only clears link local cache, will have to update it to also refresh session cache
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 06.09.2022 at 14:40.
Reply With Quote
  #5235  
Old 06.09.2022, 14:52
JDmurphy JDmurphy is offline
Fibre Channel User
 
Join Date: Mar 2012
Posts: 120
Default

Quote:
Originally Posted by Jiaz View Post
Reset currently only clears link local cache, will have to update it to also refresh session cache
Great news, thanks!

Quote:
Originally Posted by JDmurphy View Post
[...], that consequently means there are core updates that don't justify/receive a new build number?
If I'm correct, just a "yes" would hit the spot ... if I'm wrong, nevermind!

Last edited by JDmurphy; 06.09.2022 at 15:09. Reason: added snippet
Reply With Quote
  #5236  
Old 06.09.2022, 15:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by JDmurphy View Post
If I'm correct, just a "yes" would hit the spot ... if I'm wrong, nevermind!
"yes" but I'll try to explain it
Quote:
consequently means there are core updates that don't justify/receive a new build number?
those *build numbers* are the actual revision of the source code used for the build. but regulary plugin only builds/updates only checkout/build plugins and thefore the core revision does not change. unfortunately there is (not yet) no plugin buld revision and therefore plugin-only builds/updates will have changed build date but unchanged revisions.
__________________
JD-Dev & Server-Admin

Last edited by pspzockerscene; 06.09.2022 at 16:02. Reason: Added "-"
Reply With Quote
  #5237  
Old 06.09.2022, 17:20
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

Quote:
Originally Posted by Jiaz View Post
Because there are link local caches AND session caches. Reset currently only clears link local cache, will have to update it to also refresh session cache
Just checked and reset already clears link local and global cache.
Quote:
Even after resetting links, they were still throttled - so I guess a reset doesn't refresh them.
I could not reproduce this issue. Please know that reset will only reset selected links and the global link. if there are links in linkgrabber, those will not be affected by this. you will have to move those to download list and then reset.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #5238  
Old 07.09.2022, 17:25
rezad rezad is offline
JD Adviser
 
Join Date: Jan 2014
Posts: 109
Default

Quote:
Originally Posted by Jiaz View Post
Thanks for the feedback


Use the following to return the itag best resolution or the following to return actual best video height(after next update)
when Is the next update?
right now it uses those tags just literal texts.
Reply With Quote
  #5239  
Old 07.09.2022, 17:31
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 70,683
Default

Quote:
Originally Posted by rezad View Post
when Is the next update?
Please read our Update FAQ regarding releases of CORE-updates:

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5240  
Old 07.09.2022, 18:49
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 79,112
Default

@rezad: I try to release it before/on friday. Also please know that this placeholder will only work for new added links
__________________
JD-Dev & Server-Admin

Last edited by Jiaz; 07.09.2022 at 19:23.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 20:08.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.