JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #41  
Old 31.03.2022, 13:57
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

Announcement:
The next CORE-Updates will bring major changes to our Instagram plugins!

Here is a rough changelog:
- better filenames for story items
- better logging
- hashtag/profile/saved-posts crawling: put all results into one package
- packagenames: disabled packagename cleanup
- added errorhandling for profiles that contain no saved posts
- huge speed improvement when crawling posts with multiple items (type 'GraphSidecar') in context of timelines/hashtag/saved posts
- improved packagenames for story highlights: new scheme is: "story - highlights - <username> - <highlightTitle>" (old was "story - highlights - <highlightID>" or only "story - highlights - <username>")
- fixed orderID properties for stories and stories highlights
- fixed contentURLs for stories and story highlights
- new packagenames for single posts: <username> - <postID>
- property 'orderid' is now available for all elements
- property 'postid' is now 'internal_media_id'
- updated host plugin pattern
- improved directurl refresh for video items
- Best quality will now sometimes even be detected if setting "Try to download original quality" is off

Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 01.04.2022 at 17:44. Reason: Updated changelog
Reply With Quote
  #42  
Old 01.04.2022, 19:05
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

These mentioned changes to our Instagram plugins have just been released.
Have fun with the new features and please provide feedback if you encounter any issues.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #43  
Old 02.04.2022, 01:36
Shmi Shmi is offline
Vacuum Cleaner
 
Join Date: Jan 2020
Posts: 19
Default

Is it possible to disable the following setting for single element/items posts:
" - property 'orderid' is now available for all elements "

Example:
I want this filename:
barackobama - CaFxhi0Pon8

Instead of this:
barackobama - CaFxhi0Pon8 - 1


Mass renaming " - 1.jpg" to ".jpg" in filenames afterwards, would also delete the order id in multiple elements posts

Why do I want it to be like the old filenames? Because renaming already downloaded media or checking for duplicates with new files with newer names is a big problem.

Last edited by Shmi; 02.04.2022 at 01:48. Reason: corrections
Reply With Quote
  #44  
Old 02.04.2022, 02:10
goldensun87 goldensun87 is offline
JD Beta
 
Join Date: Feb 2012
Posts: 56
Default

Thank you very much for this update. Especially for the orderid packagizer element. I was thinking of asking for that.

However, is there still a packagizer element for "postID"? For example, "Cb07TUNLIcL"? Having this string attached to each filename, makes it possible to quickly navigate back to a post, or more importantly, get back to a user account who changed their username. The "internal media id" can only be viewed in a post's source code, and, well, that can only be done once the post page is loaded.

"<username> <upload date> [<postID>]_<orderid>". Now that shortcodes are more or less gone, that is the filename structure I am aiming for. I just need to be able to automatically plug the postID into the filenames, and I am back to being able to name instagram files just the way I need. At least, until Insta breaks something again ��.

Last edited by goldensun87; 02.04.2022 at 02:25.
Reply With Quote
  #45  
Old 02.04.2022, 09:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 75,200
Default

@Shmi and @goldensun87
I'm sure this should be possible, wait for feedback from pspzockerscene next week
__________________
JD-Dev & Server-Admin
Reply With Quote
  #46  
Old 04.04.2022, 14:46
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

Quote:
Originally Posted by goldensun87 View Post
However, is there still a packagizer element for "postID"?
The "postID" property has been moved/renamed because it always only contained the internal ID of the postWhat you want is the ID that represents the post also in browser e.g. instagram.com/p/<thisID>.
You can get it using the following plugin property: main_content_id

Regarding all other Instagram feedback:
Thanks for your feedback!
I'll work on it and post the next changelog once I'm done.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #47  
Old 04.04.2022, 17:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

Instagram plugin changes for the next CORE-update:

- Only append orderID to filename if wished by user and item is part of post/story with more than 1 elements
- Added new plugin property: orderid_max_raw --> Represents the total number of items in a post/story
- Added settings for custom package names for single posts (instagram.com/p/<id>):
Set 'Post crawler: Enter custom package name scheme for instagram.com/p/<id>' to 'Custom'
...and the custom naming scheme in 'Post crawler: Enter custom package name scheme for instagram.com/p/<id>' will be used.
- Sorted plugin settings a bit because our Instagram plugin now has a lot of settings
- text file downloads: fixed filenames not looking like other filenames when being added as part of posts with multiple items (default filename scheme = <date>_<uploader> - <main_content_id>)
- text file download: fixed missing DownloadLink properties such as 'uploader'
- hashtag crawler: fixed wrong usernames and removed setting "Crawl- and set usernames for filenames when crawling '/explore/tags/<hashtag>' URLs? (slows down crawl-process!)" because usernames are always available now
- Added ability to choose custom filenames (see plugin settings)
- Added support for url type: /<profileName>/tagged/ based on this request --> Max. number of items to crawl can be defined in the plugin settings (default = 25)
- hashtag crawler: added setting to enforce usage of alternative API (can get "best quality" right away and without usage of setting "Try to download original quality")
- Added "API preference" setting for Profile crawler and Hashtag crawler

Screenshot + some explanation of the API preference setting:


Bitte auf das nächste CORE-Update warten!

Please wait for the next CORE-Update!

Wartest du auf einen angekündigten Bugfix oder ein neues Feature?
Updates werden nicht immer sofort bereitgestellt!
Bitte lies unser Update FAQ! | Please read our Update FAQ!

---
Are you waiting for recently announced changes to get released?
Updates to not necessarily get released immediately!
Bitte lies unser Update FAQ! | Please read our Update FAQ!


-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 06.04.2022 at 12:54. Reason: Updated changelog
Reply With Quote
  #48  
Old 05.04.2022, 14:24
PocasNuckie PocasNuckie is offline
Baby Loader
 
Join Date: May 2021
Posts: 8
Default

Hi, first of all apologies if this isnt the proper thread for this

Yesterday I tried to download an IG profile and many files came out as Temporarily unavailable. Tried 2 more times and same files got the same error.

Tried another profile and some files gave the TU error too.

I let it rest and tried again today with the first profile I mentioned. Same exact behaviour.

My question is - Is this possibly a JDownloader issue? Could it be my (always crappy) internet connection? Should i let some time pass and try again or just accept those files as "lost"?

Thanks for your attention,
Reply With Quote
  #49  
Old 05.04.2022, 14:45
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

Please post your log-ID here | bitte poste deine Log-ID hier.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #50  
Old 05.04.2022, 15:26
PocasNuckie PocasNuckie is offline
Baby Loader
 
Join Date: May 2021
Posts: 8
Default

Quote:
Originally Posted by pspzockerscene View Post
Please post **External links are only visible to Support Staff**... | bitte poste **External links are only visible to Support Staff**....

-psp-
First time doing this:

05.04.22 13.01.16 <--> 04.04.22 10.13.40 jdlog://7587925302851/

Is this what is needed? If not, let me know, thanks
Reply With Quote
  #51  
Old 05.04.2022, 17:20
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

Can you download the problematic items if you delete them and re-add them to JD?
Please provide the following information:
- a screenshot of your instagram settings in JD
- example URLs (the URLs you were trying to download)

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #52  
Old 05.04.2022, 18:44
PocasNuckie PocasNuckie is offline
Baby Loader
 
Join Date: May 2021
Posts: 8
Default

Quote:
Originally Posted by pspzockerscene View Post
Can you download the problematic items if you delete them and re-add them to JD?
Please provide the following information:
- a screenshot of your instagram settings in JD
- example URLs (the URLs you were trying to download)

-psp-
Can you download the problematic items if you delete them and re-add them to JD?

No.

- a screenshot of your instagram settings in JD




- example URLs (the URLs you were trying to download)

This was the profile I tried to download - **External links are only visible to Support Staff****External links are only visible to Support Staff**

If any more info is needed let me know, ty
Reply With Quote
  #53  
Old 05.04.2022, 20:54
goldensun87 goldensun87 is offline
JD Beta
 
Join Date: Feb 2012
Posts: 56
Default

Quote:
Originally Posted by pspzockerscene View Post
The "postID" property has been moved/renamed because it always only contained the internal ID of the postWhat you want is the ID that represents the post also in browser e.g. instagram.com/p/<thisID>.
You can get it using the following plugin property: main_content_id

Regarding all other Instagram feedback:
Thanks for your feedback!
I'll work on it and post the next changelog once I'm done.

-psp-
Thank you for the explanation, makes perfect sense. More importantly, thank you for that very crucial packagizer element.

When the next core update drops, I should probably review all the new plugin settings, before I start crawling. A little while back, I was confused when Insta links started grabbing text files. I wasn't aware someone requested ripping post descriptions, and that the feature could be toggled on/off in the plugin settings.
Reply With Quote
  #54  
Old 06.04.2022, 01:37
TexasDude TexasDude is offline
Junior Loader
 
Join Date: Aug 2019
Posts: 11
Default

Quote:
Originally Posted by pspzockerscene View Post
The "postID" property has been moved/renamed because it always only contained the internal ID of the postWhat you want is the ID that represents the post also in browser e.g. instagram.com/p/<thisID>.
You can get it using the following plugin property: main_content_id

I'm pretty familiar with JD but this one baffles me. Where do I implement this main_content_id? I'm currently at my Insta plugin tab and don't see what I need to do.
Reply With Quote
  #55  
Old 06.04.2022, 12:28
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

@PocasNuckie
After the next CORE-update, do the following:
- Delete those items from your list
- Re-add them
-Try to download them again

If you can reproduce this issue afterwards, please provide a new log.

Quote:
Originally Posted by goldensun87 View Post
When the next core update drops, I should probably review all the new plugin settings, before I start crawling.
That's probably not a bad idea.
I've added/changed quite a lot of settings, see the changelog:
https://board.jdownloader.org/showpo...6&postcount=47

Quote:
Originally Posted by goldensun87 View Post
A little while back, I was confused when Insta links started grabbing text files.
Default settings of new features are always hard to decide on.
In this case I've decided to enable it by default so everyone will see that this feature exists now.

Quote:
Originally Posted by goldensun87 View Post
I wasn't aware someone requested ripping post descriptions, and that the feature could be toggled on/off in the plugin settings.
Sure - most of all new JD features can be turned off

Quote:
Originally Posted by TexasDude View Post
I'm pretty familiar with JD but this one baffles me. Where do I implement this main_content_id? I'm currently at my Insta plugin tab and don't see what I need to do.
I'm sorry but I'm quite lost here.
Context?
Are you trying to customize instagram filenames?

-psp-
EDIT

Also for all users who were missing 'shortcodes' in filenames: Check out my changelog - with the right settingsyou should be able to get shortcodes again after our next set of CORE-updates!
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist

Last edited by pspzockerscene; 06.04.2022 at 12:55. Reason: Improved formatting
Reply With Quote
  #56  
Old 06.04.2022, 13:22
PocasNuckie PocasNuckie is offline
Baby Loader
 
Join Date: May 2021
Posts: 8
Default

Quote:
Originally Posted by pspzockerscene View Post
@PocasNuckie
After the next CORE-update, do the following:
- Delete those items from your list
- Re-add them
-Try to download them again

If you can reproduce this issue afterwards, please provide a new log.
First of all, thanks a lot for your time.

I tried again today and everything worked fine so it was either my connection, a problem on IG side or some issue with the text files (i disabled crawling those) ...

Ill let know if the issue reappears and thanks a lot again, JD is very useful
Reply With Quote
  #57  
Old 06.04.2022, 14:01
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

Thanks for your feedback!

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
  #58  
Old 06.04.2022, 21:22
TexasDude TexasDude is offline
Junior Loader
 
Join Date: Aug 2019
Posts: 11
Default

Quote:
Originally Posted by pspzockerscene View Post
I'm sorry but I'm quite lost here.
Context?
Are you trying to customize instagram filenames?
No. You had replied to a member who stated something about most of an Insta page being downloaded but several left behind with a Temporarily Unavailable status.

I guess I'm lost on that fix.
Reply With Quote
  #59  
Old 06.04.2022, 21:27
TexasDude TexasDude is offline
Junior Loader
 
Join Date: Aug 2019
Posts: 11
Default

Quote:
Originally Posted by TexasDude View Post
No. You had replied to a member who stated something about most of an Insta page being downloaded but several left behind with a Temporarily Unavailable status.

I guess I'm lost on that fix.
Never mind. I checked the option for downloading the original quality (bigger file size), and boom, it grabbed the rest of what I was curious about.
Reply With Quote
  #60  
Old 07.04.2022, 12:13
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 61,611
Default

I'm still lost - thanks for your feedback anyways!
I'll just try to explain my answer again, quoting myself:
Quote:
Originally Posted by pspzockerscene View Post
The "postID" property has been moved/renamed because it always only contained the internal ID of the postWhat you want is the ID that represents the post also in browser e.g. instagram.com/p/<thisID>.
You can get it using the following plugin property: main_content_id
This refers to the internal Plugin properties you can use to create custom filenames using Packagizer rules.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager
JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
That's true James
Quote:
Originally Posted by James
Die Leute verstehen einfach nicht dass nur weil man mit einer Waffe auch auf Menschen schießen kann dass ein Schützenver​ein kein Ort für Amoklaufide​en ist
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 04:55.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.