JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #921  
Old 26.09.2019, 16:57
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by Demongornot View Post
Well I tried "queryLinkCrawlerJobs" using this :
Please see https://my.jdownloader.org/developers/#tag_265 for the structures/objects
It's
Quote:
"jobUUIDs" = (long[])
__________________
JD-Dev & Server-Admin
Reply With Quote
  #922  
Old 26.09.2019, 17:01
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by Demongornot View Post
@mgpai Thanks you !
@Jiaz
It increase the memory only during the crawling execution or it stay ? And if it is the latter, can it be cleared ?
The jobID is stored as property to the link. there is no cleanup for this because that would be contrary to *assignJobID* so you can
later find the links for specific job.

Quote:
Originally Posted by Demongornot View Post
Also I would love an API method to get "job" from "jobId" please !
queryLinkCrawlerJobs, see https://my.jdownloader.org/developers/#tag_262
__________________
JD-Dev & Server-Admin
Reply With Quote
  #923  
Old 26.09.2019, 17:03
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

I really recommend to NOT use api event stream at all and just use *On new link* and *Download has stopped*. in case you want to stick with api event stream, there should be events when new links got added to linkgrabber list instead of listening to the linkcrawler events
__________________
JD-Dev & Server-Admin
Reply With Quote
  #924  
Old 26.09.2019, 17:45
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

The script with trigger api event stream mustn't be synchronized/blocking because it may slow down alot or even cause deadlocks. I will provide new methods to provide synchronized blocks within scripts instead of the complete script
__________________
JD-Dev & Server-Admin
Reply With Quote
  #925  
Old 26.09.2019, 18:20
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 645
Default

Quote:
Originally Posted by Demongornot View Post
Thanks, but it return [] only, even when I make sure links are still crawled.
Sorry. My bad. I thought you wanted to get the crawled links by Job ID. As Jiaz has pointed out, in your query, instead of:
Code:
"jobId": jid

you need to use:
Code:
"jobId": [jid]
Reply With Quote
  #926  
Old 26.09.2019, 18:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by mgpai View Post
Sorry. My bad. I thought you wanted to get the crawled links by Job ID. As Jiaz has pointed out, in your query, instead of:
Code:
"jobId": jid

you need to use:
Code:
"jobId": [jid]
It's jobIds and not jobId see https://my.jdownloader.org/developers/#tag_260
__________________
JD-Dev & Server-Admin
Reply With Quote
  #927  
Old 26.09.2019, 18:55
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

@Demongornot: I suggest we create a new Thread for questions about development /api use and leave this thread for questions/finished scripts. What do you think?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #928  
Old 26.09.2019, 20:16
Demongornot Demongornot is offline
JD Beta
 
Join Date: Sep 2019
Location: Universe, Local group, Milky Way, Solar System, Earth, France
Posts: 50
Default

Quote:
Originally Posted by Jiaz View Post
@Demongornot: I suggest we create a new Thread for questions about development /api use and leave this thread for questions/finished scripts. What do you think?
I think the best would be a thread created and handled by mods/admins and superior, with only script request, resulting script and script without request and related discussions, the first post (handled by staff) would be a an index with name and if required description of all scripts with a link to their respective posts.
And another thread where we discuss general script related questions which aren't directly related to script requests and resulting scripts.
You'll have a lot of post to move, sort and create links to though.

I'll wait for your answer/decision before posting answers for the previous posts related to my questions.
Reply With Quote
  #929  
Old 27.09.2019, 12:09
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

@Demongornot: I agree. Maybe instead of a thread, maybe a seperate subforum dedicated to threads and each thread contains a single script with request/script ... new thread->new request -> script in this thread. that way it's easier to search and discuss for requests/feature wishes and scripts.
what do you and @mgpai think about this?
__________________
JD-Dev & Server-Admin
Reply With Quote
  #930  
Old 27.09.2019, 13:35
Demongornot Demongornot is offline
JD Beta
 
Join Date: Sep 2019
Location: Universe, Local group, Milky Way, Solar System, Earth, France
Posts: 50
Default

@Jiaz I agree, a subforum for development (which could include a thread for functions/methods request), API and scripts in general and another for scripts request and posting, though a main thread that catalog and link all the posted scripts would still be nice and useful, I am not a believer in the search system, though I use it as much as possible, I know that it isn't perfect (I might loose hours per weeks fighting against the stupid Google algo, even using include, exclude, date and other filters, and yet Google is the best out there) and one could miss a script just because it have a different name than his function might suggest.
The most practical thing for the "index" would be that everyone making a script could "submit" his post containing the script, moderators and highers would just need to validate it and voila, the link to said post will be automatically added to the list, if he submit another post with the same script name, it will simply be for updating the link to a newer version, this way it don't require a long and tedious job for the team to keep the list updated.
Reply With Quote
  #931  
Old 27.09.2019, 15:02
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

I don't see any real advantage from an index for scripts than just a simple subforum where each script has its own thread and the script can be discussed and updated within same thread. That way the team isn't involved and ppl can request scripts and community and nice ppl like you&mgpai can respond in thread and provide scripts, then the thread tag can be changed from request to finished .
__________________
JD-Dev & Server-Admin
Reply With Quote
  #932  
Old 27.09.2019, 20:44
Demongornot Demongornot is offline
JD Beta
 
Join Date: Sep 2019
Location: Universe, Local group, Milky Way, Solar System, Earth, France
Posts: 50
Default

It's all up to you to take the final decision.
I wasn't talking about only an index but rather both a subforum which include a pinned index thread, which would work exactly as you described while adding an easier way to find scripts.
It would offer the advantage to see all the scripts at an unique place without the user having the search feature which doesn't always work, it can also help discovering scripts we didn't know we wanted/needed and would have never thought about searching them.
It can easily prevent to miss a script because the title of the request or of the poster isn't good enough to find said script because of its name (hence why I talked about a basic description when required) or if an user search for a specific script with no ideas how to call it and/or if keywords from inside a post would be to general and drawn the potential answer inside many unrelated posts.
Also there are some script that can be good for some peoples who need really specific feature but who wouldn't make it into that list because they could be exploited in a negative way if the user don't know what he is doing, it would help to avoid this script to be "easily" found, and lets peoples who specifically want it to search for it as the "normal" way would be to look at the index.
The other side of this is best demonstrated by my first post, where an users who ask if something in JDownloader (it will probably not be posted in the scripts subforum) can be done and someone and someone answer them with a script solving their issue, it won't require to move the thread to the subforum nor renaming it, as the name could be totally irrelevant for scripts request/search.
And finally, in a thread, a long discussion can happen with many versions of the script being posted, the first and last to be found aren't necessarily the one an user might want but rather an outdated or a special version requested by someone who had specific needs, an index would help an user who isn't computer literate to find the good one as its name/description will link to the specific post of the "general" and latest version.

That's my arguments in favor in a pinned index in the subforum.
I got that idea from the Kerbal Space Program game's forum, the mods subforum contain an index who did the same :
**External links are only visible to Support Staff****External links are only visible to Support Staff**
Sadly it was from a member and not from the team, meaning that when the user became inactive, the thread wasn't updated anymore.
Reply With Quote
  #933  
Old 30.09.2019, 10:14
DunDee DunDee is offline
Baby Loader
 
Join Date: Aug 2019
Posts: 6
Default

Quote:
Originally Posted by DunDee View Post
Data from hot storage to cold are moved after no downloading 80 days when it is they can delete my data in 14 days if nobody download it. That's why i need script to simulate download from other account 1fichier.com. Im doing it once on 2 months. Need this script to do it faster with connections make and don't sit in Jd2 and look all time when connected are delete it. Can u do some script for me or modify exist in JD2.
Quote:
//check if downloads are running at all
if (isDownloadControllerRunning() && !isDownloadControllerStopping()) {
var running = getRunningDownloadLinks();
//loop through all running Downloads
for (var i = 0; i < running.length; i++) {
//check if the download has been running at least 30 seconds
if (running[i].getDownloadDuration() > 30000) {
//check if the current speed is below 50kb/s
if (running[i].getSpeed() < 50 * 1024) {
//reset the download
//running[i].reset();
//stop the download and restart it
running[i].abort();
}

}
}
}
Quote:
Originally Posted by Jiaz View Post
Thanks for the feedback. Didn't know that they're going to delete from cold storage after some time
@mgpai: contact me via mail so we can talk about possible scripts/options for dundee
Hi @mgpai , @Jiaz
Can u make for me script?
Im waiting for your help this is big problem for me Need simulate connections for fichier connect downloads and after download some data or specific time skip and move forward my list next simulate. I got many data i do it once in 80-90 days. Now again must Quota is in my account and 14 days to move this files from cold storage to hot storage if don't do it they will delete my files. Manually it's couple days time for me if i will be got some help i will be grateful for your time for me.

Last edited by DunDee; 30.09.2019 at 10:20.
Reply With Quote
  #934  
Old 30.09.2019, 13:58
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 645
Default

Quote:
Originally Posted by DunDee View Post
Hi @mgpai ... Can u make for me script?
Sorry, but I have to decline this particular request. I have, in my previous posts (in this thead), explained why I do not wish to create scripts which simulate downloads.
Reply With Quote
  #935  
Old 30.09.2019, 20:18
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

@mgpai: I told him to contact you. He has a valid use-case and it's fine for me if you help creating a script. He needs to *load* the files from his own account for specific time, else they will count as inactive and trashed/deleted.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #936  
Old 30.09.2019, 20:33
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

@Demongornot: now I understand. a new subforum with each thread to a specific script and it's questions/discussion. latest script version in first post. and one sticky thread that serves as an index for all scripts/managed threads for easier *look and find* ? To be honest, I don't have the time for maintaining or supporting that subforum but if you would spend time on it and @mgpai would also agree on this, I would setup such a subforum for you.
__________________
JD-Dev & Server-Admin
Reply With Quote
  #937  
Old 30.09.2019, 22:02
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 645
Default

Quote:
Originally Posted by Jiaz View Post
@mgpai: I told him to contact you. He has a valid use-case and it's fine for me if you help creating a script. He needs to *load* the files from his own account for specific time, else they will count as inactive and trashed/deleted.
Code:
1fichier.com/hlp.html

That is their business model. If users needs additional cold storage, they have have to opt for a different plan.
  • All data storage is based on physical infrastructures, which uses a secure and air-conditioned physical space, uses energy and has a significant cost.
  • In order to always offer you the best services at the best prices, we have to distinguish between data used (Hot Storage) and unused (Cold Storage).
  • Our Free and Access offers include up to 1TB of temporary storage.
  • The Premium offer includes by default an unlimited space of Hot Storage and 2TB of Cold Storage.
  • Extensions to get more Cold Storage are available on your management interface at unbeatable rates.
If I understand correctly, the script which simulates the download will be required only to circumvent it. I am open to be convinced otherwise.

@DunDee: Please contact me in JD Chat.
Reply With Quote
  #938  
Old 01.10.2019, 13:02
Demongornot Demongornot is offline
JD Beta
 
Join Date: Sep 2019
Location: Universe, Local group, Milky Way, Solar System, Earth, France
Posts: 50
Default

Quote:
Originally Posted by Jiaz View Post
@Demongornot: now I understand. a new subforum with each thread to a specific script and it's questions/discussion. latest script version in first post. and one sticky thread that serves as an index for all scripts/managed threads for easier *look and find* ? To be honest, I don't have the time for maintaining or supporting that subforum but if you would spend time on it and @mgpai would also agree on this, I would setup such a subforum for you.
I wasn't thinking about making the first post of the thread the latest version, you could make this the standard of you want, but I it would probably require a lot of team interversion to individually modify every topics, as it is up to the topic creator (who may just be someone registered to ask a script and who don't know about putting the script in the first post) to do that otherwise.
What I was thinking about is, the sticky index thread simply link directly to the post in the thread where the latest script version is, this can also allow for multiples scripts per post to be linked in the index.

And if a auto submitting and updating code is put in place on the forum, it mean the only job for the team would be to check for any abuse rather than having manually to link all them, except the initial subforum sorting and threads building if course.
But it can also be used to link the script's posts in the first page of the thread.

Regardless how you do it, I agree, as a subforum for scripts would be a nice addition !
Reply With Quote
  #939  
Old 01.10.2019, 15:54
Jiaz's Avatar
Jiaz Jiaz is offline
JD Manager
 
Join Date: Mar 2009
Location: Germany
Posts: 66,134
Default

Quote:
Originally Posted by Demongornot View Post
I wasn't thinking about making the first post of the thread the latest version, you could make this the standard of you want, but I it would probably require a lot of team interversion to individually modify every topics, as it is up to the topic creator (who may just be someone registered to ask a script and who don't know about putting the script in the first post) to do that otherwise.
What I was thinking about is, the sticky index thread simply link directly to the post in the thread where the latest script version is, this can also allow for multiples scripts per post to be linked in the index.
I don't see any difference if I have to update the sticky thread and update to latest script version or update thread itself and either update first post or link updated script version in first post.

Quote:
Originally Posted by Demongornot View Post
And if a auto submitting and updating code is put in place on the forum, it mean the only job for the team would be to check for any abuse rather than having manually to link all them, except the initial subforum sorting and threads building if course.
But it can also be used to link the script's posts in the first page of the thread.
Who codes/maintains that *auto submitting/updating code* ?

Quote:
Originally Posted by Demongornot View Post
Regardless how you do it, I agree, as a subforum for scripts would be a nice addition !
Perfect
__________________
JD-Dev & Server-Admin
Reply With Quote
  #940  
Old 01.10.2019, 16:06
mgpai mgpai is offline
Script Master
 
Join Date: Sep 2013
Posts: 645
Default

Quote:
Originally Posted by Amiganer View Post
The best would be as it happend if the downloads remain in the Download-Screen. If the links comes in with the grabber and it is in the list, pop up the window: "delete allready downloaded files from list". If that is possible.
If you keep the finished links in downloaded list, you can try (if you haven't already) the following options, which can be used to handle duplicate links.
  • JD can automatically remove the links from linkgrabber when they are added to the downloadlist . You can find/set different actions to handle dupes, in:
    Code:
    Settings > Advanced Settings> LinkgrabberSettings.defaultonaddeddupeslinksaction
  • They can also be prevented from being added to the linkgrabber, by creating linkgrabber filter rules (Settings > Linkgrabber Filter > Filter). After they are filtered, they can also be added back (if you so wish), by clicking "Restore 'n' filtered links" button in the linkgrabber bottom toolbar.

    Filter Rule:
    Code:
    Condition > is true > Link is already in Download List
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 11:57.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.