JDownloader Community - Appwork GmbH
 

Reply
 
Thread Tools Display Modes
  #1  
Old 25.02.2020, 17:16
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default Load URLs from text file

I read quite a few threads regarding to watchfolder but i'm so confused don't know how to get started.

I thought it's a nobrainer to just have jd automatically load a text file in 'watchfolder' but it seems more complicated than that?

I downloaded 'watchfolder' extention. Is there a template script example to follow?

Thanks
Reply With Quote
  #2  
Old 25.02.2020, 17:21
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default

just found these template. **External links are only visible to Support Staff****External links are only visible to Support Staff**
Reply With Quote
  #3  
Old 25.02.2020, 17:39
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default

I used one of the template from github above but it doens't work. jd popup saying found 15 links but nothing added to LinkGrabber. Package Name '_Youtube' isn't there


Saved this script below to WatchFolder as 'download-media-file.crawljob'
Quote:
# Package Name
packageName=_Youtube

# Download URLs
text=youtube video link 1
text=youtube video link 2
text=youtube video link 3

# jDownloader Options
enabled=true
autoStart=TRUE
forcedStart=TRUE
autoConfirm=TRUE
Reply With Quote
  #4  
Old 25.02.2020, 18:45
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

1. Sorry we do not have detailed instructions regarding folderwatch yet but inside JDownloader there are a lot of examples - why didn't you just take a look at them?
I just copied them, you ll find them in this SPOILER:
Spoiler:
Code:
#this is a property file format. You can put all these entries in a jsonarray [{..},{...}] as well.
#save this as myFile.crawljob
#Start a new entry with anything but a comment (#...) or key=. An empty line would be ok as well
#\ must be double encoded! \ -> \\
->NEW ENTRY<-
   chunks=0
#a comment
   extractPasswords=["Password1","Password2"]
   enabled=null
   text=**External links are only visible to Support Staff**
   packageName=MyPackageName
   autoStart=TRUE
   extractAfterDownload=UNSET
   downloadFolder=null
   priority=DEFAULT
   forcedStart=UNSET
   downloadPassword=null
#use only if text contains one single link
   filename=null
   overwritePackagizerEnabled=false
   setBeforePackagizerEnabled=true
   comment=null
   autoConfirm=UNSET
   deepAnalyseEnabled=false
   addOfflineLink=true

->NEW ENTRY<-
#properties that are not required can be ignored. This is absolutly fine:
   text=**External links are only visible to Support Staff**


### Available Fields:

# priority Type: Priority
# priority = null
# comment Type: String
# comment = null
# text Type: String
# text = null
# enabled Type: BooleanStatus
# enabled = null
# downloadFolder Type: String
# downloadFolder = null
# type Type: JobType
# type = NORMAL
# filename Type: String
# filename = null
# packageName Type: String
# packageName = null
# addOfflineLink Type: boolean
# addOfflineLink = true
# setBeforePackagizerEnabled Type: boolean
# setBeforePackagizerEnabled = false
# extractPasswords Type: String[]
# extractPasswords = null
# extractAfterDownload Type: BooleanStatus
# extractAfterDownload = UNSET
# deepAnalyseEnabled Type: Boolean
# deepAnalyseEnabled = false
# overwritePackagizerEnabled Type: boolean
# overwritePackagizerEnabled = true
# chunks Type: int
# chunks = 0
# downloadPassword Type: String
# downloadPassword = null
# autoConfirm Type: BooleanStatus
# autoConfirm = UNSET
# forcedStart Type: BooleanStatus
# forcedStart = UNSET
# autoStart Type: BooleanStatus
# autoStart = UNSET


2. Here is a simple example .crawljob rule which will work fine:
Code:
text=http://cdn8.appwork.org/speed.zip
deepAnalyseEnabled=false 
autoStart=TRUE 
enabled=TRUE 
forcedStart=FALSE 
autoConfirm=TRUE 
packageName=TEST_NAME
Save it as .crawljob file, put it in "[JD_installation_directory]/folderwatch" and when when the Folder Wtch extension is enabled, it will process that file, add the URL and delete the .crawljob file.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #5  
Old 26.02.2020, 00:24
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default

@psp thanks!

I just figured out that it has to do with youtube urls, could you please confirm on your end?

*.crawljob works find on other urls but not youtube
Reply With Quote
  #6  
Old 26.02.2020, 00:30
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Works absoluitely fine here.
You must have messed up your file somehow.
Also your above attempt to simply add "text=" multiple times will not work. You will then either need multiple .crawljob files or put all URLs in one line.
Gere another example with a YT URL to test - this time as crawljob file:
workupload.com/file/sJpYQem2

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #7  
Old 26.02.2020, 04:56
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default

cool, your *.crawljob file works but the template copied from 'Folder Watch' extension did not. Hope you could pin point as to why.


save as 'download-custom-files-2.crawljob' here **External links are only visible to Support Staff****External links are only visible to Support Staff**

Quote:
->NEW ENTRY<-
chunks=0
#a comment
extractPasswords=["Password1","Password2"]
enabled=null
text=**External links are only visible to Support Staff** packageName=_YOUTUBE_TEST
autoStart=TRUE
extractAfterDownload=UNSET
downloadFolder=null
priority=DEFAULT
forcedStart=UNSET
downloadPassword=null
#use only if text contains one single link
filename=null
overwritePackagizerEnabled=false
setBeforePackagizerEnabled=true
comment=null
autoConfirm=UNSET
deepAnalyseEnabled=false
addOfflineLink=true
Reply With Quote
  #8  
Old 26.02.2020, 13:01
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

-> new entry <- maybe ? guess, not tested/confirmed
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #9  
Old 26.02.2020, 17:38
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Yap possibly.

Also, while this might sound misleading, this "documentation" nowhere states that the whole thing can be used as an example

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #10  
Old 27.02.2020, 01:35
raztoki's Avatar
raztoki raztoki is offline
English Supporter
 
Join Date: Apr 2010
Location: Australia
Posts: 17,659
Default

surprised jd doesn't remove/ignore fields that are not valid.
__________________
raztoki @ jDownloader reporter/developer
http://svn.jdownloader.org/users/170

Don't fight the system, use it to your advantage. :]
Reply With Quote
  #11  
Old 28.02.2020, 00:10
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default

Quote:
->@raztoki
new entry <- maybe ? guess, not tested/confirmed
I sure overlocked this. Removed it then it works.


Quote:
@pspzockerscene
Also your above attempt to simply add "text=" multiple times will not work. You will then either need multiple .crawljob files or put all URLs in one line.
This turns out to be false. It it youtube specific. Sometimes it only detect link1 and sometime all 3 urls as layout below.


*.crawljob youtube example with multiple urls
Code:
text=youtube link 1
text=youtube link 2
text=youtube link 2

*.crawljob vemeo example with multiple urls - works without an issue
Code:
text=vemeo link 1
text=vemeo link 2
text=vemeo link 3

Also created a plain txt file as below with multiple urls and different hosts works as well

*.crawljob example with multipe urls in plain text with No other options
Code:
youtube link 1
youtube link 2
youtube link 3
vemeo link 1
vemeo link 2
vemeo link 3
ect...
Reply With Quote
  #12  
Old 02.03.2020, 17:29
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Still unable to reproduce any YT issues.

If there is one it would be the youtube crawler thatfails which would then again have nothing todo with our Folder Watch addon

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
  #13  
Old 05.03.2020, 03:55
zreenmkr zreenmkr is offline
JD Addict
 
Join Date: Feb 2020
Posts: 174
Default

Quote:
Still unable to reproduce any YT issues.
i know, it's fairly random. sometime it works sometime it doesn't.
Reply With Quote
  #14  
Old 23.02.2021, 18:44
pspzockerscene's Avatar
pspzockerscene pspzockerscene is offline
Community Manager
 
Join Date: Mar 2009
Location: Deutschland
Posts: 71,044
Default

Finally we got a Folder Watch knowledgebase article.

-psp-
__________________
JD Supporter, Plugin Dev. & Community Manager

Erste Schritte & Tutorials || JDownloader 2 Setup Download
Spoiler:

A users' JD crashes and the first thing to ask is:
Quote:
Originally Posted by Jiaz View Post
Do you have Nero installed?
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT +2. The time now is 08:22.
Provided By AppWork GmbH | Privacy | Imprint
Parts of the Design are used from Kirsch designed by Andrew & Austin
Powered by vBulletin® Version 3.8.10 Beta 1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.