SoftTree Technologies SoftTree Technologies
Technical Support Forums
RegisterSearchFAQMemberlistUsergroupsLog in
Job Queue stops processing jobs

 
Reply to topic    SoftTree Technologies Forum Index » 24x7 Scheduler, Event Server, Automation Suite View previous topic
View next topic
Job Queue stops processing jobs
Author Message
Anthony



Joined: 31 May 2005
Posts: 6

Post Job Queue stops processing jobs Reply with quote

Hi,

We have been using 24x7 for a year or so and as teh number of jobs has grown, we are having problems with the queues.
Jobs are being completed but not removed from the queue
This in turn stops other jobs from being proccessed by the queue
I found some old posts to this board that bring up the same issues
you offered a couple differernt suggestions and I would like to know which would be best for us

We have 40 jobs that run in the morning between 5-8 AM and the other 40 run between 4-7 PM
These jobs al use JAL and many of them call .bat files
of the 40 in the morning and night 20 of them are set to run about 1 every 5 minutes
the other 20 are set to run if a file is found
Some jobs take about 5 minutes to run , others just a few seconds
These 80 jobs are broken up into about 6 queues
all are set to run synchonously
none have a 3 second wait at the end
none have exit at the end
none are set to run detached

How should I set the following options in jobs
synchonous/asynchonous
run detached
do I need and exit at the end of the JAL scripts
do I need to put a 3 second wait at the end of the JAL scripts

thanks for the help
Anthony

Tue May 02, 2006 10:24 am View user's profile Send private message
SysOp
Site Admin


Joined: 26 Nov 2006
Posts: 7970

Post Re: Job Queue stops processing jobs Reply with quote

There is really only one bulletproof solution is to set jobs to run detached and synchronous and also ensure all "debugging" options are turned off in production environment, including, tracing and especially the "job status display" option.

Use 5 to 6 jobs queues for optimal performance and resource usage. Assign jobs for different applications to different jobs queues. That's it

: Hi,

: We have been using 24x7 for a year or so and as teh number of jobs has grown,
: we are having problems with the queues.
: Jobs are being completed but not removed from the queue
: This in turn stops other jobs from being proccessed by the queue
: I found some old posts to this board that bring up the same issues
: you offered a couple differernt suggestions and I would like to know which
: would be best for us

: We have 40 jobs that run in the morning between 5-8 AM and the other 40 run
: between 4-7 PM
: These jobs al use JAL and many of them call .bat files
: of the 40 in the morning and night 20 of them are set to run about 1 every 5
: minutes
: the other 20 are set to run if a file is found
: Some jobs take about 5 minutes to run , others just a few seconds
: These 80 jobs are broken up into about 6 queues
: all are set to run synchonously
: none have a 3 second wait at the end
: none have exit at the end
: none are set to run detached

: How should I set the following options in jobs
: synchonous/asynchonous
: run detached
: do I need and exit at the end of the JAL scripts
: do I need to put a 3 second wait at the end of the JAL scripts

: thanks for the help
: Anthony

Tue May 02, 2006 10:52 am View user's profile Send private message
Anthony



Joined: 31 May 2005
Posts: 6

Post Re: Job Queue stops processing jobs Reply with quote

: There is really only one bulletproof solution is to set jobs to run detached
: and synchronous and also ensure all "debugging" options are
: turned off in production environment, including, tracing and especially
: the "job status display" option.

: Use 5 to 6 jobs queues for optimal performance and resource usage. Assign
: jobs for different applications to different jobs queues. That's it

thanks!
but here is a follow up
what if the one of the jobs calls another job
and they both use the same queue?
If they are both set to synchonous then I would suspect I have put myself into a loop,
???

Wed May 03, 2006 3:01 pm View user's profile Send private message
SysOp
Site Admin


Joined: 26 Nov 2006
Posts: 7970

Post Re: Job Queue stops processing jobs Reply with quote

I don't think so. I don't know how you implemented the call but I assume you have no circular references.

If you can describe how you've done that I can show what is going to happen at the time of the call.

: thanks!
: but here is a follow up
: what if the one of the jobs calls another job
: and they both use the same queue?
: If they are both set to synchonous then I would suspect I have put myself
: into a loop,
: ???

Wed May 03, 2006 3:41 pm View user's profile Send private message
Anthony



Joined: 31 May 2005
Posts: 6

Post Re: Job Queue stops processing jobs Reply with quote

: I don't think so. I don't know how you implemented the call but I assume you
: have no circular references.

: If you can describe how you've done that I can show what is going to happen
: at the time of the call.

JOB A
------------------
//Run job
JobRun( "JobB" )

CHECK_FILE:
// Get date/time for Broker File
NotFileExists brokerfile, not_found
IfThen not_found, BAD_FILE
FileDate brokerfile, file_date
ConcatEx "*** The file's date is ", file_date, logfilew1
FileTime brokerfile, file_time
ConcatEx "*** The file's time is ", file_time, logfilew1
FileWrite logfile, logfilew1

// Check if it is file_OK
IsEqual file_date, today, date_OK
IsTimeBetween file_time, 00:00:00, 11:59:59, time_OK
And date_OK, time_OK, file_OK
ConcatEx "*** The file's date is ", date_OK, logfilew2
FileWrite logfile, logfilew2
if file_OK, GOOD_FILE, CHECK_PM

CHECK_PM:
IsTimeBetween file_time, 12:00:00, 23:59:59, time_OK
And date_OK, time_OK, file_OK
ConcatEx "*** The file's time is ", file_time, logfilew2
FileWrite logfile, logfilew2
if file_OK, PM_FILE, WAIT_CHECK

WAIT_CHECK:
set waitcounter, waitcounter+1
IsLess( waitcounter, 5, waitcount )
if waitcount, WAIT_1, BAD_FILE

WAIT_1:
wait 60
GoTo CHECK_FILE

BAD_FILE:
MailSend
Goto DONE

GOOD_FILE:
RunAndWait script1, "C:\\Temp", 30, ReturnS1
Filecopy
MailSendwithAttachment
Filedelete
FileCopyRunAndWait script2, "C:\\Temp", 20, ReturnS2
MailSend
goto DONE

PM_FILE:
//Create file for FTP
RunAndWait script1, "C:\\Temp", 30, ReturnS3
Filecopy
MailSendwithAttachment
Filedelete

//Create file for FMC
FileCopyRunAndWait script2, "C:\\Temp", 20, ReturnS2
MailSend
goto DONE

DONE:
-----------

JOB B
---------------
dim returnS1, number
dim script1, string

set script1, "\"c:\\Program Files\\Internet Explorer\\IEXPLORE.EXE\" \"http://CACVPMIISPROD/VPMWEB/UDAP/Columbus/Forms/Query/Q_EzeCastleInterface.asp&cPath=\\\\CAC\\VPMView\\100\\NS-CAC-VPM-EzeReport-\""

FileCopy
FileCopy
FileCopy

RunAndWait script1, "C:\\Temp", 310, ReturnS1


Fri May 05, 2006 11:17 am View user's profile Send private message
SysOp
Site Admin


Joined: 26 Nov 2006
Posts: 7970

Post Re: Job Queue stops processing jobs Reply with quote

In this case JobB runs as it was part of JobA. The processing is sort of inserted into processing of JobA

: JOB A
: ------------------
: //Run job
: JobRun( "JobB" )

: CHECK_FILE: // Get date/time for Broker File
: NotFileExists brokerfile, not_found
: IfThen not_found, BAD_FILE
: FileDate brokerfile, file_date
: ConcatEx "*** The file's date is ", file_date, logfilew1
: FileTime brokerfile, file_time
: ConcatEx "*** The file's time is ", file_time, logfilew1
: FileWrite logfile, logfilew1

: // Check if it is file_OK
: IsEqual file_date, today, date_OK
: IsTimeBetween file_time, 00:00:00, 11:59:59, time_OK
: And date_OK, time_OK, file_OK
: ConcatEx "*** The file's date is ", date_OK, logfilew2
: FileWrite logfile, logfilew2
: if file_OK, GOOD_FILE, CHECK_PM

: CHECK_PM: IsTimeBetween file_time, 12:00:00, 23:59:59, time_OK
: And date_OK, time_OK, file_OK
: ConcatEx "*** The file's time is ", file_time, logfilew2
: FileWrite logfile, logfilew2
: if file_OK, PM_FILE, WAIT_CHECK

: WAIT_CHECK: set waitcounter, waitcounter+1
: IsLess( waitcounter, 5, waitcount )
: if waitcount, WAIT_1, BAD_FILE

: WAIT_1: wait 60
: GoTo CHECK_FILE

: BAD_FILE: MailSend
: Goto DONE

: GOOD_FILE: RunAndWait script1, "C:\\Temp", 30, ReturnS1
: Filecopy
: MailSendwithAttachment
: Filedelete
: FileCopyRunAndWait script2, "C:\\Temp", 20, ReturnS2
: MailSend
: goto DONE

: PM_FILE: //Create file for FTP
: RunAndWait script1, "C:\\Temp", 30, ReturnS3
: Filecopy
: MailSendwithAttachment
: Filedelete

: //Create file for FMC
: FileCopyRunAndWait script2, "C:\\Temp", 20, ReturnS2
: MailSend
: goto DONE

: DONE: -----------

: JOB B
: ---------------
: dim returnS1, number
: dim script1, string

: set script1, "\"c:\\Program Files\\Internet
: Explorer\\IEXPLORE.EXE\" \"
: http://CACVPMIISPROD/VPMWEB/UDAP/Columbus/Forms/Query/Q_EzeCastleInterface.asp&cPath
: =\\\\CAC\\VPMView\\100\\NS-CAC-VPM-EzeReport-\""

: FileCopy
: FileCopy
: FileCopy

: RunAndWait script1, "C:\\Temp", 310, ReturnS1

Fri May 05, 2006 1:11 pm View user's profile Send private message
Anthony



Joined: 31 May 2005
Posts: 6

Post Re: Job Queue stops processing jobs Reply with quote

: In this case JobB runs as it was part of JobA. The processing is sort of
: inserted into processing of JobA

Great!
Thanx

Fri May 05, 2006 1:19 pm View user's profile Send private message
Display posts from previous:    
Reply to topic    SoftTree Technologies Forum Index » 24x7 Scheduler, Event Server, Automation Suite All times are GMT - 4 Hours
Page 1 of 1

 
Jump to: 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


 

 

Powered by phpBB © 2001, 2005 phpBB Group
Design by Freestyle XL / Flowers Online.