Geminiclose
Gemini Password Reset

Please provide your username.

A password reset confirmation email will be sent to your email address.

Username
  • Projects

 
ACP-1304 - Scheduler retries for starting run on ACP do not go well
Estimated: 24 Hours 0 Minutes   Logged: 2 Hours 30 Minutes   Time Left: 21 Hours 30 Minutes
Print  |  Send  |  Refresh  |  Url
Type: Bug Bug
Priority: High High
Severity: Major Major
Status: Closed Closed
Resolution: Complete
Resources: Bob Denny
Reported By: Bob Denny
Component: Main Program
Fixed In Version: 8.0
Versions Affected: 7.2b
Start Date: 3/9/2015
Percent Complete:
Created:  2/19/2015 11:24:04 AM
Revised:
 6/19/2015 12:14:58 PM
Closed:  6/19/2015 12:14:58 PM
Resolved:  3/10/2015 10:35:11 AM

See this Comm Center message by Lloyd Smith, and the attached zip file with logs. After an autofocus, for some reason ACP appears busy to ACP for 20 sec. Then the dispatcher successfully starts another Observation in ACP, yet the scheduler engine logs a bunch of warning messages!

15-Feb-2015 08:42:12.6: Acquire data for Observation M81 IFN Short...
15-Feb-2015 08:42:12.6: (belongs to Project M81 IFN Short, Plan M81 IFN Short-B 120s (1-30))
15-Feb-2015 08:42:12.6: ACP Last AF Time 15-Feb-2015 07:10:19 UTC
15-Feb-2015 08:42:12.6: Send Observation M81 IFN Short to ACP Sequencer
15-Feb-2015 08:42:12.7: WARNING: Failed to start ACP script (0)
15-Feb-2015 08:42:12.7: Observatory is currently in use
15-Feb-2015 08:42:17.5: WARNING: Failed to start ACP script (1)
15-Feb-2015 08:42:17.5: Observatory is currently in use
15-Feb-2015 08:42:21.5: WARNING: Failed to start ACP script (2)
15-Feb-2015 08:42:21.5: Observatory is currently in use
15-Feb-2015 08:42:26.2: WARNING: Failed to start ACP script (3)
15-Feb-2015 08:42:26.2: Observatory is currently in use
15-Feb-2015 08:42:31.0: WARNING: Failed to start ACP script (4)
15-Feb-2015 08:42:31.0: Observatory is currently in use

15-Feb-2015 08:42:36.0: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:43:36.1: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:44:36.1: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:45:38.3: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:46:41.7: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:47:45.0: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:48:45.5: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:49:45.6: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:50:48.7: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:51:49.5: WARNING: Request sent to busy ACP (AcquireScheduler)
15-Feb-2015 08:52:49.5: ACP data acquisition failed for Observation M81 IFN Short.
15-Feb-2015 08:52:49.5: (Observation M81 IFN Short interrupted by ACP sequencer problem.)
15-Feb-2015 08:52:50.6: ACP Last AF Time 15-Feb-2015 07:10:19 UTC

In the gap the run on ACP is successfully started. Then at 8:52 it thought that the run had ended unsuccessfully but the ACP log shows it continuing until 10:17 when it got a weather alert!


Attachments

Download ERROR - 20150215@031204.zip 2/19/2015 18.21 KB Delete