MDM Trouble Report for 2003 Nov 21

Telescope: 1.3m
Observer(s): Onken (OSU)
Instrument: CCDS

Problem(s) Encountered:
During a readout, Kilauea suddenly spat the following text 
message across the screen: 'panic: asynchronous memory fault:
MFSR=81804860 MFAR=5905c20'. (There was more, but the computer
rebooted itself before I could write it down.) When Kilauea
came back up, it wasn't receiving any info from the IC or WC. I
tried running the Prospero STARTUP command, but it said that
Ariel wasn't running. In such an instance, the Prospero manual 
refers you to the WC troubleshooting guide (wherever that might
be--is there actually a WC troubleshooting guide, or is it just
referring to the general Prospero troubleshooting guide a few
pages earlier in the manual?). With little other recourse prior
to waking someone up in the middle of the night, I tried to run
through the complete  Nothing is responding  restart 
instructions. The first problem with that was encountered at 
step 1 (shut down the IC, WC, and IE computers), in that 
nothing in the computer room is labeled as being the IE. After 
a while, I concluded that perhaps Tambora was the computer it 
was referring to--except that Tambora (or at least the Tambora 
monitor) turns off whenever you turn the WC off, so you can't 
restart Tambora and make sure everything is okay before turning
on the WC. Eventually, through a series of reboots, I got all 
of the computers up and running, but the ICSYNCH flag was 0 
instead of 1. I tried consulting with the 2.4m observer, but 
finally it was corrected by virtue of a ping being sent from 
one computer to another. (I've forgotten which direction it 
was, IC->WC, WC->IC, or WC->IE--one that wasn't mentioned in 
the Propero manual, anyway.) So that got all of the computers 
happy, and I was able to start Caliban and Prospero and begin 
taking data again. It worked fine the rest of the night.

------------------------------

Submitted on 2003 Nov 22 [7:23:48]