University of Cambridge Computer Laboratory - GN09 cooling failure – Incident details

GN09 cooling failure

ResolvedMajor outage8 hours 31 minutes

Affected

  • ResolvedUTC

    This incident has been resolved. If your server did not boot back up or is not working, and you can't resolve this yourself please contact service-desk@cst.cam.ac.uk.

  • MonitoringUTC

    The chiller fault has been repaired. Services will now be brought back up (this could take a while). If you have servers in GN09, and access to Caelum Console, you are free to turn on your servers now.

  • UpdateUTC

    We are continuing to work on a fix for this incident. A failed part on the chiller is about to be replaced.

  • IdentifiedUTC

    Most servers in GN09 have been shut down to protect against further hardware damage. Technicians are on site and investigating a suspected chiller fault.

  • InvestigatingUTC

    Cooling of GN09 failed overnight. Temperatures are already very high and some systems have failed / powered down. It is likely that more servers will have to be shut down before this is resolved.