February 24, 2016: BbLearn Unplanned Downtime

From approximately 10:20 AM to 11:30 AM, the BbLearn primary database (lmsdb1) experienced abnormally high process count, apparently caused by a loss of connection to the standby database (lmsdb2). Users may have experienced slowness during this time.

During this time, several BbLearn application nodes (bbapp1a through bbapp7a) failed automated health checks, which led to two service outages: one from 10:56 AM to 10:57 AM, and another from 11:13 AM to 11:17 AM. Individual application nodes appear to have remained operational, but users may have experienced errors trying to connect via learn.csuchico.edu during those times.

Support staff are actively investigating this incident.