Customer Business Impact:

From approximately February 12th, 5:20:00 UTC to 5:45:00 UTC, all MindTouch sites experienced intermittent slowness and errors.

‌

Problem Summary:

An infrastructure configuration was unintentionally changed, causing several server processes to fail under load.

‌

Recovery:

The configuration file was reverted back to the latest working version.

‌

Root Cause:

MindTouch Engineering is upgrading certain areas of its infrastructure to be able to handle higher loads. During the upgrade, an unintended change to the configuration was performed. This caused several server processes to fail due to insufficient resources.

‌

Corrective Actions:

MindTouch Engineering is working to automate manual processes so that these issues can be avoided. Future updates to the infrastructure configuration will be done through an automated process.