Issue affecting availability of recently submitted session analytics in US-East-1

As of 21:30 UTC, we are have resolved the issue affecting availability of session data in US-East-1.

Learnosity Support and Systems Engineering teams will follow up with a post mortem once we have completed root cause analysis and finalized any next steps or preventative measures required.

Please reach out if you have any questions or concerns.

As of 21:00 UTC, all sessions have been cleared from the scoring backlog queue and all submissions are being processed normally.

Learnosity Support and Systems Engineering teams will monitor this situation for a further 30 minutes before calling it resolved.

As of 20:30 UTC, the scoring queue backlog is almost empty and new sessions will soon be processed without delay.

Learnosity Support and Systems Engineering teams are continuing to actively investigate the issue, and will follow on with an update and resolution as soon as possible.

As of 19:30 UTC, we are now processing queued sessions rapidly and more than half of the backlog has already cleared..

Learnosity Support and Systems Engineering teams are continuing to actively investigate the issue, and will follow on with an update and resolution as soon as possible.

As of 18:30 UTC, initial remediation efforts have tripled the rate of queued session processing and we are continuing to work toward a full resolution.

Access to recently submitted session results via the Data API and Reports API remains the only affected part of the Learnosity ecosystem. New submissions continue to be safely queued for scoring while the degraded performance remains.

Learnosity Support and Systems Engineering teams are continuing to actively investigate the issue, and will follow on with an update and resolution as soon as possible.

(Note: We're correcting cited UTC times to the 24 hr format and will include both forms in this update only.)

As of 5:30pm/17:30 UTC, we've identified a possible contributing cause for the degraded performance in our analytics stack.

Learnosity Support and Systems Engineering teams are continuing to actively investigate the issue, and will follow on with an update and resolution as soon as possible.

As of 4:30 UTC, we are continuing to investigate degraded performance in our Data and Reports APIs.

Only availability of recently submitted session data is affected. Historic session data, as well as all other API stacks, remain unaffected. New submissions are persisting correctly with no data loss and these submission are being queued for scoring.

Learnosity Support and Systems Engineering teams are continuing to actively investigate the issue, and will follow on with an update and resolution as soon as possible.

As of 3:40 UTC, we are experiencing degraded performance in our analytics stack affecting the availability of session data in US-East-1 for a subset of customers.

This is affecting the Reports API and Data API. Neither authoring nor assessment stacks are affected, and there is no data loss. Submitted sessions are queueing for processing.

Learnosity Support and Systems Engineering teams are actively investigating the issue, and will follow on with an update and resolution as soon as possible.