Increased occurrence processing pipeline latency

At present everything appears to have recovered , we will leave this in a monitoring phase for the next 30 mins.

Due to ongoing issues with some of the services we have applied additional changes to our applications, our pipeline is processing as normal but there may still be some lingering effects with the WEB interface. However we have continued to process and store data we have received , all of our clients should have received the notifications defined in their accounts with the understanding that services such as SLACK/MAILGUN and other notification applications may also have been impeded during this time.

We are continuing to address the issues as they arise but believe that we are progressing to the end point that satisfies all of our customers.

We are still experiencing the effects of the AWS outage through some of our 3rd party services, we are continuing to investigate and apply mitigations around this whilst also ensuring that we maintain consistent and secure processes.

Apologies for this inconvenience, we will continue to provide updates during this time.

We have identified that some people are experiencing issues with the WEB Frontend this is also connected to the AWS impacts we are looking at how to mitigate this.

We are continuing to apply some mitigations but with the current work we can now see that our API is stable , we are just processing a backlog of other messaging that will be delayed in completing due to the volume. I will leave our pipeline as degraded while that is processing and we will move this to a monitoring phase.

Sorry for the inconvenience.

We are working on mitigations that will get around some of the externally degraded services.

We are now experiencing impact to other parts of the pipeline including the API, this again we believe is still connected to the ongoing incident with AWS which has impacted other external services.

We are experiencing a processing delay in our occurrence pipeline. We believe this is due to the ongoing issues with AWS that impact some of the other external services we use across our applications.

We apologize for any inconvenience caused by this and will endeavor to do what we can to resolve this.