Forsta Plus: We have identified an issue with the display of Action Management case data for several clients across some environments

We have determined that the issues that were the result of this incident have been resolved.

The US site has stabilized. We are still working on the EURO site. I will have an update tomorrow.

Although most customers are no longer having issues, we are seeing a couple of affected customers on the US site and a handful of customers on the EURO site. We will be providing an additional fix to resolve this issue for these customers first thing tomorrow. I will have an update in the morning.

We did not see any more of these errors on the US, PG HX, or US2 sites over the weekend. We will continue to monitor and provide another update on Tuesday.

We deployed an additional fix this morning to US and US2. The results are looking promising. We will continue to monitor over the next few days. I will provide an update on Monday.

The issue is resolved for most customers on the US site.  As of now it looks like there are only a few customers still experiencing issues with AM hub loads and reporting errors.  We are continuing to investigate why these customers are experiencing errors.

I will be able to provide an update first thing Monday.

While the PG HX site remains stable, unfortunately the US site is now starting to see reporting errors with Action Management data again. We will look into this immediately and provide an update in the next 2-3 hours.

It looks like there were some temporary issues with certain reporting filters last night, but they have since resolved themselves. We will continue to monitor for any additional issues.

We deployed the additional fix to the US site and this appears to have resolved the remaining issues with hubs.  We will continue to monitor over the next 24 hours.

Although the issue is resolved on the PG HX site, the fix only resolved the issue for some customers on the US site. Others continue to be affected. We have an additional fix for these clients we plan to deploy this afternoon. I will provide an update at that time.

A fix has been implemented on the US and PG HX sites, and we are monitoring the results. We have checked multiple reports and the case data now appears up to date. We will continue to review this, and I will provide an update tomorrow afternoon.

Our fix is nearly ready for deployment. We are planning to deploy this afternoon, at which time I can provide additional updates.

Unfortunately, during QA, we discovered that the process to fix this will be more complicated than expected. Consequently, we need another day to work on this fix. As of now, we are hoping to deploy the solution tomorrow afternoon.

I can provide an update first thing tomorrow.

We are finishing up QA on the potential fix. I will provide an update within the next few hours as to whether this fix goes into production today or not.

Our current plan is to deploy the fix Monday afternoon to ensure we can monitor the fix immediately after deployment in case of issues. If anything changes I will provide an update Monday morning. Otherwise, I will provide an update Monday afternoon after the fix is deployed.

We are finishing up work on a potential fix for this issue. At this time we expect it to be ready first thing Monday morning. I will provide an update by the end of the day.

We are continuing to work on a fix for this issue. Reporting data has started to fall out of sync for a couple of customers on other sites as well. We are not seeing any report viewing errors.

We will have an update tomorrow morning.

After some additional investigation, it looks like the situation has improved. We made some updates yesterday, and it looks like reporting period filters are no longer causing errors, and at least for some of the affected clients, the case data has caught up to this morning.

Some environments are not experiencing any issues related to this incident, but the US SaaS and PG HX continue to see reporting data falling out of sync or syncing inconsistently, though they are no longer seeing errors. We will continue to investigate.

After a cross-team discussion, we are implementing a new solution. This solution will most likely not be finished until the end of the day, at which point I can provide an update.

We are continuing to investigate the issues with the remaining affected hubs. Unfortunately we will not have a solution by the end of the day. I will provide an update first thing in the morning.

Since the last message, the issue has resolved for more customers, thanks to the fix we implemented. However, there are still some customers that are impacted. Our developers are looking into this now. We should have an update in the next few hours.

It looks like the fix has resolved the issue for some customers but not others. We will continue to investigate and should have an additional update in about five or six hours.

We are continuing to work on a fix for this issue. We should have another update by the end of the day.

Some reporting views show delayed Action Management case data for programs, as well as errors when using certain filters. Recent case activity starting yesterday may not yet appear in these views, and case counts may not reflect the latest updates.

Please note that no case data has been lost, and Action Management case creation and assignment continues to function normally.

We are working on a potential solution we hope to deploy tomorrow. We will be able to provide an update in the next few hours.