Molecule Outage

The issue has been fully resolved. The database update and reprocessing have successfully completed in production, and all services are now available. We have verified system stability and data integrity. No further impact is expected. Thank you for your patience while we worked through this incident. We will provide a full post-mortem of the incident in the coming days.

We are still working to restore service, and expect approximately 3-5 hours of additional downtime. The issue is related to running out of available IDs on the primary Valuations table. We will be migrating 30 days of data at a time to the new table, to restore service as quickly as possible. This may result in a delay accessing older data. We will keep you posted as we work through this.

We’ve implemented a fix for this issue which is related to a change to the underlying Molecule database structure. While the root issue has been identified and a fix is in place, we are experiencing severely degraded performance while the database fix is applied. This process could take up to six more hours to complete. We are monitoring progress, and will provide regular updates on the progress of the fix. Thank you for your continued patience

We are currently experiencing an outage with the U.S. application, due to an issue with the database. We have identified the issue and are in the process of deploying a fix. Due to the nature of the issue and the necessary fix, we estimate that the outage may last approximately 8 hours.