Incident impacing datasets in EUR-W3

The engineering team has monitored the datasets service over night and have concluded that the recovery done yesterday evening was sufficient to resolve this issue. The datasets service is healthy, and despite having to depend on restoring data from backups, no customer data was lost during this incident.

The datasets service is restored after bringing the backend database up from backup. Our log review concludes that no customer writes to the datasets service was submitted between the backup restpre time and when the service was brought back. No customer data was lost in this incident.

The engineering team gas identified an issue with the database service supporting datasets. The team is now recovering data from backup to restore data to the point in time when the service went down. No dataloss is expected.

The engineering team continues to investigate the reason for the datasets service failing. The impact to users will be lack of access to data where the access is managed via data sets. Users will experience access denied messages and missing data in apps and API results.

Cognite Engineering is investigating an incident where datasets are unavailable for users in EUR-W3. End users will see that datasets are not found, and extractors feeding data to data sets may fail.