Front End webserver down

This incident has been resolved.

The backup is completed. We are checking the systems to see if everything has recovered successfully.

The new server is up and running. We are restoring backups and bringing all websites back up one by one.

A few systemfiles of the front-end server got corrupted. We were only able to repair a part of the system. We are creating a new server and recovering backups this night to avoid problems in the near future. There will be no loss of data, the data is secured on separate servers with duplicates in another datacenter.

The applications on the tablets are live. Icecloud.be is still down but we are keeping this state until the ice cream vans end their day shift. We'll continue working after 22:00.

In some regions the apps are live again.

The front end webserver is down.