Services are stopped

We have seen no further issues over the weekend and are marking this resolved.

The issue was caused by a database server running out of space between Thursday night and Friday morning. Due to the time of day we didn't notice the issue before 6am Friday morning but we got to fixing it immediately.

The fix was to expand the storage on the database server but we realised that the storage pool the database server volume was on was limited to 2 TB per volume and that was the size of the database server volume.

This meant that our hosting provider had to move the volume to another storage pool before we could expand the storage. The whole situation was compounded by a file system on the database server not supporting drives larger than 2 TB which meant that we had to change the file system before the expansion could be completed.

At 17:45 all services were active once again.

We sincerely apologise for the issue! We expect more from ourselves regarding hosting our service and we will be working on a bunch of new processes to avoid this issue in the future.

We really appreciate that each and every client we were in touch with on Friday was kind and understanding. Thank you so much - we couldn't have asked for more during a rather stressful time.

A fix has been implemented and we are monitoring the results.

All services are up and running. We are monitoring the situation for the rest of the evening and we will compile a final update with all information about the downtime within the next couple of days.

We sincerely apologise for the issue and we really appreciate the understanding we have been met with throughout the day.

We are still working on verifying the data after the migration. New status in 60 minutes.

The migration finished about an hour later than expected. We are working on booting up our servers and verifying that the data migration happened without issues. New status in 60 minutes.

The migration is currently at 75% - we are updated as soon as it is completed and will keep you posted. New status in 60 minutes or less.

The migration is still ongoing. We're awaiting an estimate on when it will be done and as soon as we have it I will update the incident report. New status in 60 minutes or less.

The migration is continuing as planned. New status in 60 minutes.

Our hosting provider has started the migration from one storage pool to another. They expect it to take about two hours to complete the migration. When data is migrated we need to verify that all systems are working before starting services again so we expect at least three hours of downtime from now.
We sincerely apologise for the inconvenience caused by this issue and will supply a full update when all services are running again.
New update in 60 minutes.

We're planning the migration process with our hosting provider. We will keep you updated on the development.
New status in 60 minutes.

Our hosting provider has proposed a migration of data from one storage solution to another which would help us solve the issue. We're working out the implications of doing the migration. New status in 60 minutes.

We're still awaiting feedback regarding the proposed solution from our hosting provider. As soon as we have the needed information we can begin implementing the solution and getting services up and running again.
New status in 30 minutes - and many apologies from the Ubivox office!

Our hosting provider has found a potential solution to the issue by migrating data from one server to another. We're working with them on how to handle the process. New status in 30 minutes.

We are continuing to work on a fix for this issue.

Our hosting provider has identified an issue with our setup and are working on a solution. New status in 30 minutes.

No new for now, we're still in touch with our hosting provider who has a tech working on our case. New status in 30 minutes.

Our hosting facility is working on fixing an issue in their setup an as soon as this is done we can get our services up and running again. New status in 30 minutes.

We're working with our hosting facility to solve the issue. New status in 30 minutes.

We're working on fixing an issue with a server and have had to stop services sending e-mails etc. We will update as soon as services are running again.