EU - Ninja Remote and UI/Page Load timeouts due to performance degradation

We will publish a post-mortem in the coming days detailing the issues and our remediation steps.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to monitor for any further issues.

We are continuing to closely monitor the environment this morning as customers come online. As of right now current metrics indicate services are operating within expected performance ranges. We will continue to monitor this throughout the day and provide updates periodically should any potential impact be expected.

Update – EU Instance Performance Degradation

We are continuing to investigate performance degradation affecting portions of our EU region.

Currently Impacted Services:
RMM/Endpoint Management, Ticketing/PSA, Reporting, Patching, Mobile App, Custom Fields, Documentation, NMS, Web Portal, and Reporting may experience intermittent performance degradation.

Services Operating Normally:
NinjaRemote, MDM, Backup, CrowdStrike and SentinelOne integrations, File Transfer Service (FTS), and Realtime Tools remain fully operational.

Overall performance has shown steady improvements following adjustments made earlier this week.

Our engineering team will continue active monitoring and investigation to determine the root cause and will provide an update once that is available

We are continuing to investigate this issue.

We are continuing to investigate this issue.

We are continuing to investigate this issue.

We are continuing to investigate this issue.

We have addressed the performance issues affecting Ninja Remote, and are seeing healthy throughput and internal testing has confirmed consistent connections over the last few minutes.

We are continuing to triage and debug the issue. There is continued impact to the NinjaOne console and Ninja Remote at this time.

We are encountering DB load once again on several backend databases. We are actively triaging to bring stability to the environment. Some customers are experiencing delays in page load times or timeouts when using Ninja Remote.

We are continuing to monitor the environment and out of an abundance of caution are leaving the Status Page incident open. At this time monitoring indicates no known performance bottlenecks or other unhealthy signal. There is planned maintenance this evening, and additional fixes and tuning will be performed during this period to reduce customer impact.

We are seeing stable performance metrics at the moment. We are continuing to monitor the environment before considering this resolved.

We are seeing a positive improvement in overall performance, however we are continuing to debug a handful of load issues as we work to stabilize the environment.

We are currently experiencing extremely high load on several backend databases. We are actively working to relieve the pressure and restore services.

The issue has been identified and a fix is being implemented.

We are continuing to investigate this issue.

We are continuing to investigate this issue.

NinjaOne has identified a service issue that may affect customer performance. We are currently investigating and will provide regular status updates. Any customers having issues with the Ninja Application can contact Support for assistance at support@ninjarmm.com.

Thank you for your patience.