Check the stats and details of the latest Helium Proof-of-Coverage outages and issues
Major Resolved · 14 days ago · lasted about 8 hours
Validators with a corrupted region cache are preventing block production. The core team is working with operators to fix affected validators to resume block production. Sorry for the inconvenience and thanks for your patience. At this time, all transactions on chain will be unconfirmed until Validators begin producing blocks again. Funds are safe but activity like Proof of Coverage, Hotspot onboarding and movement, Token Transfers, etc. are unavailable. Data Transfer is not affected.
Major Resolved · about 1 month ago · lasted about 8 hours
The core developers and validator operators have noticed a chain halt at block 1,589,496. We are investigating the root cause. At this time, all transactions on chain will be unconfirmed until Validators begin producing blocks again. Funds are safe but activity like Proof of Coverage, Hotspot onboarding and movement, Token Transfers, etc. are unavailable. Data Transfer is not affected. At this time, all transactions on chain will be unconfirmed until Validators begin producing blocks again. Funds are safe but activity like Proof of Coverage, Hotspot onboarding and movement, Token Transfers, etc. are unavailable. Data Transfer is not affected.
Major Resolved · about 1 month ago · lasted about 5 hours
The core developers and validators operators have noticed a chain halt where validators aren't producing blocks after 1,587,313. We are investigating the root cause. At this time, all transactions on chain will be unconfirmed until Validators begin producing blocks again. Funds are safe but activity like Proof of Coverage, Hotspot onboarding and movement, Token Transfers, etc. are unavailable. Data Transfer is not affected.
Major Resolved · about 1 month ago · lasted about 1 hour
The core team is investigating the chain halt that occurred at block height 1,575,955. The network appears to have hit the same issue that was cleared earlier and most likely the root cause of the initial outage. The core team and Validator operators in the community are working together to resolve this issue. Hotspots will not be participating in Proof of Coverage until block production resumes. All funds are safe, but pending transactions will be delayed until we can resolve this halt. Pending Transactions include adding a Hotspot, changing a Hotspot Location, transferring a Hotspot, payments, and token burns. At this time, data transfer is not affected by the chain halt.
Major Resolved · 6 months ago · lasted about 2 hours
Chain Halt @ 1368539
There is a big block that the core devs and validator operators are keeping an eye on. We did just issue a chain variable during the last epoch so it could be related to that but we will keep the community updated as we have more information Nothing actionable at this time for Hotspot owners or other network participants. We will provide updates as they come.
Minor Resolved · 7 months ago · lasted about 2 months
Lowered Proof-of-Coverage Rate and Rewards
The core team is continuing to debug the root cause of lowered Proof-of-Coverage receipts (and consequently lowered rewards). We may have a lead and will update community as soon as it's confirmed and we have a fix. Also note that if you have altered your sys.config file on your Hotspot, you may have inadvertently broke your Hotspot's ability to participate in Proof-of-Coverage. Please check with your Hotspot Maker on what the correct configuration settings should be. If you have no idea what sys.config means, no action required - the likely cause of low rewards is what the devs are working on.
Minor Resolved · 7 months ago · lasted about 9 hours
Lowered Proof-of-Coverage Rate and Rewards
Overnight, the core team saw more PoC failures, lowered rewards, and stuck Validators (owned by validator operators that did not upgrade). What we're seeing is that when a Hotspot connects to a Validator that gets stuck, the Hotspot's proof-of-coverage receipts is rejected by the stalled Validator, and the Hotspot never tries to reconnect to another. Hotspot PoC -> Old Validator > Old Validator does not process the PoC -> Hotspot does not get rewarded. We are looking to fix this in 3 ways: 1) Identify Validators who have not upgraded and tell them to ASAP. We may consider other methods of removing them from participating in Proof-of-coverage. 2) Add logic to Hotspots (will require a software update, update to come) to reconnect to a different Validator. @hotspot-maker be prepared to issue a software update today. 3) Ensure snapshots are available No action is required for Hotspot owners. This is all hands on deck for the core team and our highest priority. We will be updatin...
Have you ever missed an important outage from a third-party service? We've built IsDown, so you never miss another outage again. It's the easiest way to monitor all your SaaS and cloud providers and get alerted when an outage impacts your business.Start free trial
No credit card required · Cancel anytime · 2021 services available
"If you are in SRE, IT, or Security and work in an environment with a lot of SaaS (which, let's face it, is all of them) - IsDown is your new best friend. Helpfully aggregates various Statuspages from services into a very clear dashboard. Worth every penny."
Mike, Head of Security
Quickly identify external outages that impact your business. We are monitoring more than 2000 services in real time.
Birds-eye view over all your services statuses
Check the status page aggregated of all your services in one place. No more going to each of the status pages and managing them individually.
Outage monitoring in real time
We monitor 24 hours a day, 7 days a week and will notify you if there is an incident. No more wasting time trying to figure out why something isn't working.
Alerts in your favorite channels
Get instant notifications in your email, Slack, Teams, or Discord when we detect a service outage. Outage monitoring where you are already doing your work.
Easily integrate with your current tools and workflows
Using Zapier or Webhooks, you can easily integrate notifications into your processes. PagerDuty integration is also available.
Avoid notifications clutter
Configure which notifications you want to receive from each service. Filter notifications by service components. You can opt to receive notifications only when a specific component is affected. You can also choose to receive notifications with a certain severity.
Have multiple dashboards. Easily shareable with the world.
Create one dashboard for each of your teams/clients/projects. Monitor only the services that each uses. Dedicated dashboard with custom notification settings. Easily make your dashboard public and share it with the world.
Prepare for scheduled maintenances
Never again be caught off guard by unexpected maintenance from your services. A feed of the next scheduled maintenances is available.
Weekly Digest of the services' outages
Every Monday, you'll receive a weekly summary of what happened the previous week as well as the maintenance schedule for the following week.
DevOps & On-Call Teams
You already monitor your internal systems. What about the external services? Monitor the services your business depends on. Don't waste time looking elsewhere when external outages are the cause of issues.
IT Support Teams
Detect external outages before your clients tell you. Anticipate possible issues and make the necessary arrangements. Having proactive communication, builds trust over clients and prevents flow of support tickets.
Simple Setup. Instant Value.
Start with a trial account that will allow you to try and monitor up to 40 services for 14 days.
There are 2021 services to choose from, and we're adding more every week.
You can get notifications by email, Slack, and Discord. You can also use Zapier or Webhooks to build your workflows.
You'll start getting alerts when we detect outages in your external dependencies! No more wasting time looking in the wrong place!
Try it out! How much time you'll save your team, by having the outages information close to them?