Windows clients hanging when accessing dataseta

This incident has been resolved.

We are continuing to monitor for any further issues.

For the moment we have not experienced any further file locking issues. We will be monitoring daily but if you are experiencing access issues to the S: and M: drives please ensure you log a ticket with Support. Meanwhile we are planning some upgrade work to move us forward.

The NFS and SMB service restarts are now complete and all errant file locks have been cleared. Access to S: and M: drives, and NFS mounts, is now available

We will be restarting the SMB and NFS services again this afternoon at 4pm. This will disrupt all Windows access to the S: and M: drives for about an hour. Also any NFS mounts of the GPFS filesystems will be similarly impacted. Apologies for the inconvenience whilst we continue to pursue a complete solution.

NFS and SMB access to the filesystem is now available. We have discovered a probable Windows file locking process is causing issues and making files appear to have no read permissions, resulting in hung S: and M: drives. This can also affect Linuz/Slurm access to files that Windows has locked. For now we have cleared all the locks and the system should be much more cooperative.
We will continue researching an ultimate solution. Please report any new issues found.

At 3pm today we will be shutting down and rebooting the protocol servers that provide the SMB and NFS services. These services will remain down for up to two hours whilst we investigate the affect. This is an attempt to clear some ongoing permissions issues where some files cannot be read. This is manifesting itself as hung mounts on Windows PCs and/or specific file access issues.
We will advise when the services are again available via this Status page.

We are aware the problem has returned for some users. Diagnostics will continue with REANNZ and HPE involvement

We removed one of the SMB servers from the configuration shortly after the service restart at 1pm today. We believe the SMB issue has been much improved since then but continue to monitor. If you are still suffering issues please be sure to restart your Windows PC before testing again. If the problem still persists then please log a ticket with REANNZ support so we are aware.

We will be restarting the GPFS SMB service at 1pm today in an attempt to rectify the problem. All Windows sessions accessing the S: and M: drives will be disrupted

We are aware there is an increasing number of jobs and users experiencing problem when trying to access datasets on the GPFS storage. We are working with HPE to diagnose this difficult issue