we are running Nexus OSS 3.31.1-01 on a Kubernetes cluster and recently had the problem that the volume for the blob store ran out of disk space.
The disk space problem is now resolved, however the blob store seems to be permanently corrupted.
In the logs we find this message:
2021-07-08 07:27:02,848+0000 INFO [FelixStartLevel] *SYSTEM org.sonatype.nexus.blobstore.file.internal.FileBlobStoreMetricsStore - Blob store metrics file /nexus-data/blobs/default/3788CA80-816C0ABF-AD478503-8EE5DC17-46D7A466-metrics.properties null not found - initializing at zero. 2021-07-08 07:27:02,922+0000 ERROR [FelixStartLevel] *SYSTEM org.sonatype.nexus.blobstore.file.internal.FileBlobStoreMetricsStore - Failed transition: NEW -> STARTED java.io.FileNotFoundException: /nexus-data/blobs/default/3788CA80-816C0ABF-AD478503-8EE5DC17-46D7A466-metrics.properties (Stale file handle)
The file mentioned in the message is present and non-empty. The whole blob store is residing on a GlusterFS volume.
All tasks doing anything on this blob store (like compact, reconcile etc) fail with the message “Invalid state: Failed”.
Any ideas what we can do, possibly recovering the artifacts still stored in this blob store?