RebuildMaven2MetadataTask fails

I have the problem that the Repair task fails everytime I try to run it, but the metadata is visible on the Nexus UI:

2023-02-06 22:14:52,218+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Task information:
2023-02-06 22:14:52,221+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - ID: 7cbab4be-4443-46e9-afe7-957a60c32e58
2023-02-06 22:14:52,221+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Type: repository.maven.rebuild-metadata
2023-02-06 22:14:52,221+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Name: maven releases rebuild maven repository metadata
2023-02-06 22:14:52,226+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Description: Rebuilding Maven Metadata of releases
2023-02-06 22:15:02,241+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataUpdater - metadata for MavenPath{path=‘com/durr/mes/product/messuite/modules/prodtrack/maven-metadata.xml’, fileName=‘maven-metadata.xml’, hashType=null} hasn’t changed, skipping
2023-02-06 22:15:03,732+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataUpdater - metadata for MavenPath{path=‘com/durr/ecoemos/erp-backend/erp-backend-impl/maven-metadata.xml’, fileName=‘maven-metadata.xml’, hashType=null} hasn’t changed, skipping
2023-02-06 22:15:05,002+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:05,119+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:05,533+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:06,041+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:07,251+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:07,561+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:10,569+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:12,083+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:30,090+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.blobstore.file.FileBlobStore - Attempt to access soft-deleted blob 42c0eadd-e536-4500-8a4e-6e27ad69e702 attributes: D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties {deletedDateTime=1674198839859, deleted=true, @BlobStore.created-by=anonymous, creationTime=1673953083116, @BlobStore.created-by-ip=10.150.46.211, @BlobStore.content-type=text/plain, sha1=548f50c5a5a22e18da546791a3baadba7aa46c9c, @BlobStore.blob-name=com/durr/mes/product/messuite/modules/materialflowtracking/materialflowtracking-rest/2.0.11/materialflowtracking-rest-2.0.11.war.sha1, deletedReason=Updating asset AttachedEntityId{asset->#35:168032}, @Bucket.repo-name=releases, size=40}
2023-02-06 22:15:30,091+0100 WARN [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.transaction.RetryController - Exceeded retry limit: 8/8 (org.sonatype.nexus.repository.storage.MissingBlobException: Blob default@36D29E98-497BAFEC-EAD0FD30-C6BC07CC-42A5D90B:42c0eadd-e536-4500-8a4e-6e27ad69e702 exists in metadata, but is missing from the blobstore)
2023-02-06 22:15:30,100+0100 ERROR [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Failed to run task ‘Rebuilding Maven Metadata of releases’ on repository ‘releases’
org.sonatype.nexus.repository.storage.RetryDeniedException: Exceeded retry limit
at org.sonatype.nexus.repository.storage.StorageTxImpl.allowRetry(StorageTxImpl.java:203)
at sun.reflect.GeneratedMethodAccessor186.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.sonatype.nexus.common.stateguard.SimpleMethodInvocation.proceed(SimpleMethodInvocation.java:53)
at org.sonatype.nexus.common.stateguard.StateGuardAspect$1.invoke(StateGuardAspect.java:69)
at com.sun.proxy.$Proxy207.allowRetry(Unknown Source)
at org.sonatype.nexus.transaction.TransactionalWrapper.proceedWithTransaction(TransactionalWrapper.java:81)
at org.sonatype.nexus.transaction.Operations.proceedWithTransaction(Operations.java:220)
at org.sonatype.nexus.transaction.Operations.transactional(Operations.java:207)
at org.sonatype.nexus.transaction.Operations.call(Operations.java:157)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.rebuildMetadataInner(MetadataRebuilder.java:476)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.rebuildMetadata(MetadataRebuilder.java:408)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder.rebuild(MetadataRebuilder.java:126)
at org.sonatype.nexus.repository.maven.internal.hosted.MavenHostedFacetImpl.rebuildMetadata(MavenHostedFacetImpl.java:111)
at org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask.execute(RebuildMaven2MetadataTask.java:60)
at org.sonatype.nexus.repository.RepositoryTaskSupport.execute(RepositoryTaskSupport.java:75)
at org.sonatype.nexus.scheduling.TaskSupport.call(TaskSupport.java:100)
at org.sonatype.nexus.quartz.internal.task.QuartzTaskJob.doExecute(QuartzTaskJob.java:143)
at org.sonatype.nexus.quartz.internal.task.QuartzTaskJob.execute(QuartzTaskJob.java:106)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at org.sonatype.nexus.quartz.internal.QuartzThreadPool.lambda$0(QuartzThreadPool.java:143)
at org.sonatype.nexus.thread.internal.MDCAwareRunnable.run(MDCAwareRunnable.java:40)
at org.apache.shiro.subject.support.SubjectRunnable.doRun(SubjectRunnable.java:120)
at org.apache.shiro.subject.support.SubjectRunnable.run(SubjectRunnable.java:108)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.sonatype.nexus.repository.storage.MissingBlobException: Blob default@36D29E98-497BAFEC-EAD0FD30-C6BC07CC-42A5D90B:42c0eadd-e536-4500-8a4e-6e27ad69e702 exists in metadata, but is missing from the blobstore
at org.sonatype.nexus.repository.storage.StorageTxImpl.requireBlob(StorageTxImpl.java:931)
at sun.reflect.GeneratedMethodAccessor160.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.sonatype.nexus.common.stateguard.SimpleMethodInvocation.proceed(SimpleMethodInvocation.java:53)
at org.sonatype.nexus.common.stateguard.MethodInvocationAction.run(MethodInvocationAction.java:39)
at org.sonatype.nexus.common.stateguard.StateGuard$GuardImpl.run(StateGuard.java:272)
at org.sonatype.nexus.common.stateguard.GuardedInterceptor.invoke(GuardedInterceptor.java:53)
at org.sonatype.nexus.common.stateguard.StateGuardAspect$1.invoke(StateGuardAspect.java:63)
at com.sun.proxy.$Proxy207.requireBlob(Unknown Source)
at org.sonatype.nexus.repository.maven.internal.MavenFacetImpl.get(MavenFacetImpl.java:193)
at org.sonatype.nexus.transaction.TransactionInterceptor.invoke(TransactionInterceptor.java:41)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.mayUpdateChecksum(MetadataRebuilder.java:546)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.lambda$3(MetadataRebuilder.java:510)
at org.sonatype.nexus.transaction.OperationPoint.proceed(OperationPoint.java:64)
at org.sonatype.nexus.transaction.TransactionalWrapper.proceedWithTransaction(TransactionalWrapper.java:56)
… 22 common frames omitted
2023-02-06 22:15:30,105+0100 ERROR [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Failed to run task ‘Rebuilding Maven Metadata of releases’
org.sonatype.goodies.common.MultipleFailures$MultipleFailuresException: Failed to run task ‘Rebuilding Maven Metadata of releases’; 1 failure
at org.sonatype.goodies.common.MultipleFailures.maybePropagate(MultipleFailures.java:95)
at org.sonatype.nexus.repository.RepositoryTaskSupport.execute(RepositoryTaskSupport.java:86)
at org.sonatype.nexus.scheduling.TaskSupport.call(TaskSupport.java:100)
at org.sonatype.nexus.quartz.internal.task.QuartzTaskJob.doExecute(QuartzTaskJob.java:143)
at org.sonatype.nexus.quartz.internal.task.QuartzTaskJob.execute(QuartzTaskJob.java:106)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at org.sonatype.nexus.quartz.internal.QuartzThreadPool.lambda$0(QuartzThreadPool.java:143)
at org.sonatype.nexus.thread.internal.MDCAwareRunnable.run(MDCAwareRunnable.java:40)
at org.apache.shiro.subject.support.SubjectRunnable.doRun(SubjectRunnable.java:120)
at org.apache.shiro.subject.support.SubjectRunnable.run(SubjectRunnable.java:108)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Suppressed: org.sonatype.nexus.repository.storage.RetryDeniedException: Exceeded retry limit
at org.sonatype.nexus.repository.storage.StorageTxImpl.allowRetry(StorageTxImpl.java:203)
at sun.reflect.GeneratedMethodAccessor186.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.sonatype.nexus.common.stateguard.SimpleMethodInvocation.proceed(SimpleMethodInvocation.java:53)
at org.sonatype.nexus.common.stateguard.StateGuardAspect$1.invoke(StateGuardAspect.java:69)
at com.sun.proxy.$Proxy207.allowRetry(Unknown Source)
at org.sonatype.nexus.transaction.TransactionalWrapper.proceedWithTransaction(TransactionalWrapper.java:81)
at org.sonatype.nexus.transaction.Operations.proceedWithTransaction(Operations.java:220)
at org.sonatype.nexus.transaction.Operations.transactional(Operations.java:207)
at org.sonatype.nexus.transaction.Operations.call(Operations.java:157)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.rebuildMetadataInner(MetadataRebuilder.java:476)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.rebuildMetadata(MetadataRebuilder.java:408)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder.rebuild(MetadataRebuilder.java:126)
at org.sonatype.nexus.repository.maven.internal.hosted.MavenHostedFacetImpl.rebuildMetadata(MavenHostedFacetImpl.java:111)
at org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask.execute(RebuildMaven2MetadataTask.java:60)
at org.sonatype.nexus.repository.RepositoryTaskSupport.execute(RepositoryTaskSupport.java:75)
… 13 common frames omitted
Caused by: org.sonatype.nexus.repository.storage.MissingBlobException: Blob default@36D29E98-497BAFEC-EAD0FD30-C6BC07CC-42A5D90B:42c0eadd-e536-4500-8a4e-6e27ad69e702 exists in metadata, but is missing from the blobstore
at org.sonatype.nexus.repository.storage.StorageTxImpl.requireBlob(StorageTxImpl.java:931)
at sun.reflect.GeneratedMethodAccessor160.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.sonatype.nexus.common.stateguard.SimpleMethodInvocation.proceed(SimpleMethodInvocation.java:53)
at org.sonatype.nexus.common.stateguard.MethodInvocationAction.run(MethodInvocationAction.java:39)
at org.sonatype.nexus.common.stateguard.StateGuard$GuardImpl.run(StateGuard.java:272)
at org.sonatype.nexus.common.stateguard.GuardedInterceptor.invoke(GuardedInterceptor.java:53)
at org.sonatype.nexus.common.stateguard.StateGuardAspect$1.invoke(StateGuardAspect.java:63)
at com.sun.proxy.$Proxy207.requireBlob(Unknown Source)
at org.sonatype.nexus.repository.maven.internal.MavenFacetImpl.get(MavenFacetImpl.java:193)
at org.sonatype.nexus.transaction.TransactionInterceptor.invoke(TransactionInterceptor.java:41)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.mayUpdateChecksum(MetadataRebuilder.java:546)
at org.sonatype.nexus.repository.maven.internal.hosted.metadata.MetadataRebuilder$Worker.lambda$3(MetadataRebuilder.java:510)
at org.sonatype.nexus.transaction.OperationPoint.proceed(OperationPoint.java:64)
at org.sonatype.nexus.transaction.TransactionalWrapper.proceedWithTransaction(TransactionalWrapper.java:56)
… 22 common frames omitted
2023-02-06 22:15:30,105+0100 INFO [quartz-3-thread-18] *SYSTEM org.sonatype.nexus.repository.maven.tasks.RebuildMaven2MetadataTask - Task complete

Can anybody help me here? Do I need to restore the backup or is it possible to solve this using the Repair tasks Nexus provides?

Somehow there is a file in blob storage marked as deleted when it shouldn’t be. Try editing the “D:\Data\Nexus\sonatype-work\nexus3\blobs\default\content\vol-25\chap-05\42c0eadd-e536-4500-8a4e-6e27ad69e702.properties” and remove the “deleted=true” line.

Hello Rich, thanks for the response!
this fixed the issue regarding the one artefact.
But I have additional artefacts, which have the same issue.
Is there a way to get rid of the and delete the line all by one?
Maybe there is also a Nexus Task for that?!