Cleanup unused nuget blobs not working?

Looks like I was missing the Compact blob store tasks - Cleanup Policies

After running that the disk space was cleaned up.