Podman Error pulling candidate and Error: reading blob sha256

[quochoangnguyen]

when trying to make a podman pull I get this_:

podman pull docker.io/neotys/neoload-loadgenerator:2024.1.2 --log-level=debug
INFO[0000] podman filtering at log level debug
DEBU[0000] Called pull.PersistentPreRunE(podman pull docker.io/neotys/neoload-loadgenerator:2024.1.2 --log-level=debug)
DEBU[0000] Using conmon: "/usr/bin/conmon"
DEBU[0000] Initializing boltdb state at /var/lib/containers/storage/libpod/bolt_state.db
DEBU[0000] Using graph driver overlay
DEBU[0000] Using graph root /var/lib/containers/storage
DEBU[0000] Using run root /run/containers/storage
DEBU[0000] Using static dir /var/lib/containers/storage/libpod
DEBU[0000] Using tmp dir /run/libpod
DEBU[0000] Using volume path /var/lib/containers/storage/volumes
DEBU[0000] Using transient store: false
DEBU[0000] Set libpod namespace to ""
DEBU[0000] [graphdriver] trying provided driver "overlay"
DEBU[0000] Cached value indicated that overlay is supported
DEBU[0000] Cached value indicated that overlay is supported
DEBU[0000] Cached value indicated that metacopy is being used
DEBU[0000] Cached value indicated that native-diff is not being used
INFO[0000] Not using native diff for overlay, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled
DEBU[0000] backingFs=xfs, projectQuotaSupported=false, useNativeDiff=false, usingMetacopy=true
DEBU[0000] Initializing event backend file
DEBU[0000] Configured OCI runtime kata initialization failed: no valid executable found for OCI runtime kata: invalid argument
DEBU[0000] Configured OCI runtime runsc initialization failed: no valid executable found for OCI runtime runsc: invalid argument
DEBU[0000] Configured OCI runtime youki initialization failed: no valid executable found for OCI runtime youki: invalid argument
DEBU[0000] Configured OCI runtime crun initialization failed: no valid executable found for OCI runtime crun: invalid argument
DEBU[0000] Configured OCI runtime krun initialization failed: no valid executable found for OCI runtime krun: invalid argument
DEBU[0000] Configured OCI runtime ocijail initialization failed: no valid executable found for OCI runtime ocijail: invalid argument
DEBU[0000] Configured OCI runtime crun-wasm initialization failed: no valid executable found for OCI runtime crun-wasm: invalid argument
DEBU[0000] Configured OCI runtime runj initialization failed: no valid executable found for OCI runtime runj: invalid argument
DEBU[0000] Using OCI runtime "/usr/bin/runc"
INFO[0000] Setting parallel job count to 25
DEBU[0000] Pulling image docker.io/neotys/neoload-loadgenerator:2024.1.2 (policy: always)
DEBU[0000] Looking up image "docker.io/neotys/neoload-loadgenerator:2024.1.2" in local containers storage
DEBU[0000] Normalized platform linux/amd64 to {amd64 linux [] }
DEBU[0000] Trying "docker.io/neotys/neoload-loadgenerator:2024.1.2" ...
DEBU[0000] Trying "docker.io/neotys/neoload-loadgenerator:2024.1.2" ...
DEBU[0000] Trying "docker.io/neotys/neoload-loadgenerator:2024.1.2" ...
DEBU[0000] Loading registries configuration "/etc/containers/registries.conf"
DEBU[0000] Loading registries configuration "/etc/containers/registries.conf.d/000-shortnames.conf"
DEBU[0000] Loading registries configuration "/etc/containers/registries.conf.d/001-rhel-shortnames.conf"
DEBU[0000] Loading registries configuration "/etc/containers/registries.conf.d/002-rhel-shortnames-overrides.conf"
DEBU[0000] Normalized platform linux/amd64 to {amd64 linux [] }
DEBU[0000] Attempting to pull candidate docker.io/neotys/neoload-loadgenerator:2024.1.2 for docker.io/neotys/neoload-loadgenerator:2024.1.2
DEBU[0000] parsed reference into "[overlay@/var/lib/containers/storage+/run/containers/storage:overlay.mountopt=nodev,metacopy=on]docker.io/neotys/neoload-loadgenerator:2024.1.2"
Trying to pull docker.io/neotys/neoload-loadgenerator:2024.1.2...
DEBU[0000] Copying source image //neotys/neoload-loadgenerator:2024.1.2 to destination image [overlay@/var/lib/containers/storage+/run/containers/storage:overlay.mountopt=nodev,metacopy=on]docker.io/neotys/neoload-loadgenerator:2024.1.2
DEBU[0000] Using registries.d directory /etc/containers/registries.d
DEBU[0000] Trying to access "docker.io/neotys/neoload-loadgenerator:2024.1.2"
DEBU[0000] No credentials matching docker.io/neotys/neoload-loadgenerator found in /run/containers/0/auth.json
DEBU[0000] No credentials matching docker.io/neotys/neoload-loadgenerator found in /root/.config/containers/auth.json
DEBU[0000] No credentials matching docker.io/neotys/neoload-loadgenerator found in /root/.docker/config.json
DEBU[0000] No credentials matching docker.io/neotys/neoload-loadgenerator found in /root/.dockercfg
DEBU[0000] No credentials for docker.io/neotys/neoload-loadgenerator found
DEBU[0000] No signature storage configuration found for docker.io/neotys/neoload-loadgenerator:2024.1.2, using built-in default file:///var/lib/containers/sigstore
DEBU[0000] Looking for TLS certificates and private keys in /etc/docker/certs.d/docker.io
DEBU[0000] GET https://registry-1.docker.io/v2/
DEBU[0000] Ping https://registry-1.docker.io/v2/ status 401
DEBU[0000] GET https://auth.docker.io/token?scope=repository%3Aneotys%2Fneoload-loadgenerator%3Apull&service=registry.docker.io
DEBU[0000] GET https://registry-1.docker.io/v2/neotys/neoload-loadgenerator/manifests/2024.1.2
DEBU[0001] Content-Type from manifest GET is "application/vnd.docker.distribution.manifest.v2+json"
DEBU[0001] Using blob info cache at /var/lib/containers/cache/blob-info-cache-v1.boltdb
DEBU[0001] IsRunningImageAllowed for image docker:docker.io/neotys/neoload-loadgenerator:2024.1.2
DEBU[0001] Using default policy section
DEBU[0001] Requirement 0: allowed
DEBU[0001] Overall: allowed
DEBU[0001] Downloading /v2/neotys/neoload-loadgenerator/blobs/sha256:5de2259523982c0986e088a9d77f050b14bb6ee71bb3decbef303d2aeb646d80
DEBU[0001] GET https://registry-1.docker.io/v2/neotys/neoload-loadgenerator/blobs/sha256:5de2259523982c0986e088a9d77f050b14bb6ee71bb3decbef303d2aeb646d80
Getting image source signatures
DEBU[0001] Reading /var/lib/containers/sigstore/neotys/neoload-loadgenerator@sha256=3399f2831ec4905a5d8a509d29ab2bfeb5ded68194804c847257877ca704d401/signature-1
DEBU[0001] Not looking for sigstore attachments: disabled by configuration
DEBU[0001] Manifest has MIME type application/vnd.docker.distribution.manifest.v2+json, ordered candidate list [application/vnd.docker.distribution.manifest.v2+json, application/vnd.docker.distribution.manifest.v1+prettyjws, application/vnd.oci.image.manifest.v1+json, application/vnd.docker.distribution.manifest.v1+json]
DEBU[0001] ... will first try using the original manifest unmodified
DEBU[0001] Checking if we can reuse blob sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1: general substitution = true, compression for MIME type "application/vnd.docker.image.rootfs.diff.tar.gzip" = true
DEBU[0001] Checking if we can reuse blob sha256:8dda4518dc36de93e5be77acc0c02903df0cdc2017933c07428aa1917d677ca0: general substitution = true, compression for MIME type "application/vnd.docker.image.rootfs.diff.tar.gzip" = true
DEBU[0001] Checking if we can reuse blob sha256:619be1103602d98e1963557998c954c892b3872986c27365e9f651f5bc27cab8: general substitution = true, compression for MIME type "application/vnd.docker.image.rootfs.diff.tar.gzip" = true
DEBU[0001] Checking if we can reuse blob sha256:9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf: general substitution = true, compression for MIME type "application/vnd.docker.image.rootfs.diff.tar.gzip" = true
DEBU[0001] Checking if we can reuse blob sha256:929a173452601f02079a1e2a9ad654f8aac7ab03119ae472104099ce8bea0616: general substitution = true, compression for MIME type "application/vnd.docker.image.rootfs.diff.tar.gzip" = true
DEBU[0001] Skipping blob sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1 (already present):
Copying blob 4f4fb700ef54 skipped: already exists
DEBU[0001] Failed to retrieve partial blob: blob type not supported for partial retrieval
DEBU[0001] Downloading /v2/neotys/neoload-loadgenerator/blobs/sha256:8dda4518dc36de93e5be77acc0c02903df0cdc2017933c07428aa1917d677ca0
DEBU[0001] GET https://registry-1.docker.io/v2/neotys/neoload-loadgenerator/blobs/sha256:8dda4518dc36de93e5be77acc0c02903df0cdc2017933c07428aa1917d677ca0
DEBU[0001] Failed to retrieve partial blob: blob type not supported for partial retrieval
DEBU[0001] Downloading /v2/neotys/neoload-loadgenerator/blobs/sha256:619be1103602d98e1963557998c954c892b3872986c27365e9f651f5bc27cab8
DEBU[0001] GET https://registry-1.docker.io/v2/neotys/neoload-loadgenerator/blobs/sha256:619be1103602d98e1963557998c954c892b3872986c27365e9f651f5bc27cab8
DEBU[0001] Failed to retrieve partial blob: blob type not supported for partial retrieval
DEBU[0001] Downloading /v2/neotys/neoload-loadgenerator/blobs/sha256:9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf
DEBU[0001] GET https://registry-1.docker.io/v2/neotys/neoload-loadgenerator/blobs/sha256:9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf
DEBU[0001] Failed to retrieve partial blob: blob type not supported for partial retrieval
DEBU[0001] Downloading /v2/neotys/neoload-loadgenerator/blobs/sha256:929a173452601f02079a1e2a9ad654f8aac7ab03119ae472104099ce8bea0616
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 8dda4518dc36 [--------------------------------------] 0.0b / 1.2KiB
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 8dda4518dc36 [--------------------------------------] 0.0b / 1.2KiB
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 8dda4518dc36 done
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 8dda4518dc36 done
Copying blob 619be1103602 [=========================>------------] 2.3MiB / 3.2MiB
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 8dda4518dc36 done
Copying blob 619be1103602 done
Copying blob 9a481f36794d [--------------------------------------] 0.0b / 1.2KiB
Copying blob 929a17345260 done
DEBU[0044] Error pulling candidate docker.io/neotys/neoload-loadgenerator:2024.1.2: reading blob sha256:9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf: Get "https://docker-images-prod.6aa30f8b08e16409b46e0173d6de2f56.r2.cloudflarestorage.com/registry-v2/docker/registry/v2/blobs/sha256/9a/9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=f1baa2dd9b876aeb89efebbfc9e5d5f4%2F20250205%2Fauto%2Fs3%2Faws4_request&X-Amz-Date=20250205T101442Z&X-Amz-Expires=1200&X-Amz-SignedHeaders=host&X-Amz-Signature=d4fca4e94f0a7bb19d42dd00dc0684a9685937e4a478b6104130808e3544085f": Forbidden
Error: reading blob sha256:9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf: Get "https://docker-images-prod.6aa30f8b08e16409b46e0173d6de2f56.r2.cloudflarestorage.com/registry-v2/docker/registry/v2/blobs/sha256/9a/9a481f36794dd89c01f3b19fb51d5dbfa8b2443ba18d0f72b10ff5a68c2621bf/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=f1baa2dd9b876aeb89efebbfc9e5d5f4%2F20250205%2Fauto%2Fs3%2Faws4_request&X-Amz-Date=20250205T101442Z&X-Amz-Expires=1200&X-Amz-SignedHeaders=host&X-Amz-Signature=d4fca4e94f0a7bb19d42dd00dc0684a9685937e4a478b6104130808e3544085f": Forbidden
DEBU[0044] Shutting down engines

[Luap99]

In general please fill out the proper bug template and format your output accordingly, like this it is unreadable.

Forbidden means the server does not allow access so I don't see how podman could do anything about that.

[quochoangnguyen]

thanks a lot