Skip to content

test-06

fa02b42
Select commit
Loading
Failed to load commit list.
Draft

race-condition-test-1 #15734

test-06
fa02b42
Select commit
Loading
Failed to load commit list.
Google Cloud Build / otel-disabled-bazel-pr (cloud-cpp-testing-resources) failed Nov 21, 2025 in 11m 45s

Summary

Build Information

Trigger otel-disabled-bazel-pr
Build 2ce53ff5-9ab2-4797-a97d-899182b8edf0
Start 2025-11-20T23:04:18-08:00
Duration 10m45.211s
Status FAILURE

Steps

Step Status Duration
kaniko-build SUCCESS 2m32.684s
download-runner-image SUCCESS 40.63s
us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel:2ce53ff5-9ab2-4797-a97d-899182b8edf0 FAILURE 7m5.734s
gcr.io/google.com/cloudsdktool/cloud-sdk QUEUED 50.202s
gcr.io/google.com/cloudsdktool/cloud-sdk SUCCESS 0s

Details

starting build "2ce53ff5-9ab2-4797-a97d-899182b8edf0"

FETCHSOURCE
From https://github.com/googleapis/google-cloud-cpp
 * branch              fa02b42c8380a1174d4aa0b8876988e9374cb344 -> FETCH_HEAD
Updating files:   8% (1863/22065)
Updating files:   9% (1986/22065)
Updating files:  10% (2207/22065)
Updating files:  11% (2428/22065)
Updating files:  12% (2648/22065)
Updating files:  13% (2869/22065)
Updating files:  14% (3090/22065)
Updating files:  15% (3310/22065)
Updating files:  16% (3531/22065)
Updating files:  17% (3752/22065)
Updating files:  18% (3972/22065)
Updating files:  19% (4193/22065)
Updating files:  20% (4413/22065)
Updating files:  21% (4634/22065)
Updating files:  22% (4855/22065)
Updating files:  23% (5075/22065)
Updating files:  24% (5296/22065)
Updating files:  25% (5517/22065)
Updating files:  26% (5737/22065)
Updating files:  27% (5958/22065)
Updating files:  28% (6179/22065)
Updating files:  29% (6399/22065)
Updating files:  30% (6620/22065)
Updating files:  31% (6841/22065)
Updating files:  32% (7061/22065)
Updating files:  33% (7282/22065)
Updating files:  34% (7503/22065)
Updating files:  35% (7723/22065)
Updating files:  36% (7944/22065)
Updating files:  37% (8165/22065)
Updating files:  38% (8385/22065)
Updating files:  39% (8606/22065)
Updating files:  40% (8826/22065)
Updating files:  41% (9047/22065)
Updating files:  42% (9268/22065)
Updating files:  43% (9488/22065)
Updating files:  44% (9709/22065)
Updating files:  45% (9930/22065)
Updating files:  46% (10150/22065)
Updating files:  47% (10371/22065)
Updating files:  48% (10592/22065)
Updating files:  49% (10812/22065)
Updating files:  50% (11033/22065)
Updating files:  51% (11254/22065)
Updating files:  52% (11474/22065)
Updating files:  53% (11695/22065)
Updating files:  54% (11916/22065)
Updating files:  55% (12136/22065)
Updating files:  56% (12357/22065)
Updating files:  57% (12578/22065)
Updating files:  58% (12798/22065)
Updating files:  59% (13019/22065)
Updating files:  60% (13239/22065)
Updating files:  61% (13460/22065)
Updating files:  62% (13681/22065)
Updating files:  63% (13901/22065)
Updating files:  64% (14122/22065)
Updating files:  65% (14343/22065)
Updating files:  66% (14563/22065)
Updating files:  67% (14784/22065)
Updating files:  68% (15005/22065)
Updating files:  69% (15225/22065)
Updating files:  70% (15446/22065)
Updating files:  71% (15667/22065)
Updating files:  72% (15887/22065)
Updating files:  73% (16108/22065)
Updating files:  74% (16329/22065)
Updating files:  75% (16549/22065)
Updating files:  76% (16770/22065)
Updating files:  77% (16991/22065)
Updating files:  78% (17211/22065)
Updating files:  79% (17432/22065)
Updating files:  80% (17652/22065)
Updating files:  81% (17873/22065)
Updating files:  82% (18094/22065)
Updating files:  83% (18314/22065)
Updating files:  84% (18535/22065)
Updating files:  85% (18756/22065)
Updating files:  86% (18976/22065)
Updating files:  87% (19197/22065)
Updating files:  88% (19418/22065)
Updating files:  89% (19638/22065)
Updating files:  90% (19859/22065)
Updating files:  91% (20080/22065)
Updating files:  92% (20300/22065)
Updating files:  93% (20521/22065)
Updating files:  93% (20571/22065)
Updating files:  94% (20742/22065)
Updating files:  95% (20962/22065)
Updating files:  96% (21183/22065)
Updating files:  97% (21404/22065)
Updating files:  98% (21624/22065)
Updating files:  99% (21845/22065)
Updating files: 100% (22065/22065)
Updating files: 100% (22065/22065), done.
HEAD is now at fa02b42c test-06
GitCommit:
fa02b42c8380a1174d4aa0b8876988e9374cb344
BUILD
Starting Step #4
Starting Step #0 - "kaniko-build"
Step #0 - "kaniko-build": Pulling image: gcr.io/kaniko-project/executor:v1.24.0-debug
Step #4: Pulling image: gcr.io/google.com/cloudsdktool/cloud-sdk
Step #4: Using default tag: latest
Step #0 - "kaniko-build": v1.24.0-debug: Pulling from kaniko-project/executor
Step #4: latest: Pulling from google.com/cloudsdktool/cloud-sdk
Step #4: bfecd07633a3: Pulling fs layer
Step #4: b77b8b8129d0: Pulling fs layer
Step #4: 5b72af2a7dc8: Pulling fs layer
Step #4: 607534597f8c: Pulling fs layer
Step #4: 6579b79e3db1: Pulling fs layer
Step #4: 0efd971c1c48: Pulling fs layer
Step #0 - "kaniko-build": 2fc842204170: Already exists
Step #0 - "kaniko-build": 8d1674b25e7b: Already exists
Step #0 - "kaniko-build": 9bdd0371dbb4: Already exists
Step #0 - "kaniko-build": 9aeeda79b717: Pulling fs layer
Step #0 - "kaniko-build": aaab912f1a4e: Pulling fs layer
Step #0 - "kaniko-build": 0006a7b536fb: Pulling fs layer
Step #0 - "kaniko-build": 3d08e2063109: Pulling fs layer
Step #0 - "kaniko-build": fc4517ec89af: Pulling fs layer
Step #0 - "kaniko-build": b892afb8bf07: Pulling fs layer
Step #0 - "kaniko-build": cdc2b9345183: Pulling fs layer
Step #0 - "kaniko-build": 3934701e2c3d: Pulling fs layer
Step #0 - "kaniko-build": 46be974dd378: Pulling fs layer
Step #0 - "kaniko-build": 2b61f8ddf6d9: Pulling fs layer
Step #0 - "kaniko-build": 3934701e2c3d: Waiting
Step #0 - "kaniko-build": 46be974dd378: Waiting
Step #0 - "kaniko-build": fc4517ec89af: Waiting
Step #0 - "kaniko-build": 2b61f8ddf6d9: Waiting
Step #0 - "kaniko-build": 9aeeda79b717: Waiting
Step #0 - "kaniko-build": cdc2b9345183: Waiting
Step #0 - "kaniko-build": aaab912f1a4e: Waiting
Step #0 - "kaniko-build": 3d08e2063109: Waiting
Step #0 - "kaniko-build": 0006a7b536fb: Waiting
Step #4: 6579b79e3db1: Verifying Checksum
Step #4: 6579b79e3db1: Download complete
Step #4: b77b8b8129d0: Verifying Checksum
Step #4: b77b8b8129d0: Download complete
Step #4: 0efd971c1c48: Verifying Checksum
Step #4: 0efd971c1c48: Download complete
Step #0 - "kaniko-build": 9aeeda79b717: Verifying Checksum
Step #0 - "kaniko-build": 9aeeda79b717: Download complete
Step #0 - "kaniko-build": 0006a7b536fb: Verifying Checksum
Step #0 - "kaniko-build": 0006a7b536fb: Download complete
Step #0 - "kaniko-build": aaab912f1a4e: Verifying Checksum
Step #0 - "kaniko-build": aaab912f1a4e: Download complete
Step #0 - "kaniko-build": 9aeeda79b717: Pull complete
Step #4: bfecd07633a3: Verifying Checksum
Step #4: bfecd07633a3: Download complete
Step #0 - "kaniko-build": 3d08e2063109: Download complete
Step #0 - "kaniko-build": fc4517ec89af: Verifying Checksum
Step #0 - "kaniko-build": fc4517ec89af: Download complete
Step #0 - "kaniko-build": aaab912f1a4e: Pull complete
Step #0 - "kaniko-build": 46be974dd378: Verifying Checksum
Step #0 - "kaniko-build": 46be974dd378: Download complete
Step #0 - "kaniko-build": cdc2b9345183: Verifying Checksum
Step #0 - "kaniko-build": cdc2b9345183: Download complete
Step #0 - "kaniko-build": 3934701e2c3d: Verifying Checksum
Step #0 - "kaniko-build": 3934701e2c3d: Download complete
Step #0 - "kaniko-build": b892afb8bf07: Verifying Checksum
Step #0 - "kaniko-build": b892afb8bf07: Download complete
Step #0 - "kaniko-build": 0006a7b536fb: Pull complete
Step #0 - "kaniko-build": 3d08e2063109: Pull complete
Step #0 - "kaniko-build": 2b61f8ddf6d9: Download complete
Step #4: 607534597f8c: Verifying Checksum
Step #4: 607534597f8c: Download complete
Step #0 - "kaniko-build": fc4517ec89af: Pull complete
Step #0 - "kaniko-build": b892afb8bf07: Pull complete
Step #0 - "kaniko-build": cdc2b9345183: Pull complete
Step #0 - "kaniko-build": 3934701e2c3d: Pull complete
Step #0 - "kaniko-build": 46be974dd378: Pull complete
Step #0 - "kaniko-build": 2b61f8ddf6d9: Pull complete
Step #4: bfecd07633a3: Pull complete
Step #0 - "kaniko-build": Digest: sha256:2562c4fe551399514277ffff7dcca9a3b1628c4ea38cb017d7286dc6ea52f4cd
Step #0 - "kaniko-build": Status: Downloaded newer image for gcr.io/kaniko-project/executor:v1.24.0-debug
Step #0 - "kaniko-build": gcr.io/kaniko-project/executor:v1.24.0-debug
Step #4: b77b8b8129d0: Pull complete
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Using dockerignore file: /workspace/ci/.dockerignore"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Retrieving image manifest fedora:40"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Retrieving image fedora:40 from registry index.docker.io"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Retrieving image manifest fedora:40"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Returning cached image manifest"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Built cross stage deps: map[]"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Retrieving image manifest fedora:40"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Returning cached image manifest"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Retrieving image manifest fedora:40"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Returning cached image manifest"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Executing 0 build triggers"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Building stage 'fedora:40' [idx: '0', base-idx: '-1']"
Step #0 - "kaniko-build": time="2025-11-21T07:04:34Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:34931edfd93bb824614aba9c723b34ef8db9a46a57dc352d0d8fd52896be0fb2..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN dnf install -y clang diffutils findutils gcc-c++ git jq lcov libcxx-devel         libcxxabi-devel libasan libubsan libtsan llvm patch python python3         python-pip tar unzip w3m wget which zip zlib-devel"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:5c06271b174395c7aaa648efa4a014359b480ceeffbd5b02612a719079db39fe..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN dnf makecache && dnf install -y python3-devel"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:24994684b2c5b5b76a2f7b99cefbf726f05835d0ee77b1a7159d90be4ea3934e..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN pip3 install --upgrade pip"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:6af306fe29573ca00b915f75404759a5b32170ebe1959be491bc0ee19e89e72b..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN pip3 install setuptools wheel"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:b4dc53fdbf870eea2e48651c01453f76bacd8a48da20fc6869b2cd1bf754d631..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN dnf makecache && dnf install -y java-latest-openjdk-devel"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:ef6c64df8688ff309fbb5665f29bfa6f88c12281bdf87a447b62cd297e5f52f8..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN echo 'root:cloudcxx' | chpasswd"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:fbe000c8e80dd45f318baf402949b617263436e40c1064b001fa94f5895ab873..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Using caching version of cmd: RUN dnf makecache && dnf install -y python3.10"
Step #0 - "kaniko-build": time="2025-11-21T07:04:35Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:17c1d7dae57b5da1708f11dfc71d1637f23d2f197c790087882d3104567cee23..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Using caching version of cmd: RUN /var/tmp/ci/install-cloud-sdk.sh"
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:67edbfa4598982fb7019cbafcc321af2fbb7e2520dd3fc5fe0490bceacaf176c..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Using caching version of cmd: RUN curl -o /usr/bin/bazelisk -sSL \"https://github.com/bazelbuild/bazelisk/releases/download/v1.24.1/bazelisk-linux-${ARCH}\" &&     chmod +x /usr/bin/bazelisk &&     ln -s /usr/bin/bazelisk /usr/bin/bazel"
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:148b344a65390cd576182aba410058a18e02a3f773f576b3077a70b7addddd7f..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Using caching version of cmd: RUN wget -O go.tgz https://go.dev/dl/go1.25.4.linux-amd64.tar.gz"
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:697d64d576a617b755a4bc7732a9478b3aa1c4a71fc8ff64b9c838914b451f95..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Using caching version of cmd: RUN tar -C /usr/local/ -xzf go.tgz"
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:c52f3564ae1c05cf170c470d00047805612cedd037aec1cda401c53c72b4cdaa..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Using caching version of cmd: RUN go version"
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Checking for cached layer us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel/cache:61773ee4829843502d4fc590665a11949c1fef72edc70b86739f8c36a4730436..."
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Using caching version of cmd: RUN curl -fsSL https://github.com/googleapis/cloud-bigtable-clients-test/archive/v0.0.4.tar.gz |     tar -xzf - --strip-components=1"
Step #0 - "kaniko-build": time="2025-11-21T07:04:36Z" level=info msg="Unpacking rootfs as cmd COPY . /var/tmp/ci requires it."
Step #4: 5b72af2a7dc8: Verifying Checksum
Step #4: 5b72af2a7dc8: Download complete
Step #0 - "kaniko-build": time="2025-11-21T07:04:39Z" level=info msg="ARG NCPU=4"
Step #0 - "kaniko-build": time="2025-11-21T07:04:39Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:04:39Z" level=info msg="ARG ARCH=amd64"
Step #0 - "kaniko-build": time="2025-11-21T07:04:39Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:04:39Z" level=info msg="RUN dnf install -y clang diffutils findutils gcc-c++ git jq lcov libcxx-devel         libcxxabi-devel libasan libubsan libtsan llvm patch python python3         python-pip tar unzip w3m wget which zip zlib-devel"
Step #0 - "kaniko-build": time="2025-11-21T07:04:39Z" level=info msg="Found cached layer, extracting to filesystem"
Step #4: 5b72af2a7dc8: Pull complete
Step #4: 607534597f8c: Pull complete
Step #4: 6579b79e3db1: Pull complete
Step #4: 0efd971c1c48: Pull complete
Step #4: Digest: sha256:8ba1f213fc9ac9ac581d2a8142ff91d8a462d16cdb889c72dca697ad197695b7
Step #4: Status: Downloaded newer image for gcr.io/google.com/cloudsdktool/cloud-sdk:latest
Step #4: gcr.io/google.com/cloudsdktool/cloud-sdk:latest
Step #4: + test -z 15734
Step #4: ++ gcloud builds describe --region us-east1 --format 'value(create_time)' 2ce53ff5-9ab2-4797-a97d-899182b8edf0
Step #4: + ctime=2025-11-21T07:03:29.672579Z
Step #4: + query=tags=pr
Step #4: + query+=' AND tags=15734'
Step #4: + query+=' AND substitutions.COMMIT_SHA != fa02b42c8380a1174d4aa0b8876988e9374cb344'
Step #4: + query+=' AND create_time < 2025-11-21T07:03:29.672579Z'
Step #4: + gcloud builds list --region us-east1 --ongoing '--format=value(id)' --filter 'tags=pr AND tags=15734 AND substitutions.COMMIT_SHA != fa02b42c8380a1174d4aa0b8876988e9374cb344 AND create_time < 2025-11-21T07:03:29.672579Z'
Step #4: + xargs -r -t gcloud builds cancel --region us-east1
Step #4: gcloud builds cancel --region us-east1 167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #0 - "kaniko-build": time="2025-11-21T07:05:18Z" level=info msg="RUN dnf makecache && dnf install -y python3-devel"
Step #0 - "kaniko-build": time="2025-11-21T07:05:18Z" level=info msg="Found cached layer, extracting to filesystem"
Step #4: Cancelled [https://cloudbuild.googleapis.com/v1/projects/cloud-cpp-testing-resources/locations/us-east1/builds/167bd9c3-c390-45a2-9a87-70716c7f7d86].
Step #4: ---
Step #4: availableSecrets:
Step #4:   secretManager:
Step #4:   - env: CODECOV_TOKEN
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/CODECOV_TOKEN/versions/latest
Step #4:   - env: UD
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD/versions/latest
Step #4:   - env: UD_PROJECT
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_PROJECT/versions/latest
Step #4:   - env: UD_REGION
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_REGION/versions/latest
Step #4:   - env: UD_ZONE
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_ZONE/versions/latest
Step #4:   - env: UD_SERVICE_ACCOUNT
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_SERVICE_ACCOUNT/versions/latest
Step #4:   - env: UD_SERVICE_ACCOUNT_NAME
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_SERVICE_ACCOUNT_NAME/versions/latest
Step #4:   - env: UD_IMPERSONATED_SERVICE_ACCOUNT_NAME
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_IMPERSONATED_SERVICE_ACCOUNT_NAME/versions/latest
Step #4:   - env: UD_IDTOKEN_SA_IMPERSONATION_CRED
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_IDTOKEN_SA_IMPERSONATION_CRED/versions/latest
Step #4:   - env: UD_EXTERNAL_ACCOUNT_CRED
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_EXTERNAL_ACCOUNT_CRED/versions/latest
Step #4:   - env: UD_FETCH_OIDC_TOKEN
Step #4:     versionName: projects/cloud-cpp-testing-resources/secrets/UD_FETCH_OIDC_TOKEN/versions/latest
Step #4: buildTriggerId: 0ada9a21-5379-48e2-9e6d-8c388d6333e5
Step #4: createTime: '2025-11-21T06:45:54.581908Z'
Step #4: id: 167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4: logUrl: https://console.cloud.google.com/cloud-build/builds;region=us-east1/167bd9c3-c390-45a2-9a87-70716c7f7d86?project=936212892354
Step #4: logsBucket: gs://cloud-cpp-community-publiclogs/logs/google-cloud-cpp/15734/8cd7f96672725009a7b2bce46ecd953ba0b0d02a/fedora-latest-bazel-coverage-__default__
Step #4: name: projects/936212892354/locations/us-east1/builds/167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4: options:
Step #4:   dynamicSubstitutions: true
Step #4:   env:
Step #4:   - HOME=/h
Step #4:   - TZ=UTC0
Step #4:   - GOOGLE_CLOUD_BUILD=yes
Step #4:   - PROJECT_ID=cloud-cpp-testing-resources
Step #4:   - BUILD_ID=167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4:   - BRANCH_NAME=fio-race-condition
Step #4:   - COMMIT_SHA=8cd7f96672725009a7b2bce46ecd953ba0b0d02a
Step #4:   - PR_NUMBER=15734
Step #4:   - TRIGGER_TYPE=pr
Step #4:   - GENERATE_GOLDEN_ONLY=
Step #4:   - UPDATED_DISCOVERY_DOCUMENT=
Step #4:   - CONSOLE_LOG_URL=https://console.cloud.google.com/cloud-build/builds;region=us-east1/167bd9c3-c390-45a2-9a87-70716c7f7d86;tab=detail?project=cloud-cpp-testing-resources
Step #4:   - RAW_LOG_URL=https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/15734/8cd7f96672725009a7b2bce46ecd953ba0b0d02a/fedora-latest-bazel-coverage-__default__/log-167bd9c3-c390-45a2-9a87-70716c7f7d86.txt
Step #4:   logging: LEGACY
Step #4:   pool:
Step #4:     name: projects/cloud-cpp-testing-resources/locations/us-east1/workerPools/google-cloud-cpp-pool
Step #4:   substitutionOption: ALLOW_LOOSE
Step #4:   volumes:
Step #4:   - name: home
Step #4:     path: /h
Step #4: projectId: cloud-cpp-testing-resources
Step #4: queueTtl: 3600s
Step #4: source:
Step #4:   gitSource:
Step #4:     revision: 8cd7f96672725009a7b2bce46ecd953ba0b0d02a
Step #4:     url: https://github.com/googleapis/google-cloud-cpp.git
Step #4: sourceProvenance:
Step #4:   resolvedGitSource:
Step #4:     revision: 8cd7f96672725009a7b2bce46ecd953ba0b0d02a
Step #4:     url: https://github.com/googleapis/google-cloud-cpp.git
Step #4: startTime: '2025-11-21T06:46:40.301287243Z'
Step #4: status: WORKING
Step #4: steps:
Step #4: - args:
Step #4:   - -c
Step #4:   - |
Step #4:     status=1
Step #4:     for delay in 0 30 30 30 30; do
Step #4:       sleep $delay
Step #4:       /kaniko/executor --log-format=text \
Step #4:         --context=dir:///workspace/ci \
Step #4:         --dockerfile=ci/cloudbuild/dockerfiles/fedora-latest-bazel.Dockerfile \
Step #4:         --cache=true \
Step #4:         --destination=us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel:167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4:       if [[ $? -eq 0 ]]; then
Step #4:         status=0
Step #4:         break
Step #4:       fi
Step #4:     done
Step #4:     exit $status
Step #4:   entrypoint: /busybox/sh
Step #4:   id: kaniko-build
Step #4:   name: gcr.io/kaniko-project/executor:v1.24.0-debug
Step #4: - entrypoint: /bin/true
Step #4:   id: download-runner-image
Step #4:   name: us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel:167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4: - args:
Step #4:   - --local
Step #4:   - --build
Step #4:   - coverage
Step #4:   entrypoint: ci/cloudbuild/build.sh
Step #4:   env:
Step #4:   - BAZEL_REMOTE_CACHE=https://storage.googleapis.com/cloud-cpp-testing-resources_cloudbuild/bazel-cache/fedora-latest-bazel-coverage
Step #4:   - LIBRARIES=all_bar_compute
Step #4:   - SHARD=__default__
Step #4:   - SCCACHE_GCS_BUCKET=cloud-cpp-testing-resources_cloudbuild
Step #4:   - SCCACHE_GCS_KEY_PREFIX=sccache/fedora-latest-bazel-coverage
Step #4:   - SCCACHE_GCS_RW_MODE=READ_WRITE
Step #4:   - CTCACHE_GCS_BUCKET=cloud-cpp-testing-resources_cloudbuild
Step #4:   - CTCACHE_GCS_FOLDER=ctcache/fedora-latest-bazel/coverage
Step #4:   - VCPKG_BINARY_SOURCES=x-gcs,gs://cloud-cpp-testing-resources_cloudbuild/vcpkg-cache/fedora-latest-bazel-coverage,readwrite
Step #4:   name: us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel:167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4:   secretEnv:
Step #4:   - CODECOV_TOKEN
Step #4:   - UD
Step #4:   - UD_PROJECT
Step #4:   - UD_REGION
Step #4:   - UD_ZONE
Step #4:   - UD_SERVICE_ACCOUNT
Step #4:   - UD_SERVICE_ACCOUNT_NAME
Step #4:   - UD_IMPERSONATED_SERVICE_ACCOUNT_NAME
Step #4:   - UD_IDTOKEN_SA_IMPERSONATION_CRED
Step #4:   - UD_FETCH_OIDC_TOKEN
Step #4:   - UD_EXTERNAL_ACCOUNT_CRED
Step #4: - allowFailure: true
Step #4:   args:
Step #4:   - -c
Step #4:   - |
Step #4:     set +e
Step #4:     gcloud artifacts docker images delete -q us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel:167bd9c3-c390-45a2-9a87-70716c7f7d86
Step #4:   entrypoint: bash
Step #4:   name: gcr.io/google.com/cloudsdktool/cloud-sdk
Step #4: - allowFailure: true
Step #4:   args:
Step #4:   - -c
Step #4:   - |
Step #4:     set -xe
Step #4:     test -z "15734" && exit 0
Step #4:     ctime="$(gcloud builds describe --region 'us-east1' --format 'value(create_time)' '167bd9c3-c390-45a2-9a87-70716c7f7d86')"
Step #4:     query="tags=pr"
Step #4:     query+=" AND tags=15734"
Step #4:     query+=" AND substitutions.COMMIT_SHA != 8cd7f96672725009a7b2bce46ecd953ba0b0d02a"
Step #4:     query+=" AND create_time < ${ctime}"
Step #4:     gcloud builds list --region 'us-east1' --ongoing --format='value(id)' --filter "${query}" | \
Step #4:       xargs -r -t gcloud builds cancel --region 'us-east1'
Step #4:   entrypoint: bash
Step #4:   name: gcr.io/google.com/cloudsdktool/cloud-sdk
Step #4:   waitFor:
Step #4:   - '-'
Step #4: substitutions:
Step #4:   BRANCH_NAME: fio-race-condition
Step #4:   COMMIT_SHA: 8cd7f96672725009a7b2bce46ecd953ba0b0d02a
Step #4:   REF_NAME: fio-race-condition
Step #4:   REPO_FULL_NAME: googleapis/google-cloud-cpp
Step #4:   REPO_NAME: google-cloud-cpp
Step #4:   REVISION_ID: 8cd7f96672725009a7b2bce46ecd953ba0b0d02a
Step #4:   SHORT_SHA: 8cd7f96
Step #4:   TRIGGER_BUILD_CONFIG_PATH: ci/cloudbuild/cloudbuild.yaml
Step #4:   TRIGGER_NAME: coverage-pr
Step #4:   _BASE_BRANCH: main
Step #4:   _BUILD_NAME: coverage
Step #4:   _CACHE_BUCKET: cloud-cpp-testing-resources_cloudbuild
Step #4:   _DISTRO: fedora-latest-bazel
Step #4:   _HEAD_BRANCH: fio-race-condition
Step #4:   _HEAD_REPO_URL: https://github.com/v-pratap/google-cloud-cpp
Step #4:   _IMAGE: cloudbuild/fedora-latest-bazel
Step #4:   _LIBRARIES: all_bar_compute
Step #4:   _LOGS_BUCKET: cloud-cpp-community-publiclogs
Step #4:   _POOL_ID: google-cloud-cpp-pool
Step #4:   _POOL_REGION: us-east1
Step #4:   _PR_NUMBER: '15734'
Step #4:   _SHARD: __default__
Step #4:   _TAG1: team-only
Step #4:   _TRIGGER_SOURCE: '15734'
Step #4:   _TRIGGER_TYPE: pr
Step #4: tags:
Step #4: - pr
Step #4: - coverage
Step #4: - fedora-latest-bazel
Step #4: - '15734'
Step #4: - team-only
Step #4: - trigger-0ada9a21-5379-48e2-9e6d-8c388d6333e5
Step #4: timeout: 36000s
Finished Step #4
Step #0 - "kaniko-build": time="2025-11-21T07:05:19Z" level=info msg="RUN pip3 install --upgrade pip"
Step #0 - "kaniko-build": time="2025-11-21T07:05:19Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:05:20Z" level=info msg="RUN pip3 install setuptools wheel"
Step #0 - "kaniko-build": time="2025-11-21T07:05:20Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:05:21Z" level=info msg="RUN dnf makecache && dnf install -y java-latest-openjdk-devel"
Step #0 - "kaniko-build": time="2025-11-21T07:05:21Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="RUN echo 'root:cloudcxx' | chpasswd"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="WORKDIR /var/tmp/build"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Cmd: workdir"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Changed working directory to /var/tmp/build"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Creating directory /var/tmp/build with uid -1 and gid -1"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Taking snapshot of files..."
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="COPY . /var/tmp/ci"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Taking snapshot of files..."
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="WORKDIR /var/tmp/downloads"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Cmd: workdir"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Changed working directory to /var/tmp/downloads"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Creating directory /var/tmp/downloads with uid -1 and gid -1"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Taking snapshot of files..."
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="RUN dnf makecache && dnf install -y python3.10"
Step #0 - "kaniko-build": time="2025-11-21T07:05:45Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:05:49Z" level=info msg="ENV CLOUDSDK_PYTHON=python3.10"
Step #0 - "kaniko-build": time="2025-11-21T07:05:49Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:05:49Z" level=info msg="RUN /var/tmp/ci/install-cloud-sdk.sh"
Step #0 - "kaniko-build": time="2025-11-21T07:05:49Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:06:44Z" level=info msg="ENV CLOUD_SDK_LOCATION=/usr/local/google-cloud-sdk"
Step #0 - "kaniko-build": time="2025-11-21T07:06:44Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:06:44Z" level=info msg="ENV PATH=${CLOUD_SDK_LOCATION}/bin:${PATH}"
Step #0 - "kaniko-build": time="2025-11-21T07:06:44Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:06:44Z" level=info msg="RUN curl -o /usr/bin/bazelisk -sSL \"https://github.com/bazelbuild/bazelisk/releases/download/v1.24.1/bazelisk-linux-${ARCH}\" &&     chmod +x /usr/bin/bazelisk &&     ln -s /usr/bin/bazelisk /usr/bin/bazel"
Step #0 - "kaniko-build": time="2025-11-21T07:06:44Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:06:45Z" level=info msg="WORKDIR /var/tmp/downloads"
Step #0 - "kaniko-build": time="2025-11-21T07:06:45Z" level=info msg="Cmd: workdir"
Step #0 - "kaniko-build": time="2025-11-21T07:06:45Z" level=info msg="Changed working directory to /var/tmp/downloads"
Step #0 - "kaniko-build": time="2025-11-21T07:06:45Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:06:45Z" level=info msg="RUN wget -O go.tgz https://go.dev/dl/go1.25.4.linux-amd64.tar.gz"
Step #0 - "kaniko-build": time="2025-11-21T07:06:45Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:06:46Z" level=info msg="RUN tar -C /usr/local/ -xzf go.tgz"
Step #0 - "kaniko-build": time="2025-11-21T07:06:46Z" level=info msg="Found cached layer, extracting to filesystem"
Step #0 - "kaniko-build": time="2025-11-21T07:06:55Z" level=info msg="ENV GO_LOCATION=/usr/local/go"
Step #0 - "kaniko-build": time="2025-11-21T07:06:55Z" level=info msg="No files changed in this command, skipping snapshotting."
Step #0 - "kaniko-build": time="2025-11-21T07:06:55Z" level=info msg="ENV PATH=${GO_LOCATION}/bin:${PATH}"
Step #0 -
...
[Logs truncated due to log size limitations. For full logs, see https://storage.cloud.google.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/15734/fa02b42c8380a1174d4aa0b8876988e9374cb344/fedora-latest-bazel-otel-disabled-bazel-__default__/log-2ce53ff5-9ab2-4797-a97d-899182b8edf0.txt.]
...
internal_session_shutdown_manager_test    (cached) PASSED in 8.2s
Step #2: //google/cloud/pubsub:internal_streaming_subscription_batch_source_test (cached) PASSED in 6.1s
Step #2: //google/cloud/pubsub:internal_subscriber_connection_impl_test  (cached) PASSED in 7.2s
Step #2: //google/cloud/pubsub:internal_subscriber_stub_factory_test     (cached) PASSED in 6.9s
Step #2: //google/cloud/pubsub:internal_subscriber_tracing_connection_test (cached) PASSED in 8.9s
Step #2: //google/cloud/pubsub:internal_subscription_concurrency_control_test (cached) PASSED in 6.3s
Step #2: //google/cloud/pubsub:internal_subscription_lease_management_test (cached) PASSED in 6.1s
Step #2: //google/cloud/pubsub:internal_subscription_message_queue_test  (cached) PASSED in 12.8s
Step #2: //google/cloud/pubsub:internal_subscription_session_test        (cached) PASSED in 8.2s
Step #2: //google/cloud/pubsub:internal_tracing_batch_callback_test      (cached) PASSED in 5.3s
Step #2: //google/cloud/pubsub:internal_tracing_batch_sink_test          (cached) PASSED in 5.6s
Step #2: //google/cloud/pubsub:internal_tracing_exactly_once_ack_handler_test (cached) PASSED in 8.1s
Step #2: //google/cloud/pubsub:internal_tracing_helpers_test             (cached) PASSED in 6.3s
Step #2: //google/cloud/pubsub:internal_tracing_message_callback_test    (cached) PASSED in 7.1s
Step #2: //google/cloud/pubsub:internal_tracing_pull_ack_handler_test    (cached) PASSED in 6.4s
Step #2: //google/cloud/pubsub:internal_tracing_pull_lease_manager_test  (cached) PASSED in 5.5s
Step #2: //google/cloud/pubsub:message_test                              (cached) PASSED in 7.0s
Step #2: //google/cloud/pubsub:options_test                              (cached) PASSED in 4.6s
Step #2: //google/cloud/pubsub:publisher_connection_test                 (cached) PASSED in 6.7s
Step #2: //google/cloud/pubsub:publisher_options_test                    (cached) PASSED in 6.2s
Step #2: //google/cloud/pubsub:publisher_test                            (cached) PASSED in 6.6s
Step #2: //google/cloud/pubsub:pull_ack_handler_test                     (cached) PASSED in 7.0s
Step #2: //google/cloud/pubsub:schema_test                               (cached) PASSED in 7.5s
Step #2: //google/cloud/pubsub:snapshot_builder_test                     (cached) PASSED in 7.0s
Step #2: //google/cloud/pubsub:snapshot_test                             (cached) PASSED in 7.1s
Step #2: //google/cloud/pubsub:subscriber_connection_test                (cached) PASSED in 6.6s
Step #2: //google/cloud/pubsub:subscriber_options_test                   (cached) PASSED in 5.5s
Step #2: //google/cloud/pubsub:subscriber_test                           (cached) PASSED in 6.7s
Step #2: //google/cloud/pubsub:subscription_admin_client_test            (cached) PASSED in 5.3s
Step #2: //google/cloud/pubsub:subscription_admin_connection_test        (cached) PASSED in 6.4s
Step #2: //google/cloud/pubsub:subscription_builder_test                 (cached) PASSED in 6.0s
Step #2: //google/cloud/pubsub:subscription_test                         (cached) PASSED in 4.5s
Step #2: //google/cloud/pubsub:topic_admin_client_test                   (cached) PASSED in 8.7s
Step #2: //google/cloud/pubsub:topic_admin_connection_test               (cached) PASSED in 5.6s
Step #2: //google/cloud/pubsub:topic_builder_test                        (cached) PASSED in 4.8s
Step #2: //google/cloud/pubsub:topic_test                                (cached) PASSED in 4.8s
Step #2: //google/cloud/pubsub/samples:mock_publisher                    (cached) PASSED in 4.2s
Step #2: //google/cloud/pubsub/samples:mock_subscriber                   (cached) PASSED in 5.2s
Step #2: //google/cloud/pubsub/samples:pubsub_samples_common_test        (cached) PASSED in 6.8s
Step #2: //google/cloud/pubsublite:endpoint_test                         (cached) PASSED in 10.1s
Step #2: //google/cloud/pubsublite:internal_alarm_registry_impl_test     (cached) PASSED in 7.8s
Step #2: //google/cloud/pubsublite:internal_default_publish_message_transformer_test (cached) PASSED in 6.2s
Step #2: //google/cloud/pubsublite:internal_default_routing_policy_test  (cached) PASSED in 8.4s
Step #2: //google/cloud/pubsublite:internal_location_test                (cached) PASSED in 5.7s
Step #2: //google/cloud/pubsublite:internal_multipartition_publisher_test (cached) PASSED in 9.3s
Step #2: //google/cloud/pubsublite:internal_partition_publisher_test     (cached) PASSED in 9.0s
Step #2: //google/cloud/pubsublite:internal_publisher_connection_impl_test (cached) PASSED in 5.9s
Step #2: //google/cloud/pubsublite:internal_resumable_async_streaming_read_write_rpc_test (cached) PASSED in 6.5s
Step #2: //google/cloud/pubsublite:internal_service_composite_test       (cached) PASSED in 6.8s
Step #2: //google/cloud/pubsublite:internal_stream_factory_test          (cached) PASSED in 5.7s
Step #2: //google/cloud/pubsublite:internal_stream_retry_policy_test     (cached) PASSED in 6.4s
Step #2: //google/cloud/pubsublite:message_metadata_test                 (cached) PASSED in 6.3s
Step #2: //google/cloud/pubsublite:topic_test                            (cached) PASSED in 4.9s
Step #2: //google/cloud/spanner:backup_test                              (cached) PASSED in 7.5s
Step #2: //google/cloud/spanner:bytes_benchmark                          (cached) PASSED in 6.5s
Step #2: //google/cloud/spanner:bytes_test                               (cached) PASSED in 7.7s
Step #2: //google/cloud/spanner:client_options_test                      (cached) PASSED in 4.8s
Step #2: //google/cloud/spanner:client_test                              (cached) PASSED in 6.7s
Step #2: //google/cloud/spanner:commit_options_test                      (cached) PASSED in 6.6s
Step #2: //google/cloud/spanner:connection_options_test                  (cached) PASSED in 6.2s
Step #2: //google/cloud/spanner:create_instance_request_builder_test     (cached) PASSED in 7.1s
Step #2: //google/cloud/spanner:database_admin_client_test               (cached) PASSED in 6.3s
Step #2: //google/cloud/spanner:database_admin_connection_test           (cached) PASSED in 8.2s
Step #2: //google/cloud/spanner:database_test                            (cached) PASSED in 5.2s
Step #2: //google/cloud/spanner:instance_admin_client_test               (cached) PASSED in 4.8s
Step #2: //google/cloud/spanner:instance_admin_connection_test           (cached) PASSED in 6.6s
Step #2: //google/cloud/spanner:instance_test                            (cached) PASSED in 4.6s
Step #2: //google/cloud/spanner:internal_connection_impl_test            (cached) PASSED in 13.9s
Step #2: //google/cloud/spanner:internal_database_admin_logging_test     (cached) PASSED in 5.6s
Step #2: //google/cloud/spanner:internal_database_admin_metadata_test    (cached) PASSED in 9.5s
Step #2: //google/cloud/spanner:internal_defaults_test                   (cached) PASSED in 4.8s
Step #2: //google/cloud/spanner:internal_instance_admin_logging_test     (cached) PASSED in 7.9s
Step #2: //google/cloud/spanner:internal_instance_admin_metadata_test    (cached) PASSED in 7.1s
Step #2: //google/cloud/spanner:internal_logging_result_set_reader_test  (cached) PASSED in 8.2s
Step #2: //google/cloud/spanner:internal_merge_chunk_benchmark           (cached) PASSED in 6.8s
Step #2: //google/cloud/spanner:internal_merge_chunk_test                (cached) PASSED in 7.9s
Step #2: //google/cloud/spanner:internal_partial_result_set_resume_test  (cached) PASSED in 8.5s
Step #2: //google/cloud/spanner:internal_partial_result_set_source_test  (cached) PASSED in 7.5s
Step #2: //google/cloud/spanner:internal_route_to_leader_test            (cached) PASSED in 7.7s
Step #2: //google/cloud/spanner:internal_session_pool_test               (cached) PASSED in 8.3s
Step #2: //google/cloud/spanner:internal_spanner_stub_factory_test       (cached) PASSED in 4.6s
Step #2: //google/cloud/spanner:internal_status_utils_test               (cached) PASSED in 5.1s
Step #2: //google/cloud/spanner:internal_transaction_impl_test           (cached) PASSED in 5.2s
Step #2: //google/cloud/spanner:internal_tuple_utils_test                (cached) PASSED in 5.5s
Step #2: //google/cloud/spanner:interval_test                            (cached) PASSED in 4.9s
Step #2: //google/cloud/spanner:json_test                                (cached) PASSED in 5.0s
Step #2: //google/cloud/spanner:keys_test                                (cached) PASSED in 5.3s
Step #2: //google/cloud/spanner:mutations_test                           (cached) PASSED in 5.7s
Step #2: //google/cloud/spanner:numeric_benchmark                        (cached) PASSED in 5.4s
Step #2: //google/cloud/spanner:numeric_test                             (cached) PASSED in 6.4s
Step #2: //google/cloud/spanner:partition_options_test                   (cached) PASSED in 5.7s
Step #2: //google/cloud/spanner:proto_enum_test                          (cached) PASSED in 5.4s
Step #2: //google/cloud/spanner:proto_message_test                       (cached) PASSED in 8.7s
Step #2: //google/cloud/spanner:query_options_test                       (cached) PASSED in 7.3s
Step #2: //google/cloud/spanner:query_partition_test                     (cached) PASSED in 7.5s
Step #2: //google/cloud/spanner:read_options_test                        (cached) PASSED in 7.0s
Step #2: //google/cloud/spanner:read_partition_test                      (cached) PASSED in 5.9s
Step #2: //google/cloud/spanner:results_test                             (cached) PASSED in 6.3s
Step #2: //google/cloud/spanner:retry_policy_test                        (cached) PASSED in 5.9s
Step #2: //google/cloud/spanner:row_benchmark                            (cached) PASSED in 6.8s
Step #2: //google/cloud/spanner:row_test                                 (cached) PASSED in 4.7s
Step #2: //google/cloud/spanner:session_pool_options_test                (cached) PASSED in 5.2s
Step #2: //google/cloud/spanner:spanner_version_test                     (cached) PASSED in 5.4s
Step #2: //google/cloud/spanner:sql_statement_test                       (cached) PASSED in 5.1s
Step #2: //google/cloud/spanner:testing_cleanup_stale_databases_test     (cached) PASSED in 4.6s
Step #2: //google/cloud/spanner:testing_random_database_name_test        (cached) PASSED in 5.5s
Step #2: //google/cloud/spanner:timestamp_test                           (cached) PASSED in 6.1s
Step #2: //google/cloud/spanner:transaction_test                         (cached) PASSED in 6.0s
Step #2: //google/cloud/spanner:update_instance_request_builder_test     (cached) PASSED in 5.7s
Step #2: //google/cloud/spanner:uuid_test                                (cached) PASSED in 8.4s
Step #2: //google/cloud/spanner:value_test                               (cached) PASSED in 6.8s
Step #2: //google/cloud/spanner/samples:mock_execute_query               (cached) PASSED in 4.3s
Step #2: //google/cloud/testing_util:async_sequencer_test                (cached) PASSED in 0.0s
Step #2: //google/cloud/testing_util:chrono_output_test                  (cached) PASSED in 0.0s
Step #2: //google/cloud/testing_util:command_line_parsing_test           (cached) PASSED in 0.1s
Step #2: //google/cloud/testing_util:example_driver_test                 (cached) PASSED in 0.0s
Step #2: //google/cloud/testing_util:is_proto_equal_test                 (cached) PASSED in 5.5s
Step #2: //google/cloud/testing_util:scoped_environment_test             (cached) PASSED in 0.1s
Step #2: //google/cloud/testing_util:setenv_test                         (cached) PASSED in 0.0s
Step #2: //google/cloud/testing_util:status_matchers_test                (cached) PASSED in 0.0s
Step #2: //google/cloud/storage:async_bucket_name_test                            PASSED in 2.6s
Step #2: //google/cloud/storage:async_idempotency_policy_test                     PASSED in 2.4s
Step #2: //google/cloud/storage:async_object_descriptor_test                      PASSED in 1.9s
Step #2: //google/cloud/storage:async_read_all_test                               PASSED in 1.9s
Step #2: //google/cloud/storage:async_reader_test                                 PASSED in 2.0s
Step #2: //google/cloud/storage:async_resume_policy_test                          PASSED in 2.3s
Step #2: //google/cloud/storage:async_retry_policy_test                           PASSED in 1.9s
Step #2: //google/cloud/storage:async_rewriter_test                               PASSED in 2.7s
Step #2: //google/cloud/storage:async_token_test                                  PASSED in 1.5s
Step #2: //google/cloud/storage:async_writer_test                                 PASSED in 1.9s
Step #2: //google/cloud/storage:auto_finalize_test                                PASSED in 2.6s
Step #2: //google/cloud/storage:bucket_access_control_test                        PASSED in 1.7s
Step #2: //google/cloud/storage:bucket_cors_entry_test                            PASSED in 2.4s
Step #2: //google/cloud/storage:bucket_iam_configuration_test                     PASSED in 2.2s
Step #2: //google/cloud/storage:bucket_metadata_test                              PASSED in 2.2s
Step #2: //google/cloud/storage:bucket_object_retention_test                      PASSED in 1.5s
Step #2: //google/cloud/storage:bucket_soft_delete_policy_test                    PASSED in 1.5s
Step #2: //google/cloud/storage:client_bucket_acl_test                            PASSED in 2.4s
Step #2: //google/cloud/storage:client_bucket_test                                PASSED in 4.3s
Step #2: //google/cloud/storage:client_default_object_acl_test                    PASSED in 1.9s
Step #2: //google/cloud/storage:client_notifications_test                         PASSED in 2.4s
Step #2: //google/cloud/storage:client_object_acl_test                            PASSED in 2.1s
Step #2: //google/cloud/storage:client_object_copy_test                           PASSED in 2.5s
Step #2: //google/cloud/storage:client_object_test                                PASSED in 2.4s
Step #2: //google/cloud/storage:client_options_test                               PASSED in 1.7s
Step #2: //google/cloud/storage:client_service_account_test                       PASSED in 2.1s
Step #2: //google/cloud/storage:client_sign_policy_document_test                  PASSED in 2.7s
Step #2: //google/cloud/storage:client_sign_url_test                              PASSED in 2.6s
Step #2: //google/cloud/storage:client_test                                       PASSED in 5.2s
Step #2: //google/cloud/storage:client_write_object_test                          PASSED in 2.3s
Step #2: //google/cloud/storage:compose_many_test                                 PASSED in 1.7s
Step #2: //google/cloud/storage:delete_by_prefix_test                             PASSED in 2.3s
Step #2: //google/cloud/storage:grpc_plugin_test                                  PASSED in 2.4s
Step #2: //google/cloud/storage:hashing_options_test                              PASSED in 2.2s
Step #2: //google/cloud/storage:hmac_key_metadata_test                            PASSED in 2.3s
Step #2: //google/cloud/storage:idempotency_policy_test                           PASSED in 2.3s
Step #2: //google/cloud/storage:internal_access_control_common_parser_test        PASSED in 2.0s
Step #2: //google/cloud/storage:internal_access_control_common_test               PASSED in 2.4s
Step #2: //google/cloud/storage:internal_access_token_credentials_test            PASSED in 2.2s
Step #2: //google/cloud/storage:internal_async_connection_impl_appendable_upload_test PASSED in 2.8s
Step #2: //google/cloud/storage:internal_async_connection_impl_insert_test        PASSED in 2.6s
Step #2: //google/cloud/storage:internal_async_connection_impl_open_test          PASSED in 2.3s
Step #2: //google/cloud/storage:internal_async_connection_impl_read_hash_test     PASSED in 1.8s
Step #2: //google/cloud/storage:internal_async_connection_impl_read_test          PASSED in 2.3s
Step #2: //google/cloud/storage:internal_async_connection_impl_test               PASSED in 2.5s
Step #2: //google/cloud/storage:internal_async_connection_impl_upload_hash_test   PASSED in 1.4s
Step #2: //google/cloud/storage:internal_async_connection_impl_upload_test        PASSED in 2.5s
Step #2: //google/cloud/storage:internal_async_connection_tracing_test            PASSED in 2.7s
Step #2: //google/cloud/storage:internal_async_default_options_test               PASSED in 2.0s
Step #2: //google/cloud/storage:internal_async_handle_redirect_error_test         PASSED in 2.6s
Step #2: //google/cloud/storage:internal_async_insert_object_test                 PASSED in 3.3s
Step #2: //google/cloud/storage:internal_async_object_descriptor_connection_tracing_test PASSED in 2.1s
Step #2: //google/cloud/storage:internal_async_object_descriptor_impl_test        PASSED in 2.5s
Step #2: //google/cloud/storage:internal_async_object_descriptor_reader_test      PASSED in 1.7s
Step #2: //google/cloud/storage:internal_async_object_descriptor_reader_tracing_test PASSED in 2.6s
Step #2: //google/cloud/storage:internal_async_open_object_test                   PASSED in 2.5s
Step #2: //google/cloud/storage:internal_async_open_stream_test                   PASSED in 2.3s
Step #2: //google/cloud/storage:internal_async_partial_upload_test                PASSED in 3.6s
Step #2: //google/cloud/storage:internal_async_read_payload_impl_test             PASSED in 2.7s
Step #2: //google/cloud/storage:internal_async_read_range_test                    PASSED in 2.1s
Step #2: //google/cloud/storage:internal_async_reader_connection_factory_test     PASSED in 2.2s
Step #2: //google/cloud/storage:internal_async_reader_connection_impl_test        PASSED in 1.8s
Step #2: //google/cloud/storage:internal_async_reader_connection_resume_test      PASSED in 2.7s
Step #2: //google/cloud/storage:internal_async_reader_connection_tracing_test     PASSED in 2.3s
Step #2: //google/cloud/storage:internal_async_rewriter_connection_impl_test      PASSED in 2.6s
Step #2: //google/cloud/storage:internal_async_rewriter_connection_tracing_test   PASSED in 2.1s
Step #2: //google/cloud/storage:internal_async_write_object_test                  PASSED in 2.5s
Step #2: //google/cloud/storage:internal_async_write_payload_impl_test            PASSED in 2.6s
Step #2: //google/cloud/storage:internal_async_writer_connection_buffered_test    PASSED in 2.4s
Step #2: //google/cloud/storage:internal_async_writer_connection_finalized_test   PASSED in 2.2s
Step #2: //google/cloud/storage:internal_async_writer_connection_impl_test        PASSED in 2.0s
Step #2: //google/cloud/storage:internal_async_writer_connection_tracing_test     PASSED in 2.6s
Step #2: //google/cloud/storage:internal_base64_test                              PASSED in 1.3s
Step #2: //google/cloud/storage:internal_bucket_acl_requests_test                 PASSED in 1.8s
Step #2: //google/cloud/storage:internal_bucket_requests_test                     PASSED in 2.5s
Step #2: //google/cloud/storage:internal_complex_option_test                      PASSED in 2.2s
Step #2: //google/cloud/storage:internal_compute_engine_util_test                 PASSED in 2.5s
Step #2: //google/cloud/storage:internal_connection_impl_bucket_acl_test          PASSED in 2.0s
Step #2: //google/cloud/storage:internal_connection_impl_bucket_test              PASSED in 2.0s
Step #2: //google/cloud/storage:internal_connection_impl_default_object_acl_test  PASSED in 2.3s
Step #2: //google/cloud/storage:internal_connection_impl_file_upload_test         PASSED in 2.0s
Step #2: //google/cloud/storage:internal_connection_impl_notifications_test       PASSED in 2.5s
Step #2: //google/cloud/storage:internal_connection_impl_object_acl_test          PASSED in 1.8s
Step #2: //google/cloud/storage:internal_connection_impl_object_copy_test         PASSED in 2.0s
Step #2: //google/cloud/storage:internal_connection_impl_object_test              PASSED in 1.8s
Step #2: //google/cloud/storage:internal_connection_impl_service_account_test     PASSED in 2.1s
Step #2: //google/cloud/storage:internal_connection_impl_sign_blob_test           PASSED in 1.5s
Step #2: //google/cloud/storage:internal_connection_impl_test                     PASSED in 2.0s
Step #2: //google/cloud/storage:internal_const_buffer_test                        PASSED in 2.2s
Step #2: //google/cloud/storage:internal_crc32c_test                              PASSED in 2.2s
Step #2: //google/cloud/storage:internal_default_object_acl_requests_test         PASSED in 2.2s
Step #2: //google/cloud/storage:internal_generate_message_boundary_test           PASSED in 2.3s
Step #2: //google/cloud/storage:internal_generic_request_test                     PASSED in 1.9s
Step #2: //google/cloud/storage:internal_grpc_bucket_access_control_parser_test   PASSED in 1.9s
Step #2: //google/cloud/storage:internal_grpc_bucket_metadata_parser_test         PASSED in 1.4s
Step #2: //google/cloud/storage:internal_grpc_bucket_name_test                    PASSED in 2.2s
Step #2: //google/cloud/storage:internal_grpc_bucket_request_parser_test          PASSED in 2.6s
Step #2: //google/cloud/storage:internal_grpc_buffer_read_object_data_test        PASSED in 2.1s
Step #2: //google/cloud/storage:internal_grpc_configure_client_context_test       PASSED in 2.8s
Step #2: //google/cloud/storage:internal_grpc_default_options_test                PASSED in 1.8s
Step #2: //google/cloud/storage:internal_grpc_make_cord_test                      PASSED in 5.1s
Step #2: //google/cloud/storage:internal_grpc_metrics_exporter_impl_test          PASSED in 2.5s
Step #2: //google/cloud/storage:internal_grpc_metrics_exporter_options_test       PASSED in 2.5s
Step #2: //google/cloud/storage:internal_grpc_metrics_histograms_test             PASSED in 2.5s
Step #2: //google/cloud/storage:internal_grpc_metrics_meter_provider_test         PASSED in 2.8s
Step #2: //google/cloud/storage:internal_grpc_monitoring_project_test             PASSED in 2.3s
Step #2: //google/cloud/storage:internal_grpc_object_access_control_parser_test   PASSED in 2.0s
Step #2: //google/cloud/storage:internal_grpc_object_metadata_parser_test         PASSED in 2.2s
Step #2: //google/cloud/storage:internal_grpc_object_read_source_test             PASSED in 1.9s
Step #2: //google/cloud/storage:internal_grpc_object_request_parser_test          PASSED in 2.4s
Step #2: //google/cloud/storage:internal_grpc_owner_parser_test                   PASSED in 1.7s
Step #2: //google/cloud/storage:internal_grpc_scale_stall_timeout_test            PASSED in 2.5s
Step #2: //google/cloud/storage:internal_grpc_sign_blob_request_parser_test       PASSED in 2.5s
Step #2: //google/cloud/storage:internal_grpc_split_write_object_data_test        PASSED in 5.1s
Step #2: //google/cloud/storage:internal_grpc_stub_acl_test                       PASSED in 2.8s
Step #2: //google/cloud/storage:internal_grpc_stub_insert_object_media_test       PASSED in 1.8s
Step #2: //google/cloud/storage:internal_grpc_stub_read_object_test               PASSED in 2.5s
Step #2: //google/cloud/storage:internal_grpc_stub_test                           PASSED in 2.2s
Step #2: //google/cloud/storage:internal_grpc_stub_upload_chunk_test              PASSED in 2.3s
Step #2: //google/cloud/storage:internal_grpc_synthetic_self_link_test            PASSED in 2.1s
Step #2: //google/cloud/storage:internal_hash_function_impl_test                  PASSED in 1.6s
Step #2: //google/cloud/storage:internal_hash_validator_test                      PASSED in 2.1s
Step #2: //google/cloud/storage:internal_hash_values_test                         PASSED in 2.1s
Step #2: //google/cloud/storage:internal_hmac_key_requests_test                   PASSED in 2.3s
Step #2: //google/cloud/storage:internal_http_response_test                       PASSED in 2.2s
Step #2: //google/cloud/storage:internal_impersonate_service_account_credentials_test PASSED in 2.4s
Step #2: //google/cloud/storage:internal_logging_stub_test                        PASSED in 2.4s
Step #2: //google/cloud/storage:internal_make_jwt_assertion_test                  PASSED in 1.9s
Step #2: //google/cloud/storage:internal_md5hash_test                             PASSED in 1.7s
Step #2: //google/cloud/storage:internal_metadata_parser_test                     PASSED in 2.5s
Step #2: //google/cloud/storage:internal_notification_requests_test               PASSED in 1.7s
Step #2: //google/cloud/storage:internal_object_acl_requests_test                 PASSED in 2.5s
Step #2: //google/cloud/storage:internal_object_read_streambuf_test               PASSED in 2.2s
Step #2: //google/cloud/storage:internal_object_requests_test                     PASSED in 1.4s
Step #2: //google/cloud/storage:internal_object_write_streambuf_test              PASSED in 1.6s
Step #2: //google/cloud/storage:internal_patch_builder_test                       PASSED in 2.4s
Step #2: //google/cloud/storage:internal_policy_document_request_test             PASSED in 1.3s
Step #2: //google/cloud/storage:internal_request_project_id_test                  PASSED in 2.1s
Step #2: //google/cloud/storage:internal_rest_object_read_source_test             PASSED in 1.9s
Step #2: //google/cloud/storage:internal_rest_request_builder_test                PASSED in 1.9s
Step #2: //google/cloud/storage:internal_rest_stub_test                           PASSED in 1.5s
Step #2: //google/cloud/storage:internal_retry_object_read_source_test            PASSED in 2.0s
Step #2: //google/cloud/storage:internal_service_account_requests_test            PASSED in 2.3s
Step #2: //google/cloud/storage:internal_sign_blob_requests_test                  PASSED in 1.4s
Step #2: //google/cloud/storage:internal_signed_url_requests_test                 PASSED in 2.3s
Step #2: //google/cloud/storage:internal_storage_connection_test                  PASSED in 2.3s
Step #2: //google/cloud/storage:internal_storage_stub_factory_test                PASSED in 2.2s
Step #2: //google/cloud/storage:internal_tracing_connection_test                  PASSED in 2.5s
Step #2: //google/cloud/storage:internal_tracing_object_read_source_test          PASSED in 1.8s
Step #2: //google/cloud/storage:internal_tuple_filter_test                        PASSED in 2.1s
Step #2: //google/cloud/storage:internal_unified_rest_credentials_test            PASSED in 2.1s
Step #2: //google/cloud/storage:lifecycle_rule_test                               PASSED in 2.2s
Step #2: //google/cloud/storage:list_buckets_reader_test                          PASSED in 1.5s
Step #2: //google/cloud/storage:list_hmac_keys_reader_test                        PASSED in 1.8s
Step #2: //google/cloud/storage:list_objects_and_prefixes_reader_test             PASSED in 2.5s
Step #2: //google/cloud/storage:list_objects_reader_test                          PASSED in 2.2s
Step #2: //google/cloud/storage:notification_metadata_test                        PASSED in 1.6s
Step #2: //google/cloud/storage:oauth2_anonymous_credentials_test                 PASSED in 1.5s
Step #2: //google/cloud/storage:oauth2_authorized_user_credentials_test           PASSED in 1.8s
Step #2: //google/cloud/storage:oauth2_compute_engine_credentials_test            PASSED in 1.5s
Step #2: //google/cloud/storage:oauth2_google_application_default_credentials_file_test PASSED in 2.4s
Step #2: //google/cloud/storage:oauth2_google_credentials_test                    PASSED in 2.4s
Step #2: //google/cloud/storage:oauth2_service_account_credentials_test           PASSED in 2.4s
Step #2: //google/cloud/storage:object_access_control_test                        PASSED in 2.2s
Step #2: //google/cloud/storage:object_metadata_test                              PASSED in 1.7s
Step #2: //google/cloud/storage:object_retention_test                             PASSED in 2.5s
Step #2: //google/cloud/storage:object_stream_test                                PASSED in 2.6s
Step #2: //google/cloud/storage:parallel_uploads_test                             PASSED in 2.2s
Step #2: //google/cloud/storage:policy_document_test                              PASSED in 2.4s
Step #2: //google/cloud/storage:retry_policy_test                                 PASSED in 2.2s
Step #2: //google/cloud/storage:service_account_test                              PASSED in 1.5s
Step #2: //google/cloud/storage:signed_url_options_test                           PASSED in 1.7s
Step #2: //google/cloud/storage:storage_class_test                                PASSED in 1.5s
Step #2: //google/cloud/storage:storage_iam_policy_test                           PASSED in 2.6s
Step #2: //google/cloud/storage:storage_version_test                              PASSED in 2.4s
Step #2: //google/cloud/storage:testing_remove_stale_buckets_test                 PASSED in 1.8s
Step #2: //google/cloud/storage:well_known_headers_test                           PASSED in 2.2s
Step #2: //google/cloud/storage:well_known_parameters_test                        PASSED in 2.5s
Step #2: //google/cloud/storage/benchmarks:aggregate_download_throughput_options_test PASSED in 1.8s
Step #2: //google/cloud/storage/benchmarks:aggregate_upload_throughput_options_test PASSED in 1.6s
Step #2: //google/cloud/storage/benchmarks:benchmark_make_random_test             PASSED in 2.6s
Step #2: //google/cloud/storage/benchmarks:benchmark_parser_test                  PASSED in 1.8s
Step #2: //google/cloud/storage/benchmarks:create_dataset_options_test            PASSED in 1.8s
Step #2: //google/cloud/storage/benchmarks:throughput_options_test                PASSED in 1.5s
Step #2: //google/cloud/storage/benchmarks:throughput_result_test                 PASSED in 1.7s
Step #2: //google/cloud/storage/examples:storage_async_mock_samples               PASSED in 1.5s
Step #2: //google/cloud/storage/examples:storage_client_mock_samples              PASSED in 2.2s
Step #2: //google/cloud/storage/examples:storage_examples_common_test             PASSED in 2.3s
Step #2: //google/cloud/storage:internal_async_writer_connection_resumed_test    TIMEOUT in 300.0s
Step #2:   /h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/testlogs/google/cloud/storage/internal_async_writer_connection_resumed_test/test.log
Step #2: //google/cloud/storage:async_client_test                                 FAILED in 2.5s
Step #2:   /h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/testlogs/google/cloud/storage/async_client_test/test.log
Step #2: 
Step #2: Executed 190 out of 756 tests: 754 tests pass and 2 fail locally.
Step #2: There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
Step #2: ==> 🕑 otel-disabled-bazel completed in 424.120 seconds
Finished Step #2
ERROR
ERROR: build step 2 "us-east1-docker.pkg.dev/cloud-cpp-testing-resources/gcb/cloudbuild/fedora-latest-bazel:2ce53ff5-9ab2-4797-a97d-899182b8edf0" failed: step exited with non-zero status: 3

Build Log: https://storage.cloud.google.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/15734/fa02b42c8380a1174d4aa0b8876988e9374cb344/fedora-latest-bazel-otel-disabled-bazel-default/log-2ce53ff5-9ab2-4797-a97d-899182b8edf0.txt