roachtest: fix cdc/initial-scan-only/parquet/metamorphic auth on GCE by aerfrei · Pull Request #168987 · cockroachdb/cockroach · GitHub
Skip to content

roachtest: fix cdc/initial-scan-only/parquet/metamorphic auth on GCE#168987

Draft
aerfrei wants to merge 1 commit intocockroachdb:masterfrom
aerfrei:aerin/cdc-metamorphic-gcs-auth
Draft

roachtest: fix cdc/initial-scan-only/parquet/metamorphic auth on GCE#168987
aerfrei wants to merge 1 commit intocockroachdb:masterfrom
aerfrei:aerin/cdc-metamorphic-gcs-auth

Conversation

@aerfrei
Copy link
Copy Markdown
Contributor

@aerfrei aerfrei commented Apr 23, 2026

The test was skipped because it failed on the GCE nightly worker with:

unable to list files in gcs bucket: ... metadata: GCE metadata
"instance/service-accounts/default/token?scopes=.../devstorage.read_write"
not defined

The test creates a cloud storage sink with AUTH=implicit, which works for the cluster nodes (their attached service account has the right scope), but not for the roachtest process itself, which runs on a TeamCity GCE worker without devstorage.read_write. The test process needs to read the sink output back to fingerprint it, which is what triggers the failure.

Switch the URI used by the local read path to AUTH=specified, populating CREDENTIALS from the GOOGLE_EPHEMERAL_CREDENTIALS env var (the same convention already used by query_comparison_util.go). The cluster-side sink URI is left untouched. If the env var is missing, fail with TransientFailure so CI surfaces it as an infra issue rather than a real test regression.

Fixes: #119295
Fixes: #127940
Epic: none
Release note: None

The test was skipped because it failed on the GCE nightly worker with:

  unable to list files in gcs bucket: ... metadata: GCE metadata
  "instance/service-accounts/default/token?scopes=.../devstorage.read_write"
  not defined

The test creates a cloud storage sink with AUTH=implicit, which works for
the cluster nodes (their attached service account has the right scope),
but not for the roachtest process itself, which runs on a TeamCity GCE
worker without devstorage.read_write. The test process needs to read the
sink output back to fingerprint it, which is what triggers the failure.

Switch the URI used by the local read path to AUTH=specified, populating
CREDENTIALS from the GOOGLE_EPHEMERAL_CREDENTIALS env var (the same
convention already used by query_comparison_util.go). The cluster-side
sink URI is left untouched. If the env var is missing, fail with
TransientFailure so CI surfaces it as an infra issue rather than a real
test regression.

Fixes: cockroachdb#119295
Fixes: cockroachdb#127940
Epic: none
Release note: None
@trunk-io
Copy link
Copy Markdown
Contributor

trunk-io Bot commented Apr 23, 2026

@cockroach-teamcity
Copy link
Copy Markdown
Member

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

roachtest: cdc/initial-scan-only/parquet/metamorphic failed changefeedccl: add gce support to cdc/initial-scan-only/parquet/metamorphic roachtest

2 participants