Fix flaky test_backup_to_s3_different_credentials by alexey-milovidov · Pull Request #101897 · ClickHouse/ClickHouse · GitHub
Skip to content

Fix flaky test_backup_to_s3_different_credentials#101897

Closed
alexey-milovidov wants to merge 3 commits into
masterfrom
fix-flaky-test-backup-s3-different-credentials
Closed

Fix flaky test_backup_to_s3_different_credentials#101897
alexey-milovidov wants to merge 3 commits into
masterfrom
fix-flaky-test-backup-s3-different-credentials

Conversation

@alexey-milovidov

@alexey-milovidov alexey-milovidov commented Apr 7, 2026

Copy link
Copy Markdown
Member

When allow_s3_native_copy=True with different credentials, the native S3 copy fails and falls back to reading+writing. During this fallback, transient S3ReadRequestsErrors are possible (similar to how S3WriteRequestsErrors are already tolerated for multipart uploads on lines 999-1003). Relax the assertion to only check for read errors when native copy is not enabled.

Fixes #90662

https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=101239&sha=4f2e44e494b3285afa9dc9d659bc7e05b440337b&name_0=PR&name_1=Integration%20tests%20%28amd_asan_ubsan%2C%20db%20disk%2C%20old%20analyzer%2C%202%2F6%29
#101239

Changelog category (leave one):

  • CI Fix or Improvement (changelog entry is not required)

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

...

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

When `allow_s3_native_copy=True` with different credentials, the native
S3 copy fails and falls back to reading+writing. During this fallback,
transient `S3ReadRequestsErrors` are possible (similar to how
`S3WriteRequestsErrors` are already tolerated for multipart uploads).

Relax the assertion to only check for read errors when native copy is
not enabled.

Fixes #90662

https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=101239&sha=4f2e44e494b3285afa9dc9d659bc7e05b440337b&name_0=PR&name_1=Integration%20tests%20%28amd_asan_ubsan%2C%20db%20disk%2C%20old%20analyzer%2C%202%2F6%29

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@clickhouse-gh

clickhouse-gh Bot commented Apr 7, 2026

Copy link
Copy Markdown
Contributor

@clickhouse-gh clickhouse-gh Bot added the pr-ci label Apr 7, 2026
@alexey-milovidov

Copy link
Copy Markdown
Member Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Flaky test: test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials[data_file_name_from_first_file_name-native_multipart]

1 participant